title: Statistics of the Effective Massive MIMO Channel in Correlated Rician Fading

abstract: Massive MIMO base stations use multiple spatial diversity branches, which are often assumed to be uncorrelated in theoretical work. Correlated branches are considered seldom since they are mathematically less tractable. For correlated Rician fading, only the first- and second-order moments have been explored. To describe propagation environments more accurately, full distribution functions are needed. This manuscript provides these functions for the maximum ratio combining effective channel, a quadratic form of a random complex normal channel vector. Its mean vector and covariance matrix are based on a plane wave model incorporating array geometry, antenna element pattern, power angular spectra and power delay profiles. Closed-form approximations of the distribution functions are presented, to allow the fast evaluation of many real-world scenarios. The statistical framework is used to show that low-directivity antenna elements provide better performance in angular constricted Rician fading with off-axis incidence than high-directivity elements. Moreover, two base station array layouts are compared, showing that a half-circle array illuminates a cell more evenly than a uniform linear array. With the full distribution functions available, performance can be compared over the full range of received powers and not only based on the average SNR.


title: Hypernet-Ensemble Learning of Segmentation Probability for Medical Image Segmentation with Ambiguous Labels

abstract: Despite the superior performance of Deep Learning (DL) on numerous segmentation tasks, the DL-based approaches are notoriously overconfident about their prediction with highly polarized label probability. This is often not desirable for many applications with the inherent label ambiguity even in human annotations. This challenge has been addressed by leveraging multiple annotations per image and the segmentation uncertainty. However, multiple per-image annotations are often not available in a real-world application and the uncertainty does not provide full control on segmentation results to users. In this paper, we propose novel methods to improve the segmentation probability estimation without sacrificing performance in a real-world scenario that we have only one ambiguous annotation per image. We marginalize the estimated segmentation probability maps of networks that are encouraged to under-/over-segment with the varying Tversky loss without penalizing balanced segmentation. Moreover, we propose a unified hypernetwork ensemble method to alleviate the computational burden of training multiple networks. Our approaches successfully estimated the segmentation probability maps that reflected the underlying structures and provided the intuitive control on segmentation for the challenging 3D medical image segmentation. Although the main focus of our proposed methods is not to improve the binary segmentation performance, our approaches marginally outperformed the state-of-the-arts. The codes are available at \url{https://github.com/sh4174/HypernetEnsemble}.


title: Optimal Rate Adaption in Federated Learning with Compressed Communications

abstract: Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for simplicity, most implementations adopt a fixed compression rate only. In this paper, we for the first time systematically examine this tradeoff, identifying the influence of the compression error on the final model accuracy with respect to the learning rate. Specifically, we factor the compression error of each global iteration into the convergence rate analysis under both strongly convex and non-convex loss functions. We then present an adaptation framework to maximize the final model accuracy by strategically adjusting the compression rate in each iteration. We have discussed the key implementation issues of our framework in practical networks with representative compression algorithms. Experiments over the popular MNIST and CIFAR-10 datasets confirm that our solution effectively reduces network traffic yet maintains high model accuracy in FL.


title: Bi-directional Beamforming Feedback-based Firmware-agnostic WiFi Sensing: An Empirical Study

abstract: In the field of WiFi sensing, as an alternative sensing source of the channel state information (CSI) matrix, the use of a beamforming feedback matrix (BFM)that is a right singular matrix of the CSI matrix has attracted significant interest owing to its wide availability regarding the underlying WiFi systems. In the IEEE 802.11ac/ax standard, the station (STA) transmits a BFM to an access point (AP), which uses the BFM for precoded multiple-input and multiple-output communications. In addition, in the same way, the AP transmits a BFM to the STA, and the STA uses the received BFM. Regarding BFM-based sensing, extensive real-world experiments were conducted as part of this study, and two key insights were reported: Firstly, this report identified a potential issue related to accuracy in existing uni-directional BFM-based sensing frameworks that leverage only BFMs transmitted for the AP or STA. Such uni-directionality introduces accuracy concerns when there is a sensing capability gap between the uni-directional BFMs for the AP and STA. Thus, this report experimentally evaluates the sensing ability disparity between the uni-directional BFMs, and shows that the BFMs transmitted for an AP achieve higher sensing accuracy compared to the BFMs transmitted from the STA when the sensing target values are estimated depending on the angle of departure of the AP. Secondly, to complement the sensing gap, this paper proposes a bi-directional sensing framework, which simultaneously leverages the BFMs transmitted from the AP and STA. The experimental evaluations reveal that bi-directional sensing achieves higher accuracy than uni-directional sensing in terms of the human localization task.


title: Scale Setting for CLS 2+1 Simulations

abstract: We present an update of the scale setting for $N_f=2+1$ flavor QCD using gradient flow scales and pseudo-scalar decay constants. We analyze the latest ensembles with $2+1$ flavors of non-perturbatively improved Wilson fermions generated by CLS for improved precision. Special care is taken to correct for mistuning by measuring directly the mass derivatives of the various observables. We determine $t_0$ with input taken from a combination of leptonic decay rates of the Pion and the Kaon.


title: Real-Time Estimation of COVID-19 Infections: Deconvolution and Sensor Fusion

abstract: We propose, implement, and evaluate a method to estimate the daily number of new symptomatic COVID-19 infections, at the level of individual U.S. counties, by deconvolving daily reported COVID-19 case counts using an estimated symptom-onset-to-case-report delay distribution. Importantly, we focus on estimating infections in real-time (rather than retrospectively), which poses numerous challenges. To address these, we develop new methodology for both the distribution estimation and deconvolution steps, and we employ a sensor fusion layer (which fuses together predictions from models that are trained to track infections based on auxiliary surveillance streams) in order to improve accuracy and stability.


title: A Note on elementarity of virtual dendro-morphisms for higher rank lattices

abstract: Let $\Gamma$ be a discrete countable group and let $(\Omega,\mu)$ be an ergodic standard Borel probability $\Gamma$-space. Given any non-elementary virtual dendro-morphism (that is a measurable cocycle in the automorphism group of a dendrite), we construct a unitary representation $V$ with no invariant vectors such that $\text{H}^2_b(\Gamma;V)$ contains a non-zero class. As a consequence, all virtual dendro-morphisms of a higher rank lattice must be elementary.


title: CMB spectral distortions from continuous large energy release

abstract: Accurate computations of spectral distortions of the cosmic microwave background (CMB) are required for constraining energy release scenarios at redshifts $z\gtrsim 10^3$. The existing literature focuses on distortions that are small perturbations to the background blackbody spectrum. At high redshifts ($z\gtrsim 10^6$), this assumption can be violated, and the CMB spectrum can be significantly distorted at least during part of its cosmic evolution. In this paper, we carry out accurate thermalization computations, evolving the distorted CMB spectrum in a general, fully non-linear way, consistently accounting for the time-dependence of the injection process, modifications to the Hubble expansion rate and relativistic Compton scattering. Specifically, we study single energy injection and decaying particle scenarios, discussing constraints on these cases. We solve the thermalization problem using two independent numerical approaches that are now available in {\tt CosmoTherm} as dedicated setups for computing CMB spectral distortions in the large distortion regime. New non-linear effects at low frequencies are furthermore highlighted, showing that these warrant a more rigorous study. This work eliminates one of the long-standing simplifications in CMB spectral distortion computations, which also opens the way to more rigorous treatments of distortions induced by high-energy particle cascade, soft photon injection and in the vicinity of primordial black holes.


title: Verified Compilation of Quantum Oracles

abstract: Quantum algorithms often apply classical operations, such as arithmetic or predicate checks, over a quantum superposition of classical data; these so-called oracles are often the largest components of a quantum program. To ease the construction of efficient, correct oracle functions, this paper presents VQO, a high-assurance framework implemented with the Coq proof assistant. The core of VQO is OQASM, the oracle quantum assembly language. OQASM operations move qubits between two different bases via the quantum Fourier transform, thus admitting important optimizations, but without inducing entanglement and the exponential blowup that comes with it. OQASM's design enabled us to prove correct VQO's compilers -- from a simple imperative language called OQIMP to OQASM, and from OQASM to SQIR, a general-purpose quantum assembly language -- and allowed us to efficiently test properties of OQASM programs using the QuickChick property-based testing framework. We have used VQO to implement a variety of arithmetic and geometric operators that are building blocks for important oracles, including those used in Shor's and Grover's algorithms. We found that VQO's QFT-based arithmetic oracles require fewer qubits, sometimes substantially fewer, than those constructed using "classical" gates; VQO's versions of the latter were nevertheless on par with or better than (in terms of both qubit and gate counts) oracles produced by Quipper, a state-of-the-art but unverified quantum programming platform.


title: Anchor Retouching via Model Interaction for Robust Object Detection in Aerial Images

abstract: Object detection has made tremendous strides in computer vision. Small object detection with appearance degradation is a prominent challenge, especially for aerial observations. To collect sufficient positive/negative samples for heuristic training, most object detectors preset region anchors in order to calculate Intersection-over-Union (IoU) against the ground-truthed data. In this case, small objects are frequently abandoned or mislabeled. In this paper, we present an effective Dynamic Enhancement Anchor (DEA) network to construct a novel training sample generator. Different from the other state-of-the-art techniques, the proposed network leverages a sample discriminator to realize interactive sample screening between an anchor-based unit and an anchor-free unit to generate eligible samples. Besides, multi-task joint training with a conservative anchor-based inference scheme enhances the performance of the proposed model while reducing computational complexity. The proposed scheme supports both oriented and horizontal object detection tasks. Extensive experiments on two challenging aerial benchmarks (i.e., DOTA and HRSC2016) indicate that our method achieves state-of-the-art performance in accuracy with moderate inference speed and computational overhead for training. On DOTA, our DEA-Net which integrated with the baseline of RoI-Transformer surpasses the advanced method by 0.40% mean-Average-Precision (mAP) for oriented object detection with a weaker backbone network (ResNet-101 vs ResNet-152) and 3.08% mean-Average-Precision (mAP) for horizontal object detection with the same backbone. Besides, our DEA-Net which integrated with the baseline of ReDet achieves the state-of-the-art performance by 80.37%. On HRSC2016, it surpasses the previous best model by 1.1% using only 3 horizontal anchors.


title: $\mu$Dep: Mutation-based Dependency Generation for Precise Taint Analysis on Android Native Code

abstract: The existence of native code in Android apps plays an important role in triggering inconspicuous propagation of secrets and circumventing malware detection. However, the state-of-the-art information-flow analysis tools for Android apps all have limited capabilities of analyzing native code. Due to the complexity of binary-level static analysis, most static analyzers choose to build conservative models for a selected portion of native code. Though the recent inter-language analysis improves the capability of tracking information flow in native code, it is still far from attaining similar effectiveness of the state-of-the-art information-flow analyzers that focus on non-native Java methods. To overcome the above constraints, we propose a new analysis framework, $\mu$Dep, to detect sensitive information flows of the Android apps containing native code. In this framework, we combine a control-flow based static binary analysis with a mutation-based dynamic analysis to model the tainting behaviors of native code in the apps. Based on the result of the analyses, $\mu$Dep conducts a stub generation for the related native functions to facilitate the state-of-the-art analyzer DroidSafe with fine-grained tainting behavior summaries of native code. The experimental results show that our framework is competitive on the accuracy, and effective in analyzing the information flows in real-world apps and malware compared with the state-of-the-art inter-language static analysis.


title: On the number of roots for harmonic trinomials

abstract: In this manuscript we study the counting problem for harmonic trinomials of the form $a\zeta^n+b\overline{\zeta}^m+c$, where $n,m\in \mathbb{N}$, $n>m$, and $a$, $b$ and $c$ are non-zero complex numbers. As a consequence, we obtain the Fundamental Theorem of Algebra and the Wilmshurst conjecture for harmonic trinomials. The proof of the counting problem relies on the Bohl method introduced in Bohl (1908).


title: Land use identification through social network interaction

abstract: The Internet generates large volumes of data at a high rate, in particular, posts on social networks. Although social network data has numerous semantic adulterations, and is not intended to be a source of geo-spatial information, in the text of posts we find pieces of important information about how people relate to their environment, which can be used to identify interesting aspects of how human beings interact with portions of land based on their activities. This research proposes a methodology for the identification of land uses using Natural Language Processing (NLP) from the contents of the popular social network Twitter. It will be approached by identifying keywords with linguistic patterns from the text, and the geographical coordinates associated with the publication. Context-specific innovations are introduced to deal with data across South America and, in particular, in the city of Arequipa, Peru. The objective is to identify the five main land uses: residential, commercial, institutional-governmental, industrial-offices and unbuilt land. Within the framework of urban planning and sustainable urban management, the methodology contributes to the optimization of the identification techniques applied for the updating of land use cadastres, since the results achieved an accuracy of about 90%, which motivates its application in the real context. In addition, it would allow the identification of land use categories at a more detailed level, in situations such as a complex/mixed distribution building based on the amount of data collected. Finally, the methodology makes land use information available in a more up-to-date fashion and, above all, avoids the high economic cost of the non-automatic production of land use maps for cities, mostly in developing countries.


title: N-SfC: Robust and Fast Shape Estimation from Caustic Images

abstract: This paper deals with the highly challenging problem of reconstructing the shape of a refracting object from a single image of its resulting caustic. Due to the ubiquity of transparent refracting objects in everyday life, reconstruction of their shape entails a multitude of practical applications. The recent Shape from Caustics (SfC) method casts the problem as the inverse of a light propagation simulation for synthesis of the caustic image, that can be solved by a differentiable renderer. However, the inherent complexity of light transport through refracting surfaces currently limits the practicability with respect to reconstruction speed and robustness. To address these issues, we introduce Neural-Shape from Caustics (N-SfC), a learning-based extension that incorporates two components into the reconstruction pipeline: a denoising module, which alleviates the computational cost of the light transport simulation, and an optimization process based on learned gradient descent, which enables better convergence using fewer iterations. Extensive experiments demonstrate the effectiveness of our neural extensions in the scenario of quality control in 3D glass printing, where we significantly outperform the current state-of-the-art in terms of computational speed and final surface error.


title: Optimal Expansion of Business Opportunity

abstract: Any firm whose business strategy has an exposure constraint that limits its potential gain naturally considers expansion, as this can increase its exposure. We model business expansion as an enlargement of the opportunity set for business policies. However, expansion is irreversible and has an opportunity cost attached. We use the expected optimization of utility to formulate this as a novel stochastic control problem combined with an optimal stopping time, and we derive an explicit solution for exponential utility. We apply the framework to an investment and a reinsurance scenario. In the investment problem, the cost and incentives to increase the trading exposure are analyzed, while the optimal timing for an insurer to launch its reinsurance business is investigated in the reinsurance problem. Our model predicts that the additional income gained through business expansion is the key incentive for a decision to expand. Interestingly, companies may have this incentive but are likely to wait for a period of time before expanding, although situations of zero opportunity cost or specific restrictive conditions on the model parameters are exceptions to waiting. The business policy remains on the boundary of the opportunity set before expansion during the waiting period. The length of the waiting period is related to the opportunity cost, return, and risk of the expanded business.


title: Testing the robustness of simulation-based gravitational-wave population inference

abstract: Gravitational-wave population studies have become more important in gravitational-wave astronomy because of the rapid growth of the observed catalog. In recent studies, emulators based on different machine learning techniques are used to emulate the outcomes of the population synthesis simulation with fast speed. In this study, we benchmark the performance of two emulators that learn the truncated power-law phenomenological model by using Gaussian process regression and normalizing flows techniques to see which one is a more capable likelihood emulator in the population inference. We benchmark the characteristic of the emulators by comparing their performance in the population inference to the phenomenological model using mock and real observation data. Our results suggest that the normalizing flows emulator can recover the posterior distribution by using the phenomenological model in the population inference with up to 300 mock injections. The normalizing flows emulator also underestimates the uncertainty for some posterior distributions in the population inference on real observation data. On the other hand, the Gaussian process regression emulator has poor performance on the same task and can only be used effectively in low-dimension cases.


title: Proper solutions for Epstein-Zin Stochastic Differential Utility

abstract: In this article, we consider the optimal investment-consumption problem for an agent with preferences governed by Epstein--Zin stochastic differential utility (EZ-SDU) who invests in a constant-parameter Black-Scholes-Merton market over the infinite horizon. The parameter combinations that we consider in this paper are such that the risk aversion parameter $R$ and the elasticity of intertemporal complementarity $S$ satisfy $\theta=\frac{1-R}{1-S}>1$. In this sense, this paper is complementary to Herdegen, Hobson and Jerome [arXiv:2107.06593]. The main novelty of the case $\theta>1$ (as opposed to $\theta\in(0,1)$) is that there is an infinite family of utility processes associated to every nonzero consumption stream. To deal with this issue, we introduce the economically motivated notion of a proper utility process, where, roughly speaking, a utility process is proper if it is nonzero whenever future consumption is nonzero. We then proceed to show that for a very wide class of consumption streams $C$, there exists a proper utility process $V$ associated to $C$. Furthermore, for a wide class of consumption streams $C$, the proper utility process $V$ is unique. Finally, we solve the optimal investment-consumption problem in a constant parameter financial market, where we optimise over the right-continuous attainable consumption streams that have a unique proper utility process associated to them.


title: Topological Signal Processing over Cell Complexes

abstract: The Topological Signal Processing (TSP) framework has been recently developed to analyze signals defined over simplicial complexes, i.e. topological spaces represented by finite sets of elements that are closed under inclusion of subsets [1]. However, the same inclusion property represents sometimes a too rigid assumption that prevents the application of simplicial complexes to many cases of interest. The goal of this paper is to extend TSP to the analysis of signals defined over cell complexes, which represent a generalization of simplicial complexes, as they are not restricted to satisfy the inclusion property. In particular, the richer topological structure of cell complexes enables them to reveal cycles of any order, as representative of data features. We propose an efficient method to infer the topology of cell complexes from data by showing how their use enables sparser edge signal representations than simplicial-based methods. Furthermore, we show how to design optimal finite impulse response (FIR) filters operating on solenoidal and irrotational signals in order to minimize the approximation error with respect to the desired spectral masks.


title: Cosmological implications of $n_s\approx 1$ in light of the Hubble tension

abstract: Recently, a low-$z$ measurement of the Hubble constant, $H_0 = 73.04 \pm 1.04 {\rm ~km/s/Mpc}$, was reported by the SH0ES Team. The long-standing Hubble tension, i.e. the difference between the Hubble constant from the local measurements and that inferred from the cosmic microwave background data based on the $\Lambda$CDM model, was further strengthened. There are many cosmological models modifying the cosmology after and around the recombination era to alleviate this tension. In fact, some of the models alter the small-scale fluctuation amplitude relative to larger scales, and thus require a significant modification of the primordial density perturbation, especially the scalar spectral index, $n_s$. In certain promising models, $n_s$ is favored to be larger than the $\Lambda$CDM prediction, and even the scale-invariant one, $n_s=1$, is allowed. In this Letter, we focus on the very early Universe models to study the implication of such unusual $n_s$. In particular, we find that an axiverse with an axion in the equilibrium distribution during inflation can be easily consistent with $n_s = 1$. This is because the axion behaves as a curvaton with mass much smaller than the inflationary Hubble parameter. We also discuss other explanations of $n_s$ different from that obtained based on the $\Lambda$CDM.


title: Storage capacity of networks with discrete synapses and sparsely encoded memories

abstract: Attractor neural networks (ANNs) are one of the leading theoretical frameworks for the formation and retrieval of memories in networks of biological neurons. In this framework, a pattern imposed by external inputs to the network is said to be learned when this pattern becomes a fixed point attractor of the network dynamics. The storage capacity is the maximum number of patterns that can be learned by the network. In this paper, we study the storage capacity of fully-connected and sparsely-connected networks with a binarized Hebbian rule, for arbitrary coding levels. Our results show that a network with discrete synapses has a similar storage capacity as the model with continuous synapses, and that this capacity tends asymptotically towards the optimal capacity, in the space of all possible binary connectivity matrices, in the sparse coding limit. We also derive finite coding level corrections for the asymptotic solution in the sparse coding limit. The result indicates the capacity of network with Hebbian learning rules converges to the optimal capacity extremely slowly when the coding level becomes small. Our results also show that in networks with sparse binary connectivity matrices, the information capacity per synapse is larger than in the fully connected case, and thus such networks store information more efficiently.


title: A Case For Noisy Shallow Gate-Based Circuits In Quantum Machine Learning

abstract: There is increasing interest in the development of gate-based quantum circuits for the training of machine learning models. Yet, little is understood concerning the parameters of circuit design, and the effects of noise and other measurement errors on the performance of quantum machine learning models. In this paper, we explore the practical implications of key circuit design parameters (number of qubits, depth etc.) using several standard machine learning datasets and IBM's Qiskit simulator. In total we evaluate over 6500 unique circuits with $n \approx 120700$ individual runs. We find that in general shallow (low depth) wide (more qubits) circuit topologies tend to outperform deeper ones in settings without noise. We also explore the implications and effects of different notions of noise and discuss circuit topologies that are more / less robust to noise for classification machine learning tasks. Based on the findings we define guidelines for circuit topologies that show near-term promise for the realisation of quantum machine learning algorithms using gate-based NISQ quantum computer.


title: Spreading, pinching, and coalescence: the Ohnesorge units

abstract: Understanding the kinematics and dynamics of spreading, pinching, and coalescence of drops is critically important for a diverse range of applications involving spraying, printing, coating, dispensing, emulsification, and atomization. Hence experimental studies visualize and characterize the increase in size over time for drops spreading over substrates, or liquid bridges between coalescing drops, or the decrease in the radius of pinching necks during drop formation. Even for Newtonian fluids, the interplay of inertial, viscous, and capillary stresses can lead to a number of scaling laws, with three limiting self-similar cases: visco-inertial (VI), visco-capillary (VC) and inertio-capillary (IC). Though experiments are presented as examples of the methods of dimensional analysis, the lack of precise values or estimates for pre-factors, transitions, and scaling exponents presents difficulties for quantitative analysis and material characterization. In this tutorial review, we reanalyze and summarize an elaborate set of landmark published experimental studies on a wide range of Newtonian fluids. We show that moving beyond VI, VC, and IC units in favor of intrinsic timescale and lengthscale determined by all three material properties (viscosity, surface tension and density), creates a complementary system that we call the Ohnesorge units. We find that in spite of large differences in topological features, timescales, and material properties, the analysis of spreading, pinching and coalescing drops in the Ohnesorge units results in a remarkable collapse of the experimental datasets, highlighting the shared and universal features displayed in such flows.


title: Learning Semantic-Aligned Feature Representation for Text-based Person Search

abstract: Text-based person search aims to retrieve images of a certain pedestrian by a textual description. The key challenge of this task is to eliminate the inter-modality gap and achieve the feature alignment across modalities. In this paper, we propose a semantic-aligned embedding method for text-based person search, in which the feature alignment across modalities is achieved by automatically learning the semantic-aligned visual features and textual features. First, we introduce two Transformer-based backbones to encode robust feature representations of the images and texts. Second, we design a semantic-aligned feature aggregation network to adaptively select and aggregate features with the same semantics into part-aware features, which is achieved by a multi-head attention module constrained by a cross-modality part alignment loss and a diversity loss. Experimental results on the CUHK-PEDES and Flickr30K datasets show that our method achieves state-of-the-art performances.


title: Symmetry and topological classification of Floquet non-Hermitian systems

abstract: Recent experimental advances in Floquet engineering and controlling dissipation in open systems have brought about unprecedented flexibility in tailoring novel phenomena without any static and Hermitian analogues. It can be epitomized by the various Floquet and non-Hermitian topological phases. Topological classifications of either static/Floquet Hermitian or static non-Hermitian systems based on the underlying symmetries have been well established in the past several years. However, a coherent understanding and classification of Floquet non-Hermitian (FNH) topological phases have not been achieved yet. Here we systematically classify FNH topological bands for 54-fold generalized Bernard-LeClair (GBL)symmetry classes and arbitrary spatial dimensions using $K$-theory. The classification distinguishes two different scenarios of the Floquet operator's spectrum gaps [dubbed as Floquet operator (FO) angle-gapped and FO angle-gapless]. The results culminate into two periodic tables, each containing 54-fold GBL symmetry classes. Our scheme reveals FNH topological phases without any static/Floquet Hermitian and static non-Hermitian counterparts. And our results naturally produce the periodic tables of Floquet Hermitian topological insulators and Floquet unitaries. The framework can also be applied to characterize the topological phases of bosonic systems. We provide concrete examples of one and two-dimensionalfermionic/bosonic systems. And we elucidate the meaning of the topological invariants and their physical consequences. Our paper lays the foundation for a comprehensive exploration of FNH topological bands. And it opens a broad avenue toward uncovering unique phenomena and functionalities emerging from the synthesis of periodic driving, non-Hermiticity, and band topology.

categories: cond-mat.mes-hall math-ph math.MP physics.optics quant-ph


title: Further improvement on index bounds

abstract: In this paper we obtain further improvement of index bounds for character sums of polynomials over finite fields. We present some examples, which show that our new bound is an improved bound compared to both the Weil bound and the index bound given by Wan and Wang. As an application, we count the number of all the solutions of some algebraic curves by using our result.


title: Characterization of $p$-ary functions in terms of association schemes and its applications

abstract: We obtain an explicit criterion for $p$-ary functions to produce association schemes in terms of their Walsh spectrum. Employing this characterization, we explicitly find a correlation between $p$-ary bent functions and association schemes; to be more exact, we prove that a $p$-ary bent function induces a $p$-class association scheme if and only if the function is weakly regular. As applications of our main criterion, we construct many infinite families of few-class association schemes arising from $p$-ary functions. Furthermore, we present four classes of $p$-ary two-weight linear codes, which are constructed from the association schemes produced in this paper.


title: Thermodynamic geometric analysis of conventional black holes under f(R) gravity

abstract: In this article, we consider a conventional black hole under f(R) gravity. Due to the small fluctuations around the equilibrium state, we have summarized the expression of the modified thermodynamic entropy of this black hole. At the same time, we also studied the geometric thermodynamics (GTD) of black holes, and studied the adaptability of the curvature scalar of the geometric thermodynamics method to the phase transition point of the black hole. In addition, we also studied the influence of the modified parameters on the thermodynamic behavior of black holes.


title: Repeating Fast Radio Burst: Coherent Circular Polarization By Bunches

abstract: Fast radio bursts (FRBs) are millisecond-duration signals that are highly dispersed at distant galaxies. However, the physical origin of FRBs is still unknown. Coherent curvature emission by bunches, e.g., powered by starquakes, has already been proposed for repeating FRBs. It has the nature of understanding narrowband radiation exhibiting time--frequency drifting. Recently, a highly active FRB source, i.e., FRB 20201124A, was reported to enter a newly active episode and emit at least some highly circular-polarized bursts. In this study, we revisit the polarized FRB emission, particularly investigating the production mechanisms of a highly circular polarization (CP) by deriving the intrinsic mechanism and propagative effect. The intrinsic mechanisms of invoking charged bunches are approached with radiative coherence. Consequently, a highly CP could naturally be explained by the coherent summation of outcome waves, generated or scattered by bunches, with different phases and electric vectors. Different kinds of evolutionary trajectories are found on the Poincare sphere for the bunch-coherent polarization, and this behavior could be tested through future observations. Cyclotron resonance can result in the absorption of R-mode photons at a low altitude region of the magnetosphere, and an FRB should then be emitted from a high-altitude region if the waves have strong linear polarization. Circularly polarized components could be produced from Faraday conversion exhibiting a \lambda^3-oscillation, but the average CP fraction depends only on the income wave, indicating a possibility of a highly circular-polarized income wave.The analysis could be welcome if extremely high CP from repeating FRBs is detected in the future. Finally, the production of a bulk of energetic bunches in the pulsar-like magnetosphere is discussed, which is relevant to the nature of the FRB central engine.


title: Remnant radio galaxy candidates of small angular sizes

abstract: Remnant radio galaxies (RRGs), characterized by the cessation of AGN activity, represent a short-lived last phase of radio galaxy's life-cycle. Hitherto, searches for RRGs, mainly based on the morphological criteria, have identified large angular size sources resulting into a bias towards the remnants of powerful FR-II radio galaxies. In this study we make the first attempt to perform a systematic search for RRGs of small angular sizes ($<$30$^{\prime\prime}$) in the XMM-LSS field. By using spectral curvature criterion we discover 48 remnant candidates exhibiting strong spectral curvature ${\it i.e.}$; ${\alpha}_{\rm 150~MHz}^{\rm 325~MHz}$ - ${\alpha}_{\rm 325~MHz}^{\rm 1.4~GHz}$ $\geq$0.5. Spectral characteristics at higher frequency regime ($>$1.4 GHz) indicate that some of our remnant candidates can depict recurrent AGN activity with an active core. We place an upper limit on the remnant fraction ($f_{\rm rem}$) to be 3.9$\%$, which increases to 5.4$\%$ if flux cutoff limit of S$_{\rm 150~MHz}$ $\geq$10 mJy is considered. Our study unveils, hitherto unexplored, a new population of small-size ($<$200 kpc) remnant candidates that are often found to reside in less dense environments and at higher redshifts ($z$) $>$1.0. We speculate that a relatively shorter active phase and/or low jet power can be plausible reasons for the small size of remnant candidates.


title: PM-MMUT: Boosted Phone-Mask Data Augmentation using Multi-Modeling Unit Training for Phonetic-Reduction-Robust E2E Speech Recognition

abstract: Consonant and vowel reduction are often encountered in speech, which might cause performance degradation in automatic speech recognition (ASR). Our recently proposed learning strategy based on masking, Phone Masking Training (PMT), alleviates the impact of such phenomenon in Uyghur ASR. Although PMT achieves remarkably improvements, there still exists room for further gains due to the granularity mismatch between the masking unit of PMT (phoneme) and the modeling unit (word-piece). To boost the performance of PMT, we propose multi-modeling unit training (MMUT) architecture fusion with PMT (PM-MMUT). The idea of MMUT framework is to split the Encoder into two parts including acoustic feature sequences to phoneme-level representation (AF-to-PLR) and phoneme-level representation to word-piece-level representation (PLR-to-WPLR). It allows AF-to-PLR to be optimized by an intermediate phoneme-based CTC loss to learn the rich phoneme-level context information brought by PMT. Experimental results on Uyghur ASR show that the proposed approaches outperform obviously the pure PMT. We also conduct experiments on the 960-hour Librispeech benchmark using ESPnet1, which achieves about 10% relative WER reduction on all the test set without LM fusion comparing with the latest official ESPnet1 pre-trained model.


title: Quantum indirect synchronization

abstract: It is well known that a system with two or more levels exists a limit cycle and can be synchronized with an external drive when the system and the drive are directly coupled. One might wonder if a system can synchronize with the external drive when they are not coupled directly. In this paper, we examine this case by considering a composite system consisting of two coupled two-level quantum systems, one of which is driven by an external field, while another couples to the driven one. Due to the decoherence caused by environments, the composite system would stay in a mixed state, and an effective limit cycle is formed, so phase locking could occur. We find the phase locking phenomenon in the phase diagram characterized by Husimi $Q$ function, and the synchronization can be generated consequently that we will refer to indirect synchronization. The $S$ function defined in the earlier study can also be used to measure the strength of synchronization. We claim that indirect synchronization is possible. This result provides us with a method to synchronize a quantum system that coupled to its neighbour without interacting with external drive directly.


title: Understanding and Improving the Exemplar-based Generation for Open-domain Conversation

abstract: Exemplar-based generative models for open-domain conversation produce responses based on the exemplars provided by the retriever, taking advantage of generative models and retrieval models. However, they often ignore the retrieved exemplars while generating responses or produce responses over-fitted to the retrieved exemplars. In this paper, we argue that these drawbacks are derived from the one-to-many problem of the open-domain conversation. When the retrieved exemplar is relevant to the given context yet significantly different from the gold response, the exemplar-based generative models are trained to ignore the exemplar since the exemplar is not helpful for generating the gold response. On the other hand, when the retrieved exemplar is lexically similar to the gold response, the generative models are trained to rely on the exemplar highly. Therefore, we propose a training method selecting exemplars that are semantically relevant to the gold response but lexically distanced from the gold response to mitigate the above disadvantages. In the training phase, our proposed training method first uses the gold response instead of dialogue context as a query to select exemplars that are semantically relevant to the gold response. And then, it eliminates the exemplars that lexically resemble the gold responses to alleviate the dependency of the generative models on that exemplars. The remaining exemplars could be irrelevant to the given context since they are searched depending on the gold response. Thus, our proposed training method further utilizes the relevance scores between the given context and the exemplars to penalize the irrelevant exemplars. Extensive experiments demonstrate that our proposed training method alleviates the drawbacks of the existing exemplar-based generative models and significantly improves the performance in terms of appropriateness and informativeness.


title: ANEA: Automated (Named) Entity Annotation for German Domain-Specific Texts

abstract: Named entity recognition (NER) is an important task that aims to resolve universal categories of named entities, e.g., persons, locations, organizations, and times. Despite its common and viable use in many use cases, NER is barely applicable in domains where general categories are suboptimal, such as engineering or medicine. To facilitate NER of domain-specific types, we propose ANEA, an automated (named) entity annotator to assist human annotators in creating domain-specific NER corpora for German text collections when given a set of domain-specific texts. In our evaluation, we find that ANEA automatically identifies terms that best represent the texts' content, identifies groups of coherent terms, and extracts and assigns descriptive labels to these groups, i.e., annotates text datasets into the domain (named) entities.


title: Computational bioacoustics with deep learning: a review and roadmap

abstract: Animal vocalisations and natural soundscapes are fascinating objects of study, and contain valuable evidence about animal behaviours, populations and ecosystems. They are studied in bioacoustics and ecoacoustics, with signal processing and analysis an important component. Computational bioacoustics has accelerated in recent decades due to the growth of affordable digital sound recording devices, and to huge progress in informatics such as big data, signal processing and machine learning. Methods are inherited from the wider field of deep learning, including speech and image processing. However, the tasks, demands and data characteristics are often different from those addressed in speech or music analysis. There remain unsolved problems, and tasks for which evidence is surely present in many acoustic signals, but not yet realised. In this paper I perform a review of the state of the art in deep learning for computational bioacoustics, aiming to clarify key concepts and identify and analyse knowledge gaps. Based on this, I offer a subjective but principled roadmap for computational bioacoustics with deep learning: topics that the community should aim to address, in order to make the most of future developments in AI and informatics, and to use audio data in answering zoological and ecological questions.


title: Orbifold K\"ahler Groups related to Mapping Class groups

abstract: We construct certain orbifold compactifications of the moduli stack of pointed stable curves over $\mathbb C$ and study their fundamental groups by means of their quantum representations. This enables to construct interesting K\"ahler groups and to settle most of the candidates for a counter-example to the Shafarevich conjecture on holomorphic convexity proposed in 1998 by Bogomolov and Katzarkov, using TQFT representations of the mapping class groups.


title: Affine invariant convergence rates of the conditional gradient method

abstract: We show that the conditional gradient method for the convex composite problem \[\min_x\{f(x) + \Psi(x)\}\] generates primal and dual iterates with a duality gap converging to zero provided a suitable {\em growth property} holds and the algorithm makes a judicious choice of stepsizes. The rate of convergence of the duality gap to zero ranges from sublinear to linear depending on the degree of the growth property. The growth property and convergence results depend on the pair $(f,\Psi)$ in an affine invariant and norm-independent fashion.


title: Safe Linear Leveling Bandits

abstract: Multi-armed bandits (MAB) are extensively studied in various settings where the objective is to \textit{maximize} the actions' outcomes (i.e., rewards) over time. Since safety is crucial in many real-world problems, safe versions of MAB algorithms have also garnered considerable interest. In this work, we tackle a different critical task through the lens of \textit{linear stochastic bandits}, where the aim is to keep the actions' outcomes close to a target level while respecting a \textit{two-sided} safety constraint, which we call \textit{leveling}. Such a task is prevalent in numerous domains. Many healthcare problems, for instance, require keeping a physiological variable in a range and preferably close to a target level. The radical change in our objective necessitates a new acquisition strategy, which is at the heart of a MAB algorithm. We propose SALE-LTS: Safe Leveling via Linear Thompson Sampling algorithm, with a novel acquisition strategy to accommodate our task and show that it achieves sublinear regret with the same time and dimension dependence as previous works on the classical reward maximization problem absent any safety constraint. We demonstrate and discuss our algorithm's empirical performance in detail via thorough experiments.


title: Hadron Collider Probes of the Quartic Couplings of Gluons to the Photon and $Z$ Boson

abstract: We explore the experimental sensitivities of measuring the $gg \rightarrow Z \gamma$ process at the LHC to the dimension-8 quartic couplings of gluon pairs to the $Z$ boson and photon, in addition to comparing them with the analogous sensitivities in the $gg \to \gamma \gamma$ process. These processes can both receive contributions from 4 different CP-conserving dimension-8 operators with distinct Lorentz structures that contain a pair of gluon field strengths, $\hat G^a_{\mu \nu}$, and a pair of electroweak SU(2) gauge field strengths, $W^i_{\mu \nu}$, as well as 4 similar operators containing a pair of $\hat G^a_{\mu \nu}$ and a pair of U(1) gauge field strengths, $B_{\mu \nu}$. We calculate the scattering angular distributions for $gg \rightarrow Z \gamma$ and the $Z \to \bar f f$ decay angular distributions for these 4 Lorentz structures, as well as the Standard Model background. We analyze the sensitivity of ATLAS measurements of the $Z(\to \ell^+\ell^-, \bar \nu \nu, \bar q q)\gamma$ final states with integrated luminosities up to 139 fb$^{-1}$ at $\sqrt{s} = 13$ TeV, showing that they exclude values $\lesssim 2$ TeV for the dimension-8 operator scales, and compare the $Z \gamma$ sensitivity with that of an ATLAS measurement of the $\gamma \gamma$ final state. We present combined $Z \gamma$ and $\gamma \gamma$ constraints on the scales of dimension-8 SMEFT operators and $\gamma \gamma$ constraints on the nonlinearity scale of the Born-Infeld extension of the Standard Model. We also estimate the sensitivities to dimension-8 operators of experiments at possible future proton-proton colliders with centre-of-mass energies of 25, 50 and 100 TeV, and discuss possible measurements of the $Z$ spin and angular correlations.


title: VirtualCube: An Immersive 3D Video Communication System

abstract: The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies. The key ingredient is VirtualCube, an abstract representation of a real-world cubicle instrumented with RGBD cameras for capturing the 3D geometry and texture of a user. We design VirtualCube so that the task of data capturing is standardized and significantly simplified, and everything can be built using off-the-shelf hardware. We use VirtualCubes as the basic building blocks of a virtual conferencing environment, and we provide each VirtualCube user with a surrounding display showing life-size videos of remote participants. To achieve real-time rendering of remote participants, we develop the V-Cube View algorithm, which uses multi-view stereo for more accurate depth estimation and Lumi-Net rendering for better rendering quality. The VirtualCube system correctly preserves the mutual eye gaze between participants, allowing them to establish eye contact and be aware of who is visually paying attention to them. The system also allows a participant to have side discussions with remote participants as if they were in the same room. Finally, the system sheds lights on how to support the shared space of work items (e.g., documents and applications) and track the visual attention of participants to work items.


title: Polarization-independent isotropic nonlocal metasurfaces with wavelength-controlled functionality

abstract: Flat optics has demonstrated great advances in miniaturizing conventional, bulky optical elements due to the recent developments in metasurface design. Specific applications of such designs include spatial differentiation and the compression of free space. However, metasurfaces designed for such applications are often polarization-dependent and are designed for a single functionality. In this work, we introduce a polarization-independent metasurface structure by designing guided resonances with degenerate band curvatures in a photonic crystal slab. Our device can perform both free-space compression and spatial differentiation when operated at different frequencies at normal incidence. This work demonstrates the promise of dispersion engineering in metasurface design to create ultrathin devices with polarization-independent functionality.


title: Ytterbium nuclear-spin qubits in an optical tweezer array

abstract: We report on the realization of a fast, scalable, and high-fidelity qubit architecture, based on $^{171}$Yb atoms in an optical tweezer array. We demonstrate several attractive properties of this atom for its use as a building block of a quantum information processing platform. Its nuclear spin of 1/2 serves as a long-lived and coherent two-level system, while its rich, alkaline-earth-like electronic structure allows for low-entropy preparation, fast qubit control, and high-fidelity readout. We present a near-deterministic loading protocol, which allows us to fill a 10$\times$10 tweezer array with 92.73(8)% efficiency and a single tweezer with 96.0(1.4)% efficiency. In the future, this loading protocol will enable efficient and uniform loading of target arrays with high probability, an essential step in quantum simulation and information applications. Employing a robust optical approach, we perform submicrosecond qubit rotations and characterize their fidelity through randomized benchmarking, yielding 5.2(5)$\times 10^{-3}$ error per Clifford gate. For quantum memory applications, we measure the coherence of our qubits with $T_2^*$=3.7(4) s and $T_2$=7.9(4) s, many orders of magnitude longer than our qubit rotation pulses. We measure spin depolarization times on the order of tens of seconds and find that this can be increased to the 100 s scale through the application of a several-gauss magnetic field. Finally, we use 3D Raman-sideband cooling to bring the atoms near their motional ground state, which will be central to future implementations of two-qubit gates that benefit from low motional entropy.


title: Measuring Context-Word Biases in Lexical Semantic Datasets

abstract: State-of-the-art pretrained contextualized models (PCM) eg. BERT use tasks such as WiC and WSD to evaluate their word-in-context representations. This inherently assumes that performance in these tasks reflect how well a model represents the coupled word and context semantics. We question this assumption by presenting the first quantitative analysis on the context-word interaction being tested in major contextual lexical semantic tasks. To achieve this, we run probing baselines on masked input, and propose measures to calculate and visualize the degree of context or word biases in existing datasets. The analysis was performed on both models and humans. Our findings demonstrate that models are usually not being tested for word-in-context semantics in the same way as humans are in these tasks, which helps us better understand the model-human gap. Specifically, to PCMs, most existing datasets fall into the extreme ends (the retrieval-based tasks exhibit strong target word bias while WiC-style tasks and WSD show strong context bias); In comparison, humans are less biased and achieve much better performance when both word and context are available than with masked input. We recommend our framework for understanding and controlling these biases for model interpretation and future task design.


title: Early planet formation in embedded protostellar disks: Setting the stage for the first generation of planetesimals

abstract: (Abridged) Recent surveys of young star formation regions have shown that the average Class II object does not have enough dust mass to make the cores of giant planets. Younger Class 0/I objects have enough dust in their embedded disk, which begs the questions: can the first steps of planet formation occur in these younger systems? The first step is building the first planetesimals, generally believed to be the product of the streaming instability. Hence the question can be restated: are the physical conditions of embedded disks conducive to the growth of the streaming instability? Here we model the collapse of a `dusty' proto-stellar cloud to show that if there is sufficient drift between the falling gas and dust, regions of the embedded disk can become sufficiently enhanced in dust to drive the streaming instability. We include four models, three with different dust grain sizes and one with a different initial cloud angular momentum to test a variety of collapse trajectories. We find a `sweet spot' for planetesimal formation for grain sizes of a few 10s of micron since they fall sufficiently fast relative to the gas to build a high dust-to-gas ratio along the disk midplane, but have slow enough radial drift speeds in the embedded disk to maintain the high dust-to-gas ratio. Unlike the gas, which is held in hydrostatic equilibrium for a time due to gas pressure, the dust can begin collapsing from all radii at a much earlier time. The streaming instability can produce at least between 7-35 M$_\oplus$ of planetesimals in the Class 0/I phase of our smooth embedded disks, depending on the size of the falling dust grains. This first generation of planetesimals could represent the first step in planet formation, and occurs earlier in the lifetime of the young star than is traditionally thought.


title: Unsupervised machine learning approaches to the $q$-state Potts model

abstract: In this paper with study phase transitions of the $q$-state Potts model, through a number of unsupervised machine learning techniques, namely Principal Component Analysis (PCA), $k$-means clustering, Uniform Manifold Approximation and Projection (UMAP), and Topological Data Analysis (TDA). Even though in all cases we are able to retrieve the correct critical temperatures $T_c(q)$, for $q = 3, 4$ and $5$, results show that non-linear methods as UMAP and TDA are less dependent on finite size effects, while still being able to distinguish between first and second order phase transitions. This study may be considered as a benchmark for the use of different unsupervised machine learning algorithms in the investigation of phase transitions.


title: Roof-Transformer: Divided and Joined Understanding with Knowledge Enhancement

abstract: Recent work on enhancing BERT-based language representation models with knowledge graphs (KGs) and knowledge bases (KBs) has yielded promising results on multiple NLP tasks. State-of-the-art approaches typically integrate the original input sentences with KG triples and feed the combined representation into a BERT model. However, as the sequence length of a BERT model is limited, such a framework supports little knowledge other than the original input sentences and is thus forced to discard some knowledge. This problem is especially severe for downstream tasks for which the input is a long paragraph or even a document, such as QA or reading comprehension tasks. We address this problem with Roof-Transformer, a model with two underlying BERTs and a fusion layer on top. One underlying BERT encodes the knowledge resources and the other one encodes the original input sentences, and the fusion layer integrates the two resultant encodings. Experimental results on a QA task and the GLUE benchmark attest the effectiveness of the proposed model.


title: Large data limit of the MBO scheme for data clustering: $\Gamma$-convergence of the thresholding energies

abstract: In this work we begin to rigorously analyze the MBO scheme for data clustering in the large data limit. Each iteration of the MBO scheme corresponds to one step of implicit gradient descent for the thresholding energy on the similarity graph of some dataset. For a subset of the nodes of the graph, the thresholding energy at time $h$ is the amount of heat transferred from the subset to its complement at time $h$, rescaled by a factor $\sqrt{h}$. It is then natural to think that outcomes of the MBO scheme are (local) minimizers of this energy. We prove that the algorithm is consistent, in the sense that these (local) minimizers converge to minimizers of a suitably weighted optimal partition problem.


title: Free reflection multiarrangements and quasi-invariants

abstract: To a complex reflection arrangement with an invariant multiplicity function one can relate the space of logarithmic vector fields and the space of quasi-invariants, which are both modules over invariant polynomials. We establish a close relation between these modules. Berest-Chalykh freeness results for the module of quasi-invariants lead to new free complex reflection multiarrangements. K. Saito's primitive derivative gives a linear map between certain spaces of quasi-invariants. We also establish a close relation between non-homogeneous quasi-invariants for root systems and logarithmic vector fields for the extended Catalan arrangements. As an application, we prove the freeness of Catalan arrangements corresponding to the non-reduced root system $BC_N$.


title: Limiting energy density and gravity in Riemann-Cartan space-time

abstract: The gravitational interaction is discussed within the framework of gauge gravitational theory in the Riemann-Cartan space-time. In the case of spatially homogeneous isotopic gravitating systems the gravitational repulsion at extreme conditions near limiting energy density and the transition from gravitational repulsion to attraction in dependence on energy density is studied. The conversion to Friedman regime and the transition to gravitational repulsion at very small energy densities is analyzed.


title: Single-Nucleon Energies Changing with Nucleon Number

abstract: The broad range of accumulated experimental data on the binding energies for single-particle states in nuclei is examined as a function of the constituent number of neutrons and protons and an unexpectedly simple pattern emerges. The dependence of the energies of neutron states on the number of constituent protons, or of proton states on the number of neutrons, are very similar to each other and the sign reflects the well-known strong attraction. For the same kind of nucleons changing as in the state -- energies for neutron states with neutron number changing or proton states with protons -- the dependence is at least a factor of four weaker in magnitude and slightly repulsive, except when the changing nucleons are only within the same orbit as the state. The systematics of the accumulated data are presented with a minimum of use made of model assumptions.


title: Long-tail Recognition via Compositional Knowledge Transfer

abstract: In this work, we introduce a novel strategy for long-tail recognition that addresses the tail classes' few-shot problem via training-free knowledge transfer. Our objective is to transfer knowledge acquired from information-rich common classes to semantically similar, and yet data-hungry, rare classes in order to obtain stronger tail class representations. We leverage the fact that class prototypes and learned cosine classifiers provide two different, complementary representations of class cluster centres in feature space, and use an attention mechanism to select and recompose learned classifier features from common classes to obtain higher quality rare class representations. Our knowledge transfer process is training free, reducing overfitting risks, and can afford continual extension of classifiers to new classes. Experiments show that our approach can achieve significant performance boosts on rare classes while maintaining robust common class performance, outperforming directly comparable state-of-the-art models.


title: Data-driven modelling of nonlinear dynamics by barycentric coordinates and memory

abstract: We present a numerical method to model dynamical systems from data. We use the recently introduced method Scalable Probabilistic Approximation (SPA) to project points from a Euclidean space to convex polytopes and represent these projected states of a system in new, lower-dimensional coordinates denoting their position in the polytope. We then introduce a specific nonlinear transformation to construct a model of the dynamics in the polytope and to transform back into the original state space. To overcome the potential loss of information from the projection to a lower-dimensional polytope, we use memory in the sense of the delay-embedding theorem of Takens. By construction, our method produces stable models. We illustrate the capacity of the method to reproduce even chaotic dynamics and attractors with multiple connected components on various examples.


title: Attentive Contextual Carryover for Multi-Turn End-to-End Spoken Language Understanding

abstract: Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional text-based natural language understanding systems, current E2E SLU approaches have not yet incorporated such critical contextual signals in multi-turn and task-oriented dialogues. In this work, we propose a contextual E2E SLU model architecture that uses a multi-head attention mechanism over encoded previous utterances and dialogue acts (actions taken by the voice assistant) of a multi-turn dialogue. We detail alternative methods to integrate these contexts into the state-ofthe-art recurrent and transformer-based models. When applied to a large de-identified dataset of utterances collected by a voice assistant, our method reduces average word and semantic error rates by 10.8% and 12.6%, respectively. We also present results on a publicly available dataset and show that our method significantly improves performance over a noncontextual baseline


title: Groups of p-absolute Galois type that are not absolute Galois groups

abstract: Let p be a prime. We study pro-p groups of p-absolute Galois type, as defined by Lam-Liu-Sharifi-Wake-Wang. We prove that the pro-p completion of the right-angled Artin group associated to a chordal simplicial graph is of p-absolute Galois type, and moreover it satisfies a strong version of the Massey vanishing property. Also, we prove that Demushkin groups are of p-absolute Galois type, and that the free pro-p product -- and, under certain conditions, the direct product -- of two pro-p groups of p-absolute Galois type satisfying the Massey vanishing property is again a pro-p group of p-absolute Galois type satisfying the Massey vanishing property. Consequently, there is a plethora of pro-p groups of p-absolute Galois type satisfying the Massey vanishing property that do not occur as absolute Galois groups.


title: A Survey of Unsupervised Domain Adaptation for Visual Recognition

abstract: While huge volumes of unlabeled data are generated and made available in many domains, the demand for automated understanding of visual data is higher than ever before. Most existing machine learning models typically rely on massive amounts of labeled training data to achieve high performance. Unfortunately, such a requirement cannot be met in real-world applications. The number of labels is limited and manually annotating data is expensive and time-consuming. It is often necessary to transfer knowledge from an existing labeled domain to a new domain. However, model performance degrades because of the differences between domains (domain shift or dataset bias). To overcome the burden of annotation, Domain Adaptation (DA) aims to mitigate the domain shift problem when transferring knowledge from one domain into another similar but different domain. Unsupervised DA (UDA) deals with a labeled source domain and an unlabeled target domain. The principal objective of UDA is to reduce the domain discrepancy between the labeled source data and unlabeled target data and to learn domain-invariant representations across the two domains during training. In this paper, we first define UDA problem. Secondly, we overview the state-of-the-art methods for different categories of UDA from both traditional methods and deep learning based methods. Finally, we collect frequently used benchmark datasets and report results of the state-of-the-art methods of UDA on visual recognition problem.


title: Probability Density Estimation Based Imitation Learning

abstract: Imitation Learning (IL) is an effective learning paradigm exploiting the interactions between agents and environments. It does not require explicit reward signals and instead tries to recover desired policies using expert demonstrations. In general, IL methods can be categorized into Behavioral Cloning (BC) and Inverse Reinforcement Learning (IRL). In this work, a novel reward function based on probability density estimation is proposed for IRL, which can significantly reduce the complexity of existing IRL methods. Furthermore, we prove that the theoretically optimal policy derived from our reward function is identical to the expert policy as long as it is deterministic. Consequently, an IRL problem can be gracefully transformed into a probability density estimation problem. Based on the proposed reward function, we present a "watch-try-learn" style framework named Probability Density Estimation based Imitation Learning (PDEIL), which can work in both discrete and continuous action spaces. Finally, comprehensive experiments in the Gym environment show that PDEIL is much more efficient than existing algorithms in recovering rewards close to the ground truth.


title: Satake equivalence for Hodge modules on affine Grassmannians

abstract: For a reductive group $G$ we equip the category of $G_\mathcal{O}$-equivariant polarizable pure Hodge modules on the affine Grassmannian $\mathrm{Gr}_G$ with a structure of neutral Tannakian category. We show that it is equivalent to a twisted tensor product of the category of representations of the Langlands dual group and the category of pure polarizable Hodge structures.


title: Khmer Text Classification Using Word Embedding and Neural Networks

abstract: Text classification is one of the fundamental tasks in natural language processing to label an open-ended text and is useful for various applications such as sentiment analysis. In this paper, we discuss various classification approaches for Khmer text, ranging from a classical TF-IDF algorithm with support vector machine classifier to modern word embedding-based neural network classifiers including linear layer model, recurrent neural network and convolutional neural network. A Khmer word embedding model is trained on a 30-million-Khmer-word corpus to construct word vector representations that are used to train three different neural network classifiers. We evaluate the performance of different approaches on a news article dataset for both multi-class and multi-label text classification tasks. The result suggests that neural network classifiers using a word embedding model consistently outperform the traditional classifier using TF-IDF. The recurrent neural network classifier provides a slightly better result compared to the convolutional network and the linear layer network.


title: Step-unrolled Denoising Autoencoders for Text Generation

abstract: In this paper we propose a new generative model of text, Step-unrolled Denoising Autoencoder (SUNDAE), that does not rely on autoregressive models. Similarly to denoising diffusion techniques, SUNDAE is repeatedly applied on a sequence of tokens, starting from random inputs and improving them each time until convergence. We present a simple new improvement operator that converges in fewer iterations than diffusion methods, while qualitatively producing better samples on natural language datasets. SUNDAE achieves state-of-the-art results (among non-autoregressive methods) on the WMT'14 English-to-German translation task and good qualitative results on unconditional language modeling on the Colossal Cleaned Common Crawl dataset and a dataset of Python code from GitHub. The non-autoregressive nature of SUNDAE opens up possibilities beyond left-to-right prompted generation, by filling in arbitrary blank patterns in a template.


title: Nucleon form factors from $N_f$=2+1+1 twisted mass QCD at the physical point

abstract: We present the nucleon axial and electromagnetic form factors using \Nf{2}{1}{1} ensembles of twisted mass fermions with clover improvement and with masses tuned to their physical values. Excited state effects are studied using several sink-source time separations in the range 0.8 fm - 1.6 fm, exponentially increasing statistics with the separation such that statistical errors remain approximately constant. In addition, quark loop disconnected diagrams are included in order to extract the isoscalar axial form factors and the proton and neutron electromagnetic form factors, as well as their strange-quark contributions. The radii and moments are extracted by modelling the $Q^2$ dependence, including using the so-called $z$-expansion. A preliminary assessment of lattice cut-off effects is presented using two lattice spacings directly at the physical point.


title: Role of Human-AI Interaction in Selective Prediction

abstract: Recent work has shown the potential benefit of selective prediction systems that can learn to defer to a human when the predictions of the AI are unreliable, particularly to improve the reliability of AI systems in high-stakes applications like healthcare or conservation. However, most prior work assumes that human behavior remains unchanged when they solve a prediction task as part of a human-AI team as opposed to by themselves. We show that this is not the case by performing experiments to quantify human-AI interaction in the context of selective prediction. In particular, we study the impact of communicating different types of information to humans about the AI system's decision to defer. Using real-world conservation data and a selective prediction system that improves expected accuracy over that of the human or AI system working individually, we show that this messaging has a significant impact on the accuracy of human judgements. Our results study two components of the messaging strategy: 1) Whether humans are informed about the prediction of the AI system and 2) Whether they are informed about the decision of the selective prediction system to defer. By manipulating these messaging components, we show that it is possible to significantly boost human performance by informing the human of the decision to defer, but not revealing the prediction of the AI. We therefore show that it is vital to consider how the decision to defer is communicated to a human when designing selective prediction systems, and that the composite accuracy of a human-AI team must be carefully evaluated using a human-in-the-loop framework.


title: Adaptation through prediction: multisensory active inference torque control

abstract: Adaptation to external and internal changes is major for robotic systems in uncertain environments. Here we present a novel multisensory active inference torque controller for industrial arms that shows how prediction can be used to resolve adaptation. Our controller, inspired by the predictive brain hypothesis, improves the capabilities of current active inference approaches by incorporating learning and multimodal integration of low and high-dimensional sensor inputs (e.g., raw images) while simplifying the architecture. We performed a systematic evaluation of our model on a 7DoF Franka Emika Panda robot arm by comparing its behavior with previous active inference baselines and classic controllers, analyzing both qualitatively and quantitatively adaptation capabilities and control accuracy. Results showed improved control accuracy in goal-directed reaching with high noise rejection due to multimodal filtering, and adaptability to dynamical inertial changes, elasticity constraints and human disturbances without the need to relearn the model nor parameter retuning.


title: FinRL-Meta: A Universe of Near-Real Market Environments for Data-Driven Deep Reinforcement Learning in Quantitative Finance

abstract: Deep reinforcement learning (DRL) has shown huge potentials in building financial market simulators recently. However, due to the highly complex and dynamic nature of real-world markets, raw historical financial data often involve large noise and may not reflect the future of markets, degrading the fidelity of DRL-based market simulators. Moreover, the accuracy of DRL-based market simulators heavily relies on numerous and diverse DRL agents, which increases demand for a universe of market environments and imposes a challenge on simulation speed. In this paper, we present a FinRL-Meta framework that builds a universe of market environments for data-driven financial reinforcement learning. First, FinRL-Meta separates financial data processing from the design pipeline of DRL-based strategy and provides open-source data engineering tools for financial big data. Second, FinRL-Meta provides hundreds of market environments for various trading tasks. Third, FinRL-Meta enables multiprocessing simulation and training by exploiting thousands of GPU cores. Our codes are available online at https://github.com/AI4Finance-Foundation/FinRL-Meta.


title: Col-OSSOS: Probing Ice Line/Color Transitions within the Kuiper Belt's Progenitor Populations

abstract: Dynamically excited objects within the Kuiper belt show a bimodal distribution in their surface colors, and these differing surface colors may be a tracer of where these objects formed. In this work we explore radial color distributions in the primordial planetesimal disk and implications for the positions of ice line/color transitions within the Kuiper belt's progenitor populations. We combine a full dynamical model of the Kuiper belt's evolution due to Neptune's migration with precise surface colors measured by the Colours of the Outer Solar System Origins Survey in order to examine the true color ratios within the Kuiper belt and the ice lines within the primordial disk. We investigate the position of a dominant, surface color changing ice-line, with two possible surface color layouts within the initial disk; (1) inner neutral surfaces and outer red, and (2) inner red surfaces and outer neutral. We performed simulations with a primordial disk that truncates at 30 au. By radially stepping the color transition out through 0.5 au intervals we show that both disk configurations are consistent with the observed color fraction. For an inner neutral, outer red primordial disk we find that the color transition can be at $28^{+2}_{-3}$ au at a 95% confidence level. For an inner red, outer neutral primordial disk the color transition can be at $27^{+3}_{-3}$ au at a 95% confidence level.


title: Equilateral Chains and Cyclic Central Configurations of the Planar 5-body Problem

abstract: Central configurations and relative equilibria are an important facet of the study of the $N$-body problem, but become very difficult to rigorously analyze for $N>3$. In this paper we focus on a particular but interesting class of configurations of the 5-body problem: the equilateral pentagonal configurations, which have a cycle of five equal edges. We prove a variety of results concerning central configurations with this property, including a computer-assisted proof of the finiteness of such configurations for any positive five masses with a range of rational-exponent homogeneous potentials (including the Newtonian case and point-vortex model), some constraints on their shapes, and we determine some exact solutions for particular N-body potentials.


title: An Open Source Representation for the NYS Electric Grid to Support Power Grid and Market Transition Studies

abstract: Under the increasing need to decarbonize energy systems, there is coupled acceleration in connection of distributed and intermittent renewable resources in power grids. To support this transition, researchers and other stakeholders are embarking on detailed studies and analyses of the evolution of this complex system, which require a validated representation of the essential characteristics of the power grid that is accurate for a specific region of interest. For example, the Climate Leadership and Community Protection Act (CLCPA) in New York State (NYS) sets ambitious targets for the transformation of the energy system, opening many interesting research and analysis questions. To provide a platform for these analyses, this paper presents an overview of the current NYS power grid and develops an open-source (https://github.com/AndersonEnergyLab-Cornell/NYgrid) baseline model using publicly available data. The proposed model is validated with real data for power flow and Locational Marginal Prices (LMPs), demonstrating the feasibility, functionality, and consistency of the model. The model is easily adjustable and customizable for various analyses of future configurations and scenarios that require spatiotemporal information about the NYS power grid with data access to all the available historical data and serves as a practical system for general methods and algorithms testing.


title: Well-posedness of density dependent SDE driven by $\alpha$-stable process with H\"{o}lder drifts

abstract: In this paper, we show the weak and strong well-posedness of density dependent stochastic differential equations driven by $\alpha$-stable processes with $\alpha \in(1,2)$. The existence part is based on Euler's approximation as \cite{HRZ20}, while, the uniqueness is based on the Schauder estimates in Besov spaces for nonlocal Fokker-Planck equations. For the existence, we only assume the drift being continuous in the density variable. For the weak uniqueness, the drift is assumed to be Lipschitz in the density variable, while for the strong uniqueness, we also need to assume the drift being $\beta_0$-order H\"older continuous in the spatial variable, where $\beta_0\in(1-\alpha/2,1)$.


title: Towards quantum Mechanics on the curved cotangent bundle

abstract: The minimal-length paradigm is a cornerstone of quantum gravity phenomenology. Recently, it has been demonstrated that minimal-length quantum mechanics can alternatively be described as an undeformed theory set on a nontrivial momentum space. However, there is no fully consistent formulation of these theories beyond Cartesian coordinates in flat space and, in particular, no position representation. This paper is intended to take the first steps in bridging this gap. We find a natural position representation of the position and momentum operators on general curved cotangent bundles. In an expansion akin to Riemann normal coordinates with curvature in both position and momentum space, we apply the formalism perturbatively to the isotropic harmonic oscillator and the hydrogenic atom. Due to the symmetry of the harmonic oscillator under exchange of positions and momenta, we show that it is impossible to distinguish position- from momentum- space curvature with oscillators alone. Thus, we obtain an instantiation of Born reciprocity on the curved cotangent bundle, i. e. in precisely the way Born originally envisioned. It manifests itself as a symmetry mixing UV and IR physics, reminiscent of T-duality in string theory.


title: Hformer: Hybrid CNN-Transformer for Fringe Order Prediction in Phase Unwrapping of Fringe Projection

abstract: Recently, deep learning has attracted more and more attention in phase unwrapping of fringe projection three-dimensional (3D) measurement, with the aim to improve the performance leveraging the powerful Convolutional Neural Network (CNN) models. In this paper, for the first time (to the best of our knowledge), we introduce the Transformer into the phase unwrapping which is different from CNN and propose Hformer model dedicated to phase unwrapping via fringe order prediction. The proposed model has a hybrid CNN-Transformer architecture that is mainly composed of backbone, encoder and decoder to take advantage of both CNN and Transformer. Encoder and decoder with cross attention are designed for the fringe order prediction. Experimental results show that the proposed Hformer model achieves better performance in fringe order prediction compared with the CNN models such as U-Net and DCNN. Moreover, ablation study on Hformer is made to verify the improved feature pyramid networks (FPN) and testing strategy with flipping in the predicted fringe order. Our work opens an alternative way to deep learning based phase unwrapping methods, which are dominated by CNN in fringe projection 3D measurement.


title: Robust factored principal component analysis for matrix-valued outlier accommodation and detection

abstract: Principal component analysis (PCA) is a popular dimension reduction technique for vector data. Factored PCA (FPCA) is a probabilistic extension of PCA for matrix data, which can substantially reduce the number of parameters in PCA while yield satisfactory performance. However, FPCA is based on the Gaussian assumption and thereby susceptible to outliers. Although the multivariate $t$ distribution as a robust modeling tool for vector data has a very long history, its application to matrix data is very limited. The main reason is that the dimension of the vectorized matrix data is often very high and the higher the dimension, the lower the breakdown point that measures the robustness. To solve the robustness problem suffered by FPCA and make it applicable to matrix data, in this paper we propose a robust extension of FPCA (RFPCA), which is built upon a $t$-type distribution called matrix-variate $t$ distribution. Like the multivariate $t$ distribution, the matrix-variate $t$ distribution can adaptively down-weight outliers and yield robust estimates. We develop a fast EM-type algorithm for parameter estimation. Experiments on synthetic and real-world datasets reveal that RFPCA is compared favorably with several related methods and RFPCA is a simple but powerful tool for matrix-valued outlier detection.


title: RSV: Robotic Sonography for Thyroid Volumetry

abstract: In nuclear medicine, radioiodine therapy is prescribed to treat diseases like hyperthyroidism. The calculation of the prescribed dose depends, amongst other factors, on the thyroid volume. This is currently estimated using conventional 2D ultrasound imaging. However, this modality is inherently user-dependant, resulting in high variability in volume estimations. To increase reproducibility and consistency, we uniquely combine a neural network-based segmentation with an automatic robotic ultrasound scanning for thyroid volumetry. The robotic acquisition is achieved by using a 6 DOF robotic arm with an attached ultrasound probe. Its movement is based on an online segmentation of each thyroid lobe and the appearance of the US image. During post-processing, the US images are segmented to obtain a volume estimation. In an ablation study, we demonstrated the superiority of the motion guidance algorithms for the robot arm movement compared to a naive linear motion, executed by the robot in terms of volumetric accuracy. In a user study on a phantom, we compared conventional 2D ultrasound measurements with our robotic system. The mean volume measurement error of ultrasound expert users could be significantly decreased from 20.85+/-16.10% to only 8.23+/-3.10% compared to the ground truth. This tendency was observed even more in non-expert users where the mean error improvement with the robotic system was measured to be as high as $85\%$ which clearly shows the advantages of the robotic support.


title: Rational Pavelka logic: the best among three worlds?

abstract: This comparative survey explores three formal approaches to reasoning with partly true statements and degrees of truth, within the family of {\L}ukasiewicz logic. These approaches are represented by infinite-valued {\L}ukasiewicz logic ({\L}), Rational Pavelka logic (RPL) and a logic with graded formulas that we refer to as Graded Rational Pavelka logic (GRPL). Truth constants for all rationals between $0$ and $1$ are used as a technical means to calibrate degrees of truth. {\L}ukasiewicz logic ostensibly features no truth constants except $0$ and $1$; Rational Pavelka logic includes constants in the basic language, with suitable axioms; Graded Rational Pavelka logic works with graded formulas and proofs, following the original intent of Pavelka, inspired by Goguen's work. Historically, Pavelka's papers precede the definition of GRPL, which in turn precedes RPL; retrieving these steps, we discuss how these formal systems naturally evolve from each other, and we also recall how this process has been a somewhat contentious issue in the realm of {\L}ukasiewicz logic. This work can also be read as a case study in logics, their fragments, and the relationship of the fragments to a logic.


title: A Homotopy Algorithm for Optimal Transport

abstract: The optimal transport problem has many applications in machine learning, physics, biology, economics, etc. Although its goal is very clear and mathematically well-defined, finding its optimal solution can be challenging for large datasets in high-dimensional space. Here, we propose a homotopy algorithm that first transforms the problem into an easy form, by changing the target distribution. It then transforms the problem back to the original form through a series of iterations, tracing a path of solutions until it finds the optimal solution for the original problem. We define the homotopy path as a subspace rotation based on the orthogonal Procrustes problem, and then we discretize the homotopy path using eigenvalue decomposition of the rotation matrix. Our goal is to provide an algorithm with complexity bound $\mathcal{O}(n^2 \log(n))$, faster than the existing methods in the literature.


title: Alternative formulations of the twistor double copy

abstract: The classical double copy relating exact solutions of biadjoint scalar, gauge and gravity theories continues to receive widespread attention. Recently, a derivation of the exact classical double copy was presented, using ideas from twistor theory, in which spacetime fields are mapped to Cech cohomology classes in twistor space. A puzzle remains, however, in how to interpret the twistor double copy, in that it relies on somehow picking special representatives of each cohomology class. In this paper, we provide two alternative formulations of the twistor double copy using the more widely-used language of Dolbeault cohomology. The first amounts to a rewriting of the Cech approach, whereas the second uses known techniques for discussing spacetime fields in Euclidean signature. The latter approach indeed allows us to identify special cohomology representatives, suggesting that further application of twistor methods in exploring the remit of the double copy may be fruitful.


title: Infinite-layer nickelate superconductors: A current experimental perspective of the crystal and electronic structures

abstract: After the reward of more than two decades of pursuit on the high-Tc cuprate analog with the hope to obtain a better understanding of the mechanism of high-Tc superconductivity, the discovery of superconductivity in the infinite-layer nickelate brings more mystery to the picture than expected. Tops in the list of questions are perhaps (1) absence of superconductivity in the bulk nickelate and limited thickness of the infinite-layer phase in thin film, (2) absence of superconductivity in the La-nickelate despite it being the earliest studied rare-earth nickelate, and the role of 4f orbital in the recipe of superconductivity, (3) absence of Meissner effect and suspect of the origin of superconductivity from the interface, (4) whether nickelate hosts similar pairing symmetry to the single-band high-Tc cuprates or multiband iron-based superconductor. In this perspective article, we will discuss the following aspects: (1) stabilization of the infinite-layer phase on the SrTiO3(001) substrate and the thickness dependency of observables; (2) rare earth dependence of the superconducting dome and phase diagram on the (La/Pr/Nd)- infinite-layer nickelate thin film; (3) experimental aspects of the measurement of Meissner effect; (4) theoretical framework and experimental study of the pairing symmetry of infinite-layer nickelate superconductor.


title: Majorana zero modes induced by superconducting phase bias

abstract: Majorana zero modes in condensed matter systems have been the subject of much interest in recent years. Their non-Abelian exchange statistics, making them a unique state of matter, and their potential applications in topological quantum computation, earned them attention from both theorists and experimentalists. It is generally understood that in order to form Majorana zero modes in quasi-one-dimensional topological insulators, time-reversal symmetry must be broken. The straightforward mechanisms for doing so -- applying magnetic fields or coupling to ferromagnets -- turned out to have many unwanted side effects, such as degradation of superconductivity and the formation of sub-gap states, which is part of the reason Majorana zero modes have been eluding direct experimental detection for a long time. Here we review several proposal that rely on controlling the phase of the superconducting order parameter, either as the sole mechanism for time-reversal-symmetry breaking, or as an additional handy knob used to reduce the applied magnetic field. These proposals hold practical promise to improve Majorana formation, and they shed light on the physics underlying the formation of the topological superconducting state.


title: On the Ergodic Control of Ensembles in the Presence of Non-linear Filters

abstract: In many sharing-economy applications, as well as in conventional economy applications, one wishes to regulate the behaviour of an ensemble of agents with guarantees on both the regulation of the ensemble in aggregate and the revenue or quality of service associated with each agent. Previous work [Automatica, Volume 108, 108483, arXiv:1807.03256 ] has developed guarantees of unique ergodicity when there are linear filters. Here, we extend the guarantees to systems including non-linear elements, such as non-linear filters.


title: Rayleigh-B\'enard thermal convection perturbed by a horizontal heat flux

abstract: In Rayleigh-B\'enard convection, it has been found that the amount of heat passing through the fluid has a power law dependence on the imposed temperature difference. Modifying this dependence, either enhancing or reducing the heat transfer capability of fluids, is important in many scientific and practical applications. Here, we present a simple means to control the vertical heat transfer in Rayleigh-B\'enard convection by injecting heat through one lateral side of the fluid domain and extracting the same amount of heat from the opposite side. This horizontal heat flux regulates the large-scale circulation, and increases the heat transfer rate in the vertical direction. Our numerical and theoretical studies demonstrate how a classical Rayleigh-B\'enard convection responds to such a perturbation, when the system is near or well above the onset of convection.


title: Multi-objective simulation optimization of the adhesive bonding process of materials

abstract: Automotive companies are increasingly looking for ways to make their products lighter, using novel materials and novel bonding processes to join these materials together. Finding the optimal process parameters for such adhesive bonding process is challenging. In this research, we successfully applied Bayesian optimization using Gaussian Process Regression and Logistic Regression, to efficiently (i.e., requiring few experiments) guide the design of experiments to the Pareto-optimal process parameter settings.


title: Hecke triangle Groups and Dessin d'enfant

abstract: In this work we will construct bipartite graphs, famously known as Dessin d'enfant, corresponding to finite index subgroups of Hecke triangle groups $(2, q, \infty )$. Then using a results of \cite{ll} we shall show the correspondences among the special polygons, the bi-partite graph, and the tree diagram for a finite index subgroup of the Hecke triangle groups $(2, q, \infty )$.


title: Cooperative Multi-Agent Reinforcement Learning with Hypergraph Convolution

abstract: Recent years have witnessed the great success of multi-agent systems (MAS). Value decomposition, which decomposes joint action values into individual action values, has been an important work in MAS. However, many value decomposition methods ignore the coordination among different agents, leading to the notorious "lazy agents" problem. To enhance the coordination in MAS, this paper proposes HyperGraph CoNvolution MIX (HGCN-MIX), a method that incorporates hypergraph convolution with value decomposition. HGCN-MIX models agents as well as their relationships as a hypergraph, where agents are nodes and hyperedges among nodes indicate that the corresponding agents can coordinate to achieve larger rewards. Then, it trains a hypergraph that can capture the collaborative relationships among agents. Leveraging the learned hypergraph to consider how other agents' observations and actions affect their decisions, the agents in a MAS can better coordinate. We evaluate HGCN-MIX in the StarCraft II multi-agent challenge benchmark. The experimental results demonstrate that HGCN-MIX can train joint policies that outperform or achieve a similar level of performance as the current state-of-the-art techniques. We also observe that HGCN-MIX has an even more significant improvement of performance in the scenarios with a large amount of agents. Besides, we conduct additional analysis to emphasize that when the hypergraph learns more relationships, HGCN-MIX can train stronger joint policies.


title: hARMS: A Hardware Acceleration Architecture for Real-Time Event-Based Optical Flow

abstract: Event-based vision sensors produce asynchronous event streams with high temporal resolution based on changes in the visual scene. The properties of these sensors allow for accurate and fast calculation of optical flow as events are generated. Existing solutions for calculating optical flow from event data either fail to capture the true direction of motion due to the aperture problem, do not use the high temporal resolution of the sensor, or are too computationally expensive to be run in real time on embedded platforms. In this research, we first present a faster version of our previous algorithm, ARMS (Aperture Robust Multi-Scale flow). The new optimized software version (fARMS) significantly improves throughput on a traditional CPU. Further, we present hARMS, a hardware realization of the fARMS algorithm allowing for real-time computation of true flow on low-power, embedded platforms. The proposed hARMS architecture targets hybrid system-on-chip devices and was designed to maximize configurability and throughput. The hardware architecture and fARMS algorithm were developed with asynchronous neuromorphic processing in mind, abandoning the common use of an event frame and instead operating using only a small history of relevant events, allowing latency to scale independently of the sensor resolution. This change in processing paradigm improved the estimation of flow directions by up to 73% compared to the existing method and yielded a demonstrated hARMS throughput of up to 1.21 Mevent/s on the benchmark configuration selected. This throughput enables real-time performance and makes it the fastest known realization of aperture-robust, event-based optical flow to date.