title: Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL

abstract: A highly desirable property of a reinforcement learning (RL) agent -- and a major difficulty for deep RL approaches -- is the ability to generalize policies learned on a few tasks over a high-dimensional observation space to similar tasks not seen during training. Many promising approaches to this challenge consider RL as a process of training two functions simultaneously: a complex nonlinear encoder that maps high-dimensional observations to a latent representation space, and a simple linear policy over this space. We posit that a superior encoder for zero-shot generalization in RL can be trained by using solely an auxiliary SSL objective if the training process encourages the encoder to map behaviorally similar observations to similar representations, as reward-based signal can cause overfitting in the encoder (Raileanu et al., 2021). We propose Cross-Trajectory Representation Learning (CTRL), a method that runs within an RL agent and conditions its encoder to recognize behavioral similarity in observations by applying a novel SSL objective to pairs of trajectories from the agent's policies. CTRL can be viewed as having the same effect as inducing a pseudo-bisimulation metric but, crucially, avoids the use of rewards and associated overfitting risks. Our experiments ablate various components of CTRL and demonstrate that in combination with PPO it achieves better generalization performance on the challenging Procgen benchmark suite (Cobbe et al., 2020).


title: A Unified Bi-directional Model for Natural and Artificial Trust in Human-Robot Collaboration

abstract: We introduce a novel capabilities-based bi-directional multi-task trust model that can be used for trust prediction from either a human or a robotic trustor agent. Tasks are represented in terms of their capability requirements, while trustee agents are characterized by their individual capabilities. Trustee agents' capabilities are not deterministic; they are represented by belief distributions. For each task to be executed, a higher level of trust is assigned to trustee agents who have demonstrated that their capabilities exceed the task's requirements. We report results of an online experiment with 284 participants, revealing that our model outperforms existing models for multi-task trust prediction from a human trustor. We also present simulations of the model for determining trust from a robotic trustor. Our model is useful for control authority allocation applications that involve human-robot teams.


title: Celebrating Diversity in Shared Multi-Agent Reinforcement Learning

abstract: Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly and limit their coordination capacity. In this paper, we aim to introduce diversity in both optimization and representation of shared multi-agent reinforcement learning. Specifically, we propose an information-theoretical regularization to maximize the mutual information between agents' identities and their trajectories, encouraging extensive exploration and diverse individualized behaviors. In representation, we incorporate agent-specific modules in the shared neural network architecture, which are regularized by L1-norm to promote learning sharing among agents while keeping necessary diversity. Empirical results show that our method achieves state-of-the-art performance on Google Research Football and super hard StarCraft II micromanagement tasks.


title: Effective Matrix Model for Gauge Theories at Finite Temperature and Density using Quantum Computing

abstract: We study the effective matrix model for for gauge fields and fermions on a quantum computer. We use the Variational Quantum Eigensolver (VQE) using IBM QISKit for the effective matrix model for SU(2) and SU(3) including fermions in the fundamental representation. For SU(2) we study the effects of finite temperature and nonzero chemical potential. In all cases we find excellent agreement with the classical computation.


title: Top-$k$ Regularization for Supervised Feature Selection

abstract: Feature selection identifies subsets of informative features and reduces dimensions in the original feature space, helping provide insights into data generation or a variety of domain problems. Existing methods mainly depend on feature scoring functions or sparse regularizations; nonetheless, they have limited ability to reconcile the representativeness and inter-correlations of features. In this paper, we introduce a novel, simple yet effective regularization approach, named top-$k$ regularization, to supervised feature selection in regression and classification tasks. Structurally, the top-$k$ regularization induces a sub-architecture on the architecture of a learning model to boost its ability to select the most informative features and model complex nonlinear relationships simultaneously. Theoretically, we derive and mathematically prove a uniform approximation error bound for using this approach to approximate high-dimensional sparse functions. Extensive experiments on a wide variety of benchmarking datasets show that the top-$k$ regularization is effective and stable for supervised feature selection.


title: CNNs and GANs in MRI-based cross-modality medical image estimation

abstract: Cross-modality image estimation involves the generation of images of one medical imaging modality from that of another modality. Convolutional neural networks (CNNs) have been shown to be useful in identifying, characterising and extracting image patterns. Generative adversarial networks (GANs) use CNNs as generators and estimated images are discriminated as true or false based on an additional network. CNNs and GANs within the image estimation framework may be considered more generally as deep learning approaches, since imaging data tends to be large, leading to a larger number of network weights. Almost all research in the CNN/GAN image estimation literature has involved the use of MRI data with the other modality primarily being PET or CT. This review provides an overview of the use of CNNs and GANs for MRI-based cross-modality medical image estimation. We outline the neural networks implemented, and detail network constructs employed for CNN and GAN image-to-image estimators. Motivations behind cross-modality image estimation are provided as well. GANs appear to provide better utility in cross-modality image estimation in comparison with CNNs, a finding drawn based on our analysis involving metrics comparing estimated and actual images. Our final remarks highlight key challenges faced by the cross-modality medical image estimation field, and suggestions for future research are outlined.


title: Clock Rigidity and Joint Position-Clock Estimation in Ultra-Wideband Sensor Networks

abstract: Joint position and clock estimation is crucial in many wireless sensor network applications, especially in distance-based estimation with time-of-arrival (TOA) measurement. In this work, we consider a TOA-based ultra-wideband (UWB) sensor network, propose a novel clock rigidity theory and investigate the relation between the network graph properties and the feasibility of clock estimation with TOA timestamp measurements. It is shown that a clock framework can be uniquely determined up to a translation of clock offset and a scaling of all clock parameters if and only if it is infinitesimally clock rigid. We further prove that a clock framework is infinitesimally clock rigid if its underlying graph is generically bearing rigid in 2-dimensional space with at least one redundant edge. Combined with distance rigidity, clock rigidity provides a graphical approach for analyzing the joint position and clock problem. It is shown that a position-clock framework can be uniquely determined up to some trivial variations corresponding to both position and clock if and only if it is infinitesimally joint rigid. Simulation results are presented to demonstrate the clock estimation and joint position-clock estimation.


title: PSY-TaLiRo: A Python Toolbox for Search-Based Test Generation for Cyber-Physical Systems

abstract: In this paper, we present the Python package PSY-TaLiRo which is a toolbox for temporal logic robustness guided falsification of Cyber-Physical Systems (CPS). PSY-TaLiRo is a completely modular toolbox supporting multiple temporal logic offline monitors as well as optimization engines for test case generation. Among the benefits of PSY-TaLiRo is that it supports search-based test generation for many different types of systems under test. All PSY-TaLiRo modules can be fully modified by the users to support new optimization and robustness computation engines as well as any System under Test (SUT).


title: Theoretical simulation and design of AlSb thin films solar cells

abstract: The effects of thickness, doping concentration and recombination of AlSb films on the performance of CdS/AlSb cells are simulated by one dimensional simulation program called analysis of microelectronic and photonic structures(AMPS1D) soft ware to understand the influence of material characteristic (such as carrier concentration and thickness) on the solar cells. The methods to improve the performance of CdS/AlSb cells by optimizing the properties of AlSb have been found. The results show that the thicker AlSb film can improve the long wave response for the higher short-circuit current density (Jsc ) of CdS/AlSb solar cells and the higher carrier concentration of the film can improve open-circuit voltage (Voc ) and fill factor (FF), and its optical thickness for CdS/AlSb solar cells is in the range of 500nm~2000nm. The conversion efficiency can be improved from 10.6% to15.3% for introducing AlSb:Te, AlSb:Cu and ZnTe:Cu thin films to CdS/ AlSb structure. Furthermore, the thicker AlSb:Te film can improve the short wave response for the higher Jsc of the cells, and its optical thickness CdS/AlSb:Te/AlSb/ZnTe:Cu solar cells is in the range of 100nm~200nm. And the lower doping concentration can promote Voc and FF to improve the characteristic of the cells.


title: Measurement of high energy dark matter from the Sun at IceCube

abstract: It is assumed that heavy dark matter particles (HDMs) with a mass of O(TeV) are captured by the Sun. HDMs can decay to relativistic light dark matter particles (LDMs), which could be measured by km$^3$ neutrino telescopes (like the IceCube detector). The numbers and fluxes of expected LDMs and neutrinos were evaluated at IceCube with the $Z^{\prime}$ portal dark matter model. Based on the assumption that no events are observed at IceCube in 6 years, the corresponding upper limits on LDM fluxes were calculated at 90\% C. L.. These results indicated that LDMs could be directly detected in the O(1TeV)-O(10TeV) energy range at IceCube with 100 GeV $\lesssim m_{Z^{\prime}} \lesssim$ 350 GeV and $\tau_{\phi} \lesssim 5\times10^{22}$ s.


title: Adam in Private: Secure and Fast Training of Deep Neural Networks with Adaptive Moment Estimation

abstract: Privacy-preserving machine learning (PPML) aims at enabling machine learning (ML) algorithms to be used on sensitive data. We contribute to this line of research by proposing a framework that allows efficient and secure evaluation of full-fledged state-of-the-art ML algorithms via secure multi-party computation (MPC). This is in contrast to most prior works, which substitute ML algorithms with approximated "MPC-friendly" variants. A drawback of the latter approach is that fine-tuning of the combined ML and MPC algorithms is required, which might lead to less efficient algorithms or inferior quality ML. This is an issue for secure deep neural networks (DNN) training in particular, as this involves arithmetic algorithms thought to be "MPC-unfriendly", namely, integer division, exponentiation, inversion, and square root. In this work, we propose secure and efficient protocols for the above seemingly MPC-unfriendly computations. Our protocols are three-party protocols in the honest-majority setting, and we propose both passively secure and actively secure with abort variants. A notable feature of our protocols is that they simultaneously provide high accuracy and efficiency. This framework enables us to efficiently and securely compute modern ML algorithms such as Adam and the softmax function "as is", without resorting to approximations. As a result, we obtain secure DNN training that outperforms state-of-the-art three-party systems; our full training is up to 6.7 times faster than just the online phase of the recently proposed FALCON@PETS'21 on a standard benchmark network. We further perform measurements on real-world DNNs, AlexNet and VGG16. The performance of our framework is up to a factor of about 12-14 faster for AlexNet and 46-48 faster for VGG16 to achieve an accuracy of 70% and 75%, respectively, when compared to FALCON.


title: Detecting and Adapting to Novelty in Games

abstract: Open-world novelty occurs when the rules of an environment can change abruptly, such as when a game player encounters "house rules". To address open-world novelty, game playing agents must be able to detect when novelty is injected, and to quickly adapt to the new rules. We propose a model-based reinforcement learning approach where game state and rules are represented as knowledge graphs. The knowledge graph representation of the state and rules allows novelty to be detected as changes in the knowledge graph, assists with the training of deep reinforcement learners, and enables imagination-based re-training where the agent uses the knowledge graph to perform look-ahead.


title: Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators

abstract: This paper presents a novel pre-trained language models (PLM) compression approach based on the matrix product operator (short as MPO) from quantum many-body physics. It can decompose an original matrix into central tensors (containing the core information) and auxiliary tensors (with only a small proportion of parameters). With the decomposed MPO structure, we propose a novel fine-tuning strategy by only updating the parameters from the auxiliary tensors, and design an optimization algorithm for MPO-based approximation over stacked network architectures. Our approach can be applied to the original or the compressed PLMs in a general way, which derives a lighter network and significantly reduces the parameters to be fine-tuned. Extensive experiments have demonstrated the effectiveness of the proposed approach in model compression, especially the reduction in finetuning parameters (91% reduction on average).


title: Stochastic Iterative Graph Matching

abstract: Recent works leveraging Graph Neural Networks to approach graph matching tasks have shown promising results. Recent progress in learning discrete distributions poses new opportunities for learning graph matching models. In this work, we propose a new model, Stochastic Iterative Graph MAtching (SIGMA), to address the graph matching problem. Our model defines a distribution of matchings for a graph pair so the model can explore a wide range of possible matchings. We further introduce a novel multi-step matching procedure, which learns how to refine a graph pair's matching results incrementally. The model also includes dummy nodes so that the model does not have to find matchings for nodes without correspondence. We fit this model to data via scalable stochastic optimization. We conduct extensive experiments across synthetic graph datasets as well as biochemistry and computer vision applications. Across all tasks, our results show that SIGMA can produce significantly improved graph matching results compared to state-of-the-art models. Ablation studies verify that each of our components (stochastic training, iterative matching, and dummy nodes) offers noticeable improvement.


title: Barcode Method for Generative Model Evaluation driven by Topological Data Analysis

abstract: Evaluating the performance of generative models in image synthesis is a challenging task. Although the Fr\'echet Inception Distance is a widely accepted evaluation metric, it integrates different aspects (e.g., fidelity and diversity) of synthesized images into a single score and assumes the normality of embedded vectors. Recent methods such as precision-and-recall and its variants such as density-and-coverage have been developed to separate fidelity and diversity based on k-nearest neighborhood methods. In this study, we propose an algorithm named barcode, which is inspired by the topological data analysis and is almost free of assumption and hyperparameter selections. In extensive experiments on real-world datasets as well as theoretical approach on high-dimensional normal samples, it was found that the 'usual' normality assumption of embedded vectors has several drawbacks. The experimental results demonstrate that barcode outperforms other methods in evaluating fidelity and diversity of GAN outputs. Official codes can be found in https://github.com/minjeekim00/Barcode.


title: BERTTune: Fine-Tuning Neural Machine Translation with BERTScore

abstract: Neural machine translation models are often biased toward the limited translation references seen during training. To amend this form of overfitting, in this paper we propose fine-tuning the models with a novel training objective based on the recently-proposed BERTScore evaluation metric. BERTScore is a scoring function based on contextual embeddings that overcomes the typical limitations of n-gram-based metrics (e.g. synonyms, paraphrases), allowing translations that are different from the references, yet close in the contextual embedding space, to be treated as substantially correct. To be able to use BERTScore as a training objective, we propose three approaches for generating soft predictions, allowing the network to remain completely differentiable end-to-end. Experiments carried out over four, diverse language pairs have achieved improvements of up to 0.58 pp (3.28%) in BLEU score and up to 0.76 pp (0.98%) in BERTScore (F_BERT) when fine-tuning a strong baseline.


title: Influence of Roles in Decision-Making during OSS Development -- A Study of Python

abstract: Governance has been highlighted as a key factor in the success of an Open Source Software (OSS) project. It is generally seen that in a mixed meritocracy and autocracy governance model, the decision-making (DM) responsibility regarding what features are included in the OSS is shared among members from select roles; prominently the project leader. However, less examination has been made whether members from these roles are also prominent in DM discussions and how decisions are made, to show they play an integral role in the success of the project. We believe that to establish their influence, it is necessary to examine not only discussions of proposals in which the project leader makes the decisions, but also those where others make the decisions. Therefore, in this study, we examine the prominence of members performing different roles in: (i) making decisions, (ii) performing certain social roles in DM discussions (e.g., discussion starters), (iii) contributing to the OSS development social network through DM discussions, and (iv) how decisions are made under both scenarios. We examine these aspects in the evolution of the well-known Python project. We carried out a data-driven longitudinal study of their email communication spanning 20 years, comprising about 1.5 million emails. These emails contain decisions for 466 Python Enhancement Proposals (PEPs) that document the language's evolution. Our findings make the influence of different roles transparent to future (new) members, other stakeholders, and more broadly, to the OSS research community.


title: NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfer

abstract: Autoregressive models have been widely used in unsupervised text style transfer. Despite their success, these models still suffer from the content preservation problem that they usually ignore part of the source sentence and generate some irrelevant words with strong styles. In this paper, we propose a Non-Autoregressive generator for unsupervised text Style Transfer (NAST), which alleviates the problem from two aspects. First, we observe that most words in the transferred sentence can be aligned with related words in the source sentence, so we explicitly model word alignments to suppress irrelevant words. Second, existing models trained with the cycle loss align sentences in two stylistic text spaces, which lacks fine-grained control at the word level. The proposed non-autoregressive generator focuses on the connections between aligned words, which learns the word-level transfer between styles. For experiments, we integrate the proposed generator into two base models and evaluate them on two style transfer tasks. The results show that NAST can significantly improve the overall performance and provide explainable word alignments. Moreover, the non-autoregressive generator achieves over 10x speedups at inference. Our codes are available at https://github.com/thu-coai/NAST.


title: Giant Biquadratic Exchange in 2D Magnets and its Role in Stabilizing Ferromagnetism of NiCl2 Monolayer

abstract: Two-dimensional (2D) van der Waals (vdW) magnets provide an ideal platform for exploring, on the fundamental side, new microscopic mechanisms and for developing, on the technological side, ultra-compact spintronic applications. So far, bilinear spin Hamiltonians have been commonly adopted to investigate the magnetic properties of 2D magnets, neglecting higher order magnetic interactions. However, we here provide quantitative evidence of giant biquadratic exchange interactions in monolayer NiX2 (X=Cl, Br and I), by combining first-principles calculations and the newly developed machine learning method for constructing Hamiltonian. Interestingly, we show that the ferromagnetic ground state within NiCl2 single layers cannot be explained by means of bilinear Heisenberg Hamiltonian; rather, the nearest-neighbor biquadratic interaction is found to be crucial. Furthermore, using a three-orbitals Hubbard model, we propose that the giant biquadratic exchange interaction originates from large hopping between unoccupied and occupied orbitals on neighboring magnetic ions. On a general framework, our work suggests biquadratic exchange interactions to be important in 2D magnets with edge-shared octahedra.


title: Fuzzy Clustering with Similarity Queries

abstract: The fuzzy or soft $k$-means objective is a popular generalization of the well-known $k$-means problem, extending the clustering capability of the $k$-means to datasets that are uncertain, vague, and otherwise hard to cluster. In this paper, we propose a semi-supervised active clustering framework, where the learner is allowed to interact with an oracle (domain expert), asking for the similarity between a certain set of chosen items. We study the query and computational complexities of clustering in this framework. We prove that having a few of such similarity queries enables one to get a polynomial-time approximation algorithm to an otherwise conjecturally NP-hard problem. In particular, we provide algorithms for fuzzy clustering in this setting that asks $O(\mathsf{poly}(k)\log n)$ similarity queries and run with polynomial-time-complexity, where $n$ is the number of items. The fuzzy $k$-means objective is nonconvex, with $k$-means as a special case, and is equivalent to some other generic nonconvex problem such as non-negative matrix factorization. The ubiquitous Lloyd-type algorithms (or alternating minimization algorithms) can get stuck at a local minimum. Our results show that by making a few similarity queries, the problem becomes easier to solve. Finally, we test our algorithms over real-world datasets, showing their effectiveness in real-world applications.


title: Analysis of the robustness of NMF algorithms

abstract: We examine three non-negative matrix factorization techniques; L2-norm, L1-norm, and L2,1-norm. Our aim is to establish the performance of these different approaches, and their robustness in real-world applications such as feature selection while managing computational complexity, sensitivity to noise and more. We thoroughly examine each approach from a theoretical perspective, and examine the performance of each using a series of experiments drawing on both the ORL and YaleB datasets. We examine the Relative Reconstruction Errors (RRE), Average Accuracy and Normalized Mutual Information (NMI) as criteria under a range of simulated noise scenarios.


title: Hydrodynamics of chiral squirmers

abstract: Many microorganisms take a chiral path while swimming in an ambient uid. In this paper, we study the combined behavior of two chiral swimmers using the well-known squirmer model taking into account chiral asymmetries. In contrast to the simple squirmer model, which has an axisymmetric distribution of slip velocity, the chiral squirmer has additional asymmetries in the surface slip, which contribute to both translations and rotations of the motion. As a result, swimming trajectories can become helical and chiral asymmetries arise in the ow patterns. We study the swimming trajectories of a pair of chiral squirmers that interact hydrodynamically. This interaction can lead to attraction and repulsion, and in some cases even to bounded states where the swimmers continue to periodically orbit around a common average trajectory. Such bound states are a signature of the chiral nature of the swimmers. Our study could be relevant to the collective movements of ciliated microorganisms.


title: Topological superconducting domain walls in magnetic Weyl semimetals

abstract: Recent experimental breakthrough in magnetic Weyl semimetals have inspired exploration on the novel effects of various magnetic structures in these materials. Here we focus on a domain wall structure which connects two uniform domains with different magnetization directions. We study the topological superconducting state in presence of an s-wave superconducting pairing potential. By tuning the chemical potential, we can reach a topological state, where a chiral Majorana mode or zero-energy Majorana bound state is localized at the edges of the domain walls. This property allows a convenient braiding operation of Majorana modes by controlling the dynamics of domain walls.

categories: cond-mat.supr-con cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el


title: Fairness-Aware Unsupervised Feature Selection

abstract: Feature selection is a prevalent data preprocessing paradigm for various learning tasks. Due to the expensive cost of acquiring supervision information, unsupervised feature selection sparks great interests recently. However, existing unsupervised feature selection algorithms do not have fairness considerations and suffer from a high risk of amplifying discrimination by selecting features that are over associated with protected attributes such as gender, race, and ethnicity. In this paper, we make an initial investigation of the fairness-aware unsupervised feature selection problem and develop a principled framework, which leverages kernel alignment to find a subset of high-quality features that can best preserve the information in the original feature space while being minimally correlated with protected attributes. Specifically, different from the mainstream in-processing debiasing methods, our proposed framework can be regarded as a model-agnostic debiasing strategy that eliminates biases and discrimination before downstream learning algorithms are involved. Experimental results on multiple real-world datasets demonstrate that our framework achieves a good trade-off between utility maximization and fairness promotion.


title: A Kinematic Analysis of the Giant Molecular Complex W3; Possible Evidence for Cloud-Cloud Collisions that Triggered OB Star Clusters in W3 Main and W3(OH)

abstract: W3 is one of the most outstanding regions of high-mass star formation in the outer solar circle, including two active star-forming clouds, W3 Main and W3(OH). Based on a new analysis of the $^{12}$CO data obtained at 38$^{\prime\prime}$ resolution, we have found three clouds having molecular mass from 2000 to 8000~$M_\odot$ at velocities, $-50$~km s$^{-1}$, $-43$~km s$^{-1}$, and $-39$~km s$^{-1}$. The $-43$~km s$^{-1}$ cloud is the most massive one, overlapping with the $-39$~km s$^{-1}$ cloud and the $-50$~km s$^{-1}$ cloud toward W3 Main and W3(OH), respectively. In W3 Main and W3(OH), we have found typical signatures of a cloud-cloud collision, i.e., the complementary distribution with/without a displacement between the two clouds and/or a V-shape in the position-velocity diagram. We frame a hypothesis that a cloud-cloud collision triggered the high-mass star formation in each region. The collision in W3 Main involves the $-39$~km s$^{-1}$ cloud and the $-43$~km s$^{-1}$ cloud. The collision likely produced a cavity in the $-43$~km s$^{-1}$ cloud having a size similar to the $-39$~km s$^{-1}$ cloud and triggered the formation of young high-mass stars in IC~1795 2 Myr ago. We suggest that the $-39$~km s$^{-1}$ cloud is still triggering the high-mass objects younger than 1 Myr embedded in W3 Main currently. On the other hand, another collision between the $-50$~km s$^{-1}$ cloud and the $-43$~km s$^{-1}$ cloud likely formed the heavily embedded objects in W3(OH) within $\sim$0.5 Myr ago. The present results favour an idea that cloud-cloud collisions are common phenomena not only in the inner solar circle but also in the outer solar circle, where the number of reported cloud-cloud collisions is yet limited (Fukui et al. 2021, PASJ, 73, S1).


title: Measurement of the Absolute Branching Fraction of $D_s^+ \to \tau^+ \nu_{\tau}$ via $\tau^+ \to e^+ \nu_e \bar{\nu}_{\tau}$

abstract: Using a dataset of 6.32 fb$^{-1}$ of $e^+ e^-$ annihilation data collected with the BESIII detector at center-of-mass energies between 4178 and 4226 MeV, we have measured the absolute branching fraction of the leptonic decay $D_s^+ \to \tau^+ \nu_{\tau}$ via $\tau^+ \to e^+ \nu_e \bar{\nu}_{\tau}$, and find $\mathcal{B}_{D_s^+ \to \tau^+ \nu_{\tau}}=(5.27\pm0.10\pm0.12)\times10^{-2}$, where the first uncertainty is statistical and the second is systematic. The precision is improved by a factor of 2 compared to the previous best measurement. Combining with $f_{D_s^+}$ from Lattice quantum chromodynamics calculations or the $|V_{cs}|$ from the CKMfitter group, we extract $|V_{cs}|=0.978\pm0.009\pm0.012$ and $f_{D_s^+}= (251.1\pm2.4\pm3.0)$ MeV, respectively. Combining our result with the world averages of $\mathcal{B}_{D_s^+ \to \tau^+ \nu_{\tau}}$ and $\mathcal{B}_{D_s^+ \to \mu^+ \nu_{\mu}}$, we obtain the ratio of the branching fractions $\mathcal{B}_{D_s^+ \to \tau^+ \nu_{\tau}} / \mathcal{B}_{D_s^+ \to \mu^+ \nu_{\mu}} = 9.72\pm0.37$, which is consistent with the standard model prediction of lepton flavor universality.


title: Discrete time crystals in Bose-Einstein Condensates and symmetry-breaking edge in a simple two-mode theory

abstract: Discrete time crystals (DTCs) refer to a novel many-body steady state that spontaneously breaks the discrete time-translational symmetry in a periodically-driven quantum system. Here, we study DTCs in a Bose-Einstein condensate (BEC) bouncing resonantly on an oscillating mirror, using a two-mode model derived from a standard quantum field theory. We investigate the validity of this model and apply it to study the long-time behavior of our system. A wide variety of initial states based on two Wannier modes are considered. We find that in previous studies the investigated phenomena in the evolution time-window ($\lessapprox$2000 driving periods) are actually "short-time" transient behavior though DTC formation signaled by the sub-harmonic responses is still shown if the inter-boson interaction is strong enough. After a much longer (about 20 times) evolution time, initial states with no "long-range" correlations relax to a steady state, where time-symmetry breaking can be unambiguously defined. Quantum revivals also eventually occur. This long-time behavior can be understood via the many-body Floquet quasi-eigenenergy spectrum of the two-mode model. A symmetry-breaking edge for DTC formation appears in the spectrum for strong enough interaction, where all quasi-eigenstates below the edge are symmetry-breaking while those above the edge are symmetric. The late-time steady state's time-translational symmetry depends solely on whether the initial energy is above or below the symmetry-breaking edge. A phase diagram showing regions of symmetry-broken and symmetric phases for differing initial energies and interaction strengths is presented. We find that according to this two-mode model, the discrete time crystal survives for times out to at least 250,000 driving periods.

categories: cond-mat.quant-gas cond-mat.mes-hall physics.atom-ph quant-ph


title: Fluctuation-dissipation Type Theorem in Stochastic Linear Learning

abstract: The fluctuation-dissipation theorem (FDT) is a simple yet powerful consequence of the first-order differential equation governing the dynamics of systems subject simultaneously to dissipative and stochastic forces. The linear learning dynamics, in which the input vector maps to the output vector by a linear matrix whose elements are the subject of learning, has a stochastic version closely mimicking the Langevin dynamics when a full-batch gradient descent scheme is replaced by that of stochastic gradient descent. We derive a generalized FDT for the stochastic linear learning dynamics and verify its validity among the well-known machine learning data sets such as MNIST, CIFAR-10 and EMNIST.


title: Specular reflections removal in colposcopic images based on neural networks: Supervised training with no ground truth previous knowledge

abstract: Cervical cancer is a malignant tumor that seriously threatens women's health, and is one of the most common that affects women worldwide. For its early detection, colposcopic images of the cervix are used for searching for possible injuries or abnormalities. An inherent characteristic of these images is the presence of specular reflections (brightness) that make it difficult to observe some regions, which might imply misdiagnosis. In this paper, a new strategy based on neural networks is introduced for eliminating specular reflections and estimating the unobserved anatomical cervix portion under the bright zones. For overcoming the fact that the ground truth corresponding to the specular reflection regions is always unknown, the new strategy proposes the supervised training of a neural network to learn how to restore any hidden regions of colposcopic images. Once the specular reflections are identified, they are removed from the image, and the previously trained network is used to fulfill these deleted areas. The quality of the processed images was evaluated quantitatively and qualitatively. In 21 of the 22 evaluated images, the detected specular reflections were eliminated, whereas, in the remaining one, these reflections were almost completely eliminated. The distribution of the colors and the content of the restored images are similar to those of the originals. The evaluation carried out by a specialist in Cervix Pathology concluded that, after eliminating the specular reflections, the anatomical and physiological elements of the cervix are observable in the restored images, which facilitates the medical diagnosis of cervical pathologies. Our method has the potential to improve the early detection of cervical cancer.


title: History Encoding Representation Design for Human Intention Inference

abstract: In this extended abstract, we investigate the design of learning representation for human intention inference. In our designed human intention prediction task, we propose a history encoding representation that is both interpretable and effective for prediction. Through extensive experiments, we show our prediction framework with a history encoding representation design is successful on the human intention prediction problem.


title: Learning Elastic Embeddings for Customizing On-Device Recommenders

abstract: In today's context, deploying data-driven services like recommendation on edge devices instead of cloud servers becomes increasingly attractive due to privacy and network latency concerns. A common practice in building compact on-device recommender systems is to compress their embeddings which are normally the cause of excessive parameterization. However, despite the vast variety of devices and their associated memory constraints, existing memory-efficient recommender systems are only specialized for a fixed memory budget in every design and training life cycle, where a new model has to be retrained to obtain the optimal performance while adapting to a smaller/larger memory budget. In this paper, we present a novel lightweight recommendation paradigm that allows a well-trained recommender to be customized for arbitrary device-specific memory constraints without retraining. The core idea is to compose elastic embeddings for each item, where an elastic embedding is the concatenation of a set of embedding blocks that are carefully chosen by an automated search function. Correspondingly, we propose an innovative approach, namely recommendation with universally learned elastic embeddings (RULE). To ensure the expressiveness of all candidate embedding blocks, RULE enforces a diversity-driven regularization when learning different embedding blocks. Then, a performance estimator-based evolutionary search function is designed, allowing for efficient specialization of elastic embeddings under any memory constraint for on-device recommendation. Extensive experiments on real-world datasets reveal the superior performance of RULE under tight memory budgets.


title: On $L^\infty$ estimates for complex Monge-Amp\`ere equations

abstract: A PDE proof is provided for the sharp $L^\infty$ estimates for the complex Monge-Amp\`ere equation which had required pluripotential theory before. The proof covers both cases of fixed background as well as degenerating background metrics. It extends to more general fully non-linear equations satisfying a structural condition, and it also gives estimates of Trudinger type.


title: Materials Representation and Transfer Learning for Multi-Property Prediction

abstract: The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements, as well as the relationships among multiple properties, to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates (i) prediction using only a material's composition, (ii) learning and exploitation of correlations among target properties in multi-target regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 3-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data is available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with Transfer learning (H-CLMP(T)) wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well-suited for multi-target regression across the physical sciences.


title: The saturation spectrum for antichains of subsets

abstract: Extending a classical theorem of Sperner, we characterize the integers $m$ such that there exists a maximal antichain of size $m$ in the Boolean lattice $B_n$, that is, the power set of $[n]:=\{1,2,\dots,n\}$, ordered by inclusion. As an important ingredient in the proof, we initiate the study of an extension of the Kruskal-Katona theorem which is of independent interest. For given positive integers $t$ and $k$, we ask which integers $s$ have the property that there exists a family $\mathcal F$ of $k$-sets with $\lvert\mathcal F\rvert=t$ such that the shadow of $\mathcal F$ has size $s$, where the shadow of $\mathcal F$ is the collection of $(k-1)$-sets that are contained in at least one member of $\mathcal F$. We provide a complete answer for $t\leqslant k+1$. Moreover, we prove that the largest integer which is not the shadow size of any family of $k$-sets is $\sqrt 2k^{3/2}+\sqrt[4]{8}k^{5/4}+O(k)$.


title: Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances

abstract: Nowadays, open-domain dialogue models can generate acceptable responses according to the historical context based on the large-scale pre-trained language models. However, they generally concatenate the dialogue history directly as the model input to predict the response, which we named as the flat pattern and ignores the dynamic information flow across dialogue utterances. In this work, we propose the DialoFlow model, in which we introduce a dynamic flow mechanism to model the context flow, and design three training objectives to capture the information dynamics across dialogue utterances by addressing the semantic influence brought about by each utterance in large-scale pre-training. Experiments on the multi-reference Reddit Dataset and DailyDialog Dataset demonstrate that our DialoFlow significantly outperforms the DialoGPT on the dialogue generation task. Besides, we propose the Flow score, an effective automatic metric for evaluating interactive human-bot conversation quality based on the pre-trained DialoFlow, which presents high chatbot-level correlation ($r=0.9$) with human ratings among 11 chatbots. Code and pre-trained models will be public. \footnote{\url{https://github.com/ictnlp/DialoFlow}}


title: Addressing Inquiries about History: An Efficient and Practical Framework for Evaluating Open-domain Chatbot Consistency

abstract: A good open-domain chatbot should avoid presenting contradictory responses about facts or opinions in a conversational session, known as its consistency capacity. However, evaluating the consistency capacity of a chatbot is still challenging. Employing human judges to interact with chatbots on purpose to check their capacities is costly and low-efficient, and difficult to get rid of subjective bias. In this paper, we propose the Addressing Inquiries about History (AIH), an efficient and practical framework for the consistency evaluation. At the conversation stage, AIH attempts to address appropriate inquiries about the dialogue history to induce the chatbot to redeclare the historical facts or opinions. We carry out the conversation between chatbots, which is more efficient than the human-bot interaction and can also alleviate the subjective bias. In this way, we manage to rapidly obtain a dialog session that contains responses with high contradiction possibilities. At the contradiction recognition stage, we can either employ human judges or a natural language inference (NLI) model to recognize whether the answers to the inquiries are contradictory with history. Finally, we are able to rank chatbots according to the contradiction statistics. Experiments on open-domain chatbots show that our approach can efficiently and reliably assess the consistency capacity of chatbots and achieve a high ranking correlation with the human evaluation. We release the framework and hope to help improve the consistency capacity of chatbots. \footnote{\url{https://github.com/ictnlp/AIH}}


title: Differentiable Architecture Search for Reinforcement Learning

abstract: In this paper, we investigate the fundamental question: To what extent are gradient-based neural architecture search (NAS) techniques applicable to RL? Using the original DARTS as a convenient baseline, we discover that the discrete architectures found can achieve up to 250% performance compared to manual architecture designs on both discrete and continuous action space environments across off-policy and on-policy RL algorithms, at only 3x more computation time. Furthermore, through numerous ablation studies, we systematically verify that not only does DARTS correctly upweight operations during its supernet phrase, but also gradually improves resulting discrete cells up to 30x more efficiently than random search, suggesting DARTS is surprisingly an effective tool for improving architectures in RL.


title: Maximal antichains of subsets II: Constructions

abstract: This is the second in a sequence of three papers investigating the question for which positive integers $m$ there exists a maximal antichain of size $m$ in the Boolean lattice $B_n$ (the power set of $[n]:=\{1,2,\dots,n\}$, ordered by inclusion). In the previous paper we characterized those $m$ between $\binom{n}{\lceil n/2\rceil}-\lceil n/2\rceil^2$ and the maximum size $\binom{n}{\lceil n/2 \rceil}$ that are not sizes of maximal antichains. In this paper we show that all smaller $m$ are sizes of maximal antichains.


title: Determining Map, Data Assimilation and an Observable Regularity Criterion for the Three-Dimensional Boussinesq System

abstract: In this paper, we provide conditions, \emph{based solely on the observed velocity data}, for the global well-posedness, regularity and convergence of the Azouni-Olson-Titi data assimilation algorithm (AOT algorithm) for a Leray-Hopf weak solutions of the three dimensional Boussinesq system. This condition also guarantees the construction of the {\it determining map}. The aforementioned conditions on the (finite-dimensional) velocity observations, which in this case comprise either of a finite-dimensional \emph{modal} projection or finitely many \emph{volume element observations}, are automatically satisfied for solutions that are globally regular and are uniformly bounded in the $H^1$-norm. However, neither regularity nor uniqueness is {\it a priori} assumed on the solutions. To the best of our knowledge, this is the first such rigorous analysis of the AOT data assimilation algorithm for the three-dimensional Boussinesq system. As a corollary, we obtain that the condition that we imposed is in fact {\it a new observable regularity criterion on the weak global attractor.} The proof of this fact proceeds through the construction of the determining map.


title: Language Scaling for Universal Suggested Replies Model

abstract: We consider the problem of scaling automated suggested replies for Outlook email system to multiple languages. Faced with increased compute requirements and low resources for language expansion, we build a single universal model for improving the quality and reducing run-time costs of our production system. However, restricted data movement across regional centers prevents joint training across languages. To this end, we propose a multi-task continual learning framework, with auxiliary tasks and language adapters to learn universal language representation across regions. The experimental results show positive cross-lingual transfer across languages while reducing catastrophic forgetting across regions. Our online results on real user traffic show significant gains in CTR and characters saved, as well as 65% training cost reduction compared with per-language models. As a consequence, we have scaled the feature in multiple languages including low-resource markets.


title: A Nearly Optimal All-Pairs Min-Cuts Algorithm in Simple Graphs

abstract: We give an $n^{2+o(1)}$-time algorithm for finding $s$-$t$ min-cuts for all pairs of vertices $s$ and $t$ in a simple, undirected graph on $n$ vertices. We do so by constructing a Gomory-Hu tree (or cut equivalent tree) in the same running time, thereby improving on the recent bound of $\tilde{O}(n^{2.5})$ by Abboud et al. (STOC 2021). Our running time is nearly optimal as a function of $n$.


title: Discovery of Causal Additive Models in the Presence of Unobserved Variables

abstract: Causal discovery from data affected by unobserved variables is an important but difficult problem to solve. The effects that unobserved variables have on the relationships between observed variables are more complex in nonlinear cases than in linear cases. In this study, we focus on causal additive models in the presence of unobserved variables. Causal additive models exhibit structural equations that are additive in the variables and error terms. We take into account the presence of not only unobserved common causes but also unobserved intermediate variables. Our theoretical results show that, when the causal relationships are nonlinear and there are unobserved variables, it is not possible to identify all the causal relationships between observed variables through regression and independence tests. However, our theoretical results also show that it is possible to avoid incorrect inferences. We propose a method to identify all the causal relationships that are theoretically possible to identify without being biased by unobserved variables. The empirical results using artificial data and simulated functional magnetic resonance imaging (fMRI) data show that our method effectively infers causal structures in the presence of unobserved variables.


title: Semiclassical Weyl law and exact spectral asymptotics in noncommutative geometry

abstract: We prove a Tauberian theorem for singular values of noncommuting operators which allows us to prove exact asymptotic formulas in noncommutative geometry at a high degree of generality. We explain how, via the Birman--Schwinger principle, these asymptotics imply that a semiclassical Weyl law holds for many interesting noncommutative examples. In Connes' notation for quantized calculus, we prove that for a wide class of $p$-summable spectral triples $(\mathcal{A},H,D)$ and self-adjoint $V \in \mathcal{A}$, there holds \[\lim_{h\downarrow 0} h^p\mathrm{Tr}(\chi_{(-\infty,0)}(h^2D^2+V)) = \int V_-^{\frac{p}{2}}|ds|^p.\] where $\int$ is Connes' noncommutative integral.


title: Refined clock-jitter reduction in the Sagnac-type time-delay interferometry combinations

abstract: The ongoing development of the space-based laser interferometer missions is aiming at unprecedented gravitational wave detections in the millihertz frequency band. The spaceborne nature of the experimental setups leads to a degree of subtlety regarding the otherwise overwhelming laser frequency noise. The cancellation of the latter is accomplished through the time-delay interferometry technique. Moreover, to eventually achieve the desired noise level, the phase fluctuations of the onboard ultra-stable oscillator must also be suppressed. This can be fulfilled by introducing sideband signals which, in turn, give rise to an improved cancellation scheme accounting for the clock-jitter noise. Nonetheless, for certain Sagnac-type interferometry layouts, it can be shown that resultant residual clock noise found in the literature can be further improved. In this regard, we propose refined cancellation combinations for two specific clock noise patterns. This is achieved by employing the so-called geometric time-delay interferometry interpretation. It is shown that for specific Sagnac combinations, the residual noise diminishes significantly to attain the experimentally acceptable sensitivity level. Moreover, we argue that the derived combination, in addition to the existing ones in the literature, furnishes a general-purpose cancellation scheme that serves for arbitrary time-delay interferometry combinations. The subsequential residual noise will only involve factors proportional to the commutators between the delay operators. Our arguments reside in the form of the clock noise expressed in terms of the coefficients of the generating set of the first module of syzygies, the linear combination of which originally constitutes the very solution for laser noise reduction.


title: Memory Approximate Message Passing

abstract: Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable for other matrix ensembles, especially for ill-conditioned ones. To handle this difficulty, orthogonal/vector AMP (OAMP/VAMP) was proposed for general right-unitarily-invariant matrices. However, the Bayes-optimal OAMP/VAMP requires high-complexity linear minimum mean square error estimator. To solve the disadvantages of AMP and OAMP/VAMP, this paper proposes a memory AMP (MAMP), in which a long-memory matched filter is proposed for interference suppression. The complexity of MAMP is comparable to AMP. The asymptotic Gaussianity of estimation errors in MAMP is guaranteed by the orthogonality principle. A state evolution is derived to asymptotically characterize the performance of MAMP. Based on the state evolution, the relaxation parameters and damping vector in MAMP are optimized. For all right-unitarily-invariant matrices, the optimized MAMP converges to OAMP/VAMP, and thus is Bayes-optimal if it has a unique fixed point. Finally, simulations are provided to verify the validity and accuracy of the theoretical results.

categories: cs.IT cs.AI eess.SP math.IT math.ST stat.TH


title: An Energy-Based Interface Detection Method for Phase Change Processes in Nanoconfinements

abstract: An energy-based liquid-vapor interface detection method is presented using molecular dynamics (MD) simulations of liquid menisci confined between two parallel plates under equilibrium and evaporation/condensation conditions. This method defines the liquid-vapor interface at the location where the kinetic energy of the molecules first exceeds the total potential energy imposed by all neighboring (liquid, vapor, and solid) atoms. This definition naturally adapts to the location of the menisci relative to the walls and can properly model the behavior of the liquid adsorbed layers. Unlike the density cutoff methods frequently used in the literature that suffer from density layering effects, this new method gives smooth and continuous liquid-vapor interfaces in nanoconfinements. Surface tension values calculated from the equilibrium MD simulations match the Young-Laplace equation better when using the radius of curvatures calculated from this method. Overall, this energy-based liquid-vapor interface detection method can be used in studies of nanoscale phase change processes and other relevant applications.


title: Diagnosing Turbulence in the Neutral and Molecular Interstellar Medium of Galaxies

abstract: Magnetohydrodynamic (MHD) turbulence is a crucial component of the current paradigms of star formation, dynamo theory, particle transport, magnetic reconnection and evolution of structure in the interstellar medium (ISM) of galaxies. Despite the importance of turbulence to astrophysical fluids, a full theoretical framework based on solutions to the Navier-Stokes equations remains intractable. Observations provide only limited line-of-sight information on densities, temperatures, velocities and magnetic field strengths and therefore directly measuring turbulence in the ISM is challenging. A statistical approach has been of great utility in allowing comparisons of observations, simulations and analytic predictions. In this review article we address the growing importance of MHD turbulence in many fields of astrophysics and review statistical diagnostics for studying interstellar and interplanetary turbulence. In particular, we will review statistical diagnostics and machine learning algorithms that have been developed for observational data sets in order to obtain information about the turbulence cascade, fluid compressibility (sonic Mach number), and magnetization of fluid (Alfv\'enic Mach number). These techniques have often been tested on numerical simulations of MHD turbulence, which may include the creation of synthetic observations, and are often formulated on theoretical expectations for compressible magnetized turbulence. We stress the use of multiple techniques, as this can provide a more accurate indication of the turbulence parameters of interest. We conclude by describing several open-source tools for the astrophysical community to use when dealing with turbulence.


title: Sneak Attack against Mobile Robotic Networks under Formation Control

abstract: The security of mobile robotic networks (MRNs) has been an active research topic in recent years. This paper demonstrates that the observable interaction process of MRNs under formation control will present increasingly severe threats. Specifically, we find that an external attack robot, who has only partial observation over MRNs while not knowing the system dynamics or access, can learn the interaction rules from observations and utilize them to replace a target robot, destroying the cooperation performance of MRNs. We call this novel attack as sneak, which endows the attacker with the intelligence of learning knowledge and is hard to be tackled by traditional defense techniques. The key insight is to separately reveal the internal interaction structure within robots and the external interaction mechanism with the environment, from the coupled state evolution influenced by the model-unknown rules and unobservable part of the MRN. To address this issue, we first provide general interaction process modeling and prove the learnability of the interaction rules. Then, with the learned rules, we design an Evaluate-Cut-Restore (ECR) attack strategy considering the partial interaction structure and geometric pattern. We also establish the sufficient conditions for a successful sneak with maximum control impacts over the MRN. Extensive simulations illustrate the feasibility and effectiveness of the proposed attack.


title: ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression

abstract: Pretrained language models (PLMs) such as BERT adopt a training paradigm which first pretrain the model in general data and then finetune the model on task-specific data, and have recently achieved great success. However, PLMs are notorious for their enormous parameters and hard to be deployed on real-life applications. Knowledge distillation has been prevailing to address this problem by transferring knowledge from a large teacher to a much smaller student over a set of data. We argue that the selection of thee three key components, namely teacher, training data, and learning objective, is crucial to the effectiveness of distillation. We, therefore, propose a four-stage progressive distillation framework ERNIE-Tiny to compress PLM, which varies the three components gradually from general level to task-specific level. Specifically, the first stage, General Distillation, performs distillation with guidance from pretrained teacher, gerenal data and latent distillation loss. Then, General-Enhanced Distillation changes teacher model from pretrained teacher to finetuned teacher. After that, Task-Adaptive Distillation shifts training data from general data to task-specific data. In the end, Task-Specific Distillation, adds two additional losses, namely Soft-Label and Hard-Label loss onto the last stage. Empirical results demonstrate the effectiveness of our framework and generalization gain brought by ERNIE-Tiny.In particular, experiments show that a 4-layer ERNIE-Tiny maintains over 98.0%performance of its 12-layer teacher BERT base on GLUE benchmark, surpassing state-of-the-art (SOTA) by 1.0% GLUE score with the same amount of parameters. Moreover, ERNIE-Tiny achieves a new compression SOTA on five Chinese NLP tasks, outperforming BERT base by 0.4% accuracy with 7.5x fewer parameters and9.4x faster inference speed.


title: Scalable Transformers for Neural Machine Translation

abstract: Transformer has been widely adopted in Neural Machine Translation (NMT) because of its large capacity and parallel training of sequence generation. However, the deployment of Transformer is challenging because different scenarios require models of different complexities and scales. Naively training multiple Transformers is redundant in terms of both computation and memory. In this paper, we propose a novel Scalable Transformers, which naturally contains sub-Transformers of different scales and have shared parameters. Each sub-Transformer can be easily obtained by cropping the parameters of the largest Transformer. A three-stage training scheme is proposed to tackle the difficulty of training the Scalable Transformers, which introduces additional supervisions from word-level and sequence-level self-distillation. Extensive experiments were conducted on WMT EN-De and En-Fr to validate our proposed Scalable Transformers.


title: Over-the-Air Computation via Broadband Channels

abstract: Over-the-air computation (AirComp) has been recognized as a low-latency solution for wireless sensor data fusion, where multiple sensors send their measurement signals to a receiver simultaneously for computation. Most existing work only considered performing AirComp over a single frequency channel. However, for a sensor network with a massive number of nodes, a single frequency channel may not be sufficient to accommodate the large number of sensors, and the AirComp performance will be very limited. So it is highly desirable to have more frequency channels for large-scale AirComp systems to benefit from multi-channel diversity. In this letter, we propose an $M$-frequency AirComp system, where each sensor selects a subset of the $M$ frequencies and broadcasts its signal over these channels under a certain power constraint. We derive the optimal sensors' transmission and receiver's signal processing methods separately, and develop an algorithm for joint design to achieve the best AirComp performance. Numerical results show that increasing one frequency channel can improve the AirComp performance by threefold compared to the single-frequency case.


title: Gravitational waves from the remnants of the first stars in nuclear star clusters

abstract: We study Population III (Pop III) binary remnant mergers in nuclear star clusters (NSCs) with a semi-analytical approach for early structure formation. Within this framework, we keep track of the dynamics of Pop III binary (compact object) remnants during cosmic structure formation, and construct the population of Pop III binary remnants that fall into NSCs by dynamical friction of field stars. The subsequent evolution within NSCs is then derived from three-body encounters and gravitational-wave (GW) emission. We find that 7.5% of Pop III binary remnants will fall into the centres ($< 3\ \rm pc$) of galaxies. About $5-50\%$ of these binaries will merge at $z>0$ in NSCs, including those with very large initial separations (up to 1~pc). The merger rate density (MRD) peaks at $z\sim 5-7$ with $\sim 0.4-10\ \rm yr^{-1}\ \rm Gpc^{-3}$, leading to a promising detection rate $\sim 170-2700\ \rm yr^{-1}$ for 3rd-generation GW detectors that can reach $z\sim 10$. Low-mass ($\lesssim 10^{6}\ \rm M_{\odot}$) NSCs formed at high redshifts ($z\gtrsim 4.5$) host most ($\gtrsim 90\%$) of our mergers, which mainly consist of black holes (BHs) with masses $\sim 40-85\ \rm M_{\odot}$, similar to the most massive BHs found in LIGO events. Particularly, our model can produce events like GW190521 involving BHs in the standard mass gap for pulsational pair-instability supernovae with a MRD $\sim 0.01-0.09\ \rm yr^{-1}\ Gpc^{-3}$ at $z\sim 1$, consistent with that inferred by LIGO.


title: Towards offensive language detection and reduction in four Software Engineering communities

abstract: Software Engineering (SE) communities such as Stack Overflow have become unwelcoming, particularly through members' use of offensive language. Research has shown that offensive language drives users away from active engagement within these platforms. This work aims to explore this issue more broadly by investigating the nature of offensive language in comments posted by users in four prominent SE platforms - GitHub, Gitter, Slack and Stack Overflow (SO). It proposes an approach to detect and classify offensive language in SE communities by adopting natural language processing and deep learning techniques. Further, a Conflict Reduction System (CRS), which identifies offence and then suggests what changes could be made to minimize offence has been proposed. Beyond showing the prevalence of offensive language in over 1 million comments from four different communities which ranges from 0.07% to 0.43%, our results show promise in successful detection and classification of such language. The CRS system has the potential to drastically reduce manual moderation efforts to detect and reduce offence in SE communities.


title: Deep Contextual Learners for Protein Networks

abstract: Spatial context is central to understanding health and disease. Yet reference protein interaction networks lack such contextualization, thereby limiting the study of where protein interactions likely occur in the human body and how they may be altered in disease. Contextualized protein interactions could better characterize genes with disease-specific interactions and elucidate diseases' manifestation in specific cell types. Here, we introduce AWARE, a graph neural message passing approach to inject cellular and tissue context into protein embeddings. AWARE optimizes for a multi-scale embedding space, whose structure reflects network topology at a single-cell resolution. We construct a multi-scale network of the Human Cell Atlas and apply AWARE to learn protein, cell type, and tissue embeddings that uphold cell type and tissue hierarchies. We demonstrate AWARE's utility on the novel task of predicting whether a protein is altered in disease and where that association most likely manifests in the human body. To this end, AWARE outperforms generic embeddings without contextual information by at least 12.5%, showing AWARE's potential to reveal context-dependent roles of proteins in disease.


title: The first non-static inhomogeneous exact solution in $f(T,B)$ gravity

abstract: We examine in this paper the possibility of finding exact solutions for Teleparallel Gravity (TG) of the type of spherically symmetric Lema\^\i tre-Tolman-Bondi (LTB) dust models. We apply to the LTB metric, as obtained from the Schwarzschild solution in General Relativity, the formalism of Teleparallel Gravity in its extension to $f(T,B)$ models. An exact LTB solution is obtained that is compatible with a specific $f(T,B)$ model that seems to be appropriate to fit observations when applied to standard spatially flat Robertson-Walker geometry.


title: Knowing the No-match: Entity Alignment with Dangling Cases

abstract: This paper studies a new problem setting of entity alignment for knowledge graphs (KGs). Since KGs possess different sets of entities, there could be entities that cannot find alignment across them, leading to the problem of dangling entities. As the first attempt to this problem, we construct a new dataset and design a multi-task learning framework for both entity alignment and dangling entity detection. The framework can opt to abstain from predicting alignment for the detected dangling entities. We propose three techniques for dangling entity detection that are based on the distribution of nearest-neighbor distances, i.e., nearest neighbor classification, marginal ranking and background ranking. After detecting and removing dangling entities, an incorporated entity alignment model in our framework can provide more robust alignment for remaining entities. Comprehensive experiments and analyses demonstrate the effectiveness of our framework. We further discover that the dangling entity detection module can, in turn, improve alignment learning and the final performance. The contributed resource is publicly available to foster further research.


title: Robustifying Reinforcement Learning Policies with $\mathcal{L}_1$ Adaptive Control

abstract: A reinforcement learning (RL) policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. Existing robust methods try to obtain a fixed policy for all envisioned dynamic variation scenarios through robust or adversarial training. These methods could lead to conservative performance due to emphasis on the worst case, and often involve tedious modifications to the training environment. We propose an approach to robustifying a pre-trained non-robust RL policy with $\mathcal{L}_1$ adaptive control. Leveraging the capability of an $\mathcal{L}_1$ control law in the fast estimation of and active compensation for dynamic variations, our approach can significantly improve the robustness of an RL policy trained in a standard (i.e., non-robust) way, either in a simulator or in the real world. Numerical experiments are provided to validate the efficacy of the proposed approach.


title: A General Method for Event Detection on Social Media

abstract: Event detection on social media has attracted a number of researches, given the recent availability of large volumes of social media discussions. Previous works on social media event detection either assume a specific type of event, or assume certain behavior of observed variables. In this paper, we propose a general method for event detection on social media that makes few assumptions. The main assumption we make is that when an event occurs, affected semantic aspects will behave differently from its usual behavior. We generalize the representation of time units based on word embeddings of social media text, and propose an algorithm to detect events in time series in a general sense. In the experimental evaluation, we use a novel setting to test if our method and baseline methods can exhaustively catch all real-world news in the test period. The evaluation results show that when the event is quite unusual with regard to the base social media discussion, it can be captured more effectively with our method. Our method can be easily implemented and can be treated as a starting point for more specific applications.


title: Repeat a physics course more than once: A diagnosis of the most frequent misconceptions in newtonian mechanics of first and second-year engineering students

abstract: In this work, we study a sample of 600 engineering students in three consecutive physics courses of different levels, according to their curriculum. We focus on the most frequent students' misconceptions in newtonian mechanics. It was administered the FCI test at the beginning of the academic semester in each course. We use the taxonomy of misconceptions probed in the FCI test, and through this, we establish correlations between the number of attempts in each course, to explore if there are misconceptions that repeat in the students that are on more than one attempt-in each course. The data reported in this paper were analyzed using the method of dominant incorrect answers. The results show that there is no relevant difference between a student on his first attempt and a student on his third or more attempt, in each course, in terms of the most frequent misconceptions.


title: Disentangling Dense Multi-Cable Knots

abstract: Disentangling two or more cables requires many steps to remove crossings between and within cables. We formalize the problem of disentangling multiple cables and present an algorithm, Iterative Reduction Of Non-planar Multiple cAble kNots (IRON-MAN), that outputs robot actions to remove crossings from multi-cable knotted structures. We instantiate this algorithm with a learned perception system, inspired by prior work in single-cable untying that given an image input, can disentangle two-cable twists, three-cable braids, and knots of two or three cables, such as overhand, square, carrick bend, sheet bend, crown, and fisherman's knots. IRON-MAN keeps track of task-relevant keypoints corresponding to target cable endpoints and crossings and iteratively disentangles the cables by identifying and undoing crossings that are critical to knot structure. Using a da Vinci surgical robot, we experimentally evaluate the effectiveness of IRON-MAN on untangling multi-cable knots of types that appear in the training data, as well as generalizing to novel classes of multi-cable knots. Results suggest that IRON-MAN is effective in disentangling knots involving up to three cables with 80.5% success and generalizing to knot types that are not present during training, with cables of both distinct or identical colors.


title: X-volution: On the unification of convolution and self-attention

abstract: Convolution and self-attention are acting as two fundamental building blocks in deep neural networks, where the former extracts local image features in a linear way while the latter non-locally encodes high-order contextual relationships. Though essentially complementary to each other, i.e., first-/high-order, stat-of-the-art architectures, i.e., CNNs or transformers lack a principled way to simultaneously apply both operations in a single computational module, due to their heterogeneous computing pattern and excessive burden of global dot-product for visual tasks. In this work, we theoretically derive a global self-attention approximation scheme, which approximates a self-attention via the convolution operation on transformed features. Based on the approximated scheme, we establish a multi-branch elementary module composed of both convolution and self-attention operation, capable of unifying both local and non-local feature interaction. Importantly, once trained, this multi-branch module could be conditionally converted into a single standard convolution operation via structural re-parameterization, rendering a pure convolution styled operator named X-volution, ready to be plugged into any modern networks as an atomic operation. Extensive experiments demonstrate that the proposed X-volution, achieves highly competitive visual understanding improvements (+1.2% top-1 accuracy on ImageNet classification, +1.7 box AP and +1.5 mask AP on COCO detection and segmentation).


title: State Estimation in Unobservable Power Systems via Graph Signal Processing Tools

abstract: We consider the problem of estimating the states in an unobservable power system. To this end, we propose novel graph signal processing (GSP) methods. For simplicity, we start with analyzing the DC power flow (DC-PF) model and then extend our algorithms to the AC power flow (AC-PF) model. The main assumption behind the proposed GSP approach is that the grid states, which include the vector of phases and the vector of the magnitudes of the voltages in the system, is a smooth graph signal with respect to the system admittance matrix that represents the underlying graph. Thus, the first step in this paper is to validate the graph-smoothness assumption of the states, both empirically and theoretically. Then, we develop the regularized GSP weighted least squares (GSP-WLS) state estimator, which does not require observability of the network. We propose a sensor placement strategy that aims to optimize the estimation performance of the GSP-WLS estimator. Finally, we extend the GSP-WLS estimator method to the AC-PF model by integrating a smoothness regularization term into the Gauss-Newton algorithm. Numerical results on the IEEE 118-bus system demonstrate that the new GSP methods outperform commonly-used estimation approaches and are robust to missing data.


title: Broadband and intense sound transmission loss by a coupled-resonance acoustic metamaterial

abstract: The advent of acoustic metamaterials opened up a new frontier in the control of sound transmission. A key limitation, however, is that an acoustic metamaterial based on a single local resonator in the unit cell produces a restricted narrow-band attenuation peak; and when multiple local resonators are used the emerging attenuation peaks -- while numerous -- are each still narrow and separated by pass bands. Here, we present a new acoustic metamaterial concept that yields a sound transmission loss through two antiresonances -- in a single band gap -- that are fully coupled and hence provide a broadband attenuation range; this is in addition to delivering an isolation intensity that exceeds 90 decibels for both peaks. The underlying coupled resonance mechanism is realized in the form of a single-panel, single-material pillared plate structure with internal contiguous holes$-$a practical configuration that lends itself to design adjustments and optimization for a frequency range of interest, down to sub-kilohertz, and to mass fabrication.


title: Using Social Media Background to Improve Cold-start Recommendation Deep Models

abstract: In recommender systems, a cold-start problem occurs when there is no past interaction record associated with the user or item. Typical solutions to the cold-start problem make use of contextual information, such as user demographic attributes or product descriptions. A group of works have shown that social media background can help predicting temporal phenomenons such as product sales and stock price movements. In this work, our goal is to investigate whether social media background can be used as extra contextual information to improve recommendation models. Based on an existing deep neural network model, we proposed a method to represent temporal social media background as embeddings and fuse them as an extra component in the model. We conduct experimental evaluations on a real-world e-commerce dataset and a Twitter dataset. The results show that our method of fusing social media background with the existing model does generally improve recommendation performance. In some cases the recommendation accuracy measured by hit-rate@K doubles after fusing with social media background. Our findings can be beneficial for future recommender system designs that consider complex temporal information representing social interests.


title: Visual Question Rewriting for Increasing Response Rate

abstract: When a human asks questions online, or when a conversational virtual agent asks human questions, questions triggering emotions or with details might more likely to get responses or answers. we explore how to automatically rewrite natural language questions to improve the response rate from people. In particular, a new task of Visual Question Rewriting(VQR) task is introduced to explore how visual information can be used to improve the new questions. A data set containing around 4K bland questions, attractive questions and images triples is collected. We developed some baseline sequence to sequence models and more advanced transformer based models, which take a bland question and a related image as input and output a rewritten question that is expected to be more attractive. Offline experiments and mechanical Turk based evaluations show that it is possible to rewrite bland questions in a more detailed and attractive way to increase the response rate, and images can be helpful.


title: Exploring Adversarial Learning for Deep Semi-Supervised Facial Action Unit Recognition

abstract: Current works formulate facial action unit (AU) recognition as a supervised learning problem, requiring fully AU-labeled facial images during training. It is challenging if not impossible to provide AU annotations for large numbers of facial images. Fortunately, AUs appear on all facial images, whether manually labeled or not, satisfy the underlying anatomic mechanisms and human behavioral habits. In this paper, we propose a deep semi-supervised framework for facial action unit recognition from partially AU-labeled facial images. Specifically, the proposed deep semi-supervised AU recognition approach consists of a deep recognition network and a discriminator D. The deep recognition network R learns facial representations from large-scale facial images and AU classifiers from limited ground truth AU labels. The discriminator D is introduced to enforce statistical similarity between the AU distribution inherent in ground truth AU labels and the distribution of the predicted AU labels from labeled and unlabeled facial images. The deep recognition network aims to minimize recognition loss from the labeled facial images, to faithfully represent inherent AU distribution for both labeled and unlabeled facial images, and to confuse the discriminator. During training, the deep recognition network R and the discriminator D are optimized alternately. Thus, the inherent AU distributions caused by underlying anatomic mechanisms are leveraged to construct better feature representations and AU classifiers from partially AU-labeled data during training. Experiments on two benchmark databases demonstrate that the proposed approach successfully captures AU distributions through adversarial learning and outperforms state-of-the-art AU recognition work.


title: Units in $F(C_n \times Q_{12})$ and $F(C_n \times D_{12})$

abstract: Let $C_n$, $Q_n$ and $D_n$ be the cyclic group, the quaternion group and the dihedral group of order $n$, respectively. The structures of the unit groups of the finite group algebras $FQ_{12}$ and $F(C_2 \times Q_{12})$ over a finite field $F$ have been studied in J. Gildea, F. Monaghan (2011), F. Monaghan (2012), G. Tang, Y. Gao (2011) and G. Tang, Y. Wei, Y. Li (2014) whereas the structures of the unit groups of the finite group algebras $FD_{12}$ and $F(C_2 \times D_{12})$ have been studied in J. Gildea, F. Monaghan (2011), N. Makhijani, R. K. Sharma, J. B. Srivastava (2016), F. Monaghan (2012), M. Sahai, S. F. Ansari and G. Tang, Y. Gao (2011). In this paper, we continue this study and establish the structures of the unit groups of the group algebras $F(C_n \times Q_{12})$ and $F(C_n \times D_{12})$, over a finite field $F$ of characteristic $p$ containing $p^k$ elements.


title: Regularization and Reparameterization Avoid Vanishing Gradients in Sigmoid-Type Networks

abstract: Deep learning requires several design choices, such as the nodes' activation functions and the widths, types, and arrangements of the layers. One consideration when making these choices is the vanishing-gradient problem, which is the phenomenon of algorithms getting stuck at suboptimal points due to small gradients. In this paper, we revisit the vanishing-gradient problem in the context of sigmoid-type activation. We use mathematical arguments to highlight two different sources of the phenomenon, namely large individual parameters and effects across layers, and to illustrate two simple remedies, namely regularization and rescaling. We then demonstrate the effectiveness of the two remedies in practice. In view of the vanishing-gradient problem being a main reason why tanh and other sigmoid-type activation has become much less popular than relu-type activation, our results bring sigmoid-type activation back to the table.


title: Out-of-Distribution Generalization in Kernel Regression

abstract: In real word applications, data generating process for training a machine learning model often differs from what the model encounters in the test stage. Understanding how and whether machine learning models generalize under such distributional shifts have been a theoretical challenge. Here, we study generalization in kernel regression when the training and test distributions are different using methods from statistical physics. Using the replica method, we derive an analytical formula for the out-of-distribution generalization error applicable to any kernel and real datasets. We identify an overlap matrix that quantifies the mismatch between distributions for a given kernel as a key determinant of generalization performance under distribution shift. Using our analytical expressions we elucidate various generalization phenomena including possible improvement in generalization when there is a mismatch. We develop procedures for optimizing training and test distributions for a given data budget to find best and worst case generalizations under the shift. We present applications of our theory to real and synthetic datasets and for many kernels. We compare results of our theory applied to Neural Tangent Kernel with simulations of wide networks and show agreement. We analyze linear regression in further depth.


title: Envy-free division of multi-layered cakes

abstract: We study the problem of dividing a multi-layered cake under non-overlapping constraints. This problem, recently proposed by Hosseini et al. (IJCAI, 2020), captures several natural scenarios such as the allocation of multiple facilities over time where each agent can utilize at most one facility simultaneously, and the allocation of tasks over time where each agent can perform at most one task simultaneously. We establish the existence of an envy-free multi-division that is both non-overlapping and contiguous within each layer when the number of agents is a prime power and the number of layers is at most the number of agents, providing a positive partial answer to an open question by Hosseini et al. To achieve this, we employ a new approach based on a general fixed point theorem, originally proven by Volovikov (1996), and recently applied by Joji\'{c}, Panina, and \v{Z}ivaljevi\'{c} (2020) to the envy-free division problem of a cake. We further design a fully polynomial-time approximation scheme (FPTAS) to find an approximate envy-free solution that is both non-overlapping and contiguous for a two-layered cake division among three agents with monotone preferences. More generally, we establish all the results for divisions among groups of almost the same size. When there are three groups and one layer, our FPTAS is actually able to deal with groups of any predetermined sizes, still under the monotone preference assumptions. For three groups, this provides thus an algorithmic version of a recent theorem by Segal-Halevi and Suksompong (2021). A classical lemma from topology ensures that every self-map of a simplex mapping each facet to itself is surjective. This lemma has often been used in economics theory and our algorithm can be interpreted as an FPTAS counterpart of its two-dimensional version.


title: Unbiased Optimal Stopping via the MUSE

abstract: We propose a new unbiased estimator for estimating the utility of the optimal stopping problem. The MUSE, short for Multilevel Unbiased Stopping Estimator, constructs the unbiased Multilevel Monte Carlo (MLMC) estimator at every stage of the optimal stopping problem in a backward recursive way. In contrast to traditional sequential methods, the MUSE can be implemented in parallel. We prove the MUSE has finite variance, finite computational complexity, and achieves $\epsilon$-accuracy with $O(1/\epsilon^2)$ computational cost under mild conditions. We demonstrate MUSE empirically in an option pricing problem involving a high-dimensional input and the use of many parallel processors.


title: Tractable Regularization of Probabilistic Circuits

abstract: Probabilistic Circuits (PCs) are a promising avenue for probabilistic modeling. They combine advantages of probabilistic graphical models (PGMs) with those of neural networks (NNs). Crucially, however, they are tractable probabilistic models, supporting efficient and exact computation of many probabilistic inference queries, such as marginals and MAP. Further, since PCs are structured computation graphs, they can take advantage of deep-learning-style parameter updates, which greatly improves their scalability. However, this innovation also makes PCs prone to overfitting, which has been observed in many standard benchmarks. Despite the existence of abundant regularization techniques for both PGMs and NNs, they are not effective enough when applied to PCs. Instead, we re-think regularization for PCs and propose two intuitive techniques, data softening and entropy regularization, that both take advantage of PCs' tractability and still have an efficient implementation as a computation graph. Specifically, data softening provides a principled way to add uncertainty in datasets in closed form, which implicitly regularizes PC parameters. To learn parameters from a softened dataset, PCs only need linear time by virtue of their tractability. In entropy regularization, the exact entropy of the distribution encoded by a PC can be regularized directly, which is again infeasible for most other density estimation models. We show that both methods consistently improve the generalization performance of a wide variety of PCs. Moreover, when paired with a simple PC structure, we achieved state-of-the-art results on 10 out of 20 standard discrete density estimation benchmarks.


title: The structure of the unit group of the group algebra $F(C_3 \times D_{10})$

abstract: Let $D_{n}$ be the dihedral group of order $n$. The structure of the unit group $U(F(C_3 \times D_{10}))$ of the group algebra $F(C_3 \times D_{10})$ over a finite field $F$ of characteristic $3$ is given in \cite{sh13}. In this article, the structure of $U(F(C_3 \times D_{10}))$ is obtained over any finite field $F$ of characteristic $p \neq 3$.


title: SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of Invariances in Domain Generalization

abstract: A major bottleneck in the real-world applications of machine learning models is their failure in generalizing to unseen domains whose data distribution is not i.i.d to the training domains. This failure often stems from learning non-generalizable features in the training domains that are spuriously correlated with the label of data. To address this shortcoming, there has been a growing surge of interest in learning good explanations that are hard to vary, which is studied under the notion of Out-of-Distribution (OOD) Generalization. The search for good explanations that are \textit{invariant} across different domains can be seen as finding local (global) minimas in the loss landscape that hold true across all of the training domains. In this paper, we propose a masking strategy, which determines a continuous weight based on the agreement of gradients that flow in each edge of network, in order to control the amount of update received by the edge in each step of optimization. Particularly, our proposed technique referred to as "Smoothed-AND (SAND)-masking", not only validates the agreement in the direction of gradients but also promotes the agreement among their magnitudes to further ensure the discovery of invariances across training domains. SAND-mask is validated over the Domainbed benchmark for domain generalization and significantly improves the state-of-the-art accuracy on the Colored MNIST dataset while providing competitive results on other domain generalization datasets.


title: Ukiyo-e Analysis and Creativity with Attribute and Geometry Annotation

abstract: The study of Ukiyo-e, an important genre of pre-modern Japanese art, focuses on the object and style like other artwork researches. Such study has benefited from the renewed interest by the machine learning community in culturally important topics, leading to interdisciplinary works including collections of images, quantitative approaches, and machine learning-based creativities. They, however, have several drawbacks, and it remains challenging to integrate these works into a comprehensive view. To bridge this gap, we propose a holistic approach We first present a large-scale Ukiyo-e dataset with coherent semantic labels and geometric annotations, then show its value in a quantitative study of Ukiyo-e paintings' object using these labels and annotations. We further demonstrate the machine learning methods could help style study through soft color decomposition of Ukiyo-e, and finally provides joint insights into object and style by composing sketches and colors using colorization. Dataset available at https://github.com/rois-codh/arc-ukiyoe-faces


title: A C-V2X Platform Using Transportation Data and Spectrum-Aware Sidelink Access

abstract: Intelligent transportation systems and autonomous vehicles are expected to bring new experiences with enhanced efficiency and safety to road users in the near future. However, an efficient and robust vehicular communication system should act as a strong backbone to offer the needed infrastructure connectivity. Deep learning (DL)-based algorithms are widely adopted recently in various vehicular communication applications due to their achieved low latency and fast reconfiguration properties. Yet, collecting actual and sufficient transportation data to train DL-based vehicular communication models is costly and complex. This paper introduces a cellular vehicle-to-everything (C-V2X) verification platform based on an actual traffic simulator and spectrum-aware access. This integrated platform can generate realistic transportation and communication data, benefiting the development and adaptivity of DL-based solutions. Accordingly, vehicular spectrum recognition and management are further investigated to demonstrate the potentials of dynamic slidelink access. Numerical results show that our platform can effectively train and realize DL-based C-V2X algorithms. The developed slidelink communication can adopt different operating bands with remarkable spectrum detection performance, validating its practicality in real-world vehicular environments.


title: Extending the known families of scalable Huffman sequences

abstract: A canonical Huffman sequence is characterized by a zero inner-product between itself and each of its shifted copies, except at their largest relative shifts: their aperiodic auto-correlation then becomes delta-like, a single central peak surrounded by zeros, with one non-zero entry at each end. Prior work showed that the few known families of Huffman sequences (of length $N = 4n-1$, for integers $n > 1$, with continuously scalable elements) are based upon Fibonacci polynomials. Related multi-dimensional ($nD$) Huffman arrays were designed, as well as non-canonical quasi-Huffman arrays that also possess delta-like auto-correlations. We examined links between these discrete sequences and delta-correlated functions defined on the continuum, and provided simple non-iterative approaches to successfully deconvolve $nD$ data blurred by diffuse Huffman arrays. Here we describe new constructions for canonical Huffman sequences. Examples of length $N = 4n+1$, $N = 2n$ and families of arbitrary length are given, including scaled forms, as well as for Fibonacci-based arrays with perfect periodic auto-correlations, that are zero for all non-zero cyclic shifts. A generalization to include canonical sequences with complex scale factors invokes an equally useful dual form of delta-correlation. We also present $1D$ arrays with a much smaller dynamic range than those where the elements are built using Fibonacci recursion. When Huffman arrays (that are comprised of inherently signed values) are employed as diffuse probe beams for image acquisition, a new two-mask de-correlating step is described here that significantly reduces the total incident radiation dose compared to a prior method that added a positive pedestal-offset.


title: Estimating parking occupancy using smart meter transaction data

abstract: The excessive search for parking, known as cruising, generates pollution and congestion. Cities are looking for approaches that will reduce the negative impact associated with searching for parking. However, adequately measuring the number of vehicles in search of parking is difficult and requires sensing technologies. In this paper, we develop an approach that eliminates the need for sensing technology by using parking meter payment transactions to estimate parking occupancy and the number of cars searching for parking. The estimation scheme is based on Particle Markov Chain Monte Carlo. We validate the performance of the Particle Markov Chain Monte Carlo approach using data simulated from a GI/GI/s queue. We show that the approach generates asymptotically unbiased Bayesian estimates of the parking occupancy and underlying model parameters such as arrival rates, average parking time, and the payment compliance rate. Finally, we estimate parking occupancy and cruising using parking meter data from SFpark, a large scale parking experiment and subsequently, compare the Particle Markov Chain Monte Carlo parking occupancy estimates against the ground truth data from the parking sensors. Our approach is easily replicated and scalable given that it only requires using data that cities already possess, namely historical parking payment transactions.


title: Chaotic time-delay signature suppression using quantum noise

abstract: Time-delay signature (TDS) suppression of semiconductor lasers with external optical feedback is necessary to ensure the security of chaos-based secure communications. Here we numerically and experimentally demonstrate a technique to effectively suppress the TDS of chaotic lasers using quantum noise. The TDS and dynamical complexity are quantified using the autocorrelation function and normalized permutation entropy at the feedback delay time, respectively. Quantum noise from quadrature fluctuations of vacuum state is prepared through balanced homodyne measurement. The effects of strength and bandwidth of quantum noise on chaotic TDS suppression and complexity enhancement are investigated numerically and experimentally. Compared to the original dynamics, the TDS of this quantum-noise improved chaos is suppressed up to 94% and the bandwidth suppression ratio of quantum noise to chaotic laser is 1:25. The experiment agrees well with the theory. The improved chaotic laser is potentially beneficial to chaos-based random number generation and secure communication.