title: Time dependent field correlators from holographic EPR pairs

abstract: We study the correlators of the fields that couple to the quark and anti-quark EPR pair in the super Yang-Mills theory using the holographic description, which is a string in AdS space with its two ends anchoring on the boundaries. We consider the cases that the endpoints of the string are static and that the endpoints are uniformly accelerated in opposite directions where the exact solutions for the string's profiles are available. In both cases, the two-point correlators of the boundary field, described by the linearized perturbations in the worldsheet, can also be derived exactly where we obtain the all-time evolution of the correlators. In the case of the accelerating string, the induced geometry on the string worldsheet has the causal structure of a two-sided AdS black hole with a wormhole connecting two causally disconnected boundaries, which can be a realization of the ER=EPR conjecture. We find that causality plays a crucial role in determining the nature of the dispersion relation of the particle and the feature of the induced mutual interaction between two particles from the field. In the case that two boundaries of the worldsheet are causally disconnected, the induced effect from the field gives the dissipative dynamics of each particle with no dependence on the distance between two particles, and the induced mutual coupling between them vanishes in the late times, following a power law. When two ends are causally connected, the induced dispersion relation becomes non-dissipative in the late times. Here, we will also comment on the implications of our findings to the entangled particle dynamics and the ER=EPR conjecture.


title: Efficient Reinforcement Learning for Unsupervised Controlled Text Generation

abstract: Controlled text generation tasks such as unsupervised text style transfer have increasingly adopted the use of Reinforcement Learning (RL). A major challenge in applying RL to such tasks is the sparse reward, which is available only after the full text is generated. Sparse rewards, combined with a large action space make RL training sample-inefficient and difficult to converge. Recently proposed reward-shaping strategies to address this issue have shown only negligible gains. In contrast, this work proposes a novel approach that provides dense rewards to each generated token. We evaluate our approach by its usage in unsupervised text style transfer. Averaged across datasets, our style transfer system improves upon current state-of-art systems by 21\% on human evaluation and 12\% on automatic evaluation. Upon ablated comparison with the current reward shaping approach (the `roll-out strategy'), using dense rewards improves the overall style transfer quality by 22\% based on human evaluation. Further the RL training is 2.5 times as sample efficient, and 7 times faster.


title: Theory of Graph Neural Networks: Representation and Learning

abstract: Graph Neural Networks (GNNs), neural network architectures targeted to learning representations of graphs, have become a popular learning model for prediction tasks on nodes, graphs and configurations of points, with wide success in practice. This article summarizes a selection of the emerging theoretical results on approximation and learning properties of widely used message passing GNNs and higher-order GNNs, focusing on representation, generalization and extrapolation. Along the way, it summarizes mathematical connections.


title: Galoisian Galois Theory

abstract: These notes are an exposition of Galois Theory from the original Lagrangian and Galoisian point of view. A particular effort was made here to better understand the connection between Lagrange's purely combinatorial approach and Galois algebraic extensions of the latter. Moreover, stimulated by the necessities of present day computer explorations, the algorithmic approach has been given priority here over every other aspect of presentation. In particular, you may not find here the clean simplistic look characteristic of the classical exposition of E. Artin. In contrast these notes should provide a good starting point in attempting constructions in this most difficult computational arena.


title: Quantum Rabi interferometry of motion and radiation

abstract: The precise determination of a displacement of a mechanical oscillator or a microwave field in a predetermined direction in phase space can be carried out with trapped ions or superconducting circuits, respectively, by coupling the oscillator with ancilla qubits. Through that coupling, the displacement information is transferred to the qubits which are then subsequently read out. However, unambiguous estimation of displacement in an unknown direction in the phase space has not been attempted in such oscillator-qubit systems. Here, we propose a hybrid oscillator-qubit interferometric setup for the unambiguous estimation of phase space displacements in an arbitrary direction, based on feasible Rabi interactions beyond the rotating-wave approximation. Using such a hybrid Rabi interferometer for quantum sensing, we show that the performance is superior to the ones attained by single-mode estimation schemes and a conventional interferometer based on Jaynes-Cummings interactions. Moreover, we find that the sensitivity of the Rabi interferometer is independent of the thermal occupation of the oscillator mode, and thus cooling it to the ground state before sensing is not required. We also perform a thorough investigation of the effect of qubit dephasing and oscillator thermalization. We find the interferometer to be fairly robust, outperforming different benchmark estimation schemes even for large dephasing and thermalization.


title: Two-dimensional plasma density evolution local to the inversion layer during sawtooth crash events using Beam Emission Spectroscopy

abstract: We present methods for analyzing Beam Emission Spectroscopy (BES) data to obtain the plasma density evolution associated with rapid sawtooth crash events at the DIII-D tokamak. BES allows coverage over a 2-D spatial plane, inherently local measurements, with fast time responses, and therefore provides a valuable new channel for data during sawtooth events. A method is developed to remove sawtooth-induced edge-light pulses contained in the BES data. The edge light pulses appear to be from the $\rm{D}_{\alpha}$ emission produced by edge recycling during sawtooth events, and are large enough that traditional spectroscopic filtering and data analysis techniques are insufficient to deduce physically meaningful quantities. A cross-calibration of 64 BES channels is performed using a novel method to ensure accurate measurements. For the large-amplitude density oscillations observed, we discuss and use the non-linear relationship between BES signal $\delta I/I_{0}$ and plasma density variation $\delta n_{e}/n_{e0}$. 2-D BES images cover a 8~cm~$\times$~20~cm region around the sawtooth inversion layer and show large-amplitude density oscillations, with additional significant spatial variations across the inversion layer, which grows and peaks near the time of the temperature crash. The edge light removal technique and method of converting large-amplitude $\delta I/I_{0}$ to $\delta n_{e}/n_{e0}$ presented here may help analyze other impulsive MHD phenomena in tokamaks.


title: BLCU-ICALL at SemEval-2022 Task 1: Cross-Attention Multitasking Framework for Definition Modeling

abstract: This paper describes the BLCU-ICALL system used in the SemEval-2022 Task 1 Comparing Dictionaries and Word Embeddings, the Definition Modeling subtrack, achieving 1st on Italian, 2nd on Spanish and Russian, and 3rd on English and French. We propose a transformer-based multitasking framework to explore the task. The framework integrates multiple embedding architectures through the cross-attention mechanism, and captures the structure of glosses through a masking language model objective. Additionally, we also investigate a simple but effective model ensembling strategy to further improve the robustness. The evaluation results show the effectiveness of our solution. We release our code at: https://github.com/blcuicall/SemEval2022-Task1-DM.


title: On Acceleration of Gradient-Based Empirical Risk Minimization using Local Polynomial Regression

abstract: We study the acceleration of the Local Polynomial Interpolation-based Gradient Descent method (LPI-GD) recently proposed for the approximate solution of empirical risk minimization problems (ERM). We focus on loss functions that are strongly convex and smooth with condition number $\sigma$. We additionally assume the loss function is $\eta$-H\"older continuous with respect to the data. The oracle complexity of LPI-GD is $\tilde{O}\left(\sigma m^d \log(1/\varepsilon)\right)$ for a desired accuracy $\varepsilon$, where $d$ is the dimension of the parameter space, and $m$ is the cardinality of an approximation grid. The factor $m^d$ can be shown to scale as $O((1/\varepsilon)^{d/2\eta})$. LPI-GD has been shown to have better oracle complexity than gradient descent (GD) and stochastic gradient descent (SGD) for certain parameter regimes. We propose two accelerated methods for the ERM problem based on LPI-GD and show an oracle complexity of $\tilde{O}\left(\sqrt{\sigma} m^d \log(1/\varepsilon)\right)$. Moreover, we provide the first empirical study on local polynomial interpolation-based gradient methods and corroborate that LPI-GD has better performance than GD and SGD in some scenarios, and the proposed methods achieve acceleration.


title: TeleGraph: A Benchmark Dataset for Hierarchical Link Prediction

abstract: Link prediction is a key problem for network-structured data, attracting considerable research efforts owing to its diverse applications. The current link prediction methods focus on general networks and are overly dependent on either the closed triangular structure of networks or node attributes. Their performance on sparse or highly hierarchical networks has not been well studied. On the other hand, the available tree-like benchmark datasets are either simulated, with limited node information, or small in scale. To bridge this gap, we present a new benchmark dataset TeleGraph, a highly sparse and hierarchical telecommunication network associated with rich node attributes, for assessing and fostering the link inference techniques. Our empirical results suggest that most of the algorithms fail to produce a satisfactory performance on a nearly tree-like dataset, which calls for special attention when designing or deploying the link prediction algorithm in practice.


title: Technical Report: Hybrid Autonomous Intersection Management

abstract: This document provides technical details regarding the Hybrid-AIM simulator that was used in Sharon and Stone (2017) and Parks-Young and Sharon (2022).


title: Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

abstract: How well can NLP models generalize to a variety of unseen tasks when provided with task instructions? To address this question, we first introduce Super-NaturalInstructions, a benchmark of 1,616 diverse NLP tasks and their expert-written instructions. Our collection covers 76 distinct task types, including but not limited to classification, extraction, infilling, sequence tagging, text rewriting, and text composition. This large and diverse collection of tasks enables rigorous benchmarking of cross-task generalization under instructions -- training models to follow instructions on a subset of tasks and evaluating them on the remaining unseen ones. Furthermore, we build Tk-Instruct, a transformer model trained to follow a variety of in-context instructions (plain language task definitions or k-shot examples). Our experiments show that Tk-Instruct outperforms existing instruction-following models such as InstructGPT by over 9% on our benchmark despite being an order of magnitude smaller. We further analyze generalization as a function of various scaling parameters, such as the number of observed tasks, the number of instances per task, and model sizes. We hope our dataset and model facilitate future progress towards more general-purpose NLP models.


title: On the existence of cut points of connected generalized Sierpinski carpets

abstract: In a previous work joint with Dai and Luo, we show that a connected generalized Sierpi\'nski carpet (or shortly a GSC) has cut points if and only if the associated $n$-th Hata graph has a long tail for all $n\geq 2$. In this paper, we extend the above result by showing that it suffices to check a finite number of those graphs to reach a conclusion. This criterion provides a truly "algorithmic" solution to the cut point problem of connected GSCs. We also construct for each $m\geq 1$ a connected GSC with exactly $m$ cut points and demonstrate that when $m\geq 2$, such a GSC must be of the so-called fragile type.


title: Privacy-Preserving Image Classification Using Isotropic Network

abstract: In this paper, we propose a privacy-preserving image classification method that uses encrypted images and an isotropic network such as the vision transformer. The proposed method allows us not only to apply images without visual information to deep neural networks (DNNs) for both training and testing but also to maintain a high classification accuracy. In addition, compressible encrypted images, called encryption-then-compression (EtC) images, can be used for both training and testing without any adaptation network. Previously, to classify EtC images, an adaptation network was required before a classification network, so methods with an adaptation network have been only tested on small images. To the best of our knowledge, previous privacy-preserving image classification methods have never considered image compressibility and patch embedding-based isotropic networks. In an experiment, the proposed privacy-preserving image classification was demonstrated to outperform state-of-the-art methods even when EtC images were used in terms of classification accuracy and robustness against various attacks under the use of two isotropic networks: vision transformer and ConvMixer.


title: Entanglement and quantum correlations in the XX spin-$1/2$ honeycomb lattice

abstract: The ground state phase diagram of the dimerized spin-1/2 XX honeycomb model in presence of a transverse magnetic field (TF) is known. With the absence of the magnetic field, two quantum phases, namely, the N\'eel and the dimerized phases have been identified. Moreover, canted N\'eel and the paramagnetic (PM) phases also emerge by applying the magnetic field. In this paper, using two complementary numerical exact techniques, Lanczos exact diagonalization, and Density matrix renormalization group (DMRG) methods, we study this model by focusing on the quantum correlations, the concurrence, and the quantum discord (QD) among nearest-neighbor spins. We show that the quantum correlations can capture the position of the quantum critical points in the whole range of the ground state phase diagram consistent with previous results. Although the concurrence and the QD are short-range, informative about long-ranged critical correlations. In addition, we address a "magnetic-entanglement" behavior that starts from an entangled field around the saturation field.


title: Easy-Sec: PUF-Based Rapid and Robust Authentication Framework for the Internet of Vehicles

abstract: With the rapid growth of new technological paradigms such as the Internet of Things (IoT), it opens new doors for many applications in the modern era for the betterment of human life. One of the recent applications of the IoT is the Internet of Vehicles (IoV) which helps to see unprecedented growth of connected vehicles on the roads. The IoV is gaining attention due to enhancing traffic safety and providing low route information. One of the most important and major requirements of the IoV is preserving security and privacy under strict latency. Moreover, vehicles are required to be authenticated frequently and fast considering limited bandwidth, high mobility, and density of the vehicles. To address the security vulnerabilities and data integrity, an ultralight authentication scheme has been proposed in this article. Physical Unclonable Function (PUF) and XOR function are used to authenticate both server and vehicle in two message flow which makes the proposed scheme ultralight, and less computation is required. The proposed Easy-Sec can authenticate vehicles maintaining low latency and resisting known security threats. Furthermore, the proposed Easy-Sec needs low overhead so that it does not increase the burden of the IoV network. Computational ( around 4 ms) and Communication (32 bytes) overhead shows the feasibility, efficiency, and also security features are depicted using formal analysis, Burrows, Abadi, and Needham (BAN) logic, and informal analysis to show the robustness of the proposed mechanisms against security threats.


title: Accelerated Magnonic Motional Cooling with Deep Reinforcement Learning

abstract: Achieving fast cooling of motional modes is a prerequisite for leveraging such bosonic quanta for high-speed quantum information processing. In this work, we address the aspect of reducing the time limit for cooling below that constrained by the conventional sideband cooling techniques; and propose a scheme to apply deep reinforcement learning (DRL) to achieve this. In particular, we have shown how the scheme can be used effectively to accelerate the dynamic motional cooling of a macroscopic magnonic sphere, and how it can be uniformly extended for more complex systems, for example, a tripartite opto-magno-mechanical system to obtain cooling of the motional mode below the time bound of coherent cooling. While conventional sideband cooling methods do not work beyond the well-known rotating wave approximation (RWA) regimes, our proposed DRL scheme can be applied uniformly to regimes operating within and beyond the RWA, and thus this offers a new and complete toolkit for rapid control and generation of macroscopic quantum states for application in quantum technologies.


title: Disturbance-free single-pixel imaging camera based on P=0.5 Bernoulli modulation and complementary detection

abstract: We present a technique called single-pixel imaging camera based on complementary detection and optimized Bernoulli modulation (CSPI camera), which can significantly reduce the influence of the disturbance light to single-pixel imaging (SPI). The numerical simulation demonstrates that when the probability of the value "1" is P=0.5 for each coded pattern, CSPI camera is disturbance-free is still disturbance-free even if the intensity fluctuation of the disturbance light is much larger than the signal's intensity. The reconstruction results of both SPI and differential SPI are also compared. This technique of CSPI camera can dramatically promote real application of single-pixel imaging Lidar.


title: Quantum critical behavior of entanglement in lattice bosons with cavity-mediated long-range interactions

abstract: We analyze the ground-state entanglement entropy of the extended Bose-Hubbard model with infinite-range interactions. This model describes the low-energy dynamics of ultracold bosons tightly bound to an optical lattice and dispersively coupled to a cavity mode. The competition between onsite repulsion and global cavity-induced interactions leads to a rich phase diagram, which exhibits superfluid, supersolid, and insulating (Mott and checkerboard) phases. We use a slave-boson treatment of harmonic quantum fluctuations around the mean-field solution and calculate the entanglement entropy across the phase transitions. At commensurate filling, the insulator-superfluid transition is signalled by a singularity in the area-law scaling coefficient of the entanglement entropy, that is similar to the one reported for the standard Bose-Hubbard model. Remarkably, at the continuous $\mathbb{Z}_2$ superfluid-to-supersolid transition we find a critical logarithmic term, regardless of the filling. This behavior originates from the appearance of a roton mode in the excitation and entanglement spectrum, becoming gapless at the critical point, and it is characteristic of collective models.


title: GAUSS: Guided Encoder-Decoder Architecture for Hyperspectral Unmixing with Spatial Smoothness

abstract: In recent hyperspectral unmixing (HU) literature, the application of deep learning (DL) has become more prominent, especially with the autoencoder (AE) architecture. We propose a split architecture and use a pseudo-ground truth for abundances to guide the `unmixing network' (UN) optimization. Preceding the UN, an `approximation network' (AN) is proposed, which will improve the association between the centre pixel and its neighbourhood. Hence, it will accentuate spatial correlation in the abundances as its output is the input to the UN and the reference for the `mixing network' (MN). In the Guided Encoder-Decoder Architecture for Hyperspectral Unmixing with Spatial Smoothness (GAUSS), we proposed using one-hot encoded abundances as the pseudo-ground truth to guide the UN; computed using the k-means algorithm to exclude the use of prior HU methods. Furthermore, we release the single-layer constraint on MN by introducing the UN generated abundances in contrast to the standard AE for HU. Secondly, we experimented with two modifications on the pre-trained network using the GAUSS method. In GAUSS$_\textit{blind}$, we have concatenated the UN and the MN to back-propagate the reconstruction error gradients to the encoder. Then, in the GAUSS$_\textit{prime}$, abundance results of a signal processing (SP) method with reliable abundance results were used as the pseudo-ground truth with the GAUSS architecture. According to quantitative and graphical results for four experimental datasets, the three architectures either transcended or equated the performance of existing HU algorithms from both DL and SP domains.


title: Pushing the Performance Limit of Scene Text Recognizer without Human Annotation

abstract: Scene text recognition (STR) attracts much attention over the years because of its wide application. Most methods train STR model in a fully supervised manner which requires large amounts of labeled data. Although synthetic data contributes a lot to STR, it suffers from the real-tosynthetic domain gap that restricts model performance. In this work, we aim to boost STR models by leveraging both synthetic data and the numerous real unlabeled images, exempting human annotation cost thoroughly. A robust consistency regularization based semi-supervised framework is proposed for STR, which can effectively solve the instability issue due to domain inconsistency between synthetic and real images. A character-level consistency regularization is designed to mitigate the misalignment between characters in sequence recognition. Extensive experiments on standard text recognition benchmarks demonstrate the effectiveness of the proposed method. It can steadily improve existing STR models, and boost an STR model to achieve new state-of-the-art results. To our best knowledge, this is the first consistency regularization based framework that applies successfully to STR.


title: On sums of $k$-th powers with almost equal primes

abstract: For "almost all" sufficiently large $N,$ satisfying necessary congruence conditions and $k\geq 2$, we show that there is an {\bf asymptotic formula} for the number of solutions of the equation \begin{align*} \begin{split} &N=p_{1}^{k}+p_{2}^{k}+\cdots+p_{s}^{k}, \\ &\left|p_{i}-( N/s)^{1/k}\right|\leq (N/s)^{\theta/k},\ (1\leq i\leq s) \end{split} \end{align*} with \begin{align*} s\geq \frac{k(k+1)}{2}+1\ \ \textup{and}\ \ \theta\geq {\bf 2/3}+\varepsilon. \end{align*} This enlarges the effective range of $s$ for which can be obtained by the method of M\"{a}tomaki and Xuancheng Shao \cite{MS}. [Discorrelation between primes in short intervals and polynomial phase, Int. Math. Res. Not. IMRN 2021, no. 16, 12330-12355.] The idea is to avoid using the exponential sums (1.2) and Vinogradov mean value theorems in Lemma 2.4 simultaneously. And the main new ingredient is from Kumchev and Liu \cite{KL} (see Lemma 2.2).


title: FKreg: A MATLAB toolbox for fast Multivariate Kernel Regression

abstract: Kernel smooth is the most fundamental technique for data density and regression estimation. However, time-consuming is the biggest obstacle for the application that the direct evaluation of kernel smooth for $N$ samples needs ${O}\left( {{N}^{2}} \right)$ operations. People have developed fast smooth algorithms using the idea of binning with FFT. Unfortunately, the accuracy is not controllable, and the implementation for multivariable and its bandwidth selection for the fast method is not available. Hence, we introduce a new MATLAB toolbox for fast multivariate kernel regression with the idea of non-uniform FFT (NUFFT), which implemented the algorithm for $M$ gridding points with ${O}\left( N+M\log M \right)$ complexity and accuracy controllability. The bandwidth selection problem utilizes the Fast Monte-Carlo algorithm to estimate the degree of freedom (DF), saving enormous cross-validation time even better when data share the same grid space for multiple regression. Up to now, this is the first toolbox for fast-binning high-dimensional kernel regression. Moreover, the estimation for local polynomial regression, the conditional variance for the heteroscedastic model, and the complex-valued datasets are also implemented in this toolbox. The performance is demonstrated with simulations and an application on the quantitive EEG.


title: Emergence of Self-dual Patterns in Active Colloids with Periodical Feedback to Local Density

abstract: The central task in the study of self-organization is to explore the general mechanism of emergences. However, this is inhibited by the missing of a full knowledge of the microscopic dynamics of emergence. Here, in this study, the microscopic dynamics of self-organization for patterns is investigated and quantified in a periodically propelled Quincke system. The periodical coupling between propulsion and repulsion at the particle level leads to local directed oscillating particle flows and promises a loop of positive feedback to density fluctuations. Nevertheless, the global evolution of the resulting cluster phase is dominated by a global dual transformation. As stable attractors of the dual transformation, self-dual patterns including stripe patterns and square lattices can be achieved by tuning the strength and the frequency of propelling. However, stripes are possible only at strong propelling where boundary particle flows can form. The findings in this study show that the dynamics of emergence on different length scales are controlled by different mechanisms. The competition and the interplay between different microscopic dynamic processes play the central role in determining the product of emergence. Moreover, the periodically oscillating self-dual patterns demonstrate a classical approach to time crystals.


title: Interactiveness Field in Human-Object Interactions

abstract: Human-Object Interaction (HOI) detection plays a core role in activity understanding. Though recent two/one-stage methods have achieved impressive results, as an essential step, discovering interactive human-object pairs remains challenging. Both one/two-stage methods fail to effectively extract interactive pairs instead of generating redundant negative pairs. In this work, we introduce a previously overlooked interactiveness bimodal prior: given an object in an image, after pairing it with the humans, the generated pairs are either mostly non-interactive, or mostly interactive, with the former more frequent than the latter. Based on this interactiveness bimodal prior we propose the "interactiveness field". To make the learned field compatible with real HOI image considerations, we propose new energy constraints based on the cardinality and difference in the inherent "interactiveness field" underlying interactive versus non-interactive pairs. Consequently, our method can detect more precise pairs and thus significantly boost HOI detection performance, which is validated on widely-used benchmarks where we achieve decent improvements over state-of-the-arts. Our code is available at https://github.com/Foruck/Interactiveness-Field.


title: Stress-Testing Point Cloud Registration on Automotive LiDAR

abstract: Rigid Point Cloud Registration (PCR) algorithms aim to estimate the 6-DOF relative motion between two point clouds, which is important in various fields, including autonomous driving. Recent years have seen a significant improvement in global PCR algorithms, i.e. algorithms that can handle a large relative motion. This has been demonstrated in various scenarios, including indoor scenes, but has only been minimally tested in the Automotive setting, where point clouds are produced by vehicle-mounted LiDAR sensors. In this work, we aim to answer questions that are important for automotive applications, including: which of the new algorithms is the most accurate, and which is fastest? How transferable are deep-learning approaches, e.g. what happens when you train a network with data from Boston, and run it in a vehicle in Singapore? How small can the overlap between point clouds be before the algorithms start to deteriorate? To what extent are the algorithms rotation invariant? Our results are at times surprising. When comparing robust parameter estimation methods for registration, we find that the fastest and most accurate is not one of the newest approaches. Instead, it is a modern variant of the well known RANSAC technique. We also suggest a new outlier filtering method, Grid-Prioritized Filtering (GPF), to further improve it. An additional contribution of this work is an algorithm for selecting challenging sets of frame-pairs from automotive LiDAR datasets. This enables meaningful benchmarking in the Automotive LiDAR setting, and can also improve training for learning algorithms.


title: DMCS : Density Modularity based Community Search

abstract: Community Search, or finding a connected subgraph (known as a community) containing the given query nodes in a social network, is a fundamental problem. Most of the existing community search models only focus on the internal cohesiveness of a community. However, a high-quality community often has high modularity, which means dense connections inside communities and sparse connections to the nodes outside the community. In this paper, we conduct a pioneer study on searching a community with high modularity. We point out that while modularity has been popularly used in community detection (without query nodes), it has not been adopted for community search, surprisingly, and its application in community search (related to query nodes) brings in new challenges. We address these challenges by designing a new graph modularity function named Density Modularity. To the best of our knowledge, this is the first work on the community search problem using graph modularity. The community search based on the density modularity, termed as DMCS, is to find a community in a social network that contains all the query nodes and has high density-modularity. We prove that the DMCS problem is NP-hard. To efficiently address DMCS, we present new algorithms that run in log-linear time to the graph size. We conduct extensive experimental studies in real-world and synthetic networks, which offer insights into the efficiency and effectiveness of our algorithms. In particular, our algorithm achieves up to 8.5 times higher accuracy in terms of NMI than baseline algorithms.


title: TVShowGuess: Character Comprehension in Stories as Speaker Guessing

abstract: We propose a new task for assessing machines' skills of understanding fictional characters in narrative stories. The task, TVShowGuess, builds on the scripts of TV series and takes the form of guessing the anonymous main characters based on the backgrounds of the scenes and the dialogues. Our human study supports that this form of task covers comprehension of multiple types of character persona, including understanding characters' personalities, facts and memories of personal experience, which are well aligned with the psychological and literary theories about the theory of mind (ToM) of human beings on understanding fictional characters during reading. We further propose new model architectures to support the contextualized encoding of long scene texts. Experiments show that our proposed approaches significantly outperform baselines, yet still largely lag behind the (nearly perfect) human performance. Our work serves as a first step toward the goal of narrative character comprehension.


title: Searching Intrinsic Dimensions of Vision Transformers

abstract: It has been shown by many researchers that transformers perform as well as convolutional neural networks in many computer vision tasks. Meanwhile, the large computational costs of its attention module hinder further studies and applications on edge devices. Some pruning methods have been developed to construct efficient vision transformers, but most of them have considered image classification tasks only. Inspired by these results, we propose SiDT, a method for pruning vision transformer backbones on more complicated vision tasks like object detection, based on the search of transformer dimensions. Experiments on CIFAR-100 and COCO datasets show that the backbones with 20\% or 40\% dimensions/parameters pruned can have similar or even better performance than the unpruned models. Moreover, we have also provided the complexity analysis and comparisons with the previous pruning methods.


title: Local multiscale model reduction using discontinuous Galerkin coupling for elasticity problems

abstract: In this paper, we consider the constrained energy minimizing generalized multiscale finite element method (CEM-GMsFEM) with discontinuous Galerkin (DG) coupling for the linear elasticity equations in highly heterogeneous and high contrast media. We will introduce the construction of a DG version of the CEM-GMsFEM, such as auxiliary basis functions and offline basis functions. The DG version of the method offers some advantages such as flexibility in coarse grid construction and sparsity of resulting discrete systems. Moreover, to our best knowledge, this is the first time where the proof of the convergence of the CEM-GMsFEM in the DG form is given. Some numerical examples will be presented to illustrate the performance of the method.


title: Semantic interpretation for convolutional neural networks: What makes a cat a cat?

abstract: The interpretability of deep neural networks has attracted increasing attention in recent years, and several methods have been created to interpret the "black box" model. Fundamental limitations remain, however, that impede the pace of understanding the networks, especially the extraction of understandable semantic space. In this work, we introduce the framework of semantic explainable AI (S-XAI), which utilizes row-centered principal component analysis to obtain the common traits from the best combination of superpixels discovered by a genetic algorithm, and extracts understandable semantic spaces on the basis of discovered semantically sensitive neurons and visualization techniques. Statistical interpretation of the semantic space is also provided, and the concept of semantic probability is proposed for the first time. Our experimental results demonstrate that S-XAI is effective in providing a semantic interpretation for the CNN, and offers broad usage, including trustworthiness assessment and semantic sample searching.


title: Is Blockchain for Internet of Medical Things a Panacea for COVID-19 Pandemic?

abstract: The outbreak of the COVID-19 pandemic has deeply influenced the lifestyle of the general public and the healthcare system of the society. As a promising approach to address the emerging challenges caused by the epidemic of infectious diseases like COVID-19, Internet of Medical Things (IoMT) deployed in hospitals, clinics, and healthcare centers can save the diagnosis time and improve the efficiency of medical resources though privacy and security concerns of IoMT stall the wide adoption. In order to tackle the privacy, security, and interoperability issues of IoMT, we propose a framework of blockchain-enabled IoMT by introducing blockchain to incumbent IoMT systems. In this paper, we review the benefits of this architecture and illustrate the opportunities brought by blockchain-enabled IoMT. We also provide use cases of blockchain-enabled IoMT on fighting against the COVID-19 pandemic, including the prevention of infectious diseases, location sharing and contact tracing, and the supply chain of injectable medicines. We also outline future work in this area.


title: A Hierarchical Terminal Recognition Approach based on Network Traffic Analysis

abstract: Recognizing the type of connected devices to a network helps to perform security policies. In smart grids, identifying massive number of grid metering terminals based on network traffic analysis is almost blank and existing research has not proposed a targeted end-to-end model to solve the flow classification problem. Therefore, we proposed a hierarchical terminal recognition approach that applies the details of grid data. We have formed a two-level model structure by segmenting the grid data, which uses the statistical characteristics of network traffic and the specific behavior characteristics of grid metering terminals. Moreover, through the selection and reconstruction of features, we combine three algorithms to achieve accurate identification of terminal types that transmit network traffic. We conduct extensive experiments on a real dataset containing three types of grid metering terminals, and the results show that our research has improved performance compared to common recognition models. The combination of an autoencoder, K-Means and GradientBoost algorithm achieved the best recognition rate with F1 value of 98.3%.


title: The Tree Loss: Improving Generalization with Many Classes

abstract: Multi-class classification problems often have many semantically similar classes. For example, 90 of ImageNet's 1000 classes are for different breeds of dog. We should expect that these semantically similar classes will have similar parameter vectors, but the standard cross entropy loss does not enforce this constraint. We introduce the tree loss as a drop-in replacement for the cross entropy loss. The tree loss re-parameterizes the parameter matrix in order to guarantee that semantically similar classes will have similar parameter vectors. Using simple properties of stochastic gradient descent, we show that the tree loss's generalization error is asymptotically better than the cross entropy loss's. We then validate these theoretical results on synthetic data, image data (CIFAR100, ImageNet), and text data (Twitter).


title: FTMPST: Fault-Tolerant Multiparty Session Types

abstract: Multiparty session types are designed to abstractly capture the structure of communication protocols and verify behavioural properties. One important such property is progress, i.e., the absence of deadlock. Distributed algorithms often resemble multiparty communication protocols. But proving their properties, in particular termination that is closely related to progress, can be elaborate. Since distributed algorithms are often designed to cope with faults, a first step towards using session types to verify distributed algorithms is to integrate fault-tolerance. We extend multiparty session types to cope with system failures such as unreliable communication and process crashes. Moreover, we augment the semantics of processes by failure patterns that can be used to represent system requirements (as, e.g., failure detectors). To illustrate our approach we analyse a variant of the well-known rotating coordinator algorithm by Chandra and Toueg.


title: Efficient Bayesian Policy Reuse with a Scalable Observation Model in Deep Reinforcement Learning

abstract: Bayesian policy reuse (BPR) is a general policy transfer framework for selecting a source policy from an offline library by inferring the task belief based on some observation signals and a trained observation model. In this paper, we propose an improved BPR method to achieve more efficient policy transfer in deep reinforcement learning (DRL). First, most BPR algorithms use the episodic return as the observation signal that contains limited information and cannot be obtained until the end of an episode. Instead, we employ the state transition sample, which is informative and instantaneous, as the observation signal for faster and more accurate task inference. Second, BPR algorithms usually require numerous samples to estimate the probability distribution of the tabular-based observation model, which may be expensive and even infeasible to learn and maintain, especially when using the state transition sample as the signal. Hence, we propose a scalable observation model based on fitting state transition functions of source tasks from only a small number of samples, which can generalize to any signals observed in the target task. Moreover, we extend the offline-mode BPR to the continual learning setting by expanding the scalable observation model in a plug-and-play fashion, which can avoid negative transfer when faced with new unknown tasks. Experimental results show that our method can consistently facilitate faster and more efficient policy transfer.


title: Bidirectional Self-Training with Multiple Anisotropic Prototypes for Domain Adaptive Semantic Segmentation

abstract: A thriving trend for domain adaptive segmentation endeavors to generate the high-quality pseudo labels for target domain and retrain the segmentor on them. Under this self-training paradigm, some competitive methods have sought to the latent-space information, which establishes the feature centroids (a.k.a prototypes) of the semantic classes and determines the pseudo label candidates by their distances from these centroids. In this paper, we argue that the latent space contains more information to be exploited thus taking one step further to capitalize on it. Firstly, instead of merely using the source-domain prototypes to determine the target pseudo labels as most of the traditional methods do, we bidirectionally produce the target-domain prototypes to degrade those source features which might be too hard or disturbed for the adaptation. Secondly, existing attempts simply model each category as a single and isotropic prototype while ignoring the variance of the feature distribution, which could lead to the confusion of similar categories. To cope with this issue, we propose to represent each category with multiple and anisotropic prototypes via Gaussian Mixture Model, in order to fit the de facto distribution of source domain and estimate the likelihood of target samples based on the probability density. We apply our method on GTA5->Cityscapes and Synthia->Cityscapes tasks and achieve 61.2 and 62.8 respectively in terms of mean IoU, substantially outperforming other competitive self-training methods. Noticeably, in some categories which severely suffer from the categorical confusion such as "truck" and "bus", our method achieves 56.4 and 68.8 respectively, which further demonstrates the effectiveness of our design.


title: Efficient Linear Attention for Fast and Accurate Keypoint Matching

abstract: Recently Transformers have provided state-of-the-art performance in sparse matching, crucial to realize high-performance 3D vision applications. Yet, these Transformers lack efficiency due to the quadratic computational complexity of their attention mechanism. To solve this problem, we employ an efficient linear attention for the linear computational complexity. Then, we propose a new attentional aggregation that achieves high accuracy by aggregating both the global and local information from sparse keypoints. To further improve the efficiency, we propose the joint learning of feature matching and description. Our learning enables simpler and faster matching than Sinkhorn, often used in matching the learned descriptors from Transformers. Our method achieves competitive performance with only 0.84M learnable parameters against the bigger SOTAs, SuperGlue (12M parameters) and SGMNet (30M parameters), on three benchmarks, HPatch, ETH, and Aachen Day-Night.


title: The Solar Ultraviolet Imaging Telescope onboard Aditya-L1

abstract: The Solar Ultraviolet Imaging Telescope (SUIT) is an instrument onboard the Aditya-L1 mission of ISRO that will measure and monitor the solar radiation emitted in the near-ultraviolet wavelength range (200-400 nm). SUIT will simultaneously map the photosphere and the chromosphere of the Sun using 11 filters sensitive to different wavelengths and covering different heights in the solar atmosphere and help us understand the processes involved in the transfer of mass and energy from one layer to the other. SUIT will also allow us to measure and monitor spatially resolved solar spectral irradiance that governs the chemistry of oxygen and ozone in the stratosphere of Earth's atmosphere. This is central to our understanding of the Sun climate relationship.


title: GitNet: Geometric Prior-based Transformation for Birds-Eye-View Segmentation

abstract: Birds-eye-view (BEV) semantic segmentation is critical for autonomous driving for its powerful spatial representation ability. It is challenging to estimate the BEV semantic maps from monocular images due to the spatial gap, since it is implicitly required to realize both the perspective-to-BEV transformation and segmentation. We present a novel two-stage Geometry Prior-based Transformation framework named GitNet, consisting of (i) the geometry-guided pre-alignment and (ii) ray-based transformer. In the first stage, we decouple the BEV segmentation into the perspective image segmentation and geometric prior-based mapping, with explicit supervision by projecting the BEV semantic labels onto the image plane to learn visibility-aware features and learnable geometry to translate into BEV space. Second, the pre-aligned coarse BEV features are further deformed by ray-based transformers to take visibility knowledge into account. GitNet achieves the leading performance on the challenging nuScenes and Argoverse Datasets.


title: The Franke-Gorini-Kossakowski-Lindblad-Sudarshan (FGKLS) Equation for Two-Dimensional Systems

abstract: Open quantum systems are, in general, described by a density matrix that is evolving under transformations belonging to a dynamical semigroup. They can obey the Franke-Gorini-Kossakowski-Lindblad-Sudarshan (FGKLS) equation. We exhaustively study the case of a Hilbert space of dimension $2$. First, we find final fixed states (called pointers) of an evolution of an open system, and we then obtain a general solution to the FGKLS equation and confirm that it converges to a pointer. After this, we check that the solution has physical meaning, i.e., it is Hermitian, positive and has trace equal to $1$, and find a moment of time starting from which the FGKLS equation can be used - the range of applicability of the semigroup symmetry. Next, we study the behavior of a solution for a weak interaction with an environment and make a distinction between interacting and non-interacting cases. Finally, we prove that there cannot exist oscillating solutions to the FGKLS equation, which would resemble the behavior of a closed quantum system.


title: Experimental Verification of the Acoustic Geometric Phase

abstract: The optical geometric phase encoded by the in-plane spatial orientation of microstructures has promoted the rapid development of numerous new-type optical meta-devices. However, pushing the concept of the geometric phase toward the acoustic community still faces challenges. In this work, we take advantage of two acoustic nonlocal metagratings that could support the direct conversion between plane wave and designated vortex mode, of which the orbital angular momentum conversion process plays a vital role in obtaining the acoustic geometric phase. We obtain the acoustic geometric phases of different orders by merely varying the orientation angle of one of the acoustic nonlocal metagratings. Intriguingly, according to our developed theory, we reveal that the reflective acoustic geometric phase, which is twice of the transmissive one, can be readily realized by transferring the transmitted configuration to a reflected one. Both the theoretical model and experimental measurements successfully verify the announced transmissive and reflective acoustic geometric phases. Moreover, the characteristics of reconfigurability and continuous phase modulation that covers the 2{\pi} range shown by the acoustic geometric phases provide us with new possibilities in advanced acoustic wavefront control.


title: $BV$-structure on Hochschild cohomology for exceptional local algebras of quaternion type. Case of the small parameter

abstract: This is the second paper in the cycle of articles about $BV$-structure on Hochshild cohomology of exceptional algebras of quaternion type. We give $BV$-structure's full description in the case of quaternion algebras $R(k,0,d)$, defined by parameter $k = 2$ according to Erdmann classification.


title: Trivial and topological bound states in bilayer graphene quantum dots and rings

abstract: We discuss and compare two different types of confinement in bilayer graphene by top and bottom gating with symmetrical microelectrodes. Trivial confinement corresponds to the same polarity of all top gates, which is opposed to that of all bottom ones. Topological confinement requires the polarity of part of the top-bottom pairs of gates to be reversed. We show that the main qualitative difference between trivial and topological bound states manifests itself in the magnetic field dependence. We illustrate our finding with an explicit calculation of the energy spectrum for quantum dots and rings. Trivial confinement shows bunching of levels into degenerate Landau bands, with a non-centered gap, while topological confinement shows no field-induced gap and a sequence of state branches always crossing zero-energy.


title: MMV-Based Sequential AoA and AoD Estimation for Millimeter Wave MIMO Channels

abstract: The fact that the millimeter-wave (mmWave) multiple-input multiple-output (MIMO) channel has sparse support in the spatial domain has motivated recent compressed sensing (CS)-based mmWave channel estimation methods, where the angles of arrivals (AoAs) and angles of departures (AoDs) are quantized using angle dictionary matrices. However, the existing CS-based methods usually obtain the estimation result through one-stage channel sounding that have two limitations: (i) the requirement of large-dimensional dictionary and (ii) unresolvable quantization error. These two drawbacks are irreconcilable; improvement of the one implies deterioration of the other. To address these challenges, we propose, in this paper, a two-stage method to estimate the AoAs and AoDs of mmWave channels. In the proposed method, the channel estimation task is divided into two stages, Stage I and Stage II. Specifically, in Stage I, the AoAs are estimated by solving a multiple measurement vectors (MMV) problem. In Stage II, based on the estimated AoAs, the receive sounders are designed to estimate AoDs. The dimension of the angle dictionary in each stage can be reduced, which in turn reduces the computational complexity substantially. We then analyze the successful recovery probability (SRP) of the proposed method, revealing the superiority of the proposed framework over the existing one-stage CS-based methods. We further enhance the reconstruction performance by performing resource allocation between the two stages. We also overcome the unresolvable quantization error issue present in the prior techniques by applying the atomic norm minimization method to each stage of the proposed two-stage approach. The simulation results illustrate the substantially improved performance with low complexity of the proposed two-stage method.


title: Quantum phase diagram for two species hardcore bosons in one-dimensional optical lattices with the resonantly driven Rabi frequency

abstract: We propose an experimental realization of the time-periodically modulated Rabi frequency and suggest density-dependent hoppings of two species hardcore bosons in a one-dimensional optical lattice. Distinct from the previous work [Phys. Rev. Research {\bf 2}, 013275 (2020)], we study effects in the first resonance region. In the effective Hamiltonian, the intra-species hopping occurs only if the density discrepancy of the other species on these sites is zero, while the inter-species one is allowed once the relevant density discrepancy becomes nonzero. At integer-$1$ filling, the quantum phase diagram of the effective Hamiltonian is determined by the perturbation analysis together with numerical calculations. We find that in the limit of dominant $J_{1}$, the system becomes a double-degenerate dimerized state, with spontaneously breaking the translation symmetry. The interplay of $J_{0}$, $J_{1}$ and the fixed ${\bar U}=1$ leads to three BKT transition lines and a tricritical BKT point. Exact transition lines are obtained by the level spectroscopic technique. Besides, general physical properties, including the charge gap, neutral gap, superfluid density and dimerization strength, are investigated as well.


title: Conventional type-II superconductivity in locally non-centrosymmetric LaRh$_2$As$_2$ single crystals

abstract: We report on the observation of superconductivity in LaRh$_2$As$_2$, which is the analogue without $f$-electrons of the heavy-fermion system with two superconducting phases CeRh$_2$As$_2$. A zero-resistivity transition, a specific-heat jump and a drop in magnetic ac susceptibility consistently point to a superconducting transition at a transition temperature of $T_c = 0.28$\,K. The magnetic field-temperature superconducting phase diagrams determined from field-dependent ac-susceptibility measurements reveal small upper critical fields $\mu_{\mathrm{0}}H_{c2} \approx 12$\,mT for $H\parallel ab$ and $\mu_{\mathrm{0}}H_{c2} \approx 9$\,mT for $H\parallel c$. The observed $H_{c2}$ is larger than the estimated thermodynamic critical field $H_c$ derived from the heat-capacity data, suggesting that LaRh$_2$A$s_2$ is a type-II superconductor with Ginzburg-Landau parameters $\kappa^{ab}_{GL} \approx 1.9$ and $\kappa^{c}_{GL}\approx 2.7$. The microscopic Eliashberg theory indicates superconductivity to be in the weak-coupling regime with an electron-phonon coupling constant $\lambda_{e-ph} \approx 0.4$. Despite a similar $T_c$ and the same crystal structure as the Ce compound, LaRh$_2$As$_2$ displays conventional superconductivity, corroborating the substantial role of the 4$f$ electrons for the extraordinary superconducting state in CeRh$_2$As$_2$.


title: Persua: A Visual Interactive System to Enhance the Persuasiveness of Arguments in Online Discussion

abstract: Persuading people to change their opinions is a common practice in online discussion forums on topics ranging from political campaigns to relationship consultation. Enhancing people's ability to write persuasive arguments could not only practice their critical thinking and reasoning but also contribute to the effectiveness and civility in online communication. It is, however, not an easy task in online discussion settings where written words are the primary communication channel. In this paper, we derived four design goals for a tool that helps users improve the persuasiveness of arguments in online discussions through a survey with 123 online forum users and interviews with five debating experts. To satisfy these design goals, we analyzed and built a labeled dataset of fine-grained persuasive strategies (i.e., logos, pathos, ethos, and evidence) in 164 arguments with high ratings on persuasiveness from ChangeMyView, a popular online discussion forum. We then designed an interactive visual system, Persua, which provides example-based guidance on persuasive strategies to enhance the persuasiveness of arguments. In particular, the system constructs portfolios of arguments based on different persuasive strategies applied to a given discussion topic. It then presents concrete examples based on the difference between the portfolios of user input and high-quality arguments in the dataset. A between-subjects study shows suggestive evidence that Persua encourages users to submit more times for feedback and helps users improve more on the persuasiveness of their arguments than a baseline system. Finally, a set of design considerations was summarized to guide future intelligent systems that improve the persuasiveness in text.


title: DRFLM: Distributionally Robust Federated Learning with Inter-client Noise via Local Mixup

abstract: Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces two challenges: (1) heterogeneity in the data among different organizations; and (2) data noises inside individual organizations. In this paper, we propose a general framework to solve the above two challenges simultaneously. Specifically, we propose using distributionally robust optimization to mitigate the negative effects caused by data heterogeneity paradigm to sample clients based on a learnable distribution at each iteration. Additionally, we observe that this optimization paradigm is easily affected by data noises inside local clients, which has a significant performance degradation in terms of global model prediction accuracy. To solve this problem, we propose to incorporate mixup techniques into the local training process of federated learning. We further provide comprehensive theoretical analysis including robustness analysis, convergence analysis, and generalization ability. Furthermore, we conduct empirical studies across different drug discovery tasks, such as ADMET property prediction and drug-target affinity prediction.


title: Tensor-networks for High-order Polynomial Approximation: A Many-body Physics Perspective

abstract: We analyze the problem of high-order polynomial approximation from a many-body physics perspective, and demonstrate the descriptive power of entanglement entropy in capturing model capacity and task complexity. Instantiated with a high-order nonlinear dynamics modeling problem, tensor-network models are investigated and exhibit promising modeling advantages. This novel perspective establish a connection between quantum information and functional approximation, which worth further exploration in future research.

categories: quant-ph cond-mat.dis-nn cs.LG cs.NA math.NA


title: An explicit example for the high temperature convolution: crossover between the binomial law $B(2,1/2)$ and the arcsine law

abstract: In this note, we study the high-temperature convolution introduced in Ref.\ \cite{mergny_cconv}, between two symmetric Bernoulli distributions. We give an analytical expression for both the Stieltjes transform and the density. This result provides the first non-trivial expression for the high-temperature convolution of two distributions and gives a new family of densities, interpolating between the centered binomial distribution with number of trials $n{=}2$ and probability of success $p{=}1/2$, and the centered and re-scaled arcsine law.


title: A Dynamical Evolution Study of the Open Clusters: Berkeley 10, Berkeley 81, Berkeley 89 and Ruprecht 135

abstract: By utilising Gaia EDR3 photometric / astrometric data, we studied the dynamical evolution from the obtained astrophysical, structural and dynamical parameters of the open clusters (OCs), Berkeley 10 (Be 10), Berkeley 81 (Be 81), Berkeley 89 (Be 89), and Ruprecht 135 (Ru 135). The Gaia EDR3 photometric distances from the isochrone fitting method are smaller than the ones of Gaia EDR2. The relaxation times of four OCs are smaller than their ages, in this regard, they are dynamically relaxed. Their steep overall mass function slopes mean that their low mass stars outnumber their massive ones. Their large $\tau$ / relatively small $t_{rlx}$ values imply an advanced mass segregation. Therefore, they seem to have lost their low-mass stars much to the field. Be 89's outer parts indicate an expansion with time. However, Be 10 and Be 81 show the relatively shrinkage core/cluster radii due to dynamical evolution. Ru 135 (1.0 Gyr) may have a primordial origin, instead of shrinking in size and mass with time. Be 89's tidal radius is less than its cluster radius. This means that its member stars lie within its tidal radius, in the sense it is gravitationally bound to the cluster. For the rest OCs, the cluster members beyond their tidal radii are gravitationally unbound to the clusters, which are more influenced by the potential of the Galaxy.


title: Unsupervised Attention-based Sentence-Level Meta-Embeddings from Contextualised Language Models

abstract: A variety of contextualised language models have been proposed in the NLP community, which are trained on diverse corpora to produce numerous Neural Language Models (NLMs). However, different NLMs have reported different levels of performances in downstream NLP applications when used as text representations. We propose a sentence-level meta-embedding learning method that takes independently trained contextualised word embedding models and learns a sentence embedding that preserves the complementary strengths of the input source NLMs. Our proposed method is unsupervised and is not tied to a particular downstream task, which makes the learnt meta-embeddings in principle applicable to different tasks that require sentence representations. Specifically, we first project the token-level embeddings obtained by the individual NLMs and learn attention weights that indicate the contributions of source embeddings towards their token-level meta-embeddings. Next, we apply mean and max pooling to produce sentence-level meta-embeddings from token-level meta-embeddings. Experimental results on semantic textual similarity benchmarks show that our proposed unsupervised sentence-level meta-embedding method outperforms previously proposed sentence-level meta-embedding methods as well as a supervised baseline.


title: A Variational Approach to Bayesian Phylogenetic Inference

abstract: Bayesian phylogenetic inference is currently done via Markov chain Monte Carlo (MCMC) with simple proposal mechanisms. This hinders exploration efficiency and often requires long runs to deliver accurate posterior estimates. In this paper, we present an alternative approach: a variational framework for Bayesian phylogenetic analysis. We propose combining subsplit Bayesian networks, an expressive graphical model for tree topology distributions, and a structured amortization of the branch lengths over tree topologies for a suitable variational family of distributions. We train the variational approximation via stochastic gradient ascent and adopt gradient estimators for continuous and discrete variational parameters separately to deal with the composite latent space of phylogenetic models. We show that our variational approach provides competitive performance to MCMC, while requiring much fewer (though more costly) iterations due to a more efficient exploration mechanism enabled by variational inference. Experiments on a benchmark of challenging real data Bayesian phylogenetic inference problems demonstrate the effectiveness and efficiency of our methods.


title: The generality of uncooperative and cooperative effects in elementary hydrogen-bonded systems

abstract: The cooperative effect plays a significant role in understanding the intermolecular donor-acceptor interactions of hydrogen bonds (H-bonds, D-H...A). Herein, using the benchmark method of high-precision ab initio, the well-known cooperative effect is reproduced in elementary H-bonded systems with different D and A atoms. That is, with the decreasing of intermolecular distance, the D-H bond length first increases and then decreases, while the H...A bond length decreases. On the contrary, when D and A are the same, as the intermolecular distance decreases, the D-H bond length decreases without increasing, which is referred to as the uncooperative effect. Further analyses conclude that compared to cooperative H-bonded systems, uncooperative systems at their respective equilibrium position have a larger core-valence bifurcation (CVB) index (>0.022) and lower binding energies (<0.25 eV), showing a clear linear inverse relationship related to H-bond strength. Therefore, the intermolecular non-H-bonding interactions are predicted to reflect the uncooperative characteristics, which is confirmed by high-precision ab initio calculations. These findings provide a direction for the comprehensive understanding of H-bonds.


title: From Parental Control to Joint Family Oversight: Can Parents and Teens Manage Mobile Online Safety and Privacy as Equals?

abstract: Our research aims to highlight and alleviate the complex tensions around online safety, privacy, and smartphone usage in families so that parents and teens can work together to better manage mobile privacy and security-related risks. We developed a mobile application ("app") for Community Oversight of Privacy and Security ("CO-oPS") and had parents and teens assess whether it would be applicable for use with their families. CO-oPS is an Android app that allows a group of users to co-monitor the apps installed on one another's devices and the privacy permissions granted to those apps. We conducted a study with 19 parent-teen (ages 13-17) pairs to understand how they currently managed mobile safety and app privacy within their family and then had them install, use, and evaluate the CO-oPS app. We found that both parents and teens gave little consideration to online safety and privacy before installing new apps or granting privacy permissions. When using CO-oPS, participants liked how the app increased transparency into one another's devices in a way that facilitated communication, but were less inclined to use features for in-app messaging or to hide apps from one another. Key themes related to power imbalances between parents and teens surfaced that made co-management challenging. Parents were more open to collaborative oversight than teens, who felt that it was not their place to monitor their parents, even though both often believed parents lacked the technological expertise to monitor themselves. Our study sheds light on why collaborative practices for managing online safety and privacy within families may be beneficial but also quite difficult to implement in practice. We provide recommendations for overcoming these challenges based on the insights gained from our study.


title: Fusion systems realizing certain Todd modules

abstract: We study a certain family of simple fusion systems over finite $3$-groups, ones that involve Todd modules of the Mathieu groups $2M_{12}$, $M_{11}$, and $A_6=O^2(M_{10})$ over $\mathbb{F}_3$, and show that they are all isomorphic to the $3$-fusion systems of almost simple groups. As one consequence, we give new $3$-local characterizations of Conway's sporadic simple groups.


title: A User Study to Evaluate a Web-based Prototype for Smart Home Internet of Things Device Management

abstract: With the growing advances in the Internet of Things (IoT) technology, IoT device management platforms are becoming increasingly important. We conducted a web-based survey and usability study with 43 participants who use IoT devices frequently to: 1) examine their smart home IoT usage patterns and privacy preferences, and 2) evaluate a web-based prototype for smart home IoT device management. We found that participants perceived privacy as more important than the convenience afforded by the IoT devices. Based on their average scores of privacy vs. convenience importance, participants with low privacy and low convenience significantly reported less privacy control and convenience preferences than participants with high privacy and high convenience. Overall, all participants were satisfied with the proposed website prototype and their actual usability evaluation demonstrated a good understanding of the website features. This paper provides an empirical examination of the privacy versus convenience trade-offs smart home users make when managing their IoT devices.


title: Homomorphic Encryption and Federated Learning based Privacy-Preserving CNN Training: COVID-19 Detection Use-Case

abstract: Medical data is often highly sensitive in terms of data privacy and security concerns. Federated learning, one type of machine learning techniques, has been started to use for the improvement of the privacy and security of medical data. In the federated learning, the training data is distributed across multiple machines, and the learning process is performed in a collaborative manner. There are several privacy attacks on deep learning (DL) models to get the sensitive information by attackers. Therefore, the DL model itself should be protected from the adversarial attack, especially for applications using medical data. One of the solutions for this problem is homomorphic encryption-based model protection from the adversary collaborator. This paper proposes a privacy-preserving federated learning algorithm for medical data using homomorphic encryption. The proposed algorithm uses a secure multi-party computation protocol to protect the deep learning model from the adversaries. In this study, the proposed algorithm using a real-world medical dataset is evaluated in terms of the model performance.


title: Exploring quantum correlations in a hybrid optomechanical system

abstract: In quantum simulations and experiments on optomechanical cavities, coherence control is a challenging issue. We propose a scheme of two coupled optomechanical cavities to enhance the intracavity entanglement. Photon hopping is employed to establish couplings between optical modes, while phonon tunneling is utilized to establish couplings between mechanical resonators. Both cavities are driven by classical light. We explore the influences of coupling strengths of the quantum correlations generated inside each cavity using two types of quantum measures: logarithmic negativity and quantum steering. This analysis will reveal the significance of these quantum metrics as well as their various aspects in the Doppler regime. We also investigate stability conditions based on coupling strengths. Therefore, it is possible to quantify the degree of intracavity entanglement. The generated entanglement can be enhanced by choosing the appropriate photon and phonon hopping strengths. A set of parameters based on the currently available experimental data was used in the calculations.


title: Nanogap-Enhanced Infrared Spectroscopy with Template-Stripped Wafer-Scale Arrays of Buried Plasmonic Cavities

abstract: We have combined atomic layer lithography and template stripping to produce a new class of substrates for surface-enhanced infrared absorption (SEIRA) spectroscopy. Our structure consists of a buried and U-shaped metal-insulator-metal waveguide whose folded vertical arms efficiently couple normally incident light. The insulator is formed by atomic layer deposition (ALD) of Al2O3 and precisely defines the gap size. The buried nanocavities are protected from contamination by a silicon template until ready for use and exposed by template stripping on demand. The exposed nanocavity generates strong infrared resonances, tightly confines infrared radiation into a gap that is as small as 3 nm ({\lambda}/3300), and creates a dense array of millimeter-long hotspots. After partial removal of the insulators, the gaps are backfilled with benzenethiol molecules, generating distinct Fano resonances due to strong coupling with gap plasmons, and a SEIRA enhancement factor of 10^5 is observed for a 3 nm gap. Because of the wafer-scale manufacturability, single-digit-nanometer control of the gap size via ALD, and long-term storage enabled by template stripping, our buried plasmonic nanocavity substrates will benefit broad applications in sensing and spectroscopy.


title: Unique electronic state in ferromagnetic semiconductor FeCl$_{2}$ monolayer

abstract: Two-dimensional (2D) van der Waals (vdW) magnetic materials could be an ideal platform for ultracompact spintronic applications. Among them, FeCl$_{2}$ monolayer in the triangular lattice is subject to a strong debate. Thus, we critically examine its spin-orbital state, electronic structure, and magnetic properties, using a set of delicate first-principles calculations, crystal field level analyses, and Monte Carlo simulations. Our work reveals that FeCl$_{2}$ monolayer is a ferromagnetic (FM) semiconductor in which the electron correlation of the narrow Fe $3d$ bands determines the band gap of about 1.2 eV. Note that only when the spin-orbit coupling (SOC) is properly handled, the unique $d$$^{5\uparrow}$$l$$^\downarrow_{z+}$ electronic ground state is achieved. Then, both the orbital and spin contributions (0.59 $\mu_{\rm B}$ plus 3.56 $\mu_{\rm B}$) to the total magnetic moment well account for, for the first time, the experimental perpendicular moment of 4.3 $\mu_{\rm B}$/Fe. Moreover, we find that a compressive strain further stabilizes the $d$$^{5\uparrow}$$l$$^\downarrow_{z+}$ ground state, and that the enhanced magnetic anisotropy and exchange coupling would boost the Curie temperature ($T_{\rm C}$) from 25 K for the pristine FeCl$_{2}$ monolayer to 69-102 K under 3$\%$-5$\%$ compressive strain. Therefore, FeCl$_{2}$ monolayer is indeed an appealing 2D FM semiconductor.


title: Visual Attention Methods in Deep Learning: An In-Depth Survey

abstract: Inspired by the human cognitive system, attention is a mechanism that imitates the human cognitive awareness about specific information, amplifying critical details to focus more on the essential aspects of data. Deep learning has employed attention to boost performance for many applications. Interestingly, the same attention design can suit processing different data modalities and can easily be incorporated into large networks. Furthermore, multiple complementary attention mechanisms can be incorporated into one network. Hence, attention techniques have become extremely attractive. However, the literature lacks a comprehensive survey on attention techniques to guide researchers in employing attention in their deep models. Note that, besides being demanding in terms of training data and computational resources, transformers only cover a single category in self-attention out of the many categories available. We fill this gap and provide an in-depth survey of 50 attention techniques, categorizing them by their most prominent features. We initiate our discussion by introducing the fundamental concepts behind the success of the attention mechanism. Next, we furnish some essentials such as the strengths and limitations of each attention category, describe their fundamental building blocks, basic formulations with primary usage, and applications specifically for computer vision. We also discuss the challenges and general open questions related to attention mechanisms. Finally, we recommend possible future research directions for deep attention. All the information about visual attention methods in deep learning is provided at \href{https://github.com/saeed-anwar/VisualAttention}{https://github.com/saeed-anwar/VisualAttention}


title: Fluctuation suppression and enhancement in interacting particle systems

abstract: We investigate in this work the effects of interaction on the fluctuation of empirical measures. The systems with positive definite interaction potentials tend to exhibit smaller fluctuation compared to the fluctuation in standard Monte Carlo sampling while systems with negative definite potentials tend to exhibit larger fluctuation. Moreover, if the temperature goes to zero, the fluctuation for positive definite kernels in the long time tends to vanish to zero, while the fluctuation for negative definite kernels in the long time tends to blow up to infinity. This phenomenon may gain deeper understanding to some physical systems like the Poisson-Boltzmann system, and may help to understand the properties of some particle based variational inference sampling methods.


title: On the anisotropy theorem of Papadakis and Petrotou

abstract: We study the anisotropy theorem for Stanley-Reisner rings of simplicial homology spheres in characteristic 2 by Papadakis and Petrotou. This theorem implies the Hard Lefschetz theorem as well as McMullen's g-conjecture for such spheres. Our first result is an explicit description of the quadratic form. We use this description to prove a conjecture stated by Papadakis and Petrotou. All anisotropy theorems for homology spheres and pseudo-manifolds in characteristic 2 follow from this conjecture. Using a specialization argument, we prove anisotropy for certain homology spheres over the field $\mathbb{Q}$. These results provide another self-contained proof of the g-conjecture for homology spheres in characteristic 2.


title: Ideal class groups of number fields and Bloch-Kato's Tate-Shafarevich groups for symmetric powers of elliptic curves

abstract: For an elliptic curve $E$ over $\mathbb{Q}$, putting $K=\mathbb{Q}(E[p])$ which is the $p$-th division field of $E$ for an odd prime $p$, we study the ideal class group $\mathrm{Cl}_K$ of $K$ as a $\mathrm{Gal}(K/\mathbb{Q})$-module. More precisely, for any $j$ with $1\leqslant j \leqslant p-2$, we give a condition that $\mathrm{Cl}_K\otimes \mathbb{F}_p$ has the symmetric power $\mathrm{Sym}^j E[p]$ of $E[p]$ as its quotient $\mathrm{Gal}(K/\mathbb{Q})$-module, in terms of Bloch-Kato's Tate-Shafarevich group of $\mathrm{Sym}^j V_p E$. Here $V_p E$ denotes the rational $p$-adic Tate module of $E$. This is a partial generalization of a result of Prasad and Shekhar for the case $j=1$.


title: Cannikin's Law in Tensor Modeling: A Rank Study for Entanglement and Separability in Tensor Complexity and Model Capacity

abstract: This study clarifies the proper criteria to assess the modeling capacity of a general tensor model. The work analyze the problem based on the study of tensor ranks, which is not a well-defined quantity for higher order tensors. To process, the author introduces the separability issue to discuss the Cannikin's law of tensor modeling. Interestingly, a connection between entanglement studied in information theory and tensor analysis is established, shedding new light on the theoretical understanding for modeling capacity problems.


title: Language-Grounded Indoor 3D Semantic Segmentation in the Wild

abstract: Recent advances in 3D semantic segmentation with deep neural networks have shown remarkable success, with rapid performance increase on available datasets. However, current 3D semantic segmentation benchmarks contain only a small number of categories -- less than 30 for ScanNet and SemanticKITTI, for instance, which are not enough to reflect the diversity of real environments (e.g., semantic image understanding covers hundreds to thousands of classes). Thus, we propose to study a larger vocabulary for 3D semantic segmentation with a new extended benchmark on ScanNet data with 200 class categories, an order of magnitude more than previously studied. This large number of class categories also induces a large natural class imbalance, both of which are challenging for existing 3D semantic segmentation methods. To learn more robust 3D features in this context, we propose a language-driven pre-training method to encourage learned 3D features that might have limited training examples to lie close to their pre-trained text embeddings. Extensive experiments show that our approach consistently outperforms state-of-the-art 3D pre-training for 3D semantic segmentation on our proposed benchmark (+9% relative mIoU), including limited-data scenarios with +25% relative mIoU using only 5% annotations.


title: Three-dimensional Magnetic and Thermodynamic Structures of Solar Microflares

abstract: Microflares, one of small-scale solar activities, are believed to be caused by magnetic reconnection. Nevertheless, their three-dimensional (3D) magnetic structures, thermodynamic structures, and physical links to the reconnection have been unclear. In this Letter, based on high-resolution 3D radiative magnetohydrodynamic simulation of the quiet Sun spanning from the upper convection zone to the corona, we investigate 3D magnetic and thermodynamic structures of three homologous microflares. It is found that they originate from localized hot plasma embedded in the chromospheric environment at the height of 2--10 Mm above the photosphere and last for 3--10 minutes with released magnetic energy in the range of $10^{27}-10^{28}$ erg. The heated plasma is almost co-spatial with the regions where the heating rate per particle is maximal. The 3D velocity field reveals a pair of converging flows with velocities of tens of km s$^{-1}$ toward and outflows with velocities of about 100 km s$^{-1}$ moving away from the hot plasma. These features support that magnetic reconnection plays a critical role in heating the localized chromospheric plasma to coronal temperature, giving rise to observed microflares. The magnetic topology analysis further discloses that the reconnection region is located near quasi-separators where both current density and squashing factors are maximal although the specific topology may vary from tether-cutting to fan-spine-like structure.


title: UFRC: A Unified Framework for Reliable COVID-19 Detection on Crowdsourced Cough Audio

abstract: We suggested a unified system with core components of data augmentation, ImageNet-pretrained ResNet-50, cost-sensitive loss, deep ensemble learning, and uncertainty estimation to quickly and consistently detect COVID-19 using acoustic evidence. To increase the model's capacity to identify a minority class, data augmentation and cost-sensitive loss are incorporated (infected samples). In the COVID-19 detection challenge, ImageNet-pretrained ResNet-50 has been found to be effective. The unified framework also integrates deep ensemble learning and uncertainty estimation to integrate predictions from various base classifiers for generalisation and reliability. We ran a series of tests using the DiCOVA2021 challenge dataset to assess the efficacy of our proposed method, and the results show that our method has an AUC-ROC of 85.43 percent, making it a promising method for COVID-19 detection. The unified framework also demonstrates that audio may be used to quickly diagnose different respiratory disorders.


title: Biometric verification of humans by means of hand geometry

abstract: This paper describes a hand geometry biometric identification system. We have acquired a database of 22 people, 10 acquisitions per person, using a conventional document scanner. We propose a feature extraction and classifier. The experimental results reveal a maximum identification rate equal to 93.64%, and a minimum value of the detection cost function equal to 2.92% using a multi layer perceptron classifier.


title: Experimental violation of the Leggett-Garg inequality with a single-spin system

abstract: Investigation the boundary between quantum mechanical description and classical realistic view is of fundamental importance. The Leggett-Garg inequality provides a criterion to distinguish between quantum systems and classical systems, and can be used to prove the macroscopic superposition state. A larger upper bound of the LG function can be obtained in a multi-level system. Here, we present an experimental violation of the Leggett-Garg inequality in a three-level system using nitrogen-vacancy center in diamond by ideal negative result measurement. The experimental maximum value of Leggett-Garg function is $K_{3}^{exp}=1.625\pm0.022$ which exceeds the L\"uders bound with a $5\sigma$ level of confidence.


title: An Integrated Programmable CPG with Bounded Output

abstract: Cyclic motions are fundamental patterns in robotic applications including industrial manipulation and legged robot locomotion. This paper proposes an approach for the online modulation of cyclic motions in robotic applications. For this purpose, we present an integrated programmable Central Pattern Generator (CPG) for the online generation of the reference joint trajectory of a robotic system out of a library of desired periodic motions. The reference trajectory is then followed by the lower-level controller of the robot. The proposed CPG generates a smooth reference joint trajectory convergence to the desired one while preserving the position and velocity joint limits of the robot. The integrated programmable CPG consists of one novel bounded output programmable oscillator. We design the programmable oscillator for encoding the desired multidimensional periodic trajectory as a stable limit cycle. We also use the state transformation method to ensure that the oscillator's output and its first-time derivative preserve the joint position and velocity limits of the robot. With the help of Lyapunov-based arguments, We prove that the proposed CPG provides the global stability and convergence of the desired trajectory. The effectiveness of the proposed integrated CPG for trajectory generation is shown in a passive rehabilitation scenario on the Kuka iiwa robot arm, and also in a walking simulation on a seven-link bipedal robot.


title: Towards cost-effective and resource-aware aggregation at Edge for Federated Learning

abstract: Federated Learning (FL) is a machine learning approach that addresses privacy and data transfer costs by computing data at the source. It's particularly popular for Edge and IoT applications where the aggregator server of FL is in resource-capped edge data centers for reducing communication costs. Existing cloud-based aggregator solutions are resource-inefficient and expensive at the Edge, leading to low scalability and high latency. To address these challenges, this study compares prior and new aggregation methodologies under the changing demands of IoT and Edge applications. This work is the first to propose an adaptive FL aggregator at the Edge, enabling users to manage the cost and efficiency trade-off. An extensive comparative analysis demonstrates that the design improves scalability by up to 4X, time efficiency by 8X, and reduces costs by more than 2X compared to extant cloud-based static methodologies.


title: Uniqueness for fractional parabolic and elliptic equations with drift

abstract: We investigate uniqueness, in suitable weighted Lebesgue spaces, of solutions to a class of fractional parabolic and elliptic equations with a drift.


title: Impact of impurities on drift wave instabilities in reversed-field pinch plasmas

abstract: The drift wave in the presence of impurity ions was investigated numerically in reversed field pinch (RFP) plasmas, using the gyrokinetic integral eigenmode equation. It was found that in RFP plasmas with hollow density profiles, an increase in $k_\theta \rho_s$ increases the growth rate of the ion temperature gradient (ITG). Comparing the results of regular and hollow plasma density profile shows that the ITG mode under the hollow density profile is much harder to be excited. For the impurities' effects, when the impurities' density gradient is opposite to the primary ions, namely when $L_{ez}$ is negative, impurities could enhance the instability. On the contrary, when $L_{ez}$ is positive, the instability is stabilized. Regarding the trapped electron mode (TEMs), the growth rate under the plasma with hollow density profile remained minor than that for the standard density gradient. There exists a threshold of $L_{ez}$. When $L_{ez}$ is less than this value, impurity destabilizes TEMs, while as $L_{ez}$ is greater than this, impurity stabilizes TEMs. The effects of $L_{ez}$ on TEM also depend on both the plasma density gradient and the impurity species. In addition, the influence of collisionality on TEMs was also studied.


title: UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue

abstract: The goal-oriented document-grounded dialogue aims at responding to the user query based on the dialogue context and supporting document. Existing studies tackle this problem by decomposing it into two sub-tasks: knowledge identification and response generation. However, such pipeline methods would unavoidably suffer from the error propagation issue. This paper proposes to unify these two sub-tasks via sequentially generating the grounding knowledge and the response. We further develop a prompt-connected multi-task learning strategy to model the characteristics and connections of different tasks and introduce linear temperature scheduling to reduce the negative effect of irrelevant document information. Experimental results demonstrate the effectiveness of our framework.


title: Global existence and blow-up of solutions to the porous medium equation with reaction and singular coefficients

abstract: We study global in time existence versus blow-up in finite time of solutions to the Cauchy problem for the porous medium equation with a variable density $\rho(x)$ and a power-like reaction term posed in the one dimensional interval $(-R,R)$, $R>0$. Here the weight function is singular at the boundary of the domain $(-R,R)$, indeed it is such that $\rho(x)\sim (R-|x|)^{-q}$ as $|x|\to R$, with $q\ge0$. We show a different behavior of solutions depending on the three cases when $q>2$, $q=2$ and $q<2$.


title: SETTI: A Self-supervised Adversarial Malware Detection Architecture in an IoT Environment

abstract: In recent years, malware detection has become an active research topic in the area of Internet of Things (IoT) security. The principle is to exploit knowledge from large quantities of continuously generated malware. Existing algorithms practice available malware features for IoT devices and lack real-time prediction behaviors. More research is thus required on malware detection to cope with real-time misclassification of the input IoT data. Motivated by this, in this paper we propose an adversarial self-supervised architecture for detecting malware in IoT networks, SETTI, considering samples of IoT network traffic that may not be labeled. In the SETTI architecture, we design three self-supervised attack techniques, namely Self-MDS, GSelf-MDS and ASelf-MDS. The Self-MDS method considers the IoT input data and the adversarial sample generation in real-time. The GSelf-MDS builds a generative adversarial network model to generate adversarial samples in the self-supervised structure. Finally, ASelf-MDS utilizes three well-known perturbation sample techniques to develop adversarial malware and inject it over the self-supervised architecture. Also, we apply a defence method to mitigate these attacks, namely adversarial self-supervised training to protect the malware detection architecture against injecting the malicious samples. To validate the attack and defence algorithms, we conduct experiments on two recent IoT datasets: IoT23 and NBIoT. Comparison of the results shows that in the IoT23 dataset, the Self-MDS method has the most damaging consequences from the attacker's point of view by reducing the accuracy rate from 98% to 74%. In the NBIoT dataset, the ASelf-MDS method is the most devastating algorithm that can plunge the accuracy rate from 98% to 77%.


title: FedCau: A Proactive Stop Policy for Communication and Computation Efficient Federated Learning

abstract: This paper investigates efficient distributed training of a Federated Learning~(FL) model over a wireless network of wireless devices. The communication iterations of the distributed training algorithm may be substantially deteriorated or even blocked by the effects of the devices' background traffic, packet losses, congestion, or latency. We abstract the communication-computation impacts as an `iteration cost' and propose a cost-aware causal FL algorithm~(FedCau) to tackle this problem. We propose an iteration-termination method that trade-offs the training performance and networking costs. We apply our approach when clients use the slotted-ALOHA, the carrier-sense multiple access with collision avoidance~(CSMA/CA), and the orthogonal frequency-division multiple access~(OFDMA) protocols. We show that, given a total cost budget, the training performance degrades as either the background communication traffic or the dimension of the training problem increases. Our results demonstrate the importance of proactively designing optimal cost-efficient stopping criteria to avoid unnecessary communication-computation costs to achieve only a marginal FL training improvement. We validate our method by training and testing FL over the MNIST dataset. Finally, we apply our approach to existing communication efficient FL methods from the literature, achieving further efficiency. We conclude that cost-efficient stopping criteria are essential for the success of practical FL over wireless networks.


title: Light transport through amorphous photonic materials with localization and bandgap regimes

abstract: We propose a framework that unifies the description of light transport in three-dimensional amorphous dielectric materials that exhibit both localization and a photonic bandgap. To this end, we argue that coherent reflection near and in the bandgap attenuates the generation of diffuse or localized photons. Using the self-consistent theory of localization and considering the density of states of photons, we can quantitatively describe all transport regimes: Transparency, light diffusion, localization, and bandgap. Comparing the model with numerical data on optical transport in hyperuniform dielectric networks confirms our findings.

categories: physics.optics cond-mat.dis-nn cond-mat.mes-hall cond-mat.soft


title: TASTEset -- Recipe Dataset and Food Entities Recognition Benchmark

abstract: Food Computing is currently a fast-growing field of research. Natural language processing (NLP) is also increasingly essential in this field, especially for recognising food entities. However, there are still only a few well-defined tasks that serve as benchmarks for solutions in this area. We introduce a new dataset -- called \textit{TASTEset} -- to bridge this gap. In this dataset, Named Entity Recognition (NER) models are expected to find or infer various types of entities helpful in processing recipes, e.g.~food products, quantities and their units, names of cooking processes, physical quality of ingredients, their purpose, taste. The dataset consists of 700 recipes with more than 13,000 entities to extract. We provide a few state-of-the-art baselines of named entity recognition models, which show that our dataset poses a solid challenge to existing models. The best model achieved, on average, 0.95 $F_1$ score, depending on the entity type -- from 0.781 to 0.982. We share the dataset and the task to encourage progress on more in-depth and complex information extraction from recipes.


title: Learning to Fill the Seam by Vision: Sub-millimeter Peg-in-hole on Unseen Shapes in Real World

abstract: In the peg insertion task, human pays attention to the seam between the peg and the hole and tries to fill it continuously with visual feedback. By imitating the human behavior, we design architectures with position and orientation estimators based on the seam representation for pose alignment, which proves to be general to the unseen peg geometries. By putting the estimators into the closed-loop control with reinforcement learning, we further achieve a higher or comparable success rate, efficiency, and robustness compared with the baseline methods. The policy is trained totally in simulation without any manual intervention. To achieve sim-to-real, a learnable segmentation module with automatic data collecting and labeling can be easily trained to decouple the perception and the policy, which helps the model trained in simulation quickly adapt to the real world with negligible effort. Results are presented in simulation and on a physical robot. Code, videos, and supplemental material are available at https://github.com/xieliang555/SFN.git


title: Exploiting Multiple EEG Data Domains with Adversarial Learning

abstract: Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly subject-dependent, and are bound to the equipment and experimental setup used, (i.e. domain). This leads to machine learning models often suffer from poor generalization ability, where they perform significantly worse on real-world data than on the exploited training data. Recent research heavily focuses on cross-subject and cross-session transfer learning frameworks to reduce domain calibration efforts for EEG signals. We argue that multi-source learning via learning domain-invariant representations from multiple data-sources is a viable alternative, as the available data from different EEG data-source domains (e.g., subjects, sessions, experimental setups) grow massively. We propose an adversarial inference approach to learn data-source invariant representations in this context, enabling multi-source learning for EEG-based brain-computer interfaces. We unify EEG recordings from different source domains (i.e., emotion recognition datasets SEED, SEED-IV, DEAP, DREAMER), and demonstrate the feasibility of our invariant representation learning approach in suppressing data-source-relevant information leakage by 35% while still achieving stable EEG-based emotion classification performance.