title: Rational function approximations of the special function $e^{x}E_{1}(x)$ and applications to irrationality of Euler-Gompertz constant $\delta$

abstract: We gave a method to construct a continued fraction of the function $F(x):=e^{x}E_{1}(x)$. More precisely we define $F_{1}(x)$ as the reciprocal of $F(x)$ and we inductively define $F_{m}(x)$ as the reciprocal of ``$F_{m-1}(x)$ minus the main term of $F_{m-1}(x)$ at infinity''. This method is analogous to the regular continued fraction expansion of real numbers. In this paper we prove that the continued fraction converges to $F(x)$ for any positive real number $x>0$ by following the proof of that the regular continued fraction of a positive and irrational real number $\alpha$ converges to $\alpha$. Essentially we prove inequalities for $Q_{m}(x)$ (in Theorem 4.1) and inequalities $F_{m}(x)>0$ (in Section 5). In particular, we prove stronger inequalities $\displaystyle\frac{P_{2k}(x)}{Q_{2k}(x)}<F(x)<\displaystyle\frac{P_{2k-1}(x)}{Q_{2k-1}(x)}$ (than $F_{m}(x)>0$) and give two proofs of these. In Section 6, we show an asymptotic relation between $Q_{2k}(x)$ and $Q_{2k-1}(x)$ by using properties of the classical Laguerre polynomial. In Section 7, we consider Euler-Gompertz constant $\delta$. As far as we know, irrationality of $\delta$ is still an open problem. We construct a sequence of rationals $\displaystyle\frac{A_{i}}{B_{i}}\ (i=1,2,3,\cdots)$ such that $\delta B_{i}-A_{i}$ approaches 0 as $i$ approaches infinity and give a sufficient condition of that $\delta B_{i}-A_{i}\neq 0$ for any positive integer $i$. Therefore, if it is proved that this condition holds, it completes a proof of irrationality of Euler-Gompertz constant $\delta$.


title: Cross-loop propagation of a quasi-periodic extreme-ultraviolet wave train triggered by successive stretching of magnetic field structures during a solar eruption

abstract: Solar extreme-ultraviolet (EUV) waves generally refer to large-scale disturbances propagating outward from sites of solar eruptions in EUV imaging observations. Using the recent observations from the Atmospheric Imaging Assembly (AIA) on board the Solar Dynamics Observatory (SDO), we report a quasi-periodic wave train propagating outward at an average speed of $\sim$308 km s$^{-1}$. At least five wavefronts can be clearly identified with the period being $\sim$120 s. These wavefronts originate from the coronal loop expansion, which propagates with an apparent speed of $\sim$95 km s$^{-1}$, about 3 times slower than the wave train. In the absence of a strong lateral expansion, these observational results might be explained by the theoretical model of Chen et al. (2002), which predicted that EUV waves may have two components: a faster component that is a fast-mode magnetoacoustic wave or shock wave and a slower apparent front formed as a result of successive stretching of closed magnetic field lines. In this scenario, the wave train and the successive loop expansion we observed likely correspond to the fast and slow components in the model, respectively.


title: The R-matrix formalism for quantized enveloping algebras

abstract: Let $U_\hbar\mathfrak{g}$ denote the Drinfeld-Jimbo quantum group associated to a complex semisimple Lie algebra $\mathfrak{g}$. We apply a modification of the $R$-matrix construction for quantum groups to the evaluation of the universal $R$-matrix of $U_\hbar\mathfrak{g}$ on the tensor square of any of its finite-dimensional representations. This produces a quantized enveloping algebra $\mathrm{U_R}(\mathfrak{g})$ whose definition is given in terms of two generating matrices satisfying variants of the well-known $RLL$ relations. We prove that $\mathrm{U_R}(\mathfrak{g})$ is isomorphic to the tensor product of the quantum double of the Borel subalgebra $U_\hbar\mathfrak{b}\subset U_\hbar\mathfrak{g}$ and a quantized polynomial algebra encoded by the space of $\mathfrak{g}$-invariants associated to the semiclassical limit $V$ of the underlying finite-dimensional representation of $U_\hbar\mathfrak{g}$. Using this description, we characterize $U_\hbar\mathfrak{g}$ and the quantum double of $U_\hbar\mathfrak{b}$ as Hopf quotients of $\mathrm{U_R}(\mathfrak{g})$ and as fixed-point subalgebras with respect to certain natural automorphisms. As an additional corollary, we deduce that $\mathrm{U_R}(\mathfrak{g})$ is quasitriangular precisely when the irreducible summands of $V$ are distinct.


title: Feature Reconstruction Attacks and Countermeasures of DNN training in Vertical Federated Learning

abstract: Federated learning (FL) has increasingly been deployed, in its vertical form, among organizations to facilitate secure collaborative training over siloed data. In vertical FL (VFL), participants hold disjoint features of the same set of sample instances. Among them, only one has labels. This participant, known as the active party, initiates the training and interacts with the other participants, known as the passive parties. Despite the increasing adoption of VFL, it remains largely unknown if and how the active party can extract feature data from the passive party, especially when training deep neural network (DNN) models. This paper makes the first attempt to study the feature security problem of DNN training in VFL. We consider a DNN model partitioned between active and passive parties, where the latter only holds a subset of the input layer and exhibits some categorical features of binary values. Using a reduction from the Exact Cover problem, we prove that reconstructing those binary features is NP-hard. Through analysis, we demonstrate that, unless the feature dimension is exceedingly large, it remains feasible, both theoretically and practically, to launch a reconstruction attack with an efficient search-based algorithm that prevails over current feature protection techniques. To address this problem, we develop a novel feature protection scheme against the reconstruction attack that effectively misleads the search to some pre-specified random values. With an extensive set of experiments, we show that our protection scheme sustains the feature reconstruction attack in various VFL applications at no expense of accuracy loss.


title: Mitigating Unintended Memorization in Language Models via Alternating Teaching

abstract: Recent research has shown that language models have a tendency to memorize rare or unique sequences in the training corpora which can thus leak sensitive attributes of user data. We employ a teacher-student framework and propose a novel approach called alternating teaching to mitigate unintended memorization in sequential modeling. In our method, multiple teachers are trained on disjoint training sets whose privacy one wishes to protect, and teachers' predictions supervise the training of a student model in an alternating manner at each time step. Experiments on LibriSpeech datasets show that the proposed method achieves superior privacy-preserving results than other counterparts. In comparison with no prevention for unintended memorization, the overall utility loss is small when training records are sufficient.


title: An Additive Autoencoder for Dimension Estimation

abstract: An additive autoencoder for dimension reduction, which is composed of a serially performed bias estimation, linear trend estimation, and nonlinear residual estimation, is proposed and analyzed. Computational experiments confirm that an autoencoder of this form, with only a shallow network to encapsulate the nonlinear behavior, is able to identify an intrinsic dimension of a dataset with a low autoencoding error. This observation leads to an investigation in which shallow and deep network structures, and how they are trained, are compared. We conclude that the deeper network structures obtain lower autoencoding errors during the identification of the intrinsic dimension. However, the detected dimension does not change compared to a shallow network.


title: Re3: Generating Longer Stories With Recursive Reprompting and Revision

abstract: We consider the problem of automatically generating longer stories of over two thousand words. Compared to prior work on shorter stories, long-range plot coherence and relevance are more central challenges here. We propose the Recursive Reprompting and Revision framework (Re3) to address these challenges by (a) prompting a general-purpose language model to construct a structured overarching plan, and (b) generating story passages by repeatedly injecting contextual information from both the plan and current story state into a language model prompt. We then revise by (c) reranking different continuations for plot coherence and premise relevance, and finally (d) editing the best continuation for factual consistency. Compared to similar-length stories generated directly from the same base model, human evaluators judged substantially more of Re3's stories as having a coherent overarching plot (by 14% absolute increase), and relevant to the given initial premise (by 20%).


title: Quantum anomalous Hall effects controlled by chiral domain walls

abstract: We report the interplay between two different topological phases in condensed matter physics, the magnetic chiral domain wall (DW), and the quantum anomalous Hall (QAH) effect. We show that the chiral DW driven by Dzyaloshinskii-Moriya interaction (DMI) can divide the uniform domain into several zones where the neighboring zone possesses opposite quantized Hall conductance. The separated domain with a chiral edge state (CES) can be continuously modified by external magnetic field-induced domain expansion and thermal fluctuation, which gives rise to the reconfigurable QAH effect. More interestingly, we show that the position of CES can be tuned by spin current-driven chiral DW motion. Several two-dimensional magnets with high Curie temperatures and large topological band gaps are proposed for realizing these phenomena. Our work thus reveals the possibility of chiral DW controllable QAH effects.


title: Improving the Reliability for Confidence Estimation

abstract: Confidence estimation, a task that aims to evaluate the trustworthiness of the model's prediction output during deployment, has received lots of research attention recently, due to its importance for the safe deployment of deep models. Previous works have outlined two important qualities that a reliable confidence estimation model should possess, i.e., the ability to perform well under label imbalance and the ability to handle various out-of-distribution data inputs. In this work, we propose a meta-learning framework that can simultaneously improve upon both qualities in a confidence estimation model. Specifically, we first construct virtual training and testing sets with some intentionally designed distribution differences between them. Our framework then uses the constructed sets to train the confidence estimation model through a virtual training and testing scheme leading it to learn knowledge that generalizes to diverse distributions. We show the effectiveness of our framework on both monocular depth estimation and image classification.


title: Stability of graph pairs involving vertex-transitive graphs

abstract: A pair of graphs $(\Gamma,\Sigma)$ is said to be stable if the full automorphism group of $\Gamma\times\Sigma$ is isomorphic to the product of the full automorphism groups of $\Gamma$ and $\Sigma$ and unstable otherwise, where $\Gamma\times\Sigma$ is the direct product of $\Gamma$ and $\Sigma$. In this paper, we reduce the study of the stability of any pair of regular graphs $(\Gamma,\Sigma)$ with coprime valencies and vertex-transitive $\Sigma$ to that of $(\Gamma,K_2)$. Since the latter is well studied in the literature, this enables us to determine the stability of any pair of regular graphs $(\Gamma,\Sigma)$ with coprime valencies in the case when $\Sigma$ is vertex-transitve and the stability of $(\Gamma,K_2)$ is known.


title: X-Align: Cross-Modal Cross-View Alignment for Bird's-Eye-View Segmentation

abstract: Bird's-eye-view (BEV) grid is a common representation for the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is fundamentally constrained by the absence of reliable depth information. Latest works leverage both camera and LiDAR modalities, but sub-optimally fuse their features using simple, concatenation-based mechanisms. In this paper, we address these problems by enhancing the alignment of the unimodal features in order to aid feature fusion, as well as enhancing the alignment between the cameras' perspective view (PV) and BEV representations. We propose X-Align, a novel end-to-end cross-modal and cross-view learning framework for BEV segmentation consisting of the following components: (i) a novel Cross-Modal Feature Alignment (X-FA) loss, (ii) an attention-based Cross-Modal Feature Fusion (X-FF) module to align multi-modal BEV features implicitly, and (iii) an auxiliary PV segmentation branch with Cross-View Segmentation Alignment (X-SA) losses to improve the PV-to-BEV transformation. We evaluate our proposed method across two commonly used benchmark datasets, i.e., nuScenes and KITTI-360. Notably, X-Align significantly outperforms the state-of-the-art by 3 absolute mIoU points on nuScenes. We also provide extensive ablation studies to demonstrate the effectiveness of the individual components.


title: Generalized Inter-class Loss for Gait Recognition

abstract: Gait recognition is a unique biometric technique that can be performed at a long distance non-cooperatively and has broad applications in public safety and intelligent traffic systems. Previous gait works focus more on minimizing the intra-class variance while ignoring the significance in constraining inter-class variance. To this end, we propose a generalized inter-class loss which resolves the inter-class variance from both sample-level feature distribution and class-level feature distribution. Instead of equal penalty strength on pair scores, the proposed loss optimizes sample-level inter-class feature distribution by dynamically adjusting the pairwise weight. Further, in class-level distribution, generalized inter-class loss adds a constraint on the uniformity of inter-class feature distribution, which forces the feature representations to approximate a hypersphere and keep maximal inter-class variance. In addition, the proposed method automatically adjusts the margin between classes which enables the inter-class feature distribution to be more flexible. The proposed method can be generalized to different gait recognition networks and achieves significant improvements. We conduct a series of experiments on CASIA-B and OUMVLP, and the experimental results show that the proposed loss can significantly improve the performance and achieves the state-of-the-art performances.


title: Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentation

abstract: Few-shot semantic segmentation aims to segment the target objects in query under the condition of a few annotated support images. Most previous works strive to mine more effective category information from the support to match with the corresponding objects in query. However, they all ignored the category information gap between query and support images. If the objects in them show large intra-class diversity, forcibly migrating the category information from the support to the query is ineffective. To solve this problem, we are the first to introduce an intermediate prototype for mining both deterministic category information from the support and adaptive category knowledge from the query. Specifically, we design an Intermediate Prototype Mining Transformer (IPMT) to learn the prototype in an iterative way. In each IPMT layer, we propagate the object information in both support and query features to the prototype and then use it to activate the query feature map. By conducting this process iteratively, both the intermediate prototype and the query feature can be progressively improved. At last, the final query feature is used to yield precise segmentation prediction. Extensive experiments on both PASCAL-5i and COCO-20i datasets clearly verify the effectiveness of our IPMT and show that it outperforms previous state-of-the-art methods by a large margin. Code is available at https://github.com/LIUYUANWEI98/IPMT


title: Closed-book Question Generation via Contrastive Learning

abstract: Question Generation (QG) is a fundamental NLP task for many downstream applications. Recent studies on open-book QG, where supportive answer-context pairs are provided to models, have achieved promising progress. However, generating natural questions under a more practical closed-book setting that lacks these supporting documents still remains a challenge. In this work, we propose a new QG model for this closed-book setting that is designed to better understand the semantics of long-form abstractive answers and store more information in its parameters through contrastive learning and an answer reconstruction module. Through experiments, we validate the proposed QG model on both public datasets and a new WikiCQA dataset. Empirical results show that the proposed QG model outperforms baselines in both automatic evaluation and human evaluation. In addition, we show how to leverage the proposed model to improve existing question-answering systems. These results further indicate the effectiveness of our QG model for enhancing closed-book question-answering tasks.


title: Adult-child pairs walking down stairs: Empirical analysis and optimal-step-based modeling of a complex pedestrian flow, with an exploration of flow-improvement strategies

abstract: Pedestrian egress from training schools in the after-class period (especially in China, as children walk down stairs together with their parents) raises practical concerns related to degraded flow conditions and possible safety hazards, but also represents a challenge to mainstream modeling approaches for several reasons: they involve heterogeneous groups (adult-child pairs), which are hardly studied compared to their homogeneous counterparts, in a complex geometry, made of staircases connected by a platform where pedestrians rotate, and over a wide range of densities. In light of our field observations at a training school in China, we develop a semi-continuous model which quantitatively reproduces the collective dynamics observed empirically and enables us to assess some guidance strategies to improve egress efficiency. In this model, which extends the optimal step approach, adults and children are described as ellipses with prescribed relative positions that evolve by successive steps handled by an event-driven algorithm, along a spontaneous semi-circular path on the platform, but may deviate from it in crowded conditions by selecting their preferred next positions. In line with the observations, most pairs walk side by side overall and only a small fraction sometimes make a detour to avoid queuing.Turning to the guidance strategies, we find that promoting front-back pairing may increase the flow, while urging people to make more detours may be counterproductive. Perhaps even more relevantly, the intuitive measure consisting in desynchronizing the flows from the different floors by shifting the ends of classes succeeds in reducing the egress time by at least 10%.


title: Radiative decays of the neutral $Z_c(3900)$ and $Z_c(4020)$

abstract: We study the radiative decays $Z_c(3900)/Z_c(4020) \to \gamma \chi_{cJ}(\gamma\chi_{cJ}^\prime)$ ($J=0, 1, 2$), with the assumption that the $Z_c(3900)$ and $Z_c(4020)$ couple strongly to $D\bar D^* +c.c$ and $D^*{\bar D}^*$ channel, respectively. By considering the contributions of intermediate charmed mesons triangle loops within an effective Lagrangian approach, it is shown that the calculated partial widths of $Z_c(3900) \to \gamma \chi_{cJ}$ are about a few hundreds keVs, while the obtained partial widths $Z_c(4020) \to \gamma \chi_{cJ}$ are about tens of keVs. The predicted partial widths of $Z_c(3900)\to\gamma\chi_{c0,1}^\prime$ are less than 1 keV, which mainly due to the very small phase space. For $Z_c(4020)\to\gamma\chi_{c0,2}^\prime$, the calculated partial widths are usually smaller than 1 keV. For the $Z_c(4020)\to\gamma\chi_{c1}^\prime$ process, the obtained partial widths can reach up to the order of 10 keV. Furthermore, the dependence of these ratios between different decay modes on the masses of $Z_c(3900)$ or $Z_c(4020)$ are also investigated, which may be a good quantity for the experiments. It is hoped that these calculations here could be tested by future experiments.


title: Efficient circuit implementation for coined quantum walks on binary trees and application to reinforcement learning

abstract: Quantum walks on binary trees are used in many quantum algorithms to achieve important speedup over classical algorithms. The formulation of this kind of algorithms as quantum circuit presents the advantage of being easily readable, executable on circuit based quantum computers and simulators and optimal on the usage of resources. We propose a strategy to compose quantum circuit that performs quantum walk on binary trees following universal gate model quantum computation principles. We give a particular attention to NAND formula evaluation algorithm as it could have many applications in game theory and reinforcement learning. We therefore propose an application of this algorithm and show how it can be used to train a quantum reinforcement learning agent in a two player game environment.


title: An efficient combination strategy for hybird quantum ensemble classifier

abstract: Quantum machine learning has shown advantages in many ways compared to classical machine learning. In machine learning, a difficult problem is how to learn a model with high robustness and strong generalization ability from a limited feature space. Combining multiple models as base learners, ensemble learning (EL) can effectively improve the accuracy, generalization ability, and robustness of the final model. The key to EL lies in two aspects, the performance of base learners and the choice of the combination strategy. Recently, quantum EL (QEL) has been studied. However, existing combination strategies in QEL are inadequate in considering the accuracy and variance among base learners. This paper presents a hybrid EL framework that combines quantum and classical advantages. More importantly, we propose an efficient combination strategy for improving the accuracy of classification in the framework. We verify the feasibility and efficiency of our framework and strategy by using the MNIST dataset. Simulation results show that the hybrid EL framework with our combination strategy not only has a higher accuracy and lower variance than the single model without the ensemble, but also has a better accuracy than the majority voting and the weighted voting strategies in most cases.


title: Evaluating the Label Efficiency of Contrastive Self-Supervised Learning for Multi-Resolution Satellite Imagery

abstract: The application of deep neural networks to remote sensing imagery is often constrained by the lack of ground-truth annotations. Adressing this issue requires models that generalize efficiently from limited amounts of labeled data, allowing us to tackle a wider range of Earth observation tasks. Another challenge in this domain is developing algorithms that operate at variable spatial resolutions, e.g., for the problem of classifying land use at different scales. Recently, self-supervised learning has been applied in the remote sensing domain to exploit readily-available unlabeled data, and was shown to reduce or even close the gap with supervised learning. In this paper, we study self-supervised visual representation learning through the lens of label efficiency, for the task of land use classification on multi-resolution/multi-scale satellite images. We benchmark two contrastive self-supervised methods adapted from Momentum Contrast (MoCo) and provide evidence that these methods can be perform effectively given little downstream supervision, where randomly initialized networks fail to generalize. Moreover, they outperform out-of-domain pretraining alternatives. We use the large-scale fMoW dataset to pretrain and evaluate the networks, and validate our observations with transfer to the RESISC45 dataset.


title: Observed Adversaries in Deep Reinforcement Learning

abstract: In this work, we point out the problem of observed adversaries for deep policies. Specifically, recent work has shown that deep reinforcement learning is susceptible to adversarial attacks where an observed adversary acts under environmental constraints to invoke natural but adversarial observations. This setting is particularly relevant for HRI since HRI-related robots are expected to perform their tasks around and with other agents. In this work, we demonstrate that this effect persists even with low-dimensional observations. We further show that these adversarial attacks transfer across victims, which potentially allows malicious attackers to train an adversary without access to the target victim.


title: TiDAL: Learning Training Dynamics for Active Learning

abstract: Active learning (AL) aims to select the most useful data samples from an unlabeled data pool and annotate them to expand the labeled dataset under a limited budget. Especially, uncertainty-based methods choose the most uncertain samples, which are known to be effective in improving model performance. However, AL literature often overlooks training dynamics (TD), defined as the ever-changing model behavior during optimization via stochastic gradient descent, even though other areas of literature have empirically shown that TD provides important clues for measuring the sample uncertainty. In this paper, we propose a novel AL method, Training Dynamics for Active Learning (TiDAL), which leverages the TD to quantify uncertainties of unlabeled data. Since tracking the TD of all the large-scale unlabeled data is impractical, TiDAL utilizes an additional prediction module that learns the TD of labeled data. To further justify the design of TiDAL, we provide theoretical and empirical evidence to argue the usefulness of leveraging TD for AL. Experimental results show that our TiDAL achieves better or comparable performance on both balanced and imbalanced benchmark datasets compared to state-of-the-art AL methods, which estimate data uncertainty using only static information after model training.


title: Large-Scale Open-Set Classification Protocols for ImageNet

abstract: Open-Set Classification (OSC) intends to adapt closed-set classification models to real-world scenarios, where the classifier must correctly label samples of known classes while rejecting previously unseen unknown samples. Only recently, research started to investigate on algorithms that are able to handle these unknown samples correctly. Some of these approaches address OSC by including into the training set negative samples that a classifier learns to reject, expecting that these data increase the robustness of the classifier on unknown classes. Most of these approaches are evaluated on small-scale and low-resolution image datasets like MNIST, SVHN or CIFAR, which makes it difficult to assess their applicability to the real world, and to compare them among each other. We propose three open-set protocols that provide rich datasets of natural images with different levels of similarity between known and unknown classes. The protocols consist of subsets of ImageNet classes selected to provide training and testing data closer to real-world scenarios. Additionally, we propose a new validation metric that can be employed to assess whether the training of deep learning models addresses both the classification of known samples and the rejection of unknown samples. We use the protocols to compare the performance of two baseline open-set algorithms to the standard SoftMax baseline and find that the algorithms work well on negative samples that have been seen during training, and partially on out-of-distribution detection tasks, but drop performance in the presence of samples from previously unseen unknown classes.


title: Deep Gesture Generation for Social Robots Using Type-Specific Libraries

abstract: Body language such as conversational gesture is a powerful way to ease communication. Conversational gestures do not only make a speech more lively but also contain semantic meaning that helps to stress important information in the discussion. In the field of robotics, giving conversational agents (humanoid robots or virtual avatars) the ability to properly use gestures is critical, yet remain a task of extraordinary difficulty. This is because given only a text as input, there are many possibilities and ambiguities to generate an appropriate gesture. Different to previous works we propose a new method that explicitly takes into account the gesture types to reduce these ambiguities and generate human-like conversational gestures. Key to our proposed system is a new gesture database built on the TED dataset that allows us to map a word to one of three types of gestures: "Imagistic" gestures, which express the content of the speech, "Beat" gestures, which emphasize words, and "No gestures." We propose a system that first maps the words in the input text to their corresponding gesture type, generate type-specific gestures and combine the generated gestures into one final smooth gesture. In our comparative experiments, the effectiveness of the proposed method was confirmed in user studies for both avatar and humanoid robot.


title: SDW-ASL: A Dynamic System to Generate Large Scale Dataset for Continuous American Sign Language

abstract: Despite tremendous progress in natural language processing using deep learning techniques in recent years, sign language production and comprehension has advanced very little. One critical barrier is the lack of largescale datasets available to the public due to the unbearable cost of labeled data generation. Efforts to provide public data for American Sign Language (ASL) comprehension have yielded two datasets, comprising more than thousand video clips. These datasets are large enough to enable a meaningful start to deep learning research on sign languages but are far too small to lead to any solution that can be practically deployed. So far, there is still no suitable dataset for ASL production. We proposed a system that can generate large scale ASL datasets for continuous ASL. It is suitable for general ASL processing and is particularly useful for ASL production. The continuous ASL dataset contains English labeled human articulations in condensed body pose data formats. To better serve the research community, we are releasing the first version of our ASL dataset, which contains 30k sentences, 416k words, a vocabulary of 18k words, in a total of 104 hours. This is the largest continuous sign language dataset published to date in terms of video duration. We also describe a system that can evolve and expand the dataset to incorporate better data processing techniques and more contents when available. It is our hope that the release of this ASL dataset and the sustainable dataset generation system to the public will propel better deep-learning research in ASL natural language processing.


title: SoK: How Not to Architect Your Next-Generation TEE Malware?

abstract: Besides Intel's SGX technology, there are long-running discussions on how trusted computing technologies can be used to cloak malware. Past research showed example methods of malicious activities utilising Flicker, Trusted Platform Module, and recently integrating with enclaves. We observe two ambiguous methodologies of malware development being associated with SGX, and it is crucial to systematise their details. One methodology is to use the core SGX ecosystem to cloak malware; potentially affecting a large number of systems. The second methodology is to create a custom enclave not adhering to base assumptions of SGX, creating a demonstration code of malware behaviour with these incorrect assumptions; remaining local without any impact. We examine what malware aims to do in real-world scenarios and state-of-art techniques in malware evasion. We present multiple limitations of maintaining the SGX-assisted malware and evading it from anti-malware mechanisms. The limitations make SGX enclaves a poor choice for achieving a successful malware campaign. We systematise twelve misconceptions (myths) outlining how an overfit-malware using SGX weakens malware's existing abilities. We find the differences by comparing SGX assistance for malware with non-SGX malware (i.e., malware in the wild in our paper). We conclude that the use of hardware enclaves does not increase the preexisting attack surface, enables no new infection vector, and does not contribute any new methods to the stealthiness of malware.


title: Uniqueness of positive solutions to the higher order Brezis-Nirenberg problem

abstract: In this paper, we study the higher order Brezis-Nirenberg problem under the Navier boundary condition \be\label{eq} \begin{cases} (-\Delta)^m u=\varepsilon u+u^{p} & \text { in }\, \Omega, \\ u>0 & \text { in }\, \Omega, \\ u=-\Delta u=\cdots=(-\Delta)^{m-1} u=0 & \text { on }\, \partial \Omega, \end{cases} \ee where $\Omega$ is a strictly convex smooth bounded domain in $\mathbb{R}^n$ with $n \geq 4m$, $m \in \mathbb{N}_{+}$, $\varepsilon\in (0,\lambda_{1})$, $\lambda_{1}$ is the first Navier eigenvalue for $(-\Delta)^{m}$ in $\Omega$, and $p=\frac{n+2m}{n-2m}$. We prove that the solutions of \eqref{eq} are unique if either $\varepsilon$ close to $\lambda_1$ or $\varepsilon$ close to 0 and $\Omega$ satisfies some symmetry assumptions. The proof is mainly based on our previous works about the blow up analysis and compactness result for solutions to higher order critical elliptic equations and the asymptotic behavior of solutions to \eqref{eq}.


title: Towards Holographic Video Communications: A Promising AI-driven Solution

abstract: Real-time holographic video communications enable immersive experiences for next-generation video services in the future metaverse era. However, high-fidelity holographic videos require high bandwidth and significant computation resources, which exceed the transferring and computing capacity of 5G networks. This article reviews state-of-the-art holographic point cloud video (PCV) transmission techniques and highlights the critical challenges of delivering such immersive services. We further implement a preliminary prototype of an AI-driven holographic video communication system and present critical experimental results to evaluate its performance. Finally, we identify future research directions and discuss potential solutions for providing real-time and high-quality holographic experiences.


abstract: Most multi-view clustering methods are limited by shallow models without sound nonlinear information perception capability, or fail to effectively exploit complementary information hidden in different views. To tackle these issues, we propose a novel Subspace-Contrastive Multi-View Clustering (SCMC) approach. Specifically, SCMC utilizes view-specific auto-encoders to map the original multi-view data into compact features perceiving its nonlinear structures. Considering the large semantic gap of data from different modalities, we employ subspace learning to unify the multi-view data into a joint semantic space, namely the embedded compact features are passed through multiple self-expression layers to learn the subspace representations, respectively. In order to enhance the discriminability and efficiently excavate the complementarity of various subspace representations, we use the contrastive strategy to maximize the similarity between positive pairs while differentiate negative pairs. Thus, a weighted fusion scheme is developed to initially learn a consistent affinity matrix. Furthermore, we employ the graph regularization to encode the local geometric structure within varying subspaces for further fine-tuning the appropriate affinities between instances. To demonstrate the effectiveness of the proposed model, we conduct a large number of comparative experiments on eight challenge datasets, the experimental results show that SCMC outperforms existing shallow and deep multi-view clustering methods.


title: Circuit depth versus energy in topologically ordered systems

abstract: We prove a nontrivial circuit-depth lower bound for preparing a low-energy state of a locally interacting quantum many-body system in two dimensions, assuming the circuit is geometrically local. For preparing any state which has an energy density of at most $\epsilon$ with respect to Kitaev's toric code Hamiltonian on a two dimensional lattice $\Lambda$, we prove a lower bound of $\Omega\left(\min\left(1/\epsilon^{\frac{1-\alpha}{2}}, \sqrt{|\Lambda|}\right)\right)$ for any $\alpha >0$. We discuss two implications. First, our bound implies that the lowest energy density obtainable from a large class of existing variational circuits (e.g., Hamiltonian variational ansatz) cannot, in general, decay exponentially with the circuit depth. Second, if long-range entanglement is present in the ground state, this can lead to a nontrivial circuit-depth lower bound even at nonzero energy density. Unlike previous approaches to prove circuit-depth lower bounds for preparing low energy states, our proof technique does not rely on the ground state to be degenerate.


title: Explicit minimisers for anisotropic Coulomb energies in 3D

abstract: In this paper we consider a general class of anisotropic energies in three dimensions and give a complete characterisation of their minimisers. We show that, depending on the Fourier transform of the interaction potential, the minimiser is either the normalised characteristic function of an ellipsoid or a measure supported on a two-dimensional ellipse. In particular, it is always an ellipsoid if the transform is strictly positive, while when the Fourier transform is degenerate both cases can occur. Finally, we show an explicit example where loss of dimensionality of the minimiser does occur.


title: Analysis of publications by authors of Ukrainian institutes in Scopus-delisted titles

abstract: In Ukraine, Scopus data are used to evaluate academics. Existing shortcomings in the Ukrainian evaluation system allow them to publish in titles that have been delisted from Scopus, and continue to use those papers as credible research output for evaluation. The purpose of this study was to analyse the publishing activity of Ukrainian institutions in Scopus-delisted titles (as of September 2021) in different fields between 2011 and 2020 and to attempt to appreciate how common this practice is among Ukrainian authors. Scopus was sourced to collect bibliographic and citations-related data, while SciVal was used to analyse these data. The findings suggest that for 17 Ukrainian institutions, papers from titles that have been delisted from Scopus still play an important part of the publication achievement of their employees. In particular, in the field of economics, econometrics and finance, 46.92% of Ukrainian papers were published in a title that was excluded from Scopus. Moreover, the analysis indicated that in two Ukrainian institutions, the level of citation of such papers significantly exceeds the average number of citations to Scopus-indexed papers in the same year and in the same field. Given that bibliometric indicators are also used for research assessment in other Eastern European countries, the results of this paper are applicable to a wider geographic context.


title: Benchmarking Long-tail Generalization with Likelihood Splits

abstract: In order to reliably process natural language, NLP systems must generalize to the long tail of rare utterances. We propose a method to create challenging benchmarks that require generalizing to the tail of the distribution by re-splitting existing datasets. We create 'Likelihood Splits' where examples that are assigned lower likelihood by a pre-trained language model (LM) are placed in the test set, and more likely examples are in the training set. This simple approach can be customized to construct meaningful train-test splits for a wide range of tasks. Likelihood Splits surface more challenges than random splits: relative error rates of state-of-the-art models increase by 59% for semantic parsing on Spider, 93% for natural language inference on SNLI, and 33% for yes/no question answering on BoolQ, on our splits compared with the corresponding random splits. Moreover, Likelihood Splits create fairer benchmarks than adversarial filtering; when the LM used to create the splits is also employed as the task model, our splits do not unfairly penalize the LM.


title: Dirichlet problem for Schr\"odinger operators on Heisenberg groups

abstract: We investigate the Dirichlet problem associated to the Schr\"odinger operator $\mathcal L=-\Delta_{\mathbb{H}^n}+V$ on Heisenberg group $\mathbb H^n$: \begin{align*} \begin{cases} \partial_{ss}u(g,s)-\mathcal L u(g,s)=0\,,\quad &{\rm in \,\ } \mathbb{H}^n\times\mathbb{R}^+,\\ u(g,0)=f \,,\quad &{\rm on \,\ } \mathbb{H}^n \end{cases} \end{align*} with $f$ in $L^p(\mathbb{H}^n)$ ($1< p<\infty$) and in $H^1_{\mathcal L}(\mathbb{H}^n)$, i.e., the Hardy space associated with $\mathcal L$. Here $\Delta_{\mathbb{H}^n}$ is the sub-Laplacian on $\mathbb H^n$ and the nonnegative potential $V$ belongs to the reverse H\"older class $B_{Q/2}$ with $Q$ the homogeneous dimension of $\mathbb{H}^n$. The new approach is to establish a suitable weak maximum principle, which is the key to solve this problem under the condition $V\in B_{Q/2}$. This result is new even back to $\mathbb R^n$ (the condition will become $V\in B_{n/2}$) since the previous known result requires $V\in B_{(n+1)/2}$ which went through a Liouville type theorem.


title: Robust offset-free nonlinear model predictive control for systems learned by neural nonlinear autoregressive exogenous models

abstract: This paper presents a robust Model Predictive Control (MPC) scheme that provides offset-free setpoint tracking for systems described by Neural Nonlinear AutoRegressive eXogenous (NNARX) models. The NNARX model learns the dynamics of the plant from input-output data, and during the training the Incremental Input-to-State Stability (${\delta}$ISS) property is forced to guarantee stability. The trained NNARX model is then augmented with an explicit integral action on the output tracking error, which allows the control scheme to enjoy offset-free tracking ability. A tube-based MPC is finally designed, leveraging the unique structure of the model, to ensure robust stability and robust asymptotic zero error regulation for constant reference signals in the presence of model-plant mismatch or unknown disturbances. Numerical simulations on a water heating system show the effectiveness of the proposed control algorithm.


title: Multi-Player Immersive Communications and Interactions in Metaverse: Challenges, Architecture, and Future Directions

abstract: The metaverse has awakened users' expectations of an immersive interaction that fuses the virtual digital world and the physical world across space and time. However, the metaverse is still in its infancy, typically expanding multi-player applications (e.g., multi-player games) to implement a prototype with the help of 5G/Beyond 5G, Artificial Intelligence, digital twin, and other enabling technologies. This article reviews the characteristics, key enabling technologies, and driving applications of the state-of-the-art metaverse. We focus on the immersive interactions perspective of the metaverse from the tasks, inputs, and feedback across the users, digital world, and physical world and reveal the key challenges. Afterwards, we present a multi-player interaction prototype platform based on a cloud-edge-device collaborative framework. Also, we evaluate it with centralized and device-to-device (D2D) approaches to verify the efficiency and flexibility of interactions. Finally, we point out future research approaches and discuss potential solutions to enable more stable and higher quality multi-player interactions for metaverse services.


title: Trajectory Optimization for Quadruped Mobile Manipulators that Carry Heavy Payload

abstract: This paper presents a simplified model-based trajectory optimization (TO) formulation for motion planning on quadruped mobile manipulators that carry heavy payload of known mass. The proposed payload-aware formulation simultaneously plans locomotion, payload manipulation and considers both robot and payload model dynamics while remaining computationally efficient. At the presence of heavy payload, the approach exhibits reduced leg outstretching (thus increased manipulability) in kinematically demanding motions due to the contribution of payload manipulation in the optimization. The framework's computational efficiency and performance is validated through a number of simulation and experimental studies with the bi-manual quadruped CENTAURO robot carrying on its arms a payload that exceeds 15 % of its mass and traversing non-flat terrain.


title: Getting higher on rugged landscapes: Inversion mutations open access to fitter adaptive peaks in NK fitness landscapes

abstract: Molecular evolution is often conceptualised as adaptive walks on rugged fitness landscapes, driven by mutations and constrained by incremental fitness selection. It is well known that epistasis shapes the ruggedness of the landscape's surface, outlining their topography (with high-fitness peaks separated by valleys of lower fitness genotypes). However, within the strong selection weak mutation (SSWM) limit, once an adaptive walk reaches a local peak, natural selection restricts passage through downstream paths and hampers any possibility of reaching higher fitness values. Here, in addition to the widely used point mutations, we introduce a minimal model of sequence inversions to simulate adaptive walks. We use the well known NK model to instantiate rugged landscapes. We show that adaptive walks can reach higher fitness values through inversion mutations, which, compared to point mutations, allows the evolutionary process to escape local fitness peaks. To elucidate the effects of this chromosomal rearrangement, we use a graph-theoretical representation of accessible mutants and show how new evolutionary paths are uncovered. The present model suggests a simple mechanistic rationale to analyse escapes from local fitness peaks in molecular evolution driven by (intragenic) structural inversions and reveals some consequences of the limits of point mutations for simulations of molecular evolution.


title: On Classification of Fermionic Rational Conformal Field Theories

abstract: We systematically study how the integrality of the conformal characters shapes the space of fermionic rational conformal field theories in two dimensions. The integrality suggests that conformal characters on torus with a given choice of spin structures should be invariant under a principal congruence subgroup of $\mathrm{PSL}(2,\mathbb{Z})$. The invariance strongly constrains the possible values of the central charge as well as the conformal weights in both Neveu-Schwarz and Ramond sectors, which improves the conventional holomorphic modular bootstrap method in a significant manner. This allows us to make much progress on the classification of fermionic rational conformal field theories with the number of independent characters less than five.


title: OOOE: Only-One-Object-Exists Assumption to Find Very Small Objects in Chest Radiographs

abstract: The accurate localization of inserted medical tubes and parts of human anatomy is a common problem when analyzing chest radiographs and something deep neural networks could potentially automate. However, many foreign objects like tubes and various anatomical structures are small in comparison to the entire chest X-ray, which leads to severely unbalanced data and makes training deep neural networks difficult. In this paper, we present a simple yet effective `Only-One-Object-Exists' (OOOE) assumption to improve the deep network's ability to localize small landmarks in chest radiographs. The OOOE enables us to recast the localization problem as a classification problem and we can replace commonly used continuous regression techniques with a multi-class discrete objective. We validate our approach using a large scale proprietary dataset of over 100K radiographs as well as publicly available RANZCR-CLiP Kaggle Challenge dataset and show that our method consistently outperforms commonly used regression-based detection models as well as commonly used pixel-wise classification methods. Additionally, we find that the method using the OOOE assumption generalizes to multiple detection problems in chest X-rays and the resulting model shows state-of-the-art performance on detecting various tube tips inserted to the patient as well as patient anatomy.


title: Improving Out-of-Distribution Generalization by Adversarial Training with Structured Priors

abstract: Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a growing surge of interest in exploiting Adversarial Training (AT) to improve OOD performance. Recent works have revealed that the robust model obtained by conducting sample-wise AT also retains transferability to biased test domains. In this paper, we empirically show that sample-wise AT has limited improvement on OOD performance. Specifically, we find that AT can only maintain performance at smaller scales of perturbation while Universal AT (UAT) is more robust to larger-scale perturbations. This provides us with clues that adversarial perturbations with universal (low dimensional) structures can enhance the robustness against large data distribution shifts that are common in OOD scenarios. Inspired by this, we propose two AT variants with low-rank structures to train OOD-robust models. Extensive experiments on DomainBed benchmark show that our proposed approaches outperform Empirical Risk Minimization (ERM) and sample-wise AT. Our code is available at https://github.com/NOVAglow646/NIPS22-MAT-and-LDAT-for-OOD.


title: ISCom: Interest-aware Semantic Communication Scheme for Point Cloud Video Streaming

abstract: The provisioning of immersive point cloud video (PCV) streaming on pervasive mobile devices is a cornerstone for enabling immersive communication and interactions in the future 6G metaverse era. However, most streaming techniques are dedicated to efficient PCV compression and codec extending from traditional 3-DoF video services. Some emerging AI-enabled approaches are still in their infancy phase and are constrained by intensive computational and adaptive flow techniques. In this paper, we present ISCom, an Interest-aware Semantic Communication Scheme for PCV, consisting of a region-of-interest (ROI) selection module, a lightweight PCV streaming module, and an intelligent scheduler. First, we propose a two-stage efficient ROI selection method for providing interest-aware PCV streaming, which significantly reduces the data volume. Second, we design a lightweight PCV encoder-decoder network for resource-constrained devices, adapting to the heterogeneous computing capabilities of terminals. Third, we train a deep reinforcement learning (DRL)-based scheduler to adapt an optimal encoder-decoder network for various devices, considering the dynamic network environments and computing capabilities of different devices. Extensive experiments show that ISCom outperforms baselines on mobile devices at least 10 FPS and up to 22 FPS.


title: The five gradients inequality for non quadratic costs

abstract: We give a proof of the "five gradients inequality" of Optimal Transportation Theory for general costs of the form $c(x,y)=h(x-y)$ where $h$ is a $C^1$ strictly convex radially symmetric function.


title: Modified gravity approaches to the cosmological constant problem

abstract: The cosmological constant and its phenomenology remain among the greatest puzzles in theoretical physics. We review how modifications of Einstein's general relativity could alleviate the different problems associated with it that result from the interplay of classical gravity and quantum field theory. We introduce a modern and concise language to describe the problems associated with its phenomenology, and inspect no-go theorems and their loopholes to motivate the approaches discussed here. Constrained gravity approaches exploit minimal departures from general relativity; massive gravity introduces mass to the graviton; Horndeski theories lead to the breaking of translational invariance of the vacuum; and models with extra dimensions change the symmetries of the vacuum. We also review screening mechanisms that have to be present in some of these theories if they aim to recover the success of general relativity on small scales as well. Finally, we summarise the statuses of these models in their attempt to solve the different cosmological constant problems while being able to account for current astrophysical and cosmological observations.


title: On the calibration of underrepresented classes in LiDAR-based semantic segmentation

abstract: The calibration of deep learning-based perception models plays a crucial role in their reliability. Our work focuses on a class-wise evaluation of several model's confidence performance for LiDAR-based semantic segmentation with the aim of providing insights into the calibration of underrepresented classes. Those classes often include VRUs and are thus of particular interest for safety reasons. With the help of a metric based on sparsification curves we compare the calibration abilities of three semantic segmentation models with different architectural concepts, each in a in deterministic and a probabilistic version. By identifying and describing the dependency between the predictive performance of a class and the respective calibration quality we aim to facilitate the model selection and refinement for safety-critical applications.


title: CROWDLAB: Supervised learning to infer consensus labels and quality scores for data with multiple annotators

abstract: Real-world data for classification is often labeled by multiple annotators. For analyzing such data, we introduce CROWDLAB, a straightforward approach to utilize any trained classifier to estimate: (1) A consensus label for each example that aggregates the available annotations; (2) A confidence score for how likely each consensus label is correct; (3) A rating for each annotator quantifying the overall correctness of their labels. Existing algorithms to estimate related quantities in crowdsourcing often rely on sophisticated generative models with iterative inference. CROWDLAB instead uses a straightforward weighted ensemble. Existing algorithms often rely solely on annotator statistics, ignoring the features of the examples from which the annotations derive. CROWDLAB utilizes any classifier model trained on these features, and can thus better generalize between examples with similar features. On real-world multi-annotator image data, our proposed method provides superior estimates for (1)-(3) than existing algorithms like Dawid-Skene/GLAD.


title: Slow-growth approximation for near-wall patch representation of wall-bounded turbulence

abstract: Wall-bounded turbulent shear flows are known to exhibit universal small-scale dynamics that are modulated by large-scale flow structures. Strong pressure gradients complicate this characterization, however; they can cause significant variation of the mean flow in the streamwise direction. For such situations, we perform asymptotic analysis of the Navier-Stokes equations to inform a model for the effect of mean flow growth on near-wall turbulence in a small domain localized to the boundary. The asymptotics are valid whenever the viscous length scale is small relative to the length scale over which the mean flow varies. To ensure the correct momentum environment, a dynamic procedure is introduced that accounts for the additional sources of mean momentum flux through the upper domain boundary arising from the asymptotic terms. Comparisons of the model's low-order, single-point statistics with those from direct numerical simulation and well-resolved large eddy simulation of adverse-pressure gradient turbulent boundary layers indicate the asymptotic model successfully accounts for the effect of boundary layer growth on the small-scale near-wall turbulence.


title: Accelerating the Evolutionary Algorithms by Gaussian Process Regression with $\epsilon$-greedy acquisition function

abstract: In this paper, we propose a novel method to estimate the elite individual to accelerate the convergence of optimization. Inspired by the Bayesian Optimization Algorithm (BOA), the Gaussian Process Regression (GPR) is applied to approximate the fitness landscape of original problems based on every generation of optimization. And simple but efficient $\epsilon$-greedy acquisition function is employed to find a promising solution in the surrogate model. Proximity Optimal Principle (POP) states that well-performed solutions have a similar structure, and there is a high probability of better solutions existing around the elite individual. Based on this hypothesis, in each generation of optimization, we replace the worst individual in Evolutionary Algorithms (EAs) with the elite individual to participate in the evolution process. To illustrate the scalability of our proposal, we combine our proposal with the Genetic Algorithm (GA), Differential Evolution (DE), and CMA-ES. Experimental results in CEC2013 benchmark functions show our proposal has a broad prospect to estimate the elite individual and accelerate the convergence of optimization.


title: Krylov complexity in inverted harmonic oscillator

abstract: Recently, the out-of-time-ordered correlator(OTOC) and Krylov complexity have been studied actively as a measure of operator growth. OTOC is known to exhibit exponential growth in chaotic systems, which was confirmed in many previous works. However, in some non-chaotic systems, it was observed that OTOC shows chaotic behavior and cannot distinguish saddle-dominated scrambling from chaotic systems. For K-complexity, in the universal operator growth hypothesis, it was stated that Lanczos coefficients show linear growth in chaotic systems, which is the fastest. But recently, it appeared that Lanczos coefficients and K-complexity show chaotic behavior in the LMG model and cannot distinguish saddle-dominated scrambling from chaos. In this paper, we compute Lanczos coefficients and K-complexity in an inverted harmonic oscillator. We find that they exhibit chaotic behavior, which agrees with the case of the LMG model. We also analyze bounds on the quantum Lyapunov coefficient and the growth rate of Lanczos coefficients and find that there is a difference with the chaotic system. Microcanonical K-complexity is also analyzed and compared with the OTOC case.


title: ALIFE: Adaptive Logit Regularizer and Feature Replay for Incremental Semantic Segmentation

abstract: We address the problem of incremental semantic segmentation (ISS) recognizing novel object/stuff categories continually without forgetting previous ones that have been learned. The catastrophic forgetting problem is particularly severe in ISS, since pixel-level ground-truth labels are available only for the novel categories at training time. To address the problem, regularization-based methods exploit probability calibration techniques to learn semantic information from unlabeled pixels. While such techniques are effective, there is still a lack of theoretical understanding of them. Replay-based methods propose to memorize a small set of images for previous categories. They achieve state-of-the-art performance at the cost of large memory footprint. We propose in this paper a novel ISS method, dubbed ALIFE, that provides a better compromise between accuracy and efficiency. To this end, we first show an in-depth analysis on the calibration techniques to better understand the effects on ISS. Based on this, we then introduce an adaptive logit regularizer (ALI) that enables our model to better learn new categories, while retaining knowledge for previous ones. We also present a feature replay scheme that memorizes features, instead of images directly, in order to reduce memory requirements significantly. Since a feature extractor is changed continually, memorized features should also be updated at every incremental stage. To handle this, we introduce category-specific rotation matrices updating the features for each category separately. We demonstrate the effectiveness of our approach with extensive experiments on standard ISS benchmarks, and show that our method achieves a better trade-off in terms of accuracy and efficiency.


title: An Analysis Method for Metric-Level Switching in Beat Tracking

abstract: For expressive music, the tempo may change over time, posing challenges to tracking the beats by an automatic model. The model may first tap to the correct tempo, but then may fail to adapt to a tempo change, or switch between several incorrect but perceptually plausible ones (e.g., half- or double-tempo). Existing evaluation metrics for beat tracking do not reflect such behaviors, as they typically assume a fixed relationship between the reference beats and estimated beats. In this paper, we propose a new performance analysis method, called annotation coverage ratio (ACR), that accounts for a variety of possible metric-level switching behaviors of beat trackers. The idea is to derive sequences of modified reference beats of all metrical levels for every two consecutive reference beats, and compare every sequence of modified reference beats to the subsequences of estimated beats. We show via experiments on three datasets of different genres the usefulness of ACR when utilized alongside existing metrics, and discuss the new insights to be gained.


title: Deepfake Detection System for the ADD Challenge Track 3.2 Based on Score Fusion

abstract: This paper describes the deepfake audio detection system submitted to the Audio Deep Synthesis Detection (ADD) Challenge Track 3.2 and gives an analysis of score fusion. The proposed system is a score-level fusion of several light convolutional neural network (LCNN) based models. Various front-ends are used as input features, including low-frequency short-time Fourier transform and Constant Q transform. Due to the complex noise and rich synthesis algorithms, it is difficult to obtain the desired performance using the training set directly. Online data augmentation methods effectively improve the robustness of fake audio detection systems. In particular, the reasons for the poor improvement of score fusion are explored through visualization of the score distributions and comparison with score distribution on another dataset. The overfitting of the model to the training set leads to extreme values of the scores and low correlation of the score distributions, which makes score fusion difficult. Fusion with partially fake audio detection system improves system performance further. The submission on track 3.2 obtained the weighted equal error rate (WEER) of 11.04\%, which is one of the best performing systems in the challenge.


title: Mean-field analysis for heavy ball methods: Dropout-stability, connectivity, and global convergence

abstract: The stochastic heavy ball method (SHB), also known as stochastic gradient descent (SGD) with Polyak's momentum, is widely used in training neural networks. However, despite the remarkable success of such algorithm in practice, its theoretical characterization remains limited. In this paper, we focus on neural networks with two and three layers and provide a rigorous understanding of the properties of the solutions found by SHB: \emph{(i)} stability after dropping out part of the neurons, \emph{(ii)} connectivity along a low-loss path, and \emph{(iii)} convergence to the global optimum. To achieve this goal, we take a mean-field view and relate the SHB dynamics to a certain partial differential equation in the limit of large network widths. This mean-field perspective has inspired a recent line of work focusing on SGD while, in contrast, our paper considers an algorithm with momentum. More specifically, after proving existence and uniqueness of the limit differential equations, we show convergence to the global optimum and give a quantitative bound between the mean-field limit and the SHB dynamics of a finite-width network. Armed with this last bound, we are able to establish the dropout-stability and connectivity of SHB solutions.


title: Personalized Federated Hypernetworks for Privacy Preservation in Multi-Task Reinforcement Learning

abstract: Multi-Agent Reinforcement Learning currently focuses on implementations where all data and training can be centralized to one machine. But what if local agents are split across multiple tasks, and need to keep data private between each? We develop the first application of Personalized Federated Hypernetworks (PFH) to Reinforcement Learning (RL). We then present a novel application of PFH to few-shot transfer, and demonstrate significant initial increases in learning. PFH has never been demonstrated beyond supervised learning benchmarks, so we apply PFH to an important domain: RL price-setting for energy demand response. We consider a general case across where agents are split across multiple microgrids, wherein energy consumption data must be kept private within each microgrid. Together, our work explores how the fields of personalized federated learning and RL can come together to make learning efficient across multiple tasks while keeping data secure.


title: Conflict-free Charging and Real-time Control for an Electric Bus Network

abstract: The rapid adoption of electric buses by transit agencies around the world is leading to new challenges in the planning and operation of bus networks. In particular, the limited driving range of electric vehicles imposes operational constraints such as the need to charge buses during service. Research on this topic has mostly focused on the strategic and tactical planning aspects until now, and very little work has been done on the real-time operational aspect. To remedy this, we propose integrating the charging scheduling problem with a real-time speed control strategy in this paper. The control problem is formulated as a mixed-integer linear program and solved to optimality with the branch-and-bound method. Simulations are carried out by repeatedly solving the control problem in a receding horizon fashion over a full day of operation. The results show that the proposed controller manages to anticipate and avoid potential conflicts where the charging demand exceeds the charger capacity. This feature makes the controller achieve lower operational costs, both in terms of service regularity and energy consumption, compared to a standard first-come, first-served charging scheme.


title: Reexamination of the Kochen-Specker theorem: Relaxation of the completeness assumption

abstract: The Kochen-Specker theorem states that exclusive and complete deterministic outcome assignments are impossible for certain sets of measurements, called Kochen-Specker (KS) sets. A straightforward consequence is that KS sets do not have joint probability distributions because no set of joint outcomes over such a distribution can be constructed. However, we show it is possible to construct a joint quasiprobability distribution over any KS set by relaxing the completeness assumption. Interestingly, completeness is still observable at the level of measurable marginal probability distributions. This suggests the observable completeness might not be a fundamental feature, but a secondary property.


title: Scalable Neural Video Representations with Learnable Positional Features

abstract: Succinct representation of complex signals using coordinate-based neural representations (CNRs) has seen great progress, and several recent efforts focus on extending them for handling videos. Here, the main challenge is how to (a) alleviate a compute-inefficiency in training CNRs to (b) achieve high-quality video encoding while (c) maintaining the parameter-efficiency. To meet all requirements (a), (b), and (c) simultaneously, we propose neural video representations with learnable positional features (NVP), a novel CNR by introducing "learnable positional features" that effectively amortize a video as latent codes. Specifically, we first present a CNR architecture based on designing 2D latent keyframes to learn the common video contents across each spatio-temporal axis, which dramatically improves all of those three requirements. Then, we propose to utilize existing powerful image and video codecs as a compute-/memory-efficient compression procedure of latent codes. We demonstrate the superiority of NVP on the popular UVG benchmark; compared with prior arts, NVP not only trains 2 times faster (less than 5 minutes) but also exceeds their encoding quality as 34.07$\rightarrow$34.57 (measured with the PSNR metric), even using $>$8 times fewer parameters. We also show intriguing properties of NVP, e.g., video inpainting, video frame interpolation, etc.


title: An Empirical Study on Finding Spans

abstract: We present an empirical study on methods for span finding, the selection of consecutive tokens in text for some downstream tasks. We focus on approaches that can be employed in training end-to-end information extraction systems, and find there is no definitive solution without considering task properties, and provide our observations to help with future design choices: 1) a tagging approach often yields higher precision while span enumeration and boundary prediction provide higher recall; 2) span type information can benefit a boundary prediction approach; 3) additional contextualization does not help span finding in most cases.


title: Fast Optimization of Weighted Sparse Decision Trees for use in Optimal Treatment Regimes and Optimal Policy Design

abstract: Sparse decision trees are one of the most common forms of interpretable models. While recent advances have produced algorithms that fully optimize sparse decision trees for prediction, that work does not address policy design, because the algorithms cannot handle weighted data samples. Specifically, they rely on the discreteness of the loss function, which means that real-valued weights cannot be directly used. For example, none of the existing techniques produce policies that incorporate inverse propensity weighting on individual data points. We present three algorithms for efficient sparse weighted decision tree optimization. The first approach directly optimizes the weighted loss function; however, it tends to be computationally inefficient for large datasets. Our second approach, which scales more efficiently, transforms weights to integer values and uses data duplication to transform the weighted decision tree optimization problem into an unweighted (but larger) counterpart. Our third algorithm, which scales to much larger datasets, uses a randomized procedure that samples each data point with a probability proportional to its weight. We present theoretical bounds on the error of the two fast methods and show experimentally that these methods can be two orders of magnitude faster than the direct optimization of the weighted loss, without losing significant accuracy.


title: Thermodynamics of Ising Antiferromagnets with Phantom Cross-link Network on Husimi Lattice

abstract: A second order cross-linked network is applied onto the classical Husimi lattice, to investigate the role of a "phantom" non-neighboring interactions of mid- and long-range in Bethe-like lattices for the first time. Since antiferromagnetic Ising model on Husimi lattice has been exactly solved and successfully presented the melting and glass transition, the Phantom Cross-link Network (PCN) is introduced here to understand the relationship between glassy defect and long-range interactions in small molecule systems, and the concept is inspired from the classical rubber network theory (Flory, 1985). One random site out of four on the recursive unites with certain distance I (the net size) is selected to be linked onto the PCN. The solutions are still in the fashion of normal antiferromagnetic Ising model, with expected frustrations along with the net size I. Beside the regular Curie transition, several interesting thermodynamics are observed in this toy model, and as the main found, PCN clearly introduces glassy portion into the system, identified by the supercooling behavior with lower TC, the metastable entropy curve and the Kauzmann paradox.


title: Processing Particle Data Flows with SmartNICs

abstract: Many distributed applications implement complex data flows and need a flexible mechanism for routing data between producers and consumers. Recent advances in programmable network interface cards, or SmartNICs, represent an opportunity to offload data-flow tasks into the network fabric, thereby freeing the hosts to perform other work. System architects in this space face multiple questions about the best way to leverage SmartNICs as processing elements in data flows. In this paper, we advocate the use of Apache Arrow as a foundation for implementing data-flow tasks on SmartNICs. We report on our experiences adapting a partitioning algorithm for particle data to Apache Arrow and measure the on-card processing performance for the BlueField-2 SmartNIC. Our experiments confirm that the BlueField-2's (de)compression hardware can have a significant impact on in-transit workflows where data must be unpacked, processed, and repacked.


title: Rethinking Annotation: Can Language Learners Contribute?

abstract: Researchers have traditionally recruited native speakers to provide annotations for widely used benchmark datasets. However, there are languages for which recruiting native speakers can be difficult, and it would help to find learners of those languages to annotate the data. In this paper, we investigate whether language learners can contribute annotations to benchmark datasets. In a carefully controlled annotation experiment, we recruit 36 language learners, provide two types of additional resources (dictionaries and machine-translated sentences), and perform mini-tests to measure their language proficiency. We target three languages, English, Korean, and Indonesian, and the four NLP tasks of sentiment analysis, natural language inference, named entity recognition, and machine reading comprehension. We find that language learners, especially those with intermediate or advanced levels of language proficiency, are able to provide fairly accurate labels with the help of additional resources. Moreover, we show that data annotation improves learners' language proficiency in terms of vocabulary and grammar. One implication of our findings is that broadening the annotation task to include language learners can open up the opportunity to build benchmark datasets for languages for which it is difficult to recruit native speakers.


title: Ensemble Creation via Anchored Regularization for Unsupervised Aspect Extraction

abstract: Aspect Based Sentiment Analysis is the most granular form of sentiment analysis that can be performed on the documents / sentences. Besides delivering the most insights at a finer grain, it also poses equally daunting challenges. One of them being the shortage of labelled data. To bring in value right out of the box for the text data being generated at a very fast pace in today's world, unsupervised aspect-based sentiment analysis allows us to generate insights without investing time or money in generating labels. From topic modelling approaches to recent deep learning-based aspect extraction models, this domain has seen a lot of development. One of the models that we improve upon is ABAE that reconstructs the sentences as a linear combination of aspect terms present in it, In this research we explore how we can use information from another unsupervised model to regularize ABAE, leading to better performance. We contrast it with baseline rule based ensemble and show that the ensemble methods work better than the individual models and the regularization based ensemble performs better than the rule-based one.


title: Thermodynamic optical pressures in tight-binding nonlinear multimode photonic systems

abstract: Optical forces are known to arise in a universal fashion in many and diverse physical settings. As such, they are successfully employed over a wide range of applications in areas like biophotonics, optomechanics and integrated optics. While inter-elemental optical forces in few-mode photonic networks have been so far systematically analyzed, little is known, if any, as to how they manifest themselves in highly multimoded optical environments. In this work, by means of statistical mechanics, we formally address this open problem in optically thermalized weakly nonlinear heavily multimode tight-binding networks. The outlined thermodynamic formulation allows one to obtain in an elegant manner analytical results for the exerted thermodynamic pressures in utterly complex arrangements-results that are either computationally intensive or impossible to obtain otherwise. Thus, we derive simple closed-form expressions for the thermodynamic optical pressures displayed among elements, which depend only on the internal energy as well as the coupling coefficients involved. In all cases, our theoretical results are in excellent agreement with numerical computations. Our study may pave the way towards a deeper understanding of these complex processes and could open up avenues in harnessing radiation forces in multimode optomechanical systems.


title: Multi-Target XGBoostLSS Regression

abstract: Current implementations of Gradient Boosting Machines are mostly designed for single-target regression tasks and commonly assume independence between responses when used in multivariate settings. As such, these models are not well suited if non-negligible dependencies exist between targets. To overcome this limitation, we present an extension of XGBoostLSS that models multiple targets and their dependencies in a probabilistic regression setting. Empirical results show that our approach outperforms existing GBMs with respect to runtime and compares well in terms of accuracy.


title: Soft isogeometric analysis of the Bound States of a Quantum Three-Body Problem in 1D

abstract: The study of quantum three-body problems has been centered on low-energy states that rely on accurate numerical approximation. Recently, isogeometric analysis (IGA) has been adopted to solve the problem as an alternative but more robust (with respect to atom mass ratios) method that outperforms the classical Born-Oppenheimer (BO) approximation. In this paper, we focus on the performance of IGA and apply the recently-developed softIGA to reduce the spectral errors of the low-energy bound states. The main idea is to add high-order derivative-jump terms with a penalty parameter to the IGA bilinear forms. With an optimal choice of the penalty parameter, we observe eigenvalue error superconvergence. We focus on linear (finite elements) and quadratic elements and demonstrate the outperformance of softIGA over IGA through a variety of examples including both two- and three-body problems in 1D.


title: Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution Classes

abstract: Out-of-Distribution (OOD) detection is essential in real-world applications, which has attracted increasing attention in recent years. However, most existing OOD detection methods require many labeled In-Distribution (ID) data, causing a heavy labeling cost. In this paper, we focus on the more realistic scenario, where limited labeled data and abundant unlabeled data are available, and these unlabeled data are mixed with ID and OOD samples. We propose the Adaptive In-Out-aware Learning (AIOL) method, in which we employ the appropriate temperature to adaptively select potential ID and OOD samples from the mixed unlabeled data and consider the entropy over them for OOD detection. Moreover, since the test data in realistic applications may contain OOD samples whose classes are not in the mixed unlabeled data (we call them unseen OOD classes), data augmentation techniques are brought into the method to further improve the performance. The experiments are conducted on various benchmark datasets, which demonstrate the superiority of our method.


title: Heat flow in polygons with reflecting edges

abstract: We investigate the heat flow in an open, bounded set $D$ in $\mathbb{R}^2$ with polygonal boundary $\partial D$. We suppose that $D$ contains an open, bounded set $\widetilde{D}$ with polygonal boundary $\partial \widetilde{D}$. The initial condition is the indicator function of $\widetilde{D}$ and we impose a Neumann boundary condition on the edges of $\partial D$. We obtain an asymptotic formula for the heat content of $\widetilde{D}$ in $D$ as time $t\downarrow 0$.


title: Multi-agent Dynamic Algorithm Configuration

abstract: Automated algorithm configuration relieves users from tedious, trial-and-error tuning tasks. A popular algorithm configuration tuning paradigm is dynamic algorithm configuration (DAC), in which an agent learns dynamic configuration policies across instances by reinforcement learning (RL). However, in many complex algorithms, there may exist different types of configuration hyperparameters, and such heterogeneity may bring difficulties for classic DAC which uses a single-agent RL policy. In this paper, we aim to address this issue and propose multi-agent DAC (MA-DAC), with one agent working for one type of configuration hyperparameter. MA-DAC formulates the dynamic configuration of a complex algorithm with multiple types of hyperparameters as a contextual multi-agent Markov decision process and solves it by a cooperative multi-agent RL (MARL) algorithm. To instantiate, we apply MA-DAC to a well-known optimization algorithm for multi-objective optimization problems. Experimental results show the effectiveness of MA-DAC in not only achieving superior performance compared with other configuration tuning approaches based on heuristic rules, multi-armed bandits, and single-agent RL, but also being capable of generalizing to different problem classes. Furthermore, we release the environments in this paper as a benchmark for testing MARL algorithms, with the hope of facilitating the application of MARL.


title: SNN-SC: A Spiking Semantic Communication Framework for Feature Transmission

abstract: In Collaborative Intelligence (CI), Artificial Intelligence (AI) models are split between edge devices and cloud. Features extracted from input on edge devices are transmitted to the cloud for subsequent tasks. Extracting task-related and compact information is critical when transmission bandwidth is limited. In this paper, we propose a task-oriented Semantic Communication (SC) framework (SNN-SC) to address this problem. In SC, only important information for downstream tasks is extracted and transmitted. However, most of the existing SC works only transmit analog information on the AWGN channel and cannot be directly used for digital channels. SNN-SC fills this gap by using Spiking Neural Networks (SNNs) to extract and transmit semantic information. Since the outputs of SNNs are binary spikes, SNN-SC can be directly applied to digital channels. In SNN-SC, a new spiking neuron is proposed to help the cloud recover binary semantic information into informative floating-point features. Furthermore, we improve the performance of SNN-SC by maximizing the entropy of the semantic information. We evaluate the performance of SNN-SC on different collaborative classification models, digital channels, and bandwidths. The experimental results show that SNN-SC is more robust than the CNN-based SC framework and separate source and channel coding method on digital channels.


title: Astrophysical searches of ultralight particles

abstract: The Standard Model of particle physics is a $SU(3)_c\times SU(2)_L\times U(1)_Y$ gauge theory that can explain the strong, weak, and electromagnetic interactions between the particles. The gravitational interaction is described by Einstein's General Relativity theory which is a classical theory of gravity. These theories can explain all the four fundamental forces of nature with great level of accuracy. However, there are several theoretical and experimental motivations of studying physics beyond the Standard Model of particle physics and Einstein's General Relativity theory. Probing these new physics scenarios with ultralight particles has its own importance as they can be a promising candidates for dark matter that can evade the constraints from dark matter direct detection experiments and solve the small scale structure problems of the universe. In this paper, we have considered axions and gauge bosons as light particles and their possible searches through astrophysical observations. In particular, we obtain constraints on ultralight axions from orbital period loss of compact binary systems, gravitational light bending, and Shapiro time delay. We also derive constraints on ultralight gauge bosons from indirect evidence of gravitational waves, and perihelion precession of planets. Such type of observations can also constrain several particle physics models and are discussed.


title: $\texttt{RGESolver}$ : a $\texttt{C++}$ library to perform Renormalization Group evolution in the Standard Model Effective Theory

abstract: Renormalization group evolution above the electroweak scale is a crucial ingredient in the phenomenology of the Standard Model Effective Theory. The RGESolver open-source C++ library performs the evolution at leading order for dimension-six operators in the most general flavour scenario (assuming lepton and baryon number conservation). Given its efficiency, RGESolver can be used to include the effects of renormalization group evolution in extensive phenomenological analyses in the framework of the Standard Model Effective Theory.


title: Sparse-grids uncertainty quantification of part-scale additive manufacturing processes

abstract: The present paper aims at applying uncertainty quantification methodologies to process simulations of powder bed fusion of metal. In particular, for a part-scale thermomechanical model of an Inconel 625 super-alloy beam, we study the uncertainties of three process parameters, namely the activation temperature, the powder convection coefficient and the gas convection coefficient. First, we perform a variance-based global sensitivity analysis to study how each uncertain parameter contributes to the variability of the beam displacements. The results allow us to conclude that the gas convection coefficient has little impact and can therefore be fixed to a constant value for subsequent studies. Then, we conduct an inverse uncertainty quantification analysis, based on a Bayesian approach on synthetic displacements data, to quantify the uncertainties of the two remaining parameters, namely the activation temperature and the powder convection coefficient. Finally, we use the results of the inverse uncertainty quantification analysis to perform a data-informed forward uncertainty quantification analysis of the residual strains. Crucially, we make use of surrogate models based on sparse grids to keep to a minimum the computational burden of every step of the uncertainty quantification analysis. The proposed uncertainty quantification workflow allows us to substantially ease the typical trial-and-error approach used to calibrate power bed fusion part-scale models, and to greatly reduce uncertainties on the numerical prediction of the residual strains. In particular, we demonstrate the possibility of using displacement measurements to obtain a data-informed probability density function of the residual strains, a quantity much more complex to measure than displacements.


title: Forensic-Ready Risk Management Concepts

abstract: Currently, numerous approaches exist supporting the implementation of forensic readiness and, indirectly, forensic-ready software systems. However, the terminology used in the approaches and their focus tends to vary. To facilitate the design of forensic-ready software systems, the clarity of the underlying concepts needs to be established so that their requirements can be unambiguously formulated and assessed. This is especially important when considering forensic readiness as an add-on to information security. In this paper, the concepts relevant to forensic readiness are derived and aligned based on six existing approaches. The results then serve as a stepping stone for enhancing Information Systems Security Risk Management (ISSRM) with forensic readiness.


title: On the degree of global smoothings for subanalytic sets

abstract: In [4] Bierstone and Parusinski proved the existence of global smoothings for closed subanalytic sets, both in an embedded and a non-embedded sense. In particular, in the non-embedded desingularization procedure the authors construct smoothings of (generically) even degree, indeed it is well-known the existence of subanalytic sets which do not admit non-embedded smoothings of (generically) odd degree. In this paper we introduce a natural topological notion of nonbounding equator for subanalytic sets and we prove a criterion to determine whether a closed subanalytic set $X$ only admits global smoothings of even degree along the nonbounding equator. More in detail, we prove that if $X$ has a nonbounding equator $Y$ then every smoothing of $X$ which is a covering on a connected neighborhood $W$ of $Y$ has even degree over $W$.


title: Multivariate tail dependence and local stochastic dominance

abstract: Given two multivariate copulas with corresponding tail dependence functions, we investigate the relation between a natural tail dependence ordering $\leq_{tdo}$ and the order $\leq_{loc}$ of local stochastic dominance. We show that, although the two orderings are not equivalent in general, they coincide for various important classes of copulas, among them all multivariate Archimedean and bivariate lower extreme value copulas. We illustrate the relevance of our results by an implication to risk management.


title: Neighborhood Structure Configuration Models

abstract: We develop a new method to efficiently sample synthetic networks that preserve the d-hop neighborhood structure of a given network for any given d. The proposed algorithm trades off the diversity in network samples against the depth of the neighborhood structure that is preserved. Our key innovation is to employ a colored Configuration Model with colors derived from iterations of the so-called Color Refinement algorithm. We prove that with increasing iterations the preserved structural information increases: the generated synthetic networks and the original network become more and more similar, and are eventually indistinguishable in terms of centrality measures such as PageRank, HITS, Katz centrality and eigenvector centrality. Our work enables to efficiently generate samples with a precisely controlled similarity to the original network, especially for large networks.


title: Singular connection approach to topological phases and resonant optical responses

abstract: We introduce a class of singular connections as an alternative to the Berry connection for any family of quantum states defined over a parameter space. We find a natural application of the singular connection in the context of transition dipoles between two bands. We find that the shift vector is nothing but the difference between the singular connection and the connection induced from the Berry connections of involved bands; the gauge invariance of the shift vector is transparent from this expression. We show, using singular connections, that the topological invariant in two dimensions associated with optical transitions between the two bands can be computed, by means of this connection, by algebraically counting the points in the zero locus of a transition dipole matrix element of the two bands involved. It follows that this invariant provides a natural topological lower bound on the number of momenta in the Brillouin zone for which an electron cannot be excited from one Bloch band to the other by absorbing a photon.

categories: cond-mat.mes-hall cond-mat.quant-gas math-ph math.MP quant-ph


title: The Fine-Grained Complexity of Graph Homomorphism Parameterized by Clique-Width

abstract: The generic homomorphism problem, which asks whether an input graph $G$ admits a homomorphism into a fixed target graph $H$, has been widely studied in the literature. In this article, we provide a fine-grained complexity classification of the running time of the homomorphism problem with respect to the clique-width of $G$ (denoted $\operatorname{cw}$) for virtually all choices of $H$ under the Strong Exponential Time Hypothesis. In particular, we identify a property of $H$ called the signature number $s(H)$ and show that for each $H$, the homomorphism problem can be solved in time $\mathcal{O}^*(s(H)^{\operatorname{cw}})$. Crucially, we then show that this algorithm can be used to obtain essentially tight upper bounds. Specifically, we provide a reduction that yields matching lower bounds for each $H$ that is either a projective core or a graph admitting a factorization with additional properties -- allowing us to cover all possible target graphs under long-standing conjectures.


title: An $\alpha$-regret analysis of Adversarial Bilateral Trade

abstract: We study sequential bilateral trade where sellers and buyers valuations are completely arbitrary (i.e., determined by an adversary). Sellers and buyers are strategic agents with private valuations for the good and the goal is to design a mechanism that maximizes efficiency (or gain from trade) while being incentive compatible, individually rational and budget balanced. In this paper we consider gain from trade which is harder to approximate than social welfare. We consider a variety of feedback scenarios and distinguish the cases where the mechanism posts one price and when it can post different prices for buyer and seller. We show several surprising results about the separation between the different scenarios. In particular we show that (a) it is impossible to achieve sublinear $\alpha$-regret for any $\alpha<2$, (b) but with full feedback sublinear $2$-regret is achievable (c) with a single price and partial feedback one cannot get sublinear $\alpha$ regret for any constant $\alpha$ (d) nevertheless, posting two prices even with one-bit feedback achieves sublinear $2$-regret, and (e) there is a provable separation in the $2$-regret bounds between full and partial feedback.


title: Superconductivity in doped triangular Mott insulators: the roles of parent spin backgrounds and charge kinetic energy

abstract: We study the prerequisites for realizing superconductivity in doped triangular-lattice Mott insulators by considering three distinct parent spin backgrounds, i.e., $120^{\circ}$ antiferromagnets, quantum spin liquid, and stripy antiferromagnets, and all possible sign combinations $(\tau_1, \tau_2)$ of nearest-neighbor hopping and next-nearest-neighbor hopping $(t_1, t_2)$. Based on density-matrix renormalization group calculations, we find that, with finite $t_2$ and specific sign combinations $(\tau_1, \tau_2)$, the quasi-long-range superconductivity order can always be achieved, regardless of the nature of the parent spin backgrounds. Besides specific hopping signs $(\tau_1, \tau_2)$, these superconductivity phases in triangular lattices are commonly characterized by short-ranged spin correlations and two charges per stripe. In the robust superconductivity phase realized at larger $t_2/t_1$, flipping the signs $\tau_2$ and $\tau_1$ gives rise to the stripe phase without strong pairing and pseudogap-like phase without Cooper-pair phase coherence, respectively. Interestingly, the roles of the two hopping signs are switched at smaller $t_2/t_1$. Moreover, different sign combinations $(\tau_1, \tau_2)$ would stabilize distinct phases including superconductivity, charge density waves, spin density waves, and pseudogap-like phases accordingly. Our findings suggest the important role of charge kinetic energy in realizing superconductivity in doped triangular-lattice Mott insulators.


title: Topological entropy of nonautonomous dynamical systems on uniform spaces

abstract: In this paper, we focus on some properties, calculations and estimations of topological entropy for a nonautonomous dynamical system $(X,f_{0,\infty})$ generated by a sequence of continuous self-maps $f_{0,\infty}=\{f_n\}_{n=0}^{\infty}$ on a compact uniform space $X$. We obtain the relations of topological entropy among $(X, f_{0,\infty})$, its $k$-th product system and its $n$-th iteration system. We confirm that the entropy of $(X, f_{0,\infty})$ equals to that of $f_{0,\infty}$ restricted to its non-wandering set provided that $f_{0,\infty}$ is equi-continuous. We prove that the entropy of $(X, f_{0,\infty})$ is less than or equal to that of its limit system $(X, f)$ when $f_{0,\infty}$ converges uniformly to $f$. We show that two topologically equi-semiconjugate systems have the same entropy if the equi-semiconjugacy is finite-to-one. Finally, we derive the estimations of upper and lower bounds of entropy for an invariant subsystem of a coupled-expanding system associated with a transition matrix.


title: Retrospectives on the Embodied AI Workshop

abstract: We present a retrospective on the state of Embodied AI research. Our analysis focuses on 13 challenges presented at the Embodied AI Workshop at CVPR. These challenges are grouped into three themes: (1) visual navigation, (2) rearrangement, and (3) embodied vision-and-language. We discuss the dominant datasets within each theme, evaluation metrics for the challenges, and the performance of state-of-the-art models. We highlight commonalities between top approaches to the challenges and identify potential future directions for Embodied AI research.