title: Few-Shot Continual Active Learning by a Robot

abstract: In this paper, we consider a challenging but realistic continual learning (CL) problem, Few-Shot Continual Active Learning (FoCAL), where a CL agent is provided with unlabeled data for a new or a previously learned task in each increment and the agent only has limited labeling budget available. Towards this, we build on the continual learning and active learning literature and develop a framework that can allow a CL agent to continually learn new object classes from a few labeled training examples. Our framework represents each object class using a uniform Gaussian mixture model (GMM) and uses pseudo-rehearsal to mitigate catastrophic forgetting. The framework also uses uncertainty measures on the Gaussian representations of the previously learned classes to find the most informative samples to be labeled in an increment. We evaluate our approach on the CORe-50 dataset and on a real humanoid robot for the object classification task. The results show that our approach not only produces state-of-the-art results on the dataset but also allows a real robot to continually learn unseen objects in a real environment with limited labeling supervision provided by its user.


title: Origin of negative electrocaloric effect in Pnma-type antiferroelectric perovskites

abstract: Anomalous electrocaloric effect (ECE) with decreasing temperature upon application of an electric field is known to occur in antiferroelectrics (AFEs), and previous understanding refers to the field-induced canting of electric dipoles if there is no phase transitions. Here, we use a first-principle-based method to study the ECE in Nd-substituted BiFeO3 (BNFO) perovskite solid solutions, which has the Pnma-type AFE ground state. We demonstrate another scenario to achieve and explain anomalous ECE, emphasizing that explicit consideration of octahedral tiltings is indispensable for a correct understanding. This mechanism may be general for AFEs for which the antipolar mode is not the primary order parameter. We also find that the negative ECE can reach a large magnitude in BNFO.


title: Cographs and 1-sums

abstract: A graph that can be generated from $K_1$ using joins and 0-sums is called a cograph. We define a sesquicograph to be a graph that can be generated from $K_1$ using joins, 0-sums, and 1-sums. We show that, like cographs, sesquicographs are closed under induced minors. Cographs are precisely the graphs that do not have the 4-vertex path as an induced subgraph. We obtain an analogue of this result for sesquicographs, that is, we find those non-sesquicographs for which every proper induced subgraph is a sesquicograph.


title: Bayesian Repulsive Mixture Modeling with Mat\'ern Point Processes

abstract: Mixture models are a standard tool in statistical analysis, widely used for density modeling and model-based clustering. Current approaches typically model the parameters of the mixture components as independent variables. This can result in overlapping or poorly separated clusters when either the number of clusters or the form of the mixture components is misspecified. Such model misspecification can undermine the interpretability and simplicity of these mixture models. To address this problem, we propose a Bayesian mixture model with repulsion between mixture components. The repulsion is induced by a generalized Mat\'ern type-III repulsive point process model, obtained through a dependent sequential thinning scheme on a primary Poisson point process. We derive a novel and efficient Gibbs sampler for posterior inference, and demonstrate the utility of the proposed method on a number of synthetic and real-world problems.


title: Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment

abstract: Word alignment which aims to extract lexicon translation equivalents between source and target sentences, serves as a fundamental tool for natural language processing. Recent studies in this area have yielded substantial improvements by generating alignments from contextualized embeddings of the pre-trained multilingual language models. However, we find that the existing approaches capture few interactions between the input sentence pairs, which degrades the word alignment quality severely, especially for the ambiguous words in the monolingual context. To remedy this problem, we propose Cross-Align to model deep interactions between the input sentence pairs, in which the source and target sentences are encoded separately with the shared self-attention modules in the shallow layers, while cross-lingual interactions are explicitly constructed by the cross-attention modules in the upper layers. Besides, to train our model effectively, we propose a two-stage training framework, where the model is trained with a simple Translation Language Modeling (TLM) objective in the first stage and then finetuned with a self-supervised alignment objective in the second stage. Experiments show that the proposed Cross-Align achieves the state-of-the-art (SOTA) performance on four out of five language pairs.


title: Deep Clustering: A Comprehensive Survey

abstract: Cluster analysis plays an indispensable role in machine learning and data mining. Learning a good data representation is crucial for clustering algorithms. Recently, deep clustering, which can learn clustering-friendly representations using deep neural networks, has been broadly applied in a wide range of clustering tasks. Existing surveys for deep clustering mainly focus on the single-view fields and the network architectures, ignoring the complex application scenarios of clustering. To address this issue, in this paper we provide a comprehensive survey for deep clustering in views of data sources. With different data sources and initial conditions, we systematically distinguish the clustering methods in terms of methodology, prior knowledge, and architecture. Concretely, deep clustering methods are introduced according to four categories, i.e., traditional single-view deep clustering, semi-supervised deep clustering, deep multi-view clustering, and deep transfer clustering. Finally, we discuss the open challenges and potential future opportunities in different fields of deep clustering.


title: Strong Gravitational Lensing Parameter Estimation with Vision Transformer

abstract: Quantifying the parameters and corresponding uncertainties of hundreds of strongly lensed quasar systems holds the key to resolving one of the most important scientific questions: the Hubble constant ($H_{0}$) tension. The commonly used Markov chain Monte Carlo (MCMC) method has been too time-consuming to achieve this goal, yet recent work has shown that convolution neural networks (CNNs) can be an alternative with seven orders of magnitude improvement in speed. With 31,200 simulated strongly lensed quasar images, we explore the usage of Vision Transformer (ViT) for simulated strong gravitational lensing for the first time. We show that ViT could reach competitive results compared with CNNs, and is specifically good at some lensing parameters, including the most important mass-related parameters such as the center of lens $\theta_{1}$ and $\theta_{2}$, the ellipticities $e_1$ and $e_2$, and the radial power-law slope $\gamma'$. With this promising preliminary result, we believe the ViT (or attention-based) network architecture can be an important tool for strong lensing science for the next generation of surveys. The open source of our code and data is in \url{https://github.com/kuanweih/strong_lensing_vit_resnet}.


title: Adaptive Distribution Calibration for Few-Shot Learning with Hierarchical Optimal Transport

abstract: Few-shot classification aims to learn a classifier to recognize unseen classes during training, where the learned model can easily become over-fitted based on the biased distribution formed by only a few training examples. A recent solution to this problem is calibrating the distribution of these few sample classes by transferring statistics from the base classes with sufficient examples, where how to decide the transfer weights from base classes to novel classes is the key. However, principled approaches for learning the transfer weights have not been carefully studied. To this end, we propose a novel distribution calibration method by learning the adaptive weight matrix between novel samples and base classes, which is built upon a hierarchical Optimal Transport (H-OT) framework. By minimizing the high-level OT distance between novel samples and base classes, we can view the learned transport plan as the adaptive weight information for transferring the statistics of base classes. The learning of the cost function between a base class and novel class in the high-level OT leads to the introduction of the low-level OT, which considers the weights of all the data samples in the base class. Experimental results on standard benchmarks demonstrate that our proposed plug-and-play model outperforms competing approaches and owns desired cross-domain generalization ability, indicating the effectiveness of the learned adaptive weights.


title: Fine-grained Anomaly Detection in Sequential Data via Counterfactual Explanations

abstract: Anomaly detection in sequential data has been studied for a long time because of its potential in various applications, such as detecting abnormal system behaviors from log data. Although many approaches can achieve good performance on anomalous sequence detection, how to identify the anomalous entries in sequences is still challenging due to a lack of information at the entry-level. In this work, we propose a novel framework called CFDet for fine-grained anomalous entry detection. CFDet leverages the idea of interpretable machine learning. Given a sequence that is detected as anomalous, we can consider anomalous entry detection as an interpretable machine learning task because identifying anomalous entries in the sequence is to provide an interpretation to the detection result. We make use of the deep support vector data description (Deep SVDD) approach to detect anomalous sequences and propose a novel counterfactual interpretation-based approach to identify anomalous entries in the sequences. Experimental results on three datasets show that CFDet can correctly detect anomalous entries.


title: Inference in parametric models with many L-moments

abstract: L-moments are expected values of linear combinations of order statistics that provide robust alternatives to traditional moments. The estimation of parametric models by matching sample L-moments has been shown to outperform maximum likelihood estimation (MLE) in small samples from popular distributions. The choice of the number of L-moments to be used in estimation remains ad-hoc, though: researchers typically set the number of L-moments equal to the number of parameters, as to achieve an order condition for identification. This approach is generally inefficient in larger samples. In this paper, we show that, by properly choosing the number of L-moments and weighting these accordingly, we are able to construct an estimator that outperforms MLE in finite samples, and yet does not suffer from efficiency losses asymptotically. We do so by considering a "generalised" method of L-moments estimator and deriving its asymptotic properties in a framework where the number of L-moments varies with sample size. We then propose methods to automatically select the number of L-moments in a given sample. Monte Carlo evidence shows our proposed approach is able to outperform (in a mean-squared error sense) MLE in smaller samples, whilst working as well as it in larger samples. We then consider extensions of our approach to conditional and semiparametric models, and apply the latter to study expenditure patterns in a ridesharing platform in Brazil.


title: The Possibility of Mirror Planet as Planet Nine in Solar System

abstract: A series of dynamical anomalies in the orbits of distant trans-Neptunian objects points to a new celestial body (usually named Planet Nine) in the solar system. In this draft, we point out that a mirror planet captured from the outer solar system or formed in the solar system is also a possible candidate. The introduction of the mirror matter model is due to an unbroken parity symmetry and is a potential explanation for dark matter. This mirror planet has null or fainter electromagnetic counterparts with a smaller optical radius and might be explored through gravitational effects.


title: Trace Formula of Semicommutators

abstract: For weighted Bergman spaces on the unit disk, we give trace formulas of semicommutators of Toeplitz operators with $\mathscr{C}^2(\overline{\mathbb{D}})$ symbols. We generalize this formula to weighted Bergman spaces on the unit ball in higher dimensions. Applications and examples on the Hankel operators are also discussed.


title: Take a Fresh Look at Recommender Systems from an Evaluation Standpoint

abstract: Recommendation has become a prominent area of research in the field of Information Retrieval (IR). Evaluation is also a traditional research topic in this community. Motivated by a few counter-intuitive observations reported in recent studies, this perspectives paper takes a fresh look at recommender systems from an evaluation standpoint. Rather than examining metrics like recall, hit rate, or NDCG, or perspectives like novelty and diversity, the key focus here is on how these metrics are calculated when evaluating a recommender algorithm. Specifically, the commonly used train/test data splits and their consequences are re-examined. We begin by examining common data splitting methods, such as random split or leave-one-out, and discuss why the popularity baseline is poorly defined under such splits. We then move on to explore the two implications of neglecting a global timeline during evaluation: data leakage and oversimplification of user preference modeling. Afterwards, we present new perspectives on recommender systems, including techniques for evaluating algorithm performance that more accurately reflect real-world scenarios, and possible approaches to consider decision contexts in user preference modeling.


title: Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP

abstract: Open-vocabulary semantic segmentation aims to segment an image into semantic regions according to text descriptions, which may not have been seen during training. Recent two-stage methods first generate class-agnostic mask proposals and then leverage pre-trained vision-language models, e.g., CLIP, to classify masked regions. We identify the performance bottleneck of this paradigm to be the pre-trained CLIP model, since it does not perform well on masked images. To address this, we propose to finetune CLIP on a collection of masked image regions and their corresponding text descriptions. We collect training data by mining an existing image-caption dataset (e.g., COCO Captions), using CLIP to match masked image regions to nouns in the image captions. Compared with the more precise and manually annotated segmentation labels with fixed classes (e.g., COCO-Stuff), we find our noisy but diverse dataset can better retain CLIP's generalization ability. Along with finetuning the entire model, we utilize the "blank" areas in masked images using a method we dub mask prompt tuning. Experiments demonstrate mask prompt tuning brings significant improvement without modifying any weights of CLIP, and it can further improve a fully finetuned model. In particular, when trained on COCO and evaluated on ADE20K-150, our best model achieves 29.6% mIoU, which is +8.5% higher than the previous state-of-the-art. For the first time, open-vocabulary generalist models match the performance of supervised specialist models in 2017 without dataset-specific adaptations.


title: Prediction of Drug-Induced TdP Risks Using Machine Learning and Rabbit Ventricular Wedge Assay

abstract: Torsades de pointes (TdP) is an irregular heart rhythm as a side effect of drugs and may cause sudden cardiac death. A machine learning model that can accurately identify drug TdP risk is necessary. This study uses multinomial logistic regression models to predict three-class drug TdP risks based on datasets generated from rabbit ventricular wedge assay experiments. The training-test split and five-fold cross-validation provide unbiased measurements for prediction accuracy. We utilize bootstrap to construct a 95% confidence interval for prediction accuracy. The model interpretation is further demonstrated by permutation predictor importance. Our study offers an interpretable modeling method suitable for drug TdP risk prediction. Our method can be easily generalized to broader applications of drug side effect assessment.


title: A Contextual Bandit Approach for Value-oriented Prediction Interval Forecasting

abstract: Prediction interval (PI) is an effective tool to quantify uncertainty and usually serves as an input to downstream robust optimization. Traditional approaches focus on improving the quality of PI in the view of statistical scores and assume the improvement in quality will lead to a higher value in the power systems operation. However, such an assumption cannot always hold in practice. In this paper, we propose a value-oriented PI forecasting approach, which aims at reducing operational costs in downstream operations. For that, it is required to issue PIs with the guidance of operational costs in robust optimization, which is addressed within the contextual bandit framework here. Concretely, the agent is used to select the optimal quantile proportion, while the environment reveals the costs in operations as rewards to the agent. As such, the agent can learn the policy of quantile proportion selection for minimizing the operational cost. The numerical study regarding a two-timescale operation of a virtual power plant verifies the superiority of the proposed approach in terms of operational value. And it is especially evident in the context of extensive penetration of wind power.


title: Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing

abstract: Residual networks have shown great success and become indispensable in today's deep models. In this work, we aim to re-investigate the training process of residual networks from a novel social psychology perspective of loafing, and further propose a new training strategy to strengthen the performance of residual networks. As residual networks can be viewed as ensembles of relatively shallow networks (i.e., \textit{unraveled view}) in prior works, we also start from such view and consider that the final performance of a residual network is co-determined by a group of sub-networks. Inspired by the social loafing problem of social psychology, we find that residual networks invariably suffer from similar problem, where sub-networks in a residual network are prone to exert less effort when working as part of the group compared to working alone. We define this previously overlooked problem as \textit{network loafing}. As social loafing will ultimately cause the low individual productivity and the reduced overall performance, network loafing will also hinder the performance of a given residual network and its sub-networks. Referring to the solutions of social psychology, we propose \textit{stimulative training}, which randomly samples a residual sub-network and calculates the KL-divergence loss between the sampled sub-network and the given residual network, to act as extra supervision for sub-networks and make the overall goal consistent. Comprehensive empirical results and theoretical analyses verify that stimulative training can well handle the loafing problem, and improve the performance of a residual network by improving the performance of its sub-networks. The code is available at https://github.com/Sunshine-Ye/NIPS22-ST .


title: Self-supervised Video Representation Learning with Motion-Aware Masked Autoencoders

abstract: Masked autoencoders (MAEs) have emerged recently as art self-supervised spatiotemporal representation learners. Inheriting from the image counterparts, however, existing video MAEs still focus largely on static appearance learning whilst are limited in learning dynamic temporal information hence less effective for video downstream tasks. To resolve this drawback, in this work we present a motion-aware variant -- MotionMAE. Apart from learning to reconstruct individual masked patches of video frames, our model is designed to additionally predict the corresponding motion structure information over time. This motion information is available at the temporal difference of nearby frames. As a result, our model can extract effectively both static appearance and dynamic motion spontaneously, leading to superior spatiotemporal representation learning capability. Extensive experiments show that our MotionMAE outperforms significantly both supervised learning baseline and state-of-the-art MAE alternatives, under both domain-specific and domain-generic pretraining-then-finetuning settings. In particular, when using ViT-B as the backbone our MotionMAE surpasses the prior art model by a margin of 1.2% on Something-Something V2 and 3.2% on UCF101 in domain-specific pretraining setting. Encouragingly, it also surpasses the competing MAEs by a large margin of over 3% on the challenging video object segmentation task. The code is available at https://github.com/happy-hsy/MotionMAE.


title: Constrained Maximum Cross-Domain Likelihood for Domain Generalization

abstract: As a recent noticeable topic, domain generalization aims to learn a generalizable model on multiple source domains, which is expected to perform well on unseen test domains. Great efforts have been made to learn domain-invariant features by aligning distributions across domains. However, existing works are often designed based on some relaxed conditions which are generally hard to satisfy and fail to realize the desired joint distribution alignment. In this paper, we propose a novel domain generalization method, which originates from an intuitive idea that a domain-invariant classifier can be learned by minimizing the KL-divergence between posterior distributions from different domains. To enhance the generalizability of the learned classifier, we formalize the optimization objective as an expectation computed on the ground-truth marginal distribution. Nevertheless, it also presents two obvious deficiencies, one of which is the side-effect of entropy increase in KL-divergence and the other is the unavailability of ground-truth marginal distributions. For the former, we introduce a term named maximum in-domain likelihood to maintain the discrimination of the learned domain-invariant representation space. For the latter, we approximate the ground-truth marginal distribution with source domains under a reasonable convex hull assumption. Finally, a Constrained Maximum Cross-domain Likelihood (CMCL) optimization problem is deduced, by solving which the joint distributions are naturally aligned. An alternating optimization strategy is carefully designed to approximately solve this optimization problem. Extensive experiments on four standard benchmark datasets, i.e., Digits-DG, PACS, Office-Home and miniDomainNet, highlight the superior performance of our method.


title: Optimal Fault-Tolerant Data Fusion in Sensor Networks: Fundamental Limits and Efficient Algorithms

abstract: Distributed estimation in the context of sensor networks is considered, where distributed agents are given a set of sensor measurements, and are tasked with estimating a target variable. A subset of sensors are assumed to be faulty. The objective is to minimize i) the mean square estimation error at each node (accuracy objective), and ii) the mean square distance between the estimates at each pair of nodes (consensus objective). It is shown that there is an inherent tradeoff between the former and latter objectives. Assuming a general stochastic model, the sensor fusion algorithm optimizing this tradeoff is characterized through a computable optimization problem, and a Cramer-Rao type lower bound for the achievable accuracy-consensus loss is obtained. Finding the optimal sensor fusion algorithm is computationally complex. To address this, a general class of low-complexity Brooks-Iyengar Algorithms are introduced, and their performance, in terms of accuracy and consensus objectives, is compared to that of optimal linear estimators through case study simulations of various scenarios.


title: The Role of Coverage in Online Reinforcement Learning

abstract: Coverage conditions -- which assert that the data logging distribution adequately covers the state space -- play a fundamental role in determining the sample complexity of offline reinforcement learning. While such conditions might seem irrelevant to online reinforcement learning at first glance, we establish a new connection by showing -- somewhat surprisingly -- that the mere existence of a data distribution with good coverage can enable sample-efficient online RL. Concretely, we show that coverability -- that is, existence of a data distribution that satisfies a ubiquitous coverage condition called concentrability -- can be viewed as a structural property of the underlying MDP, and can be exploited by standard algorithms for sample-efficient exploration, even when the agent does not know said distribution. We complement this result by proving that several weaker notions of coverage, despite being sufficient for offline RL, are insufficient for online RL. We also show that existing complexity measures for online RL, including Bellman rank and Bellman-Eluder dimension, fail to optimally capture coverability, and propose a new complexity measure, the sequential extrapolation coefficient, to provide a unification.


title: HVS Revisited: A Comprehensive Video Quality Assessment Framework

abstract: Video quality is a primary concern for video service providers. In recent years, the techniques of video quality assessment (VQA) based on deep convolutional neural networks (CNNs) have been developed rapidly. Although existing works attempt to introduce the knowledge of the human visual system (HVS) into VQA, there still exhibit limitations that prevent the full exploitation of HVS, including an incomplete model by few characteristics and insufficient connections among these characteristics. To overcome these limitations, this paper revisits HVS with five representative characteristics, and further reorganizes their connections. Based on the revisited HVS, a no-reference VQA framework called HVS-5M (NRVQA framework with five modules simulating HVS with five characteristics) is proposed. It works in a domain-fusion design paradigm with advanced network structures. On the side of the spatial domain, the visual saliency module applies SAMNet to obtain a saliency map. And then, the content-dependency and the edge masking modules respectively utilize ConvNeXt to extract the spatial features, which have been attentively weighted by the saliency map for the purpose of highlighting those regions that human beings may be interested in. On the other side of the temporal domain, to supplement the static spatial features, the motion perception module utilizes SlowFast to obtain the dynamic temporal features. Besides, the temporal hysteresis module applies TempHyst to simulate the memory mechanism of human beings, and comprehensively evaluates the quality score according to the fusion features from the spatial and temporal domains. Extensive experiments show that our HVS-5M outperforms the state-of-the-art VQA methods. Ablation studies are further conducted to verify the effectiveness of each module towards the proposed framework.


title: Observation of superconductivity in the noncentrosymmetric nodal chain semimetal Ba5In4Bi5

abstract: The combination with superconductivity and topological nontrivial band structure provides a promising route towards novel quantum states such as topological superconductivity. Here, we report the first observation of superconductivity (4.1 K) in Ba5In4Bi5 single crystal, a noncentrosymmetric topological semimetal featuring nodal chain loops at the high-symmetry points R and X. The magnetization, resistivity, and specific heat capacity measurements reveal that Ba5In4Bi5 is a moderately coupled type-II Bardeen-Cooper-Schrieffer superconductor. Bulk superconductivity is suggested from the magnetic susceptibility and specific heat measurements. The results show that Ba5In4Bi5 provides a new platform for exploring the relationship of superconductivity and topological nontrivial band topology.


title: Regular graphs with a complete bipartite graph as a star complement

abstract: Let $G$ be a graph of order $n$ and $\mu$ be an adjacency eigenvalue of $G$ with multiplicity $k\geq 1$. A star complement $H$ for $\mu$ in $G$ is an induced subgraph of $G$ of order $n-k$ with no eigenvalue $\mu$, and the vertex subset $X=V(G-H)$ is called a star set for $\mu$ in $G$. The study of star complements and star sets provides a strong link between graph structure and linear algebra. In this paper, we study the regular graphs with $K_{t,s}\ (s\geq t\geq 2)$ as a star complement for an eigenvalue $\mu$, especially, characterize the case of $t=3$ completely, obtain some properties when $t=s$, and propose some problems for further study.


title: Cross-strait Variations on Two Near-synonymous Loanwords xie2shang1 and tan2pan4: A Corpus-based Comparative Study

abstract: This study attempts to investigate cross-strait variations on two typical synonymous loanwords in Chinese, i.e. xie2shang1 and tan2pan4, drawn on MARVS theory. Through a comparative analysis, the study found some distributional, eventual, and contextual similarities and differences across Taiwan and Mainland Mandarin. Compared with the underused tan2pan4, xie2shang1 is significantly overused in Taiwan Mandarin and vice versa in Mainland Mandarin. Additionally, though both words can refer to an inchoative process in Mainland and Taiwan Mandarin, the starting point for xie2shang1 in Mainland Mandarin is somewhat blurring compared with the usage in Taiwan Mandarin. Further on, in Taiwan Mandarin, tan2pan4 can be used in economic and diplomatic contexts, while xie2shang1 is used almost exclusively in political contexts. In Mainland Mandarin, however, the two words can be used in a hybrid manner within political contexts; moreover, tan2pan4 is prominently used in diplomatic contexts with less reference to economic activities, while xie2sahng1 can be found in both political and legal contexts, emphasizing a role of mediation.


title: New Parameter Measurements for the Ultra-Short-Period Planet TOI-1807b

abstract: The ultra-short-period (USP) planets are exoplanets with very short orbital periods ($\textit{P} < 1$ day), and TOI-1807b is one such planet recently discovered by the TESS mission where it orbits in the TOI-1807 system that is still little known nowadays. In this paper, we re-analyzed the transit light curves of TOI-1807 using the latest TESS data from Sector 49, combined with previous data from Sector 22 and 23. By running the MCMC simulation through all three sectors, we found that our transit model fits the data from Sector 49 the best, and we deduced that TOI-1807b is a Super-Earth with a mass of $2.27^{+0.49}_{-0.58}\, M_\oplus$, a radius of $1.37^{+0.10}_{-0.09}\, R_\oplus$, a density of $0.875^{+0.264}_{-0.285}\, \rho_\oplus$, and a surface temperature of $1499^{+82}_{-129}\, \mathrm{K}$. We confirmed that TOI-1807b orbits at approximately $0.0135^{+0.0013}_{-0.0022}\, \mathrm{AU}$ with a period of $0.54929^{+0.00012}_{-0.00005}\, \mathrm{days}$, which raises the possibility of the planet being tidally locked due to spin-orbit synchronization. In addition, we suggest that TOI-1807b might slowly undergo its orbital decay process, and we further identify that TOI-1807b is in a circular, synchronous orbit and permanently deformed due to tides, leading to $\sim$4% correction in density. Since TOI-1807 is such a young star with an age of only $300 \pm 80\, \mathrm{Myr}$, we also imply that the radiation emitted from active TOI-1807 could be so intense that it might have destroyed most of the atmosphere over the surface of TOI-1807b.


title: Particle and thermal transport through one dimensional topological systems via Lindblad formalism

abstract: We apply the Lindblad quantum master equation to two examples of one-dimensional topological systems, the Su-Schrieffer-Heeger (SSH) model and Kitaev chain, to study their particle and thermal transport. The steady-state properties are obtained by decomposing fermions into Majorana fermions and extracting their correlation functions. We focus on the particle and thermal currents flowing through the bulk when the system is driven by two reservoirs coupled to the two ends. The ratio of the currents of the SSH model from the topological and trivial regimes with the same bandwidth demonstrates suppression of transport due to the edge states, which couple to the reservoirs but do not participate in transport. A similar comparison cannot be performed for the Kitaev chain because the topological and trivial regimes have different bandwidths, and the edge states are less significant away from the transition. Therefore, the results contrast various topological properties in quantum transport.


title: On the Fourier coefficients of word maps on unitary groups

abstract: Given a word $w(x_{1},\ldots,x_{r})$, i.e., an element in the free group on $r$ elements, and an integer $d\geq1$, we study the characteristic polynomial of the random matrix $w(X_{1},\ldots,X_{r})$, where $X_{i}$ are Haar-random independent $d\times d$ unitary matrices. If $c_{m}(X)$ denotes the $m$-th coefficient of the characteristic polynomial of $X$, our main theorem implies that there is a positive constant $\epsilon(w)$, depending only on $w$, such that \[ \left|\mathbb{E}\left(c_{m}\left(w(X_{1},\ldots,X_{r})\right)\right)\right|\leq\left(\begin{array}{c} d\\ m \end{array}\right)^{1-\epsilon(w)}, \] for every $d$ and every $1\leq m\leq d$. Our main computational tool is the Weingarten Calculus, which allows us to express integrals on unitary groups such as the expectation above, as certain sums on symmetric groups. We exploit a hidden symmetry to find cancellations in the sum expressing $\mathbb{E}\left(c_{m}(w)\right)$. These cancellations, coming from averaging a Weingarten function over cosets, follow from Schur's orthogonality relations.


title: Neural Extended Kalman Filters for Learning and Predicting Dynamics of Structural Systems

abstract: Accurate structural response prediction forms a main driver for structural health monitoring and control applications. This often requires the proposed model to adequately capture the underlying dynamics of complex structural systems. In this work, we utilize a learnable Extended Kalman Filter (EKF), named the Neural Extended Kalman Filter (Neural EKF) throughout this paper, for learning the latent evolution dynamics of complex physical systems. The Neural EKF is a generalized version of the conventional EKF, where the modeling of process dynamics and sensory observations can be parameterized by neural networks, therefore learned by end-to-end training. The method is implemented under the variational inference framework with the EKF conducting inference from sensing measurements. Typically, conventional variational inference models are parameterized by neural networks independent of the latent dynamics models. This characteristic makes the inference and reconstruction accuracy weakly based on the dynamics models and renders the associated training inadequate. In this work, we show that the structure imposed by the Neural EKF is beneficial to the learning process. We demonstrate the efficacy of the framework on both simulated and real-world structural monitoring datasets, with the results indicating significant predictive capabilities of the proposed scheme.


title: Test-time Recalibration of Conformal Predictors Under Distribution Shift Based on Unlabeled Examples

abstract: Modern image classifiers are very accurate, but the predictions come without uncertainty estimates. Conformal predictors provide uncertainty estimates by computing a set of classes containing the correct class with a user-specified probability based on the classifier's probability estimates. To provide such sets, conformal predictors often estimate a cutoff threshold for the probability estimates based on a calibration set. Conformal predictors guarantee reliability only when the calibration set is from the same distribution as the test set. Therefore, conformal predictors need to be recalibrated for new distributions. However, in practice, labeled data from new distributions is rarely available, making calibration infeasible. In this work, we consider the problem of predicting the cutoff threshold for a new distribution based on unlabeled examples. While it is impossible in general to guarantee reliability when calibrating based on unlabeled examples, we propose a method that provides excellent uncertainty estimates under natural distribution shifts, and provably works for a specific model of a distribution shift.


title: Optimal Execution with Identity Optionality

abstract: This paper investigates the impact of anonymous trading on the agents' strategy in an optimal execution framework. It mainly explores the specificity of order attribution on the Toronto Stock Exchange, where brokers can choose to either trade with their own identity or under a generic anonymous code that is common to all the brokers. We formulate a stochastic differential game for the optimal execution problem of a population of $N$ brokers and incorporate permanent and temporary price impacts for both the identity-revealed and anonymous trading processes. We then formulate the limiting mean-field game of controls with common noise and obtain a solution in closed-form via the probabilistic approach for the Almgren-Chris price impact framework. Finally, we perform a sensitivity analysis to explore the impact of the model parameters on the optimal strategy.


title: Galaxy Spin Classification I: Z-wise vs S-wise Spirals With Chirality Equivariant Residual Network

abstract: The angular momentum of galaxies (galaxy spin) contains rich information about the initial condition of the Universe, yet it is challenging to efficiently measure the spin direction for the tremendous amount of galaxies that are being mapped by the ongoing and forthcoming cosmological surveys. We present a machine learning based classifier for the Z-wise vs S-wise spirals, which can help to break the degeneracy in the galaxy spin direction measurement. The proposed Chirality Equivariant Residual Network (CE-ResNet) is manifestly equivariant under a reflection of the input image, which guarantees that there is no inherent asymmetry between the Z-wise and S-wise probability estimators. We train the model with Sloan Digital Sky Survey (SDSS) images, with the training labels given by the Galaxy Zoo 1 (GZ1) project. A combination of data augmentation tricks are used during the training, making the model more robust to be applied to other surveys. We find a $\sim\!30\%$ increase of both types of spirals when Dark Energy Spectroscopic Instrument (DESI) images are used for classification, due to the better imaging quality of DESI. We verify that the $\sim\!7\sigma$ difference between the numbers of Z-wise and S-wise spirals is due to human bias, since the discrepancy drops to $<\!1.8\sigma$ with our CE-ResNet classification results. We discuss the potential systematics that are relevant to the future cosmological applications.

categories: astro-ph.CO astro-ph.GA astro-ph.IM cs.LG


title: A State Feedback Controller for Mitigation of Continuous-Time Networked SIS Epidemics

abstract: The paper considers continuous-time networked susceptible-infected-susceptible (SIS) diseases spreading over a population. Each agent represents a sub-population and has its own healing rate and infection rate; the state of the agent at a time instant denotes what fraction of the said sub-population is infected with the disease at the said time instant. By taking account of the changes in behaviors of the agents in response to the infection rates in real-time, our goal is to devise a feedback strategy such that the infection level for each agent strictly stays below a pre-specified value. Furthermore, we are also interested in ensuring that the closed-loop system converges either to the disease-free equilibrium or, when it exists, to the endemic equilibrium. The upshot of devising such a strategy is that it allows health administration officials to ensure that there is sufficient capacity in the healthcare system to treat the most severe cases. We demonstrate the effectiveness of our controller via numerical examples.


title: Multi-Objective Personalized Product Retrieval in Taobao Search

abstract: In large-scale e-commerce platforms like Taobao, it is a big challenge to retrieve products that satisfy users from billions of candidates. This has been a common concern of academia and industry. Recently, plenty of works in this domain have achieved significant improvements by enhancing embedding-based retrieval (EBR) methods, including the Multi-Grained Deep Semantic Product Retrieval (MGDSPR) model [16] in Taobao search engine. However, we find that MGDSPR still has problems of poor relevance and weak personalization compared to other retrieval methods in our online system, such as lexical matching and collaborative filtering. These problems promote us to further strengthen the capabilities of our EBR model in both relevance estimation and personalized retrieval. In this paper, we propose a novel Multi-Objective Personalized Product Retrieval (MOPPR) model with four hierarchical optimization objectives: relevance, exposure, click and purchase. We construct entire-space multi-positive samples to train MOPPR, rather than the single-positive samples for existing EBR models.We adopt a modified softmax loss for optimizing multiple objectives. Results of extensive offline and online experiments show that MOPPR outperforms the baseline MGDSPR on evaluation metrics of relevance estimation and personalized retrieval. MOPPR achieves 0.96% transaction and 1.29% GMV improvements in a 28-day online A/B test. Since the Double-11 shopping festival of 2021, MOPPR has been fully deployed in mobile Taobao search, replacing the previous MGDSPR. Finally, we discuss several advanced topics of our deeper explorations on multi-objective retrieval and ranking to contribute to the community.


title: Nitrogen-vacancy singlet manifold ionization energy

abstract: The singlet states of the negatively-charged nitrogen-vacancy centers in diamond play a key role in its optical spin control and readout. In this work, the hitherto unknown ionization energy of the singlet is measured experimentally and found to be between 1.91-2.25 eV. This is obtained by analyzing photoluminescence measurements incorporating spin control and NV charge state differentiation, along with simulations based on the nitrogen-vacancy's master equation. This work establishes a protocol for a more accurate estimate of this ionization energy, which can possibly lead to improved read-out methods.


title: A Transformer-based deep neural network model for SSVEP classification

abstract: Steady-state visual evoked potential (SSVEP) is one of the most commonly used control signal in the brain-computer interface (BCI) systems. However, the conventional spatial filtering methods for SSVEP classification highly depend on the subject-specific calibration data. The need for the methods that can alleviate the demand for the calibration data become urgent. In recent years, developing the methods that can work in inter-subject classification scenario has become a promising new direction. As the popular deep learning model nowadays, Transformer has excellent performance and has been used in EEG signal classification tasks. Therefore, in this study, we propose a deep learning model for SSVEP classification based on Transformer structure in inter-subject classification scenario, termed as SSVEPformer, which is the first application of the transformer to the classification of SSVEP. Inspired by previous studies, the model adopts the frequency spectrum of SSVEP data as input, and explores the spectral and spatial domain information for classification. Furthermore, to fully utilize the harmonic information, an extended SSVEPformer based on the filter bank technology (FB-SSVEPformer) is proposed to further improve the classification performance. Experiments were conducted using two open datasets (Dataset 1: 10 subjects, 12-class task; Dataset 2: 35 subjects, 40-class task) in the inter-subject classification scenario. The experimental results show that the proposed models could achieve better results in terms of classification accuracy and information transfer rate, compared with other baseline methods. The proposed model validates the feasibility of deep learning models based on Transformer structure for SSVEP classification task, and could serve as a potential model to alleviate the calibration procedure in the practical application of SSVEP-based BCI systems.


title: Thin accretion disk luminosity and its image around rotating black holes in perfect fluid dark matter

abstract: Motivated by the fact that the universe is dominated by dark matter and dark energy, we consider rotating black holes surrounded by perfect fluid dark matter and study the accretion process in thin disk around such black holes. Here, we are interested in how the presence of dark matter affects the properties of the electromagnetic radiation emitted from a thin accretion disk. For this purpose, we use the Novikov-Thorne model and obtain the electromagnetic spectrum of an accretion disk around a rotating black hole in perfect fluid dark matter and compare with the general relativistic case. The results indicate that for small values of dark matter parameter we considered here, the size of the innermost stable circular orbits would decrease and thus the electromagnetic spectrum of the accretion disk increases. Therefore, disks in the presence of perfect fluid dark matter are hotter and more luminous than in general relativity. Finally, we construct thin accretion disk images around these black holes using the numerical ray-tracing technique. We show that the inclination angle has a remarkable effect on the images, while the effect of dark matter parameter is small.


title: Grow and Merge: A Unified Framework for Continuous Categories Discovery

abstract: Although a number of studies are devoted to novel category discovery, most of them assume a static setting where both labeled and unlabeled data are given at once for finding new categories. In this work, we focus on the application scenarios where unlabeled data are continuously fed into the category discovery system. We refer to it as the {\bf Continuous Category Discovery} ({\bf CCD}) problem, which is significantly more challenging than the static setting. A common challenge faced by novel category discovery is that different sets of features are needed for classification and category discovery: class discriminative features are preferred for classification, while rich and diverse features are more suitable for new category mining. This challenge becomes more severe for dynamic setting as the system is asked to deliver good performance for known classes over time, and at the same time continuously discover new classes from unlabeled data. To address this challenge, we develop a framework of {\bf Grow and Merge} ({\bf GM}) that works by alternating between a growing phase and a merging phase: in the growing phase, it increases the diversity of features through a continuous self-supervised learning for effective category mining, and in the merging phase, it merges the grown model with a static one to ensure satisfying performance for known classes. Our extensive studies verify that the proposed GM framework is significantly more effective than the state-of-the-art approaches for continuous category discovery.


title: Safety Verification for Neural Networks Based on Set-boundary Analysis

abstract: Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment in practice. In this paper we propose a set-boundary reachability method to investigate the safety verification problem of NNs from a topological perspective. Given an NN with an input set and a safe set, the safety verification problem is to determine whether all outputs of the NN resulting from the input set fall within the safe set. In our method, the homeomorphism property of NNs is mainly exploited, which establishes a relationship mapping boundaries to boundaries. The exploitation of this property facilitates reachability computations via extracting subsets of the input set rather than the entire input set, thus controlling the wrapping effect in reachability analysis and facilitating the reduction of computation burdens for safety verification. The homeomorphism property exists in some widely used NNs such as invertible NNs. Notable representations are invertible residual networks (i-ResNets) and Neural ordinary differential equations (Neural ODEs). For these NNs, our set-boundary reachability method only needs to perform reachability analysis on the boundary of the input set. For NNs which do not feature this property with respect to the input set, we explore subsets of the input set for establishing the local homeomorphism property, and then abandon these subsets for reachability computations. Finally, some examples demonstrate the performance of the proposed method.


title: Non-intrusive Load Monitoring based on Self-supervised Learning

abstract: Deep learning models for non-intrusive load monitoring (NILM) tend to require a large amount of labeled data for training. However, it is difficult to generalize the trained models to unseen sites due to different load characteristics and operating patterns of appliances between data sets. For addressing such problems, self-supervised learning (SSL) is proposed in this paper, where labeled appliance-level data from the target data set or house is not required. Initially, only the aggregate power readings from target data set are required to pre-train a general network via a self-supervised pretext task to map aggregate power sequences to derived representatives. Then, supervised downstream tasks are carried out for each appliance category to fine-tune the pre-trained network, where the features learned in the pretext task are transferred. Utilizing labeled source data sets enables the downstream tasks to learn how each load is disaggregated, by mapping the aggregate to labels. Finally, the fine-tuned network is applied to load disaggregation for the target sites. For validation, multiple experimental cases are designed based on three publicly accessible REDD, UK-DALE, and REFIT data sets. Besides, state-of-the-art neural networks are employed to perform NILM task in the experiments. Based on the NILM results in various cases, SSL generally outperforms zero-shot learning in improving load disaggregation performance without any sub-metering data from the target data sets.


title: Complex Scalar fields in Scalar-Tensor and Scalar-Torsion theories

abstract: We investigate the cosmological dynamics in a spatially flat Friedmann--Lema\^{\i}tre--Robertson--Walker geometry in scalar-tensor and scalar-torsion theories where the nonminimally coupled scalar field is a complex field. We derive the cosmological field equations and we make use of dimensionless variables in order to determine the stationary points and determine their stability properties. The physical properties of the stationary points are discussed while we find that the two-different theories, scalar-tensor and scalar-torsion theories, share many common features in terms of the evolution of the physical variables in the background space.


title: On generalized $\unicode{x00A3}$-cotorsion LCA groups

abstract: A locally compact abelian group $G$ is called a generalized $\unicode{x00A3}$-cotosion group if $G$ contains an open $\unicode{x00A3}$-cotosion subgroup $H$ such that $G/H$ is a cotorsion group. In this paper, we determine the generalized $\unicode{x00A3}$-cotorsion LCA groups.


title: Oze: Decentralized Graph-based Concurrency Control for Real-world Long Transactions on BoM Benchmark

abstract: In this paper, we propose Oze, a new concurrency control protocol that handles heterogeneous workloads which include long-running update transactions. Oze explores a large scheduling space using a fully precise multi-version serialization graph to reduce false positives. Oze manages the graph in a decentralized manner to exploit many cores in modern servers. We also propose a new OLTP benchmark, BoMB (Bill of Materials Benchmark), based on a use case in an actual manufacturing company. BoMB consists of one long-running update transaction and five short transactions that conflict with each other. Experiments using BoMB show that Oze keeps the abort rate of the long-running update transaction at zero while reaching up to 1.7 Mtpm for short transactions with near linear scalability, whereas state-of-the-art protocols cannot commit the long transaction or experience performance degradation in short transaction throughput.


title: Coded Residual Transform for Generalizable Deep Metric Learning

abstract: A fundamental challenge in deep metric learning is the generalization capability of the feature embedding network model since the embedding network learned on training classes need to be evaluated on new test classes. To address this challenge, in this paper, we introduce a new method called coded residual transform (CRT) for deep metric learning to significantly improve its generalization capability. Specifically, we learn a set of diversified prototype features, project the feature map onto each prototype, and then encode its features using their projection residuals weighted by their correlation coefficients with each prototype. The proposed CRT method has the following two unique characteristics. First, it represents and encodes the feature map from a set of complimentary perspectives based on projections onto diversified prototypes. Second, unlike existing transformer-based feature representation approaches which encode the original values of features based on global correlation analysis, the proposed coded residual transform encodes the relative differences between the original features and their projected prototypes. Embedding space density and spectral decay analysis show that this multi-perspective projection onto diversified prototypes and coded residual representation are able to achieve significantly improved generalization capability in metric learning. Finally, to further enhance the generalization performance, we propose to enforce the consistency on their feature similarity matrices between coded residual transforms with different sizes of projection prototypes and embedding dimensions. Our extensive experimental results and ablation studies demonstrate that the proposed CRT method outperform the state-of-the-art deep metric learning methods by large margins and improving upon the current best method by up to 4.28% on the CUB dataset.


title: Central recirculation zone in a V-shaped premixed swirling flame

abstract: This paper presents an experimental study on the emergence of the central recirculation zone (CRZ) in a V-shaped premixed swirling flame, using simultaneous measurement of particle image velocimetry (PIV) and CH* chemiluminescence. The results show that either increasing the Reynolds number (Re) or decreasing the equivalence ratio ({\Phi}) would facilitate the emergence of CRZ. Further analysis demonstrates that the CRZ characteristics and its emergence are strongly influenced by the inner shear layer (ISL) surrounding the CRZ, while the swirl intensity remains unchanged. Dimensional analysis is performed to understand the underlying mechanism, suggesting the CRZ emergence is controlled by a non-dimensional parameter, Re_s=|{\gamma}|_max D/{\nu}_s, defined based on the maximum ISL intensity (|{\gamma}|_max), the exit diameter (D), and the kinematic viscosity ({\nu}_s) of the burnt gas. By estimating the temperature and viscosity with a simple heat-loss model, we show in the |{\gamma}|_max D-{\nu}_s regime diagram that the cases with and without CRZ are separated by a single boundary line, corresponding to a critical Re_s of about 424. This verifies the applicability of the proposed Re_s criterion to lean-premixed V-shaped swirling flames under various conditions. Unlike most previous works that attribute the CRZ of swirling flames to vortex breakdown, the present work reveals the non-negligible effect of the ISL, especially the CRZ suppression when the ISL is weakened by flame heating.


title: Deep Span Representations for Named Entity Recognition

abstract: Span-based models are one of the most straightforward methods for named entity recognition (NER). Existing span-based NER systems shallowly aggregate the token representations to span representations. However, this typically results in significant ineffectiveness for long-span entities, a coupling between the representations of overlapping spans, and ultimately a performance degradation. In this study, we propose DSpERT (Deep Span Encoder Representations from Transformers), which comprises a standard Transformer and a span Transformer. The latter uses low-layered span representations as queries, and aggregates the token representations as keys and values, layer by layer from bottom to top. Thus, DSpERT produces span representations of deep semantics. With weight initialization from pretrained language models, DSpERT achieves performance higher than or competitive with recent state-of-the-art systems on eight NER benchmarks. Experimental results verify the importance of the depth for span representations, and show that DSpERT performs particularly well on long-span entities and nested structures. Further, the deep span representations are well structured and easily separable in the feature space.


title: MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning

abstract: Multimodal representation learning has shown promising improvements on various vision-language tasks. Most existing methods excel at building global-level alignment between vision and language while lacking effective fine-grained image-text interaction. In this paper, we propose a jointly masked multimodal modeling method to learn fine-grained multimodal representations. Our method performs joint masking on image-text input and integrates both implicit and explicit targets for the masked signals to recover. The implicit target provides a unified and debiased objective for vision and language, where the model predicts latent multimodal representations of the unmasked input. The explicit target further enriches the multimodal representations by recovering high-level and semantically meaningful information: momentum visual features of image patches and concepts of word tokens. Through such a masked modeling process, our model not only learns fine-grained multimodal interaction, but also avoids the semantic gap between high-level representations and low- or mid-level prediction targets (e.g. image pixels), thus producing semantically rich multimodal representations that perform well on both zero-shot and fine-tuned settings. Our pre-trained model (named MAMO) achieves state-of-the-art performance on various downstream vision-language tasks, including image-text retrieval, visual question answering, visual reasoning, and weakly-supervised visual grounding.


title: Guided Nonlocal Patch Regularization and Efficient Filtering-Based Inversion for Multiband Fusion

abstract: In multiband fusion, an image with a high spatial and low spectral resolution is combined with an image with a low spatial but high spectral resolution to produce a single multiband image having high spatial and spectral resolutions. This comes up in remote sensing applications such as pansharpening~(MS+PAN), hyperspectral sharpening~(HS+PAN), and HS-MS fusion~(HS+MS). Remote sensing images are textured and have repetitive structures. Motivated by nonlocal patch-based methods for image restoration, we propose a convex regularizer that (i) takes into account long-distance correlations, (ii) penalizes patch variation, which is more effective than pixel variation for capturing texture information, and (iii) uses the higher spatial resolution image as a guide image for weight computation. We come up with an efficient ADMM algorithm for optimizing the regularizer along with a standard least-squares loss function derived from the imaging model. The novelty of our algorithm is that by expressing patch variation as filtering operations and by judiciously splitting the original variables and introducing latent variables, we are able to solve the ADMM subproblems efficiently using FFT-based convolution and soft-thresholding. As far as the reconstruction quality is concerned, our method is shown to outperform state-of-the-art variational and deep learning techniques.


title: Controllable Dialogue Simulation with In-Context Learning

abstract: Building dialogue systems requires a large corpus of annotated dialogues. Such datasets are usually created via crowdsourcing, which is expensive and time-consuming. In this paper, we propose \textsc{Dialogic}, a novel dialogue simulation method based on large language model in-context learning to automate dataset creation. Seeded with a few annotated dialogues, \textsc{Dialogic} automatically selects in-context examples for demonstration and prompts GPT-3 to generate new dialogues and annotations in a controllable way. Our method can rapidly expand a small set of dialogue data with minimum or zero \textit{human involvement} and \textit{parameter update} and is thus much more cost-efficient and time-saving than crowdsourcing. Experimental results on the MultiWOZ dataset demonstrate that training a model on the simulated dialogues leads to even better performance than using the same amount of human-generated dialogues under the challenging low-resource settings, with as few as 85 dialogues as a seed. When enough data is available, our method can still serve as an effective data augmentation method. Human evaluation results also show that our simulated dialogues have near-human fluency and annotation accuracy. The code and data are available at \textbf{\url{https://github.com/Leezekun/dialogic}}.


title: Analogy Generation by Prompting Large Language Models: A Case Study of InstructGPT

abstract: We propose a novel application of prompting Pre-trained Language Models (PLMs) to generate analogies and study how to design effective prompts for two task settings: generating a source concept analogous to a given target concept (aka Analogous Concept Generation or ACG), and generating an explanation of the similarity between a given pair of target concept and source concept (aka Analogous Explanation Generation or AEG). We found that it is feasible to prompt InstructGPT to generate meaningful analogies and the best prompts tend to be precise imperative statements especially with a low temperature setting. We also systematically analyzed the sensitivity of the InstructGPT model to prompt design, temperature, and injected spelling errors, and found that the model is particularly sensitive to certain variations (e.g., questions vs. imperative statements). Further, we conducted human evaluation on 1.4k of the generated analogies and found that the quality of generations varies substantially by model size. The largest InstructGPT model can achieve human-level performance at generating meaningful analogies for a given target while there is still room for improvement on the AEG task.


title: Robust analytic continuation of Green's functions via projection, pole estimation, and semidefinite relaxation

abstract: Green's functions of fermions are described by matrix-valued Herglotz-Nevanlinna functions. Since analytic continuation is fundamentally an ill-posed problem, the causal space described by the matrix-valued Herglotz-Nevanlinna structure can be instrumental in improving the accuracy and in enhancing the robustness with respect to noise. We demonstrate a three-pronged procedure for robust analytic continuation called PES: (1) Projection of data to the causal space. (2) Estimation of pole locations. (3) Semidefinite relaxation within the causal space. We compare the performance of PES with the recently developed Nevanlinna and Carath\'{e}odory continuation methods and find that PES is more robust in the presence of noise and does not require the usage of extended precision arithmetics. We also demonstrate that a causal projection improves the performance of the Nevanlinna and Carath\'{e}odory methods. The PES method is generalized to bosonic response functions, for which the Nevanlinna and Carath\'{e}odory continuation methods have not yet been developed. It is particularly useful for studying spectra with sharp features, as they occur in the study of molecules and band structures in solids.


title: Invertible Rescaling Network and Its Extensions

abstract: Image rescaling is a commonly used bidirectional operation, which first downscales high-resolution images to fit various display screens or to be storage- and bandwidth-friendly, and afterward upscales the corresponding low-resolution images to recover the original resolution or the details in the zoom-in images. However, the non-injective downscaling mapping discards high-frequency contents, leading to the ill-posed problem for the inverse restoration task. This can be abstracted as a general image degradation-restoration problem with information loss. In this work, we propose a novel invertible framework to handle this general problem, which models the bidirectional degradation and restoration from a new perspective, i.e. invertible bijective transformation. The invertibility enables the framework to model the information loss of pre-degradation in the form of distribution, which could mitigate the ill-posed problem during post-restoration. To be specific, we develop invertible models to generate valid degraded images and meanwhile transform the distribution of lost contents to the fixed distribution of a latent variable during the forward degradation. Then restoration is made tractable by applying the inverse transformation on the generated degraded image together with a randomly-drawn latent variable. We start from image rescaling and instantiate the model as Invertible Rescaling Network (IRN), which can be easily extended to the similar decolorization-colorization task. We further propose to combine the invertible framework with existing degradation methods such as image compression for wider applications. Experimental results demonstrate the significant improvement of our model over existing methods in terms of both quantitative and qualitative evaluations of upscaling and colorizing reconstruction from downscaled and decolorized images, and rate-distortion of image compression.


title: Revealing the short-range structure of the "mirror nuclei" $^3$H and $^3$He

abstract: When protons and neutrons (nucleons) are bound into atomic nuclei, they are close enough together to feel significant attraction, or repulsion, from the strong, short-distance part of the nucleon-nucleon interaction. These strong interactions lead to hard collisions between nucleons, generating pairs of highly-energetic nucleons referred to as short-range correlations (SRCs). SRCs are an important but relatively poorly understood part of nuclear structure and mapping out the strength and isospin structure (neutron-proton vs proton-proton pairs) of these virtual excitations is thus critical input for modeling a range of nuclear, particle, and astrophysics measurements. Hitherto measurements used two-nucleon knockout or ``triple-coincidence'' reactions to measure the relative contribution of np- and pp-SRCs by knocking out a proton from the SRC and detecting its partner nucleon (proton or neutron). These measurementsshow that SRCs are almost exclusively np pairs, but had limited statistics and required large model-dependent final-state interaction (FSI) corrections. We report on the first measurement using inclusive scattering from the mirror nuclei $^3$H and $^3$He to extract the np/pp ratio of SRCs in the A=3 system. We obtain a measure of the np/pp SRC ratio that is an order of magnitude more precise than previous experiments, and find a dramatic deviation from the near-total np dominance observed in heavy nuclei. This result implies an unexpected structure in the high-momentum wavefunction for $^3$He and $^3$H. Understanding these results will improve our understanding of the short-range part of the N-N interaction.


title: A possible 250-second X-ray quasi-periodicity in the fast blue optical transient AT2018cow

abstract: The fast blue optical transients (FBOTs) are a new population of extragalactic transients of unclear physical origin. A variety of mechanisms have been proposed including failed supernova explosion, shock interaction with a dense medium, young magnetar, accretion onto a compact object, and stellar tidal disruption event, but none is conclusive. Here we report the discovery of a possible X-ray quasi-periodicity signal with a period of $\sim$250 second (at a significance level of 99.76%) in the brightest FBOT AT2018cow through the analysis of XMM-Newton/PN data. The signal is independently detected at the same frequency in the average power density spectrum from data taken from the Swift telescope, with observations covering from 6 to 37 days after the optical discovery, though the significance level is lower (94.26%). This suggests that the QPO frequency may be stable over at least 1.1$\times$ 10$^{4}$ cycles. Assuming the $\sim$250 second QPO to be a scaled-down analogue of that typically seen in stellar mass black holes, a black hole mass of $\sim10^{3}-10^{5}$ solar masses could be inferred. The overall X-ray luminosity evolution could be modeled with the stellar tidal disruption by a black hole of $\sim10^4$ solar masses, providing a viable mechanism to produce AT2018cow. Our findings suggest that other bright FBOTs may also harbor intermediate-mass black holes.


title: CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation Models

abstract: We motivate and introduce CHARD: Clinical Health-Aware Reasoning across Dimensions, to investigate the capability of text generation models to act as implicit clinical knowledge bases and generate free-flow textual explanations about various health-related conditions across several dimensions. We collect and present an associated dataset, CHARDat, consisting of explanations about 52 health conditions across three clinical dimensions. We conduct extensive experiments using BART and T5 along with data augmentation, and perform automatic, human, and qualitative analyses. We show that while our models can perform decently, CHARD is very challenging with strong potential for further exploration.


title: Aging transition in coupled quantum oscillators

abstract: Aging transition is an emergent behavior observed in networks consisting of active (self-oscillatory) and inactive (non self-oscillatory) nodes, where the network transits from a global oscillatory state to an oscillation collapsed state when the fraction of inactive oscillators surpasses a critical value. However, the aging transition in quantum domain has not been studied yet. In this paper we investigate the quantum manifestation of aging transition in a network of active-inactive quantum oscillators. We show that, unlike classical case, the quantum aging is not characterized by a complete collapse of oscillation but by sufficient reduction in the mean boson number. We identify a critical ``knee" value in the fraction of inactive oscillators around which quantum aging occurs in two different ways. Further, in stark contrast to the classical case, quantum aging transition depends upon the nonlinear damping parameter. We also explain the underlying processes leading to quantum aging that have no counterpart in the classical domain.


title: Predicting fluid-structure interaction with graph neural networks

abstract: We present a rotation equivariant, quasi-monolithic graph neural network framework for the reduced-order modeling of fluid-structure interaction systems. With the aid of an arbitrary Lagrangian-Eulerian formulation, the system states are evolved temporally with two sub-networks. The movement of the mesh is reduced to the evolution of several coefficients via complex-valued proper orthogonal decomposition, and the prediction of these coefficients over time is handled by a single multi-layer perceptron. A finite element-inspired hypergraph neural network is employed to predict the evolution of the fluid state based on the state of the whole system. The structural state is implicitly modeled by the movement of the mesh on the solid-fluid interface; hence it makes the proposed framework quasi-monolithic. The effectiveness of the proposed framework is assessed on two prototypical fluid-structure systems, namely the flow around an elastically-mounted cylinder, and the flow around a hyperelastic plate attached to a fixed cylinder. The proposed framework tracks the interface description and provides stable and accurate system state predictions during roll-out for at least 2000 time steps, and even demonstrates some capability in self-correcting erroneous predictions. The proposed framework also enables direct calculation of the lift and drag forces using the predicted fluid and mesh states, in contrast to existing convolution-based architectures. The proposed reduced-order model via graph neural network has implications for the development of physics-based digital twins concerning moving boundaries and fluid-structure interactions.


title: Reap the Harvest on Blockchain: A Survey of Yield Farming Protocols

abstract: Yield farming represents an immensely popular asset management activity in decentralized finance (DeFi). It involves supplying, borrowing, or staking crypto assets to earn an income in forms of transaction fees, interest, or participation rewards at different DeFi marketplaces. In this systematic survey, we present yield farming protocols as an aggregation-layer constituent of the wider DeFi ecosystem that interact with primitive-layer protocols such as decentralized exchanges (DEXs) and protocols for loanable funds (PLFs). We examine the yield farming mechanism by first studying the operations encoded in the yield farming smart contracts, and then performing stylized, parameterized simulations on various yield farming strategies. We conduct a thorough literature review on related work, and establish a framework for yield farming protocols that takes into account pool structure, accepted token types, and implemented strategies. Using our framework, we characterize major yield aggregators in the market including Yearn Finance, Beefy, and Badger DAO. Moreover, we discuss anecdotal attacks against yield aggregators and generalize a number of risks associated with yield farming.


title: Online Training Through Time for Spiking Neural Networks

abstract: Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models. Recent progress in training methods has enabled successful deep SNNs on large-scale tasks with low latency. Particularly, backpropagation through time (BPTT) with surrogate gradients (SG) is popularly used to achieve high performance in a very small number of time steps. However, it is at the cost of large memory consumption for training, lack of theoretical clarity for optimization, and inconsistency with the online property of biological learning and rules on neuromorphic hardware. Other works connect spike representations of SNNs with equivalent artificial neural network formulation and train SNNs by gradients from equivalent mappings to ensure descent directions. But they fail to achieve low latency and are also not online. In this work, we propose online training through time (OTTT) for SNNs, which is derived from BPTT to enable forward-in-time learning by tracking presynaptic activities and leveraging instantaneous loss and gradients. Meanwhile, we theoretically analyze and prove that gradients of OTTT can provide a similar descent direction for optimization as gradients based on spike representations under both feedforward and recurrent conditions. OTTT only requires constant training memory costs agnostic to time steps, avoiding the significant memory costs of BPTT for GPU training. Furthermore, the update rule of OTTT is in the form of three-factor Hebbian learning, which could pave a path for online on-chip learning. With OTTT, it is the first time that two mainstream supervised SNN training methods, BPTT with SG and spike representation-based training, are connected, and meanwhile in a biologically plausible form. Experiments on CIFAR-10, CIFAR-100, ImageNet, and CIFAR10-DVS demonstrate the superior performance of our method on large-scale static and neuromorphic datasets in small time steps.


title: Exact solutions of temperature-dependent Smoluchowski equations

abstract: We report a number of exact solutions for temperature-dependent Smoluchowski equations. These equations quantify the ballistic agglomeration, where the evolution of densities of agglomerates of different size is entangled with the evolution of the mean kinetic energy (partial temperatures) of such clusters. The obtained exact solutions may be used as a benchmark to assess the accuracy and computational efficiency of the numerical approaches, developed to solve the temperature-dependent Smoluchowski equations. Moreover, they may also illustrate the possible evolution regimes in these systems. The exact solutions have been obtained for a series of model rate coefficients, and we demonstrate that there may be an infinite number of such model coefficient which allow exact analysis. We compare our exact solutions with the numerical solutions for various evolution regimes; an excellent agreement between numerical and exact results proves the accuracy of the exploited numerical method.


title: Normal-mode splitting in the optomechanical system with an optical parametric amplifier and coherent feedback

abstract: Strong coupling in optomechanical systems is the basic condition for observing many quantum phenomena such as optomechanical squeezing and entanglement. Normal-mode splitting (NMS) is the most evident signature of strong coupling systems. Here we show the NMS in the spectra of the movable mirror and the output field in an optomechanical system can be flexibly engineered by a combination of optical parametric amplifier (OPA) and coherent feedback (CF). Moreover, the NMS could be enhanced by optimizing the parameters such as input optical power, OPA gain and phase, CF strength in terms of amplitude reflectivity of beam splitter.


title: Super-Resolution by Predicting Offsets: An Ultra-Efficient Super-Resolution Network for Rasterized Images

abstract: Rendering high-resolution (HR) graphics brings substantial computational costs. Efficient graphics super-resolution (SR) methods may achieve HR rendering with small computing resources and have attracted extensive research interests in industry and research communities. We present a new method for real-time SR for computer graphics, namely Super-Resolution by Predicting Offsets (SRPO). Our algorithm divides the image into two parts for processing, i.e., sharp edges and flatter areas. For edges, different from the previous SR methods that take the anti-aliased images as inputs, our proposed SRPO takes advantage of the characteristics of rasterized images to conduct SR on the rasterized images. To complement the residual between HR and low-resolution (LR) rasterized images, we train an ultra-efficient network to predict the offset maps to move the appropriate surrounding pixels to the new positions. For flat areas, we found simple interpolation methods can already generate reasonable output. We finally use a guided fusion operation to integrate the sharp edges generated by the network and flat areas by the interpolation method to get the final SR image. The proposed network only contains 8,434 parameters and can be accelerated by network quantization. Extensive experiments show that the proposed SRPO can achieve superior visual effects at a smaller computational cost than the existing state-of-the-art methods.


title: Local entropy and nonextensivity of networks ensembles

abstract: Nonextensivity is foreseeable in network ensembles, as heterogeneous interactions generally exist in complex networked systems that need to be described by network ensembles. But this nonextensivity has not been literatured proved yet. In this work, the existence of nonextensivity in the binary and weighted network ensembles is theoretically proved for the first time (both in the microcanonical and canonical ensemble) based on the finding of the local entropy's nonlinear change when new nodes are added to the network ensembles. This proof also shows that the existence of nonextensivity is the main difference between the network ensembles and other traditional models in statistical physics (Ising model).


title: Boosting Out-of-distribution Detection with Typical Features

abstract: Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or introducing diverse outlier examples to retrain the model, we delve into the obstacle factors in OOD detection from the perspective of typicality and regard the feature's high-probability region of the deep model as the feature's typical set. We propose to rectify the feature into its typical set and calculate the OOD score with the typical features to achieve reliable uncertainty estimation. The feature rectification can be conducted as a {plug-and-play} module with various OOD scores. We evaluate the superiority of our method on both the commonly used benchmark (CIFAR) and the more challenging high-resolution benchmark with large label space (ImageNet). Notably, our approach outperforms state-of-the-art methods by up to 5.11$\%$ in the average FPR95 on the ImageNet benchmark.


title: High-performance non-Fermi-liquid metallic thermoelectric materials

abstract: Searching for high-performance thermoelectric (TE) materials in the paradigm of narrow-bandgap semiconductors has lasted for nearly 70 years and is obviously hampered by a bottleneck of research now. Here we report on the discovery of a few metallic compounds, TiFexCu2x-1Sb and TiFe1.33Sb, showing the thermopower exceeding many TE semiconductors and the dimensionless figure of merits comparable with the state-of-the-art TE materials. A quasi-linear temperature (T) dependence of electrical resistivity in 2 K - 700 K and the logarithmic T-dependent electronic specific heat at low temperature are also observed to coexist with the high thermopower, highlighting the strong intercoupling of the non-Fermi-liquid (NFL) quantum critical behavior of electrons with TE transports. Electronic structure analysis reveals the existence of fluctuating Fe-eg-related local magnetic moments, Fe-Fe antiferromagnetic (AFM) interaction at the nearest 4c-4d sites, and two-fold degenerate eg orbitals antiferromagnetically coupled with the dual-type itinerant electrons close to the Fermi level, all of which infer to a competition between the AFM ordering and Kondo-like spin compensation as well as a parallel two-channel Kondo effect. These effects are both strongly meditated by the structural disorder due to the random filling of Fe/Cu at the equivalent 4c/4d sites of the Heusler crystal lattice. The magnetic susceptibility deviates from ideal antiferromagnetism but can be fitted well by x(T) = 1/({\theta} + BT{\alpha}), seemingly being consistent with the quantum critical scenario of strong local correlation as discussed before. Our work not only breaks the dilemma that the promising TE materials should be heavily-doped semiconductors, but also demonstrates the correlation among high TE performance, NFL quantum criticality, and magnetic fluctuation, which opens up new directions for future research.


title: What should a generic object be?

abstract: Jacobs has proposed definitions for (weak, strong, split) generic objects for a fibered category; building on his definition of (split) generic objects, Jacobs develops a menagerie of important fibrational structures with applications to categorical logic and computer science, including higher order fibrations, polymorphic fibrations, ${\lambda}2$-fibrations, triposes, and others. We observe that a split generic object need not in particular be a generic object under the given definitions, and that the definitions of polymorphic fibrations, triposes, etc. are strict enough to rule out some fundamental examples: for instance, the fibered preorder induced by a partial combinatory algebra in realizability is not a tripos in this sense. We propose a new alignment of terminology that emphasizes the forms of generic object appearing most commonly in nature, i.e. in the study of internal categories, triposes, and the denotational semantics of polymorphism. In addition, we propose a new class of acyclic generic objects inspired by recent developments in higher category theory and the semantics of homotopy type theory, generalizing the realignment property of universes to the setting of an arbitrary fibration.


title: Baryonic Effects on Lagrangian Clustering and Angular Momentum Reconstruction

abstract: Recent studies illustrate the correlation between the angular momenta of cosmic structures and their Lagrangian properties. However, only baryons are observable and it is unclear whether they reliably trace the cosmic angular momenta. We study the Lagrangian mass distribution, spin correlation, and predictability of dark matter, gas, and stellar components of galaxy-halo systems using IllustrisTNG, and show that the primordial segregations between components are typically small. Their protoshapes are also similar in terms of the statistics of moment of inertia tensors. Under the common gravitational potential they are expected to exert the same tidal torque and the strong spin correlations are not destroyed by the nonlinear evolution and complicated baryonic effects, as confirmed by the high-resolution hydrodynamic simulations. We further show that their late-time angular momenta traced by total gas, stars, or the central galaxies, can be reliably reconstructed by the initial perturbations. These results suggest that baryonic angular momenta can potentially be used in reconstructing the parameters and models related to the initial perturbations.


title: Lasso trigonometric polynomial approximation for periodic function recovery in equidistant points

abstract: In this paper, we propose a fully discrete soft thresholding trigonometric polynomial approximation on $[-\pi,\pi],$ named Lasso trigonometric interpolation. This approximation is an $\ell_1$-regularized discrete least squares approximation under the same conditions of classical trigonometric interpolation on an equidistant grid. Lasso trigonometric interpolation is sparse and meanwhile it is an efficient tool to deal with noisy data. We theoretically analyze Lasso trigonometric interpolation for continuous periodic function. The principal results show that the $L_2$ error bound of Lasso trigonometric interpolation is less than that of classical trigonometric interpolation, which improved the robustness of trigonometric interpolation. This paper also presents numerical results on Lasso trigonometric interpolation on $[-\pi,\pi]$, with or without the presence of data errors.


title: Analytic Solution of an Active Brownian Particle in a Harmonic Well

abstract: We provide an analytical solution for the time-dependent Fokker-Planck equation for a two-dimensional active Brownian particle trapped in an isotropic harmonic potential. Using the passive Brownian particle as basis states we show that the Fokker-Planck operator becomes lower diagonal, implying that the eigenvalues are unaffected by the activity. The propagator is then expressed as a combination of the equilibrium eigenstates with weights obeying exact iterative relations. We show that for the low-order correlation functions, such as the positional autocorrelation function, the recursion terminates at finite order in the P\'eclet number allowing us to generate exact compact expressions and derive the velocity autocorrelation function and the time-dependent diffusion coefficient. The nonmonotonic behavior of latter quantities serves as a fingerprint of the non-equilibrium dynamics.

categories: cond-mat.soft cond-mat.stat-mech math-ph math.MP


title: Attention Diversification for Domain Generalization

abstract: Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After investigating this issue from the perspective of shortcut learning, we find the devils lie in the fact that models trained on different domains merely bias to different domain-specific features yet overlook diverse task-related features. Under this guidance, a novel Attention Diversification framework is proposed, in which Intra-Model and Inter-Model Attention Diversification Regularization are collaborated to reassign appropriate attention to diverse task-related features. Briefly, Intra-Model Attention Diversification Regularization is equipped on the high-level feature maps to achieve in-channel discrimination and cross-channel diversification via forcing different channels to pay their most salient attention to different spatial locations. Besides, Inter-Model Attention Diversification Regularization is proposed to further provide task-related attention diversification and domain-related attention suppression, which is a paradigm of "simulate, divide and assemble": simulate domain shift via exploiting multiple domain-specific models, divide attention maps into task-related and domain-related groups, and assemble them within each group respectively to execute regularization. Extensive experiments and analyses are conducted on various benchmarks to demonstrate that our method achieves state-of-the-art performance over other competing methods. Code is available at https://github.com/hikvision-research/DomainGeneralization.


title: Characterizations of bilocality and $n$-locality of correlation tensors

abstract: In the literature, bilocality and $n$-locality of correlation tensors (CTs) are described by integration local hidden variable models (called C-LHVMs) rather than by summation LHVMs (called D-LHVMs). Obviously, C-LHVMs are easier to be constructed than D-LHVMs, while the later are easier to be used than the former, e.g., in discussing on the topological and geometric properties of the sets of all bilocal and of all $n$-local CTs. In this context, one may ask whether the two descriptions are equivalent. In the present work, we first establish some equivalent characterizations of bilocality of a tripartite CT ${\bf{P}}=\Lbrack P(abc|xyz)\Rbrack$, implying that the two descriptions of bilocality are equivalent. As applications, we prove that all bilocal CTs with the same size form a compact path-connected set that has many star-convex subsets. Secondly, we introduce and discuss the bilocality of a tripartite probability tensor (PT) ${\bf{P}}=\Lbrack P(abc)\Rbrack$, including equivalent characterizations and properties of bilocal PTs. Lastly, we obtain corresponding results about $n$-locality of $n+1$-partite CTs ${\bf{P}}=\Lbrack P({\bf{a}}b|{\bf{x}}y)\Rbrack$ and PTs ${\bf{P}}=\Lbrack P({\bf{a}}b)\Rbrack$, respectively.


title: Let Images Give You More:Point Cloud Cross-Modal Training for Shape Analysis

abstract: Although recent point cloud analysis achieves impressive progress, the paradigm of representation learning from a single modality gradually meets its bottleneck. In this work, we take a step towards more discriminative 3D point cloud representation by fully taking advantages of images which inherently contain richer appearance information, e.g., texture, color, and shade. Specifically, this paper introduces a simple but effective point cloud cross-modality training (PointCMT) strategy, which utilizes view-images, i.e., rendered or projected 2D images of the 3D object, to boost point cloud analysis. In practice, to effectively acquire auxiliary knowledge from view images, we develop a teacher-student framework and formulate the cross modal learning as a knowledge distillation problem. PointCMT eliminates the distribution discrepancy between different modalities through novel feature and classifier enhancement criteria and avoids potential negative transfer effectively. Note that PointCMT effectively improves the point-only representation without architecture modification. Sufficient experiments verify significant gains on various datasets using appealing backbones, i.e., equipped with PointCMT, PointNet++ and PointMLP achieve state-of-the-art performance on two benchmarks, i.e., 94.4% and 86.7% accuracy on ModelNet40 and ScanObjectNN, respectively. Code will be made available at https://github.com/ZhanHeshen/PointCMT.


title: Decomposed Mutual Information Optimization for Generalized Context in Meta-Reinforcement Learning

abstract: Adapting to the changes in transition dynamics is essential in robotic applications. By learning a conditional policy with a compact context, context-aware meta-reinforcement learning provides a flexible way to adjust behavior according to dynamics changes. However, in real-world applications, the agent may encounter complex dynamics changes. Multiple confounders can influence the transition dynamics, making it challenging to infer accurate context for decision-making. This paper addresses such a challenge by Decomposed Mutual INformation Optimization (DOMINO) for context learning, which explicitly learns a disentangled context to maximize the mutual information between the context and historical trajectories, while minimizing the state transition prediction error. Our theoretical analysis shows that DOMINO can overcome the underestimation of the mutual information caused by multi-confounded challenges via learning disentangled context and reduce the demand for the number of samples collected in various environments. Extensive experiments show that the context learned by DOMINO benefits both model-based and model-free reinforcement learning algorithms for dynamics generalization in terms of sample efficiency and performance in unseen environments.


title: C5 as simplest ultrahard allotrope with mixed sp2/sp3 carbon hybridizations from first principles

abstract: From crystal chemistry rationale and density functional DFT calculations, novel tetragonal carbon C5 is proposed as simplest ultrahard allotrope with mixed hybrid carbon hybridizations (sp2 - sp3). Novel pentacarbon is identified as cohesive and stable both dynamically and mechanically. Whereas charge density is localized about tetrahedral C-sp3, it is found delocalized around trigonal C-sp2 resulting in metallic behavior. The anisotropic structure characteristics caused by the aligned trigonal carbon along the tetragonal c-axis provide high Vickers hardness with a magnitude close to diamond


title: Adaptive Control of Unknown Pure Feedback Systems with Pure State Constraints

abstract: This paper deals with the tracking control problem for a class of unknown pure feedback system with pure state constraints on the state variables and unknown time-varying bounded disturbances. An adaptive controller is presented for such systems for the very first time. The controller is designed using the backstepping method. While designing it, Barrier Lyapunov Functions is used so that the state variables do not contravene its constraints. In order to cope with the unknown dynamics of the system, an online approximator is designed using a neural network with a novel adaptive law for its weight update. In the stability analysis of the system, the time derivative of Lyapunov function involves known virtual control coefficient with unknown direction and to deal with such problem Nussbaum gain is used to design the control law. Furthermore, to make the controller robust and computationally inexpensive, a novel disturbance observer is designed to estimate the disturbance along with neural network approximation error and the time derivative of virtual control input. The effectiveness of the proposed approach is demonstrated through a simulation study on the third-order nonlinear system.


title: Migrating from Microservices to Serverless: An IoT Platform Case Study

abstract: Microservice architecture is the common choice for developing cloud applications these days since each individual microservice can be independently modified, replaced, and scaled. As a result, application development and operating cloud infrastructure were bundled together into what is now commonly called DevOps. However, with the increasing popularity of the serverless computing paradigm and its several advantages such as no infrastructure management, a pay-per-use billing policy, and on-demand fine-grained autoscaling, there is a growing interest in utilizing FaaS and serverless CaaS technologies for refactoring microservices-based applications. Towards this, we migrate a complex IoT platform application onto OpenWhisk (OW) and Google Cloud Run (GCR). We comprehensively evaluate the performance of the different deployment strategies, i.e., Google Kubernetes Engine (GKE)-Standard, OW, and GCR for the IoT platform using different load testing scenarios. Results from our experiments show that while GKE standard performs best for most scenarios, GCR is always cheaper wrt costs.