title: Teaching Robots to Span the Space of Functional Expressive Motion

abstract: Our goal is to enable robots to perform functional tasks in emotive ways, be it in response to their users' emotional states, or expressive of their confidence levels. Prior work has proposed learning independent cost functions from user feedback for each target emotion, so that the robot may optimize it alongside task and environment specific objectives for any situation it encounters. However, this approach is inefficient when modeling multiple emotions and unable to generalize to new ones. In this work, we leverage the fact that emotions are not independent of each other: they are related through a latent space of Valence-Arousal-Dominance (VAD). Our key idea is to learn a model for how trajectories map onto VAD with user labels. Considering the distance between a trajectory's mapping and a target VAD allows this single model to represent cost functions for all emotions. As a result 1) all user feedback can contribute to learning about every emotion; 2) the robot can generate trajectories for any emotion in the space instead of only a few predefined ones; and 3) the robot can respond emotively to user-generated natural language by mapping it to a target VAD. We introduce a method that interactively learns to map trajectories to this latent space and test it in simulation and in a user study. In experiments, we use a simple vacuum robot as well as the Cassie biped.


title: Deep Lexical Hypothesis: Identifying personality structure in natural language

abstract: Recent advances in natural language processing (NLP) have produced general models that can perform complex tasks such as summarizing long passages and translating across languages. Here, we introduce a method to extract adjective similarities from language models as done with survey-based ratings in traditional psycholexical studies but using millions of times more text in a natural setting. The correlational structure produced through this method is highly similar to that of self- and other-ratings of 435 terms reported by Saucier and Goldberg (1996a). The first three unrotated factors produced using NLP are congruent with those in survey data, with coefficients of 0.89, 0.79, and 0.79. This structure is robust to many modeling decisions: adjective set, including those with 1,710 terms (Goldberg, 1982) and 18,000 terms (Allport & Odbert, 1936); the query used to extract correlations; and language model. Notably, Neuroticism and Openness are only weakly and inconsistently recovered. This is a new source of signal that is closer to the original (semantic) vision of the Lexical Hypothesis. The method can be applied where surveys cannot: in dozens of languages simultaneously, with tens of thousands of items, on historical text, and at extremely large scale for little cost. The code is made public to facilitate reproduction and fast iteration in new directions of research.


title: Multi-fidelity validation of variable-density turbulent mixing models

abstract: In this study, ensembles of experimental data are presented and utilized to compare and validate two models used in the simulation of variable density, compressible turbulent mixing. Though models of this kind (Reynolds Averaged Navier Stokes and Large Eddy Simulations) have been validated extensively with more canonical flows in previous studies, the present approach offers novelty in the complexity of the geometry, the ensemble based validation, and the uniformity of the computational framework on which the models are tested. Moreover, all experimental and computational tasks were completed by the authors which has led to a tightly coupled experimental configuration with its digital twin. The experimental divergent shock tube facility and its data acquisition methods are described and replicated in simulation space. A 2D Euler model which neglects the turbulent mixing at the interface is optimized to experimental data using a Gaussian process. This model then serves as the basis for both the 2D RANS and 3D LES studies that make comparisons to the mixing layer data from the experiment. RANS is shown to produce good agreement with experimental data only at late flow development times. The LES ensembles generally show good agreement with experimental data, but display sensitivity to the characterization of initial conditions. Resolution dependent behavior is also observed for certain higher-order statistics of interest. Overall, the LES model successfully captures the effects of divergent geometry, compressibility, and combined non-linear instabilities inherent to the problem. The successful prediction of mixing width and its growth rate highlight the existence of three distinct regimes in the development of the instability, each with similarities to previously studied instabilities.


title: LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Models

abstract: The Transformer architecture is ubiquitously used as the building block of large-scale autoregressive language models. However, finding architectures with the optimal trade-off between task performance (perplexity) and hardware constraints like peak memory utilization and latency is non-trivial. This is exacerbated by the proliferation of various hardware. We leverage the somewhat surprising empirical observation that the number of decoder parameters in autoregressive Transformers has a high rank correlation with task performance, irrespective of the architecture topology. This observation organically induces a simple Neural Architecture Search (NAS) algorithm that uses decoder parameters as a proxy for perplexity without need for any model training. The search phase of our training-free algorithm, dubbed Lightweight Transformer Search (LTS), can be run directly on target devices since it does not require GPUs. Using on-target-device measurements, LTS extracts the Pareto-frontier of perplexity versus any hardware performance cost. We evaluate LTS on diverse devices from ARM CPUs to NVIDIA GPUs and two popular autoregressive Transformer backbones: GPT-2 and Transformer-XL. Results show that the perplexity of 16-layer GPT-2 and Transformer-XL can be achieved with up to 1.5x, 2.5x faster runtime and 1.2x, 2.0x lower peak memory utilization. When evaluated in zero and one-shot settings, LTS Pareto-frontier models achieve higher average accuracy compared to the 350M parameter OPT across 14 tasks, with up to 1.6x lower latency. LTS extracts the Pareto-frontier in under 3 hours while running on a commodity laptop. We effectively remove the carbon footprint of hundreds of GPU hours of training during search, offering a strong simple baseline for future NAS methods in autoregressive language modeling.


title: Contrastive Graph Convolutional Networks for Hardware Trojan Detection in Third Party IP Cores

abstract: The availability of wide-ranging third-party intellectual property (3PIP) cores enables integrated circuit (IC) designers to focus on designing high-level features in ASICs/SoCs. The massive proliferation of ICs brings with it an increased number of bad actors seeking to exploit those circuits for various nefarious reasons. This is not surprising as integrated circuits affect every aspect of society. Thus, malicious logic (Hardware Trojans, HT) being surreptitiously injected by untrusted vendors into 3PIP cores used in IC design is an ever present threat. In this paper, we explore methods for identification of trigger-based HT in designs containing synthesizable IP cores without a golden model. Specifically, we develop methods to detect hardware trojans by detecting triggers embedded in ICs purely based on netlists acquired from the vendor. We propose GATE-Net, a deep learning model based on graph-convolutional networks (GCN) trained using supervised contrastive learning, for flagging designs containing randomly-inserted triggers using only the corresponding netlist. Our proposed architecture achieves significant improvements over state-of-the-art learning models yielding an average 46.99% improvement in detection performance for combinatorial triggers and 21.91% improvement for sequential triggers across a variety of circuit types. Through rigorous experimentation, qualitative and quantitative performance evaluations, we demonstrate effectiveness of GATE-Net and the supervised contrastive training of GATE-Net for HT detection.


title: Portability for GPU-accelerated molecular docking applications for cloud and HPC: can portable compiler directives provide performance across all platforms?

abstract: High-throughput structure-based screening of drug-like molecules has become a common tool in biomedical research. Recently, acceleration with graphics processing units (GPUs) has provided a large performance boost for molecular docking programs. Both cloud and high-performance computing (HPC) resources have been used for large screens with molecular docking programs; while NVIDIA GPUs have dominated cloud and HPC resources, new vendors such as AMD and Intel are now entering the field, creating the problem of software portability across different GPUs. Ideally, software productivity could be maximized with portable programming models that are able to maintain high performance across architectures. While in many cases compiler directives have been used as an easy way to offload parallel regions of a CPU-based program to a GPU accelerator, they may also be an attractive programming model for providing portability across different GPU vendors, in which case the porting process may proceed in the reverse direction: from low-level, architecture-specific code to higher-level directive-based abstractions. MiniMDock is a new mini-application (miniapp) designed to capture the essential computational kernels found in molecular docking calculations, such as are used in pharmaceutical drug discovery efforts, in order to test different solutions for porting across GPU architectures. Here we extend MiniMDock to GPU offloading with OpenMP directives, and compare to performance of kernels using CUDA, and HIP on both NVIDIA and AMD GPUs, as well as across different compilers, exploring performance bottlenecks. We document this reverse-porting process, from highly optimized device code to a higher-level version using directives, compare code structure, and describe barriers that were overcome in this effort.


title: The Endomorphism Rings of Supersingular Elliptic Curves over $\mathbb{F}_p$ and the Binary Quadratic Forms

abstract: It is well known that there is a one-to-one correspondence between supersingular $j$-invariants up to the action of $\text{Gal}(\mathbb{F}_{p^2}/\mathbb{F}_p)$ and type classes of maximal orders in $B_{p,\infty}$ by Deuring's theorem. Interestingly, we establish a one-to-one correspondence between $\mathbb{F}_p$-isomorphism classes of supersingular elliptic curves and primitive reduced binary quadratic forms with discriminant $-p$ or $-16p$. Due to this correspondence and the fact that $\mathbb{F}_p$-isogenies between elliptic curves could be represented by quadratic forms, we show that operations of these isogenies on supersingular elliptic curves over $\mathbb{F}_p$ are compatible with the composition of quadratic forms. Based on these results, we could reduce the security of CSIDH cryptosystem to computing this correspondence explicitly.


title: Universal Segmentation of 33 Anatomies

abstract: In the paper, we present an approach for learning a single model that universally segments 33 anatomical structures, including vertebrae, pelvic bones, and abdominal organs. Our model building has to address the following challenges. Firstly, while it is ideal to learn such a model from a large-scale, fully-annotated dataset, it is practically hard to curate such a dataset. Thus, we resort to learn from a union of multiple datasets, with each dataset containing the images that are partially labeled. Secondly, along the line of partial labelling, we contribute an open-source, large-scale vertebra segmentation dataset for the benefit of spine analysis community, CTSpine1K, boasting over 1,000 3D volumes and over 11K annotated vertebrae. Thirdly, in a 3D medical image segmentation task, due to the limitation of GPU memory, we always train a model using cropped patches as inputs instead a whole 3D volume, which limits the amount of contextual information to be learned. To this, we propose a cross-patch transformer module to fuse more information in adjacent patches, which enlarges the aggregated receptive field for improved segmentation performance. This is especially important for segmenting, say, the elongated spine. Based on 7 partially labeled datasets that collectively contain about 2,800 3D volumes, we successfully learn such a universal model. Finally, we evaluate the universal model on multiple open-source datasets, proving that our model has a good generalization performance and can potentially serve as a solid foundation for downstream tasks.


title: A Variational Quantum Algorithm For Approximating Convex Roofs

abstract: Many entanglement measures are first defined for pure states of a bipartite Hilbert space, and then extended to mixed states via the convex roof extension. In this article we alter the convex roof extension of an entanglement measure, to produce a sequence of extensions that we call $f$-$d$ extensions, for $d \in \mathbb{N}$, where $f:[0,1]\to [0, \infty)$ is a fixed continuous function which vanishes only at zero. We prove that for any such function $f$, and any continuous, faithful, non-negative function, (such as an entanglement measure), $\mu$ on the set of pure states of a finite dimensional bipartite Hilbert space, the collection of $f$-$d$ extensions of $\mu$ detects entanglement, i.e. a mixed state $\rho$ on a finite dimensional bipartite Hilbert space is separable, if and only if there exists $d \in \mathbb{N}$ such that the $f$-$d$ extension of $\mu$ applied to $\rho$ is equal to zero. We introduce a quantum variational algorithm which aims to approximate the $f$-$d$ extensions of entanglement measures defined on pure states. However, the algorithm does have its drawbacks. We show that this algorithm exhibits barren plateaus when used to approximate the family of $f$-$d$ extensions of the Tsallis entanglement entropy for a certain function $f$ and unitary ansatz $U(\theta)$ of sufficient depth. In practice, if additional information about the state is known, then one needs to avoid using the suggested ansatz for long depth of circuits.


title: Learning Incrementally to Segment Multiple Organs in a CT Image

abstract: There exists a large number of datasets for organ segmentation, which are partially annotated and sequentially constructed. A typical dataset is constructed at a certain time by curating medical images and annotating the organs of interest. In other words, new datasets with annotations of new organ categories are built over time. To unleash the potential behind these partially labeled, sequentially-constructed datasets, we propose to incrementally learn a multi-organ segmentation model. In each incremental learning (IL) stage, we lose the access to previous data and annotations, whose knowledge is assumingly captured by the current model, and gain the access to a new dataset with annotations of new organ categories, from which we learn to update the organ segmentation model to include the new organs. While IL is notorious for its `catastrophic forgetting' weakness in the context of natural image analysis, we experimentally discover that such a weakness mostly disappears for CT multi-organ segmentation. To further stabilize the model performance across the IL stages, we introduce a light memory module and some loss functions to restrain the representation of different categories in feature space, aggregating feature representation of the same class and separating feature representation of different classes. Extensive experiments on five open-sourced datasets are conducted to illustrate the effectiveness of our method.


title: Chern insulator in a hyperbolic lattice

abstract: Motivated by the recent experimental realizations of hyperbolic lattices in circuit quantum electrodynamics and the research interest in the non-Euclidean generalization of topological phenomena, we investigate the Chern insulator phases in a hyperbolic $\{8,3\}$ lattice, which is made from regular octagons ($8$-gons) such that the coordination number of each lattice site is $3$. Based on the conformal projection of the hyperbolic lattice into the Euclidean plane, i.e., the Poincar\'{e} disk model, by calculating the Bott index ($B$) and the two-terminal conductance, we reveal two Chern insulator phases (with $B=1$ and $B=-1$, respectively) accompanied with quantized conductance plateaus in the hyperbolic $\{8,3\}$ lattice. The numerical calculation results of the nonequilibrium local current distribution further confirm that the quantized conductance plateau originates from the chiral edge states and the two Chern insulator phases exhibit opposite chirality. Moreover, we explore the effect of disorder on topological phases in the hyperbolic lattice. It is demonstrated that the chiral edge states of Chern insulators are robust against weak disorder in the hyperbolic lattice. More fascinating is the discovery of disorder-induced topological non-trivial phases exhibiting chiral edge states in the hyperbolic lattice, realizing a non-Euclidean analog of topological Anderson insulator. Our work provides a route for the exploration of topological non-trivial states in hyperbolic geometric systems.


title: BEATS: An Open-Source, High-Precision, Multi-Channel EEG Acquisition Tool System

abstract: Stable and accurate electroencephalogram (EEG) signal acquisition is fundamental in non-invasive brain-computer interface (BCI) technology. Commonly used EEG acquisition system's hardware and software are usually closed-source. Its inability to flexible expansion and secondary development is a major obstacle to real-time BCI research. This paper presents the Beijing University of Posts and Telecommunications EEG Acquisition Tool System named BEATS. It implements a comprehensive system from hardware to software, composed of the analog front-end, microprocessor, and software platform. BEATS is capable of collecting 32-channel EEG signals at a guaranteed sampling rate of 4k Hz with wireless transmission. Compared to state-of-the-art systems used in many EEG fields, it displays a better sampling rate. Using techniques including direct memory access, first in first out, and timer, the precision and stability of the acquisition are ensured at the microsecond level. An evaluation is conducted during 24 hours of continuous acquisitions. The data loss is 0 packets and the average maximum delay is only 0.07 s/h. Moreover, as an open source system, BEATS provides detailed design files, and adopts a plug-in structure and easy-to-access materials, which makes it can be quickly reproduced. Schematics, source code, and other materials of BEATS are available at https://github.com/buptantEEG/BEATS.


title: Partially discontinuous nodal finite elements for $H(\mathrm{curl})$ and $H(\mathrm{div})$

abstract: We investigate discretization of $H(\mathrm{curl})$ and $H(\mathrm{div})$ in two and three space dimensions by partially discontinuous nodal finite elements, i.e., vector-valued Lagrange finite elements with discontinuity in certain directions. These spaces can be implemented as a combination of continuous and discontinuous Lagrange elements and fit in de~Rham complexes. We construct well-conditioned nodal bases.


title: Interactive Image Synthesis with Panoptic Layout Generation

abstract: Interactive image synthesis from user-guided input is a challenging task when users wish to control the scene structure of a generated image with ease.Although remarkable progress has been made on layout-based image synthesis approaches, in order to get realistic fake image in interactive scene, existing methods require high-precision inputs, which probably need adjustment several times and are unfriendly to novice users. When placement of bounding boxes is subject to perturbation, layout-based models suffer from "missing regions" in the constructed semantic layouts and hence undesirable artifacts in the generated images. In this work, we propose Panoptic Layout Generative Adversarial Networks (PLGAN) to address this challenge. The PLGAN employs panoptic theory which distinguishes object categories between "stuff" with amorphous boundaries and "things" with well-defined shapes, such that stuff and instance layouts are constructed through separate branches and later fused into panoptic layouts. In particular, the stuff layouts can take amorphous shapes and fill up the missing regions left out by the instance layouts. We experimentally compare our PLGAN with state-of-the-art layout-based models on the COCO-Stuff, Visual Genome, and Landscape datasets. The advantages of PLGAN are not only visually demonstrated but quantitatively verified in terms of inception score, Fr\'echet inception distance, classification accuracy score, and coverage.


title: Grid-Forming Inverter-based Wind Turbine Generators: Comprehensive Review, Comparative Analysis, and Recommendations

abstract: High penetration of wind power with conventional grid following controls for inverter-based wind turbine generators (WTGs) weakens the power grid, challenging the power system stability. Grid-forming (GFM) controls are emerging technologies that can address such stability issues. Numerous methodologies of GFM inverters have been developed in the literature; however, their applications for WTGs have not been thoroughly explored. As WTGs need to incorporate multiple control functions to operate reliably in different operational regions, the GFM control should be appropriately developed for the WTGs. This paper presents a review of GFM controls for WTGs, which covers the latest developments in GFM controls and includes multi-loop and single-loop GFM, virtual synchronous machine-based GFM, and virtual inertia control-based GFM. A comparison study for these GFM-based WTGs regarding normal and abnormal operating conditions together with black-start capability is then performed. The control parameters of these GFM types are properly designed and optimized to enable a fair comparison. In addition, the challenges of applying these GFM controls to wind turbines are discussed, which include the impact of DC-link voltage control strategy and the current saturation algorithm on the GFM control performance, black-start capability, and autonomous operation capability. Finally, recommendations and future developments of GFM-based wind turbines to increase the power system reliability are presented.


title: Scribble-Supervised Medical Image Segmentation via Dual-Branch Network and Dynamically Mixed Pseudo Labels Supervision

abstract: Medical image segmentation plays an irreplaceable role in computer-assisted diagnosis, treatment planning, and following-up. Collecting and annotating a large-scale dataset is crucial to training a powerful segmentation model, but producing high-quality segmentation masks is an expensive and time-consuming procedure. Recently, weakly-supervised learning that uses sparse annotations (points, scribbles, bounding boxes) for network training has achieved encouraging performance and shown the potential for annotation cost reduction. However, due to the limited supervision signal of sparse annotations, it is still challenging to employ them for networks training directly. In this work, we propose a simple yet efficient scribble-supervised image segmentation method and apply it to cardiac MRI segmentation. Specifically, we employ a dual-branch network with one encoder and two slightly different decoders for image segmentation and dynamically mix the two decoders' predictions to generate pseudo labels for auxiliary supervision. By combining the scribble supervision and auxiliary pseudo labels supervision, the dual-branch network can efficiently learn from scribble annotations end-to-end. Experiments on the public ACDC dataset show that our method performs better than current scribble-supervised segmentation methods and also outperforms several semi-supervised segmentation methods.


title: Learning Category-Level Generalizable Object Manipulation Policy via Generative Adversarial Self-Imitation Learning from Demonstrations

abstract: Generalizable object manipulation skills are critical for intelligent and multi-functional robots to work in real-world complex scenes. Despite the recent progress in reinforcement learning, it is still very challenging to learn a generalizable manipulation policy that can handle a category of geometrically diverse articulated objects. In this work, we tackle this category-level object manipulation policy learning problem via imitation learning in a task-agnostic manner, where we assume no handcrafted dense rewards but only a terminal reward. Given this novel and challenging generalizable policy learning problem, we identify several key issues that can fail the previous imitation learning algorithms and hinder the generalization to unseen instances. We then propose several general but critical techniques, including generative adversarial self-imitation learning from demonstrations, progressive growing of discriminator, and instance-balancing for expert buffer, that accurately pinpoints and tackles these issues and can benefit category-level manipulation policy learning regardless of the tasks. Our experiments on ManiSkill benchmarks demonstrate a remarkable improvement on all tasks and our ablation studies further validate the contribution of each proposed technique.


title: Continual Horizontal Federated Learning for Heterogeneous Data

abstract: Federated learning is a promising machine learning technique that enables multiple clients to collaboratively build a model without revealing the raw data to each other. Among various types of federated learning methods, horizontal federated learning (HFL) is the best-studied category and handles homogeneous feature spaces. However, in the case of heterogeneous feature spaces, HFL uses only common features and leaves client-specific features unutilized. In this paper, we propose a HFL method using neural networks named continual horizontal federated learning (CHFL), a continual learning approach to improve the performance of HFL by taking advantage of unique features of each client. CHFL splits the network into two columns corresponding to common features and unique features, respectively. It jointly trains the first column by using common features through vanilla HFL and locally trains the second column by using unique features and leveraging the knowledge of the first one via lateral connections without interfering with the federated training of it. We conduct experiments on various real world datasets and show that CHFL greatly outperforms vanilla HFL that only uses common features and local learning that uses all features that each client has.


title: Revisiting Linearized Bregman Iterations under Lipschitz-like Convexity Condition

abstract: The linearized Bregman iterations (LBreI) and its variants have received considerable attention in signal/image processing and compressed sensing. Recently, LBreI has been extended to a larger class of nonconvex functions, along with several theoretical issues left for further investigation. In particular, the gradient Lipschitz continuity assumption precludes its use in many practical applications. In this study, we propose a generalized algorithmic framework to unify LBreI-type methods. Our main discovery is that the gradient Lipschitz continuity assumption can be replaced by a Lipschitz-like convexity condition in both convex and nonconvex cases. The proposed framework and theory are then applied to linear/quadratic inverse problems.


title: FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosis

abstract: Many works have shown that deep learning-based medical image classification models can exhibit bias toward certain demographic attributes like race, gender, and age. Existing bias mitigation methods primarily focus on learning debiased models, which may not necessarily guarantee all sensitive information can be removed and usually comes with considerable accuracy degradation on both privileged and unprivileged groups. To tackle this issue, we propose a method, FairPrune, that achieves fairness by pruning. Conventionally, pruning is used to reduce the model size for efficient inference. However, we show that pruning can also be a powerful tool to achieve fairness. Our observation is that during pruning, each parameter in the model has different importance for different groups' accuracy. By pruning the parameters based on this importance difference, we can reduce the accuracy difference between the privileged group and the unprivileged group to improve fairness without a large accuracy drop. To this end, we use the second derivative of the parameters of a pre-trained model to quantify the importance of each parameter with respect to the model accuracy for each group. Experiments on two skin lesion diagnosis datasets over multiple sensitive attributes demonstrate that our method can greatly improve fairness while keeping the average accuracy of both groups as high as possible.


title: Controllability of Multilayer Networked Sampled-data Systems

abstract: This paper explores the state controllability of multilayer networked sampled-data systems with inter-layer couplings, where zero-order holders (ZOHs) are on the control and transmission channels. The effects of both single- and multi-rate sampling on controllability of multilayer networked linear time-invariant (LTI) systems are analyzed, with some sufficient and/or necessary controllability conditions derived. Under specific conditions, the pathological sampling of single node systems could be eliminated by the network structure and inner couplings among different nodes and different layers. The representative drive-response inter-layer coupling mode is studied, and it reveals that the whole system could be controllable due to the inter-layer couplings even if the response layer is uncontrollable itself. Moreover, simulated examples show that the modification of sampling rate on local channels could lay a positive or negative effect on the controllability of the whole system. All the results indicate that the controllability of the multilayer networked sampled-data system is collectively affected by mutually coupled factors.


title: Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Driving

abstract: Pseudo-LiDAR 3D detectors have made remarkable progress in monocular 3D detection by enhancing the capability of perceiving depth with depth estimation networks, and using LiDAR-based 3D detection architectures. The advanced stereo 3D detectors can also accurately localize 3D objects. The gap in image-to-image generation for stereo views is much smaller than that in image-to-LiDAR generation. Motivated by this, we propose a Pseudo-Stereo 3D detection framework with three novel virtual view generation methods, including image-level generation, feature-level generation, and feature-clone, for detecting 3D objects from a single image. Our analysis of depth-aware learning shows that the depth loss is effective in only feature-level virtual view generation and the estimated depth map is effective in both image-level and feature-level in our framework. We propose a disparity-wise dynamic convolution with dynamic kernels sampled from the disparity feature map to filter the features adaptively from a single image for generating virtual image features, which eases the feature degradation caused by the depth estimation errors. Till submission (November 18, 2021), our Pseudo-Stereo 3D detection framework ranks 1st on car, pedestrian, and cyclist among the monocular 3D detectors with publications on the KITTI-3D benchmark. The code is released at https://github.com/revisitq/Pseudo-Stereo-3D.


title: FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context

abstract: We advance sketch research to scenes with the first dataset of freehand scene sketches, FS-COCO. With practical applications in mind, we collect sketches that convey scene content well but can be sketched within a few minutes by a person with any sketching skills. Our dataset comprises 10,000 freehand scene vector sketches with per point space-time information by 100 non-expert individuals, offering both object- and scene-level abstraction. Each sketch is augmented with its text description. Using our dataset, we study for the first time the problem of fine-grained image retrieval from freehand scene sketches and sketch captions. We draw insights on: (i) Scene salience encoded in sketches using the strokes temporal order; (ii) Performance comparison of image retrieval from a scene sketch and an image caption; (iii) Complementarity of information in sketches and image captions, as well as the potential benefit of combining the two modalities. In addition, we extend a popular vector sketch LSTM-based encoder to handle sketches with larger complexity than was supported by previous work. Namely, we propose a hierarchical sketch decoder, which we leverage at a sketch-specific "pre-text" task. Our dataset enables for the first time research on freehand scene sketch understanding and its practical applications.


title: MixCL: Pixel label matters to contrastive learning

abstract: Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing self-supervised methods applied in natural imaging tasks focus on designing proxy tasks for unlabeled data. For example, contrastive learning is often based on the fact that an image and its transformed version share the same identity. However, pixel annotations contain much valuable information for medical image segmentation, which is largely ignored in contrastive learning. In this work, we propose a novel pre-training framework called Mixed Contrastive Learning (MixCL) that leverages both image identities and pixel labels for better modeling by maintaining identity consistency, label consistency, and reconstruction consistency together. Consequently, thus pre-trained model has more robust representations that characterize medical images. Extensive experiments demonstrate the effectiveness of the proposed method, improving the baseline by 5.28% and 14.12% in Dice coefficient when 5% labeled data of Spleen and 15% of BTVC are used in fine-tuning, respectively.


title: Towards Benchmarking and Evaluating Deepfake Detection

abstract: Deepfake detection automatically recognizes the manipulated medias through the analysis of the difference between manipulated and non-altered videos. It is natural to ask which are the top performers among the existing deepfake detection approaches to identify promising research directions and provide practical guidance. Unfortunately, it's difficult to conduct a sound benchmarking comparison of existing detection approaches using the results in the literature because evaluation conditions are inconsistent across studies. Our objective is to establish a comprehensive and consistent benchmark, to develop a repeatable evaluation procedure, and to measure the performance of a range of detection approaches so that the results can be compared soundly. A challenging dataset consisting of the manipulated samples generated by more than 13 different methods has been collected, and 11 popular detection approaches (9 algorithms) from the existing literature have been implemented and evaluated with 6 fair-minded and practical evaluation metrics. Finally, 92 models have been trained and 644 experiments have been performed for the evaluation. The results along with the shared data and evaluation methodology constitute a benchmark for comparing deepfake detection approaches and measuring progress.


title: In the Service of Online Order: Tackling Cyber-Bullying with Machine Learning and Affect Analysis

abstract: One of the burning problems lately in Japan has been cyber-bullying, or slandering and bullying people online. The problem has been especially noticed on unofficial Web sites of Japanese schools. Volunteers consisting of school personnel and PTA (Parent-Teacher Association) members have started Online Patrol to spot malicious contents within Web forums and blogs. In practise, Online Patrol assumes reading through the whole Web contents, which is a task difficult to perform manually. With this paper we introduce a research intended to help PTA members perform Online Patrol more efficiently. We aim to develop a set of tools that can automatically detect malicious entries and report them to PTA members. First, we collected cyber-bullying data from unofficial school Web sites. Then we performed analysis of this data in two ways. Firstly, we analysed the entries with a multifaceted affect analysis system in order to find distinctive features for cyber-bullying and apply them to a machine learning classifier. Secondly, we applied a SVM based machine learning method to train a classifier for detection of cyber-bullying. The system was able to classify cyber-bullying entries with 88.2% of balanced F-score.


title: Quaternionic metamonogenic functions in the unit disk

abstract: We construct a set of quaternionic metamonogenic functions (that is, in $\mbox{Ker}(D+\lambda)$ for diverse $\lambda$) in the unit disk, such that every metamonogenic function is approximable in the quaternionic Hilbert module $L^2$ of the disk. The set is orthogonal except for the small subspace of elements of orders zero and one. These functions are used to express time-dependent solutions of the imaginary-time wave equation in the polar coordinate system.


title: OmniWheg: An Omnidirectional Wheel-Leg Transformable Robot

abstract: This paper presents the design, analysis, and performance evaluation of an omnidirectional transformable wheel-leg robot called OmniWheg. We design a novel mechanism consisting of a separable omni-wheel and 4-bar linkages, allowing the robot to transform between omni-wheeled and legged modes smoothly. In wheeled mode, the robot can move in all directions and efficiently adjust the relative position of its wheels, while it can overcome common obstacles in legged mode, such as stairs and steps. Unlike other articles studying whegs, this implementation with omnidirectional wheels allows the correction of misalignments between right and left wheels before traversing obstacles, which effectively improves the success rate and simplifies the preparation process before the wheel-leg transformation. We describe the design concept, mechanism, and the dynamic characteristic of the wheel-leg structure. We then evaluate its performance in various scenarios, including passing obstacles, climbing steps of different heights, and turning/moving omnidirectionally. Our results confirm that this mobile platform can overcome common indoor obstacles and move flexibly on the flat ground with the new transformable wheel-leg mechanism, while keeping a high degree of stability.


title: GraspARL: Dynamic Grasping via Adversarial Reinforcement Learning

abstract: Grasping moving objects, such as goods on a belt or living animals, is an important but challenging task in robotics. Conventional approaches rely on a set of manually defined object motion patterns for training, resulting in poor generalization to unseen object trajectories. In this work, we introduce an adversarial reinforcement learning framework for dynamic grasping, namely GraspARL. To be specific. we formulate the dynamic grasping problem as a 'move-and-grasp' game, where the robot is to pick up the object on the mover and the adversarial mover is to find a path to escape it. Hence, the two agents play a min-max game and are trained by reinforcement learning. In this way, the mover can auto-generate diverse moving trajectories while training. And the robot trained with the adversarial trajectories can generalize to various motion patterns. Empirical results on the simulator and real-world scenario demonstrate the effectiveness of each and good generalization of our method.


title: Truncation Error Analysis for an Accurate Nonlocal Manifold Poisson Model with Dirichlet Boundary

abstract: In this work, we introduced a class of nonlocal models to accurately approximate the Poisson model on manifolds that are embedded in high dimensional Euclid spaces with Dirichlet boundary. In comparison to the existing nonlocal Poisson models, instead of utilizing volumetric boundary constraint to reduce the truncation error to its local counterpart, we rely on the Poisson equation itself along the boundary to explicitly express the second order normal derivative by some geometry-based terms, so that to create a new model with $\mathcal{O}(\delta)$ truncation error along the $2\delta-$boundary layer and $\mathcal{O}(\delta^2)$ at interior, with $\delta$ be the nonlocal interaction horizon. Our concentration is on the construction and the truncation error analysis of such nonlocal model. The control on the truncation error is currently optimal among all nonlocal models, and is sufficient to attain second order localization rate that will be derived in our subsequent work.


title: Adversarial Patterns: Building Robust Android Malware Classifiers

abstract: Machine learning models are increasingly being adopted across various fields, such as medicine, business, autonomous vehicles, and cybersecurity, to analyze vast amounts of data, detect patterns, and make predictions or recommendations. In the field of cybersecurity, these models have made significant improvements in malware detection. However, despite their ability to understand complex patterns from unstructured data, these models are susceptible to adversarial attacks that perform slight modifications in malware samples, leading to misclassification from malignant to benign. Numerous defense approaches have been proposed to either detect such adversarial attacks or improve model robustness. These approaches have resulted in a multitude of attack and defense techniques and the emergence of a field known as `adversarial machine learning.' In this survey paper, we provide a comprehensive review of adversarial machine learning in the context of Android malware classifiers. Android is the most widely used operating system globally and is an easy target for malicious agents. The paper first presents an extensive background on Android malware classifiers, followed by an examination of the latest advancements in adversarial attacks and defenses. Finally, the paper provides guidelines for designing robust malware classifiers and outlines research directions for the future.


title: Two-dimensional ionic crystals: The cases of IA-VII alkali halides and IA-IB CsAu

abstract: The alkali halides, known as ionic crystals, have the NaCl-type or CsCl-type structure as the ground state. We study the structural, vibrational, and electronic properties of two-dimensional (2D) ionic crystals from first-principles. Two potential structures that are hexagonal and tetragonal are investigated as structural templates. Through phonon dispersion calculations, 8 and 16 out of 20 alkali halides in the hexagonal and tetragonal structures are dynamically stable, respectively. The electron energy gaps range from 6.8 eV for LiF to 3.9 eV for RbI and CsI in the tetragonal structure within the generalized gradient approximation. By considering the Madelung energy and the core-core repulsion, we propose a hard sphere model that accounts for the nearest-neighbor bond length and the cohesive energy of 2D alkali halides. The 2D CsAu in the tetragonal structure is also predicted to be stable as an ionic crystal including only metallic elements, showing a band gap of 2.6 eV that is higher than that of the 3D counterparts.


title: Detecting Offensive Language on Social Networks: An End-to-end Detection Method based on Graph Attention Networks

abstract: The pervasiveness of offensive language on the social network has caused adverse effects on society, such as abusive behavior online. It is urgent to detect offensive language and curb its spread. Existing research shows that methods with community structure features effectively improve the performance of offensive language detection. However, the existing models deal with community structure independently, which seriously affects the effectiveness of detection models. In this paper, we propose an end-to-end method based on community structure and text features for offensive language detection (CT-OLD). Specifically, the community structure features are directly captured by the graph attention network layer, and the text embeddings are taken from the last hidden layer of BERT. Attention mechanisms and position encoding are used to fuse these features. Meanwhile, we add user opinion to the community structure for representing user features. The user opinion is represented by user historical behavior information, which outperforms that represented by text information. Besides the above point, the distribution of users and tweets is unbalanced in the popular datasets, which limits the generalization ability of the model. To address this issue, we construct and release a dataset with reasonable user distribution. Our method outperforms baselines with the F1 score of 89.94%. The results show that the end-to-end model effectively learns the potential information of community structure and text, and user historical behavior information is more suitable for user opinion representation.


title: Abuse and Fraud Detection in Streaming Services Using Heuristic-Aware Machine Learning

abstract: This work presents a fraud and abuse detection framework for streaming services by modeling user streaming behavior. The goal is to discover anomalous and suspicious incidents and scale the investigation efforts by creating models that characterize the user behavior. We study the use of semi-supervised as well as supervised approaches for anomaly detection. In the semi-supervised approach, by leveraging only a set of authenticated anomaly-free data samples, we show the use of one-class classification algorithms as well as autoencoder deep neural networks for anomaly detection. In the supervised anomaly detection task, we present a so-called heuristic-aware data labeling strategy for creating labeled data samples. We carry out binary classification as well as multi-class multi-label classification tasks for not only detecting the anomalous samples but also identifying the underlying anomaly behavior(s) associated with each one. Finally, using a systematic feature importance study we provide insights into the underlying set of features that characterize different streaming fraud categories. To the best of our knowledge, this is the first paper to use machine learning methods for fraud and abuse detection in real-world scale streaming services.


title: Pressure-induced structural phase transition of vanadium: A revisit from the perspective of ensemble theory

abstract: For realistic crystals, the free energy strictly formulated in ensemble theory can hardly be obtained because of the difficulty in solving the high-dimension integral of the partition function, the dilemma of which makes it even a doubt if the rigorous ensemble theory is applicable to phase transitions of condensed matters. In the present work, the partition function of crystal vanadium under compression up to $320$ GPa at room temperature is solved by an approach developed very recently, and the derived equation of state is in a good agreement with all the experimental measurements, especially the latest one covering the widest pressure range up to $300$ GPa. Furthermore, the derived Gibbs free energy proves the very argument to understand most of the experiments reported in the past decade on the pressure-induced phase transition, and, especially, a novel phase transition sequence concerning three different phases observed very recently and the measured angles of two phases agree with our theoretical results excellently.


title: Ultrasound-Guided Assistive Robots for Scoliosis Assessment with Optimization-based Control and Variable Impedance

abstract: Assistive robots for healthcare have seen a growing demand due to the great potential of relieving medical practitioners from routine jobs. In this paper, we investigate the development of an optimization-based control framework for an ultrasound-guided assistive robot to perform scoliosis assessment. A conventional procedure for scoliosis assessment with ultrasound imaging typically requires a medical practitioner to slide an ultrasound probe along a patient's back. To automate this type of procedure, we need to consider multiple objectives, such as contact force, position, orientation, energy, posture, etc. To address the aforementioned components, we propose to formulate the control framework design as a quadratic programming problem with each objective weighed by its task priority subject to a set of equality and inequality constraints. In addition, as the robot needs to establish constant contact with the patient during spine scanning, we incorporate variable impedance regulation of the end-effector position and orientation in the control architecture to enhance safety and stability during the physical human-robot interaction. Wherein, the variable impedance gains are retrieved by learning from the medical expert's demonstrations. The proposed methodology is evaluated by conducting real-world experiments of autonomous scoliosis assessment with a robot manipulator xArm. The effectiveness is verified by the obtained coronal spinal images of both a phantom and a human subject.


title: A hierarchy of efficient bounds on quantum capacities exploiting symmetry

abstract: Optimal rates for achieving an information processing task are often characterized in terms of regularized information measures. In many cases of quantum tasks, we do not know how to compute such quantities. Here, we exploit the symmetries in the recently introduced $D^{\#}$ in order to obtain a hierarchy of semidefinite programming bounds on various regularized quantities. As applications, we give a general procedure to give efficient bounds on the regularized Umegaki channel divergence as well as the classical capacity and two-way assisted quantum capacity of quantum channels. In particular, we obtain slight improvements for the capacity of the amplitude damping channel. We also prove that for fixed input and output dimensions, the regularized sandwiched R\'enyi divergence between any two quantum channels can be approximated up to an $\epsilon$ accuracy in time that is polynomial in $1/\epsilon$.


title: Distributionally Robust Bayesian Optimization with $\varphi$-divergences

abstract: The study of robustness has received much attention due to its inevitability in data-driven settings where many systems face uncertainty. One such example of concern is Bayesian Optimization (BO), where uncertainty is multi-faceted, yet there only exists a limited number of works dedicated to this direction. In particular, there is the work of Kirschner et al. (2020), which bridges the existing literature of Distributionally Robust Optimization (DRO) by casting the BO problem from the lens of DRO. While this work is pioneering, it admittedly suffers from various practical shortcomings such as finite contexts assumptions, leaving behind the main question Can one devise a computationally tractable algorithm for solving this DRO-BO problem? In this work, we tackle this question to a large degree of generality by considering robustness against data-shift in $\varphi$-divergences, which subsumes many popular choices, such as the $\chi^2$-divergence, Total Variation, and the extant Kullback-Leibler (KL) divergence. We show that the DRO-BO problem in this setting is equivalent to a finite-dimensional optimization problem which, even in the continuous context setting, can be easily implemented with provable sublinear regret bounds. We then show experimentally that our method surpasses existing methods, attesting to the theoretical results.


title: Coexistence of extended and localized states in one-dimensional non-Hermitian Anderson model

abstract: In one-dimensional Hermitian tight-binding models, mobility edges separating extended and localized states can appear in the presence of properly engineered quasi-periodical potentials and coupling constants. On the other hand, mobility edges don't exist in a one-dimensional Anderson lattice since localization occurs whenever a diagonal disorder through random numbers is introduced. Here, we consider a nonreciprocal non-Hermitian lattice and show that the coexistence of extended and localized states appears with or without diagonal disorder in the topologically nontrivial region. We discuss that the mobility edges appear basically due to the boundary condition sensitivity of the nonreciprocal non-Hermitian lattice.


title: Mapping evolving population geography in China

abstract: China's demographic changes have important global economic and geopolitical implications. Yet, our understanding of such transitions at the micro-spatial scale remains limited due to spatial inconsistency of the census data caused by administrative boundary adjustments. To fill this gap, we manually collected and built a population census panel from 2010 to 2020 at both the county and prefectural-city levels. We show that the massive internal migration drives China's increasing population concentration and regional disparity, resulting in severe population aging in shrinking cities and increasing gender imbalance in growing cities.


title: 3D endoscopic depth estimation using 3D surface-aware constraints

abstract: Robotic-assisted surgery allows surgeons to conduct precise surgical operations with stereo vision and flexible motor control. However, the lack of 3D spatial perception limits situational awareness during procedures and hinders mastering surgical skills in the narrow abdominal space. Depth estimation, as a representative perception task, is typically defined as an image reconstruction problem. In this work, we show that depth estimation can be reformed from a 3D surface perspective. We propose a loss function for depth estimation that integrates the surface-aware constraints, leading to a faster and better convergence with the valid information from spatial information. In addition, camera parameters are incorporated into the training pipeline to increase the control and transparency of the depth estimation. We also integrate a specularity removal module to recover more buried image information. Quantitative experimental results on endoscopic datasets and user studies with medical professionals demonstrate the effectiveness of our method.


title: Thermal Relaxation of Dark Matter Admixed Neutron Star

abstract: Motivated by the various theoretical studies regarding the efficient capturing of dark matter by neutron stars, we explore the possible indirect effects of captured dark matter on the cooling mechanism of a neutron star. The equation of states for different configurations of dark matter admixed star at finite temperature is obtained using the relativistic mean-field formalism with the IOPB-I parameter set. We show that the variation in the dark matter momentum vastly modifies the neutrino emissivity through specific neutrino generating processes of the star. The specific heat and the thermal conductivity of a dark matter admixed star have also been investigated to explore the propagation of cooling waves in the interior of the star. The dependence of theoretical surface temperature cooling curves on the equation of state and chemical composition of the stellar matter has also been discussed along with the observational data of thermal radiation from various sources. We observed that the dark matter admixed canonical stars with $k_{f}^{\rm DM} > 0.04$ comply with the fast cooling scenario. Further, the metric for internal thermal relaxation epoch has also been calculated with different dark matter momentum and we deduced that increment of dark matter segment amplify the cooling and internal relaxation rates of the star.


title: A Versatile Multi-View Framework for LiDAR-based 3D Object Detection with Guidance from Panoptic Segmentation

abstract: 3D object detection using LiDAR data is an indispensable component for autonomous driving systems. Yet, only a few LiDAR-based 3D object detection methods leverage segmentation information to further guide the detection process. In this paper, we propose a novel multi-task framework that jointly performs 3D object detection and panoptic segmentation. In our method, the 3D object detection backbone in Bird's-Eye-View (BEV) plane is augmented by the injection of Range-View (RV) feature maps from the 3D panoptic segmentation backbone. This enables the detection backbone to leverage multi-view information to address the shortcomings of each projection view. Furthermore, foreground semantic information is incorporated to ease the detection task by highlighting the locations of each object class in the feature maps. Finally, a new center density heatmap generated based on the instance-level information further guides the detection backbone by suggesting possible box center locations for objects. Our method works with any BEV-based 3D object detection method, and as shown by extensive experiments on the nuScenes dataset, it provides significant performance gains. Notably, the proposed method based on a single-stage CenterPoint 3D object detection network achieved state-of-the-art performance on nuScenes 3D Detection Benchmark with 67.3 NDS.


title: Stochastic hydrodynamics and hydro-kinetics: Similarities and differences

abstract: The hydro-kinetic formalism has been used as a complementary approach to solving the Stochastic Differential Equations (SDE) corresponding to noisy hydrodynamics. The hydro-kinetic formalism consists of a deterministic set of relaxation type equations that tracks the evolution of 2-point correlation functions of stochastic hydrodynamic quantities. Hence they are comparatively easier to solve than the SDEs, which are computationally intensive and need to deal with arbitrarily large gradients. This work compares the two approaches for the propagation and diffusion of conserved charge fluctuations in the Bjorken hydrodynamic model. For white noise, the two approaches agree. For colored Catteneo noise, which is causal, the two approaches diverge. This is because white noise only induces two-point correlations, while Catteneo noise also induces higher-order correlations. This difference is quantified from the effects of causal evolution and influence from higher-order correlations induced by the Catteneo noise.


title: Continual Few-shot Relation Learning via Embedding Space Regularization and Data Augmentation

abstract: Existing continual relation learning (CRL) methods rely on plenty of labeled training data for learning a new task, which can be hard to acquire in real scenario as getting large and representative labeled data is often expensive and time-consuming. It is therefore necessary for the model to learn novel relational patterns with very few labeled data while avoiding catastrophic forgetting of previous task knowledge. In this paper, we formulate this challenging yet practical problem as continual few-shot relation learning (CFRL). Based on the finding that learning for new emerging few-shot tasks often results in feature distributions that are incompatible with previous tasks' learned distributions, we propose a novel method based on embedding space regularization and data augmentation. Our method generalizes to new few-shot tasks and avoids catastrophic forgetting of previous tasks by enforcing extra constraints on the relational embeddings and by adding extra {relevant} data in a self-supervised manner. With extensive experiments we demonstrate that our method can significantly outperform previous state-of-the-art methods in CFRL task settings.


title: Dynamical Control of Interlayer Excitons and Trions in WSe$_2$/Mo$_{0.5}$W$_{0.5}$Se$_2$ Heterobilayer via Tunable Near-Field Cavity

abstract: Emerging photo-induced excitonic processes in transition metal dichalcogenide (TMD) heterobilayers, e.g., coupling, dephasing, and energy transfer of intra- and inter-layer excitons, allow new opportunities for ultrathin photonic devices. Yet, with the associated large degree of spatial heterogeneity, understanding and controlling their complex competing interactions at the nanoscale remains a challenge. Here, we present an all-round dynamic control of intra- and inter-layer excitonic processes in a WSe$_2$/Mo$_{0.5}$W$_{0.5}$Se$_2$ heterobilayer using multifunctional tip-enhanced photoluminescence (TEPL) spectroscopy. Specifically, we control the radiative recombination path and emission rate, electronic bandgap energy, and neutral to charged exciton conversion with <20 nm spatial resolution in a reversible manner. It is achieved through the tip-induced engineering of Au tip-heterobilayer distance and interlayer distance, GPa scale local pressure, and plasmonic hot-electron injection respectively, with simultaneous spectroscopic TEPL measurements. This unique nano-opto-electro-mechanical control approach provides new strategies for developing versatile nano-excitonic devices based on TMD heterobilayers.


title: Product structure and regularity theorem for totally nonnegative flag varieties

abstract: The totally nonnegative flag variety was introduced by Lusztig. It has enriched combinatorial, geometric, and Lie-theoretic structures. In this paper, we introduce a (new) $J$-total positivity on the full flag variety of an arbitrary Kac-Moody group, generalizing the (ordinary) total positivity. We show that the $J$-totally nonnegative flag variety has a cellular decomposition into totally positive $J$-Richardson varieties. Moreover, each totally positive $J$-Richardson variety admits a favorable decomposition, called a product structure. Combined with the generalized Poincare conjecture, we prove that the closure of each totally positive $J$-Richardson variety is a regular CW complex homeomorphic to a closed ball. Moreover, the $J$-total positivity on the full flag provides a model for the (ordinary) totally nonnegative partial flag variety. As a consequence, we prove that the closure of each (ordinary) totally positive Richardson variety is a regular CW complex homeomorphic to a closed ball, confirming conjectures of Galashin, Karp and Lam.


title: Spontaneous Polarization Induced Photovoltaic Effect In Rhombohedrally Stacked MoS$_2$

abstract: Stacking order in van der Waals materials determines the coupling between atomic layers and is therefore key to the materials' properties. By exploring different stacking orders, many novel physical phenomena have been realized in artificial vdW stacks. Recently, 2D ferroelectricity has been observed in zero-degree aligned hBN and graphene-hBN heterostructures, holding promise in a range of electronic applications. In those artificial stacks, however, the single domain size is limited by the stacking-angle misalignment to about 0.1 to 1 $\mu$m, which is incompatible with most optical or optoelectronic applications. Here we show MoS$_2$ in the rhombohedral phase can host a homogeneous spontaneous polarization throughout few-$\mu$m-sized exfoliated flakes, as it is a natural crystal requiring no stacking and is, therefore free of misalignment. Utilizing this homogeneous polarization and its induced depolarization field (DEP), we build a graphene-MoS$_2$ based photovoltaic device with high efficiency. The few-layer MoS$_2$ is thinner than most oxide-based ferroelectric films, which allows us to maximize the DEP and study its impact at the atomically thin limit, while the highly uniform polarization achievable in the commensurate crystal enables a tangible path for up-scaling. The external quantum efficiency of our device is up to 16% at room temperature, over one order larger than the highest efficiency observed in bulk photovoltaic devices, owing to the reduced screening in graphene, the exciton-enhanced light-matter interaction, and the ultrafast interlayer relaxation in MoS$_2$. In view of the wide range of bandgap energy in other TMDs, our findings make rhombohedral TMDs a promising and versatile candidate for applications such as energy-efficient photo-detection with high speed and programmable polarity.


title: Search for the Majorana Nature of Neutrinos in the Inverted Mass Ordering Region with KamLAND-Zen

abstract: The KamLAND-Zen experiment has provided stringent constraints on the neutrinoless double-beta ($0\nu\beta\beta$) decay half-life in $^{136}$Xe using a xenon-loaded liquid scintillator. We report an improved search using an upgraded detector with almost double the amount of xenon and an ultralow radioactivity container, corresponding to an exposure of 970 kg yr of $^{136}$Xe. These new data provide valuable insight into backgrounds, especially from cosmic muon spallation of xenon, and have required the use of novel background rejection techniques. We obtain a lower limit for the $0\nu\beta\beta$ decay half-life of $T_{1/2}^{0\nu} > 2.3 \times 10^{26}$ yr at 90% C.L., corresponding to upper limits on the effective Majorana neutrino mass of 36-156 meV using commonly adopted nuclear matrix element calculations.


title: Whiplash Gradient Descent Dynamics

abstract: In this paper, we propose the Whiplash Inertial Gradient dynamics, a closed-loop optimization method that utilises gradient information, to find the minima of a cost function in finite-dimensional settings. We introduce the symplectic asymptotic convergence analysis for the Whiplash system for convex functions. We also introduce relaxation sequences to explain the non-classical nature of the algorithm and an exploring heuristic variant of the Whiplash algorithm to escape saddle points, deterministically. We study the algorithm's performance for various costs and provide a practical methodology for analyzing convergence rates using integral constraint bounds and a novel Lyapunov rate method. Our results demonstrate polynomial and exponential rates of convergence for quadratic cost functions.


title: Weighted Simultaneous Algebra Reconstruction Technique (wSART) for Additive Light Field Synthesis

abstract: We apply an iterative weighting scheme for additive light field synthesis. Unlike previous work optimizing additive light field evenly over viewpoints, we constrain the optimization to deliver a reconstructed light field of high image quality for viewpoints of large weight.


title: Benchmarking tunnel and encryption methodologies in cloud environments

abstract: The recent past has seen the adoption of multi-cloud deployments by enterprises due to availability, features, and regulatory requirements. A typical deployment involves parts of an application/workloads running inside a private cloud with the other parts spread across multiple on-prem/public clouds. Typical cluster-to-cluster networking in such deployments involve the establishment of site-to-site encrypted tunnels to connect the workloads. In this report, we benchmark the performance of various tunneling and encryption technologies to provide directions on their use in multi-cloud deployments. Based on the various experiments conducted on three different testbeds, we present quantifiable data which can be leveraged by operators and cloud providers tasked with design and development decisions of multi-cloud network connectivity and orchestration.


title: Generalized probability and current densities: A Field theory

abstract: We introduce a generalized Lagrangian density - involving a non-Hermitian kinetic term - for a quantum particle with the generalized momentum operator. Upon variation of the Lagrangian, we obtain the corresponding Schr\"odinger equation. The extended probability and particle current densities are found which satisfy the continuity equation.


title: X-ray constraint for the unseen companion of V723 Mon: it is a mass-gap black hole rather than binary neutron stars

abstract: Recently, the red giant V723 Mon is reported to have an unseen companion with a mass of $3.04\pm0.06M_{\odot}$, but question remains about whether it is a single (thus the so-called mass-gap) black hole or an inner binary of two more ordinary compact objects (neutron stars or white dwarfs). In this work, we estimate the X-ray emission by considering the wind-fed accretion from V723 Mon onto the compact companion. We analyze three different scenarios of the dark companion, i.e., a single black hole, binary neutron stars and binary of a neutron star and a white dwarf. We show that the single black hole is the most favored scenario. We also calculate the synchrotron emission from the bow shock caused by the interaction of the compact companion with the wind. We find this emission peaks at $\sim$ 0.1-1 GHz, with a flux density $\sim$ 1 mJy, which is expected to be detected by observations with higher angular resolution in the future.


title: Second-order magnetic responses in quantum magnets: Magnetization under ac magnetic fields

abstract: We investigate second-order magnetic responses of quantum magnets against ac magnetic fields. We focus on the case where the $z$ component of the spin is conserved in the unperturbed Hamiltonian and the driving field is applied in the $xy$ plane. We find that linearly polarized driving fields induce a second-harmonic response, while circularly polarized fields generate only a zero-frequency response, leading to a magnetization with a direction determined by the helicity. Employing an unbiased numerical method, we demonstrate the nonlinear magnetic effect driven by the circularly polarized field in the XXZ model and show that the magnitude of the magnetization can be predicted by the dynamical spin structure factor in the linear response regime.


title: Attention Concatenation Volume for Accurate and Efficient Stereo Matching

abstract: Stereo matching is a fundamental building block for many vision and robotics applications. An informative and concise cost volume representation is vital for stereo matching of high accuracy and efficiency. In this paper, we present a novel cost volume construction method which generates attention weights from correlation clues to suppress redundant information and enhance matching-related information in the concatenation volume. To generate reliable attention weights, we propose multi-level adaptive patch matching to improve the distinctiveness of the matching cost at different disparities even for textureless regions. The proposed cost volume is named attention concatenation volume (ACV) which can be seamlessly embedded into most stereo matching networks, the resulting networks can use a more lightweight aggregation network and meanwhile achieve higher accuracy, e.g. using only 1/25 parameters of the aggregation network can achieve higher accuracy for GwcNet. Furthermore, we design a highly accurate network (ACVNet) based on our ACV, which achieves state-of-the-art performance on several benchmarks.


title: Non-Hermitian Morphing of Topological Modes

abstract: Topological modes (TMs) are usually localized at defects or boundaries of a much larger topological lattice. Recent studies of non-Hermitian band theories unveiled the non-Hermitian skin effect (NHSE), by which the bulk states collapse to the boundary as skin modes. Here, we experimentally demonstrate that the NHSE can conversely affect wavefunctions of TMs by delocalizing them from the boundary. At a critical non-Hermitian parameter, the in-gap TMs even become completely extended in the entire bulk lattice, forming an extended mode outside of a continuum. These extended modes are still protected by bulk-band topology, making them robust against local disorders. The delocalization effect is experimentally realized in active mechanical lattices in both one-dimensional (1D) and two-dimensional (2D) topological lattices, as well as in a higher-order topological lattice. Furthermore, by the judicious engineering of the non-Hermiticity distribution, the TMs can deform into a diversity of shapes. Our findings not only broaden and deepen the current understanding of the TMs and the NHSE but also open new grounds for topological applications.


title: On Uses of Van der Waerden Test: A Graphical Approach

abstract: Although several nonparametric tests are available for testing population identical distributions or equal means in multiple groups problem, the Van der Waerden test has asymptotically the same efficiency as the classical one-way analysis of variance test under normality assumption where it depends on inverse normal score. In this study the Waerden test statistic is used to create a form that assists in deriving adjusted p values chart in terms of Bonferroni and Benjamini-Hochberg methods. The sampling distribution of the proposed form is derived as a gamma distribution that utilized to acquire initial p values. The proposed method will provide well recognition and deep knowledge where the changes occur. Simulation study is executed to study the characteristic of the proposed method in terms of size and power of the test and compared with original Waerden test and one-way analysis of variance test. The results are of great practical values since the proposed method stretches visible shape to decision maker to gives complete picture and deep insight where the differences happen, keep size and power of the test almost similar to original Waerden test and gives a glimpse of various information that completes the pairwise comparisons. To show the benefits of the proposed method, two applications are presented.


title: HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging

abstract: The rapid development of deep learning provides a better solution for the end-to-end reconstruction of hyperspectral image (HSI). However, existing learning-based methods have two major defects. Firstly, networks with self-attention usually sacrifice internal resolution to balance model performance against complexity, losing fine-grained high-resolution (HR) features. Secondly, even if the optimization focusing on spatial-spectral domain learning (SDL) converges to the ideal solution, there is still a significant visual difference between the reconstructed HSI and the truth. Therefore, we propose a high-resolution dual-domain learning network (HDNet) for HSI reconstruction. On the one hand, the proposed HR spatial-spectral attention module with its efficient feature fusion provides continuous and fine pixel-level features. On the other hand, frequency domain learning (FDL) is introduced for HSI reconstruction to narrow the frequency domain discrepancy. Dynamic FDL supervision forces the model to reconstruct fine-grained frequencies and compensate for excessive smoothing and distortion caused by pixel-level losses. The HR pixel-level attention and frequency-level refinement in our HDNet mutually promote HSI perceptual quality. Extensive quantitative and qualitative evaluation experiments show that our method achieves SOTA performance on simulated and real HSI datasets. Code and models will be released at https://github.com/caiyuanhao1998/MST


title: Time-aware Graph Neural Networks for Entity Alignment between Temporal Knowledge Graphs

abstract: Entity alignment aims to identify equivalent entity pairs between different knowledge graphs (KGs). Recently, the availability of temporal KGs (TKGs) that contain time information created the need for reasoning over time in such TKGs. Existing embedding-based entity alignment approaches disregard time information that commonly exists in many large-scale KGs, leaving much room for improvement. In this paper, we focus on the task of aligning entity pairs between TKGs and propose a novel Time-aware Entity Alignment approach based on Graph Neural Networks (TEA-GNN). We embed entities, relations and timestamps of different KGs into a vector space and use GNNs to learn entity representations. To incorporate both relation and time information into the GNN structure of our model, we use a time-aware attention mechanism which assigns different weights to different nodes with orthogonal transformation matrices computed from embeddings of the relevant relations and timestamps in a neighborhood. Experimental results on multiple real-world TKG datasets show that our method significantly outperforms the state-of-the-art methods due to the inclusion of time information.


title: Neural mechanisms underlying the temporal organization of naturalistic animal behavior

abstract: Naturalistic animal behavior exhibits a strikingly complex organization in the temporal domain, whose variability stems from at least three sources: hierarchical, contextual, and stochastic. What are the neural mechanisms and computational principles generating such complex temporal features? In this review, we provide a critical assessment of the existing behavioral and neurophysiological evidence for these sources of temporal variability in naturalistic behavior. We crystallize recent studies which converge on an emergent mechanistic theory of temporal variability based on attractor neural networks and metastable dynamics, arising from the coordinated interactions between mesoscopic neural circuits. We highlight the crucial role played by structural heterogeneities and by noise arising in mesoscopic circuits. We assess the shortcomings and missing links in the current theoretical and experimental literature and propose new directions of investigations to fill these gaps.


title: Simultaneous optical trapping and magnetic micromanipulation of ferromagnetic iron-doped upconversion microparticles in six degrees of freedom

abstract: Optical trapping of magnetic Fe-oxide particles is notoriously difficult due to their high refractive indices, not to mention high absorptivity at the trapping infra-red wavelengths. We synthesize Fe co-doped NaYF4:Yb,Er ferromagnetic upconversion particles that not only have refractive indices conducive for optical trapping, but also heat less than Haematite particles at off-resonant wavelengths. These particles are hexagonal shaped with dimensions of the order of 3 micrometer and also bear high coercivity of 20 mT and saturation magnetisation of 1 Am^2/kg. This enables simultaneous use of optical trapping and magnetic forces to generate micro-manipulation in all the six degrees of freedom of a rigid body. We also show that these particles heat significantly when illuminated on absorption resonance at 975 nm while emitting visible light with possible implications for fluorescence microscopy and photothermal therapy of cancer cells.


title: Greedy double subspaces coordinate descent method via orthogonalization

abstract: The coordinate descent method is an effective iterative method for solving large linear least-squares problems. In this paper, for the highly coherent columns case, we construct an effective coordinate descent method which iteratively projects the estimate onto a solution space formed by two greedily selected hyperplanes via Gram-Schmidt orthogonalization. Our methods may be regarded as a simple block version of coordinate descent method which involves two active columns. The convergence analysis of this method is provided and numerical simulations also confirm the effectiveness for matrices with highly coherent columns.


title: Variational Inequalities For The Differences Of Averages Over Lacunary Sequences

abstract: Let $f$ be a locally integrable function defined on $\mathbb{R}$, and let $(n_k)$ be a lacunary sequence. Define the operator $A_{n_k}$ by $$A_{n_k}f(x)=\frac{1}{n_k}\int_0^{n_k}f(x-t)\, dt.$$ We prove various types of new inequalities for the variation operator $$\mathcal{V}_sf(x)=\left(\sum_{k=1}^\infty|A_{n_k}f(x)-A_{n_{k-1}}f(x)|^s\right)^{1/s}$$ when $2\leq s<\infty$.


title: Training language models to follow instructions with human feedback

abstract: Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.


title: PatchMVSNet: Patch-wise Unsupervised Multi-View Stereo for Weakly-Textured Surface Reconstruction

abstract: Learning-based multi-view stereo (MVS) has gained fine reconstructions on popular datasets. However, supervised learning methods require ground truth for training, which is hard to be collected, especially for the large-scale datasets. Though nowadays unsupervised learning methods have been proposed and have gotten gratifying results, those methods still fail to reconstruct intact results in challenging scenes, such as weakly-textured surfaces, as those methods primarily depend on pixel-wise photometric consistency which is subjected to various illuminations. To alleviate matching ambiguity in those challenging scenes, this paper proposes robust loss functions leveraging constraints beneath multi-view images: 1) Patch-wise photometric consistency loss, which expands the receptive field of the features in multi-view similarity measuring, 2) Robust twoview geometric consistency, which includes a cross-view depth consistency checking with the minimum occlusion. Our unsupervised strategy can be implemented with arbitrary depth estimation frameworks and can be trained with arbitrary large-scale MVS datasets. Experiments show that our method can decrease the matching ambiguity and particularly improve the completeness of weakly-textured reconstruction. Moreover, our method reaches the performance of the state-of-the-art methods on popular benchmarks, like DTU, Tanks and Temples and ETH3D. The code will be released soon.


title: DetFlowTrack: 3D Multi-object Tracking based on Simultaneous Optimization of Object Detection and Scene Flow Estimation

abstract: 3D Multi-Object Tracking (MOT) is an important part of the unmanned vehicle perception module. Most methods optimize object detection and data association independently. These methods make the network structure complicated and limit the improvement of MOT accuracy. we proposed a 3D MOT framework based on simultaneous optimization of object detection and scene flow estimation. In the framework, a detection-guidance scene flow module is proposed to relieve the problem of incorrect inter-frame assocation. For more accurate scene flow label especially in the case of motion with rotation, a box-transformation-based scene flow ground truth calculation method is proposed. Experimental results on the KITTI MOT dataset show competitive results over the state-of-the-arts and the robustness under extreme motion with rotation.


title: Transformations in Learned Image Compression from a Modulation Perspective

abstract: In this paper, a unified transformation method in learned image compression(LIC) is proposed from the perspective of modulation. Firstly, the quantization in LIC is considered as a generalized channel with additive uniform noise. Moreover, the LIC is interpreted as a particular communication system according to the consistency in structures and optimization objectives. Thus, the technology of communication systems can be applied to guide the design of modules in LIC. Furthermore, a unified transform method based on signal modulation (TSM) is defined. In the view of TSM, the existing transformation methods are mathematically reduced to a linear modulation. A series of transformation methods, e.g. TPM and TJM, are obtained by extending to nonlinear modulation. The experimental results on various datasets and backbone architectures verify that the effectiveness and robustness of the proposed method. More importantly, it further confirms the feasibility of guiding LIC design from a communication perspective. For example, when backbone architecture is hyperprior combining context model, our method achieves 3.52$\%$ BD-rate reduction over GDN on Kodak dataset without increasing complexity.


title: Analysis of an alternative Navier-Stokes system: Weak entropy solutions and a convergent numerical scheme

abstract: We consider an alternative Navier-Stokes model for compressible viscous ideal gases, originally proposed in \cite{Svard18}. We derive a priori estimates that are sufficiently strong to support a weak entropy solution of the system. Guided by these estimates, we propose a finite volume scheme, derive the analogous estimates and demonstrate grid convergence towards a weak entropy solution. Furthermore, this existence proof is valid for "large" initial data and no a priori assumptions on the solution are needed.


title: Reservoir Computing with Spin Waves in Skyrmion Crystal

abstract: Magnetic skyrmions are nanometric spin textures characterized by a quantized topological invariant in magnets and often emerge in a crystallized form called skyrmion crystal in an external magnetic field. We propose that magnets hosting a skyrmion crystal possess high potential for application to reservoir computing, which is one of the most successful information processing techniques inspired by functions of human brains. Our skyrmion-based reservoir exploits precession dynamics of magnetizations, i.e., spin waves, propagating in the skyrmion crystal. Because of complex interferences and slow relaxations of the spin-wave dynamics, the skyrmion spin-wave reservoir attains several important characteristics required for reservoir computing, e.g., the generalization ability, the nonlinearity, and the short-term memory. We investigate these properties by imposing three standard tasks to test the performances of reservoir, i.e., the duration-estimation task, the short-term memory task, and the parity-check task. Through these investigations, we demonstrate that magnetic skyrmion crystals are promising materials for spintronics reservoir devices. Because magnetic skyrmions emerge spontaneously in magnets via self-organization process under application of a static magnetic field, the proposed skyrmion reservoir requires neither advanced nanofabrication nor complicated manufacturing for production in contrast to other previously proposed magnetic reservoirs constructed with fabricated spintronics devices. Our proposal is expected to realize a breakthrough in the research of spintronics reservoirs of high performance.


title: MF-Hovernet: An Extension of Hovernet for Colon Nuclei Identification and Counting (CoNiC) Challenge

abstract: Nuclei Identification and Counting is the most important morphological feature of cancers, especially in the colon. Many deep learning-based methods have been proposed to deal with this problem. In this work, we construct an extension of Hovernet for nuclei identification and counting to address the problem named MF-Hovernet. Our proposed model is the combination of multiple filer block to Hovernet architecture. The current result shows the efficiency of multiple filter block to improve the performance of the original Hovernet model.


title: Tropical Lagrangian multi-sections and tropical locally free sheaves

abstract: This article is a continuation of the work "Tropical Lagrangian multi-sections and smoothing of locally free sheaves over degenerated Calabi-Yau surfaces". We generalize the notion of tropical Lagrangian multi-sections to any dimensions. Together with some linear algebra data, we construct a special class of locally free sheaves, called tropical locally free sheaves. We will also provide the reverse construction and show that there is a 1-1 correspondence between isomorphism classes of tropical locally free sheaves and tropical Lagrangian multi-sections modulo certain equivalence.


title: A general alternating-direction implicit Newton method for solving complex continuous-time algebraic Riccati matrix equation

abstract: In this paper, applying the Newton method, we transform the complex continuous-time algebraic Riccati matrix equation into a Lyapunov equation. Then, we introduce an efficient general alternating-direction implicit (GADI) method to solve the Lyapunov equation. The inexact Newton-GADI method is presented to save computational amount effectively. Moreover, we analyze the convergence of the Newton-GADI method. The convergence rate of the Newton-GADI and Newton-ADI methods is compared by analyzing their spectral radii. Furthermore, we give a way to select the quasi-optimal parameter. Corresponding numerical tests are shown to illustrate the effectiveness of the proposed algorithms.


title: Imaging Anisotropic Conductivities from Current Densities

abstract: In this paper, we propose and analyze a reconstruction algorithm for imaging an anisotropic conductivity tensor in a second-order elliptic PDE with a nonzero Dirichlet boundary condition from internal current densities. It is based on a regularized output least-squares formulation with the standard $L^2(\Omega)^{d,d}$ penalty, which is then discretized by the standard Galerkin finite element method. We establish the continuity and differentiability of the forward map with respect to the conductivity tensor in the $L^p(\Omega)^{d,d}$-norms, the existence of minimizers and optimality systems of the regularized formulation using the concept of H-convergence. Further, we provide a detailed analysis of the discretized problem, especially the convergence of the discrete approximations with respect to the mesh size, using the discrete counterpart of H-convergence. In addition, we develop a projected Newton algorithm for solving the first-order optimality system. We present extensive two-dimensional numerical examples to show the efficiency of the proposed method.


title: A class of inverse curvature flows and $L^p$ dual Christoffel-Minkowski problem

abstract: In this paper, we consider a large class of expanding flows of closed, smooth, star-shaped hypersurface in Euclidean space $\mathbb{R}^{n+1}$ with speed $\psi u^\alpha\rho^\delta f^{-\beta}$, where $\psi$ is a smooth positive function on unit sphere, $u$ is the support function of the hypersurface, $\rho$ is the radial function, $f$ is a smooth, symmetric, homogenous of degree one, positive function of the principal curvatures of the hypersurface on a convex cone. When $\psi=1$, we prove that the flow exists for all time and converges to infinity if $\alpha+\delta+\beta\le1, \beta>0$ and $\alpha\le0$, while in case $\alpha+\delta+\beta>1,\alpha,\delta\le0$, the flow blows up in finite time, and where we assume the initial hypersurface to be strictly convex. In both cases the properly rescaled flows converge to a sphere centered the origin. In particular, the results of Gerhardt \cite{GC,GC3} and Urbas \cite{UJ2} can be recovered by putting $\alpha=\delta=0$. Our previous works \cite{DL,DL2} can be recovered by putting $\delta=0$. By the convergence of these flows, we can give a new proof of uniqueness theorems for solutions to $L^p$-Minkowski problem and $L^p$-Christoffel-Minkowski problem with constant prescribed data. Similarly, we pose the $L^p$ dual Christoffel-Minkowski problem and prove a uniqueness theorem for solutions to $L^p$ dual Minkowski problem and $L^p$ dual Christoffel-Minkowski problem with constant prescribed data. At last, we focus on the longtime existence and convergence of a class of anisotropic flows (i.e. for general function $\psi$). The final result not only gives a new proof of many previously known solutions to $L^p$ dual Minkowski problem, $L^p$-Christoffel-Minkowski problem, etc. by such anisotropic flows, but also provides solutions to $L^p$ dual Christoffel-Minkowski problem with some conditions.


title: Convolutional Analysis Operator Learning by End-To-End Training of Iterative Neural Networks

abstract: The concept of sparsity has been extensively applied for regularization in image reconstruction. Typically, sparsifying transforms are either pre-trained on ground-truth images or adaptively trained during the reconstruction. Thereby, learning algorithms are designed to minimize some target function which encodes the desired properties of the transform. However, this procedure ignores the subsequently employed reconstruction algorithm as well as the physical model which is responsible for the image formation process. Iterative neural networks - which contain the physical model - can overcome these issues. In this work, we demonstrate how convolutional sparsifying filters can be efficiently learned by end-to-end training of iterative neural networks. We evaluated our approach on a non-Cartesian 2D cardiac cine MRI example and show that the obtained filters are better suitable for the corresponding reconstruction algorithm than the ones obtained by decoupled pre-training.


title: SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models

abstract: Knowledge graph completion (KGC) aims to reason over known facts and infer the missing links. Text-based methods such as KGBERT (Yao et al., 2019) learn entity representations from natural language descriptions, and have the potential for inductive KGC. However, the performance of text-based methods still largely lag behind graph embedding-based methods like TransE (Bordes et al., 2013) and RotatE (Sun et al., 2019b). In this paper, we identify that the key issue is efficient contrastive learning. To improve the learning efficiency, we introduce three types of negatives: in-batch negatives, pre-batch negatives, and self-negatives which act as a simple form of hard negatives. Combined with InfoNCE loss, our proposed model SimKGC can substantially outperform embedding-based methods on several benchmark datasets. In terms of mean reciprocal rank (MRR), we advance the state-of-the-art by +19% on WN18RR, +6.8% on the Wikidata5M transductive setting, and +22% on the Wikidata5M inductive setting. Thorough analyses are conducted to gain insights into each component. Our code is available at https://github.com/intfloat/SimKGC .


title: A Possible 3-Year Quasi-Periodic Oscillation in {\gamma}-Ray Emission from the FSRQ S5 1044+71

abstract: Variability is a typical observation feature of Fermi blazars, sometimes it shows quasi-periodic oscillation (QPO). In this work, we obtained 5-day binned light curves (with a time coverage of $\sim$ 12.9 yr) for S5 1044+71 based on Fermi LAT data, adopted five different methods: Date-compensated Discrete Fourier Transform (DCDFT), Jurkevich (JV), Lomb-Scargle Periodogram (LSP), a Fortran 90 program (REDFIT) and the Weighted Wavelet Z-transform (WWZ) to the $\gamma$-ray light curve, and found a possible QPO of 3.06 $\pm$ 0.43 yr at the significance level of $\sim3.6\sigma$. A binary black hole model including accretion model and dual-jets model is used to explain this quasi-periodic variability. We also estimated the Doppler factors and the apparent velocity for the two jet components. We speculate that this $\gamma$-ray quasi-periodic modulation suggest the presence of a binary supermassive black hole in S5 1044+71.


title: Clique-factors in graphs with sublinear $\ell$-independence number

abstract: Given a graph $G$ and an integer $\ell\ge 2$, we denote by $\alpha_{\ell}(G)$ the maximum size of a $K_{\ell}$-free subset of vertices in $V(G)$. A recent question of Nenadov and Pehova asks for determining the best possible minimum degree conditions forcing clique-factors in $n$-vertex graphs $G$ with $\alpha_{\ell}(G) = o(n)$, which can be seen as a Ramsey--Tur\'an variant of the celebrated Hajnal--Szemer\'edi theorem. In this paper we find the asymptotical sharp minimum degree threshold for $K_r$-factors in $n$-vertex graphs $G$ with $\alpha_\ell(G)=n^{1-o(1)}$ for all $r\ge \ell\ge 2$.


title: Entanglement on nucleation barrier of polymer crystal

abstract: We propose a theoretical approach to quantitatively account for the role of entanglement in the nucleation of polymer melts, which is the unique feature of polymer differentiated from small molecules. By performing molecular dynamics simulations, we obtain the nucleation barriers of polymer systems with different entanglement densities, which exhibits an opposite trend compared to the prediction of the classic nucleation theory (CNT). To amend the deficiency of the CNT in polymer crystallization, we introduce the entanglement free energy to reflect the role of entanglement in polymer nucleation. Specifically, the polymer nucleation not only involves free energies of monomers inside and on the surface of a nucleus as considered in the CNT, but also affects the entanglement network around the nucleus. Our theoretical approach provides a reasonable interpretation for the unsolved nucleation phenomena of polymers in simulations and experiments.