title: Evaluating Various Tokenizers for Arabic Text Classification

abstract: The first step in any NLP pipeline is to split the text into individual tokens. The most obvious and straightforward approach is to use words as tokens. However, given a large text corpus, representing all the words is not efficient in terms of vocabulary size. In the literature, many tokenization algorithms have emerged to tackle this problem by creating subwords which in turn limits the vocabulary size in a given text corpus. Most tokenization techniques are language-agnostic i.e they don't incorporate the linguistic features of a given language. Not to mention the difficulty of evaluating such techniques in practice. In this paper, we introduce three new tokenization algorithms for Arabic and compare them to three other baselines using unsupervised evaluations. In addition to that, we compare all the six algorithms by evaluating them on three supervised classification tasks which are sentiment analysis, news classification and poetry classification using six publicly available datasets. Our experiments show that none of the tokenization technique is the best choice overall and that the performance of a given tokenization algorithm depends on the size of the dataset, type of the task, and the amount of morphology that exists in the dataset. However, some tokenization techniques are better overall as compared to others on various text classification tasks.


title: Resilient Control of Platooning Networked Robotic Systems via Dynamic Watermarking

abstract: Networked robotic systems, such as connected vehicle platoons, can improve the safety and efficiency of transportation networks by allowing for high-speed coordination. To enable such coordination, these systems rely on networked communications. This can make them susceptible to cyber attacks. Though security methods such as encryption or specially designed network topologies can increase the difficulty of successfully executing such an attack, these techniques are unable to guarantee secure communication against an attacker. More troublingly, these security methods are unable to ensure that individual agents are able to detect attacks that alter the content of specific messages. To ensure resilient behavior under such attacks, this paper formulates a networked linear time-varying version of dynamic watermarking in which each agent generates and adds a private excitation to the input of its corresponding robotic subsystem. This paper demonstrates that such a method can enable each agent in a networked robotic system to detect cyber attacks. By altering measurements sent between vehicles, this paper illustrates that an attacker can create unstable behavior within a platoon. By utilizing the dynamic watermarking method proposed in this paper, the attack is detected, allowing the vehicles in the platoon to gracefully degrade to a non-communicative control strategy that maintains safety across a variety of scenarios.


title: Machine Learning Based Prediction of Future Stress Events in a Driving Scenario

abstract: This paper presents a model for predicting a driver's stress level up to one minute in advance. Successfully predicting future stress would allow stress mitigation to begin before the subject becomes stressed, reducing or possibly avoiding the performance penalties of stress. The proposed model takes features extracted from Galvanic Skin Response (GSR) signals on the foot and hand and Respiration and Electrocardiogram (ECG) signals from the chest of the driver. The data used to train the model was retrieved from an existing database and then processed to create statistical and frequency features. A total of 42 features were extracted from the data and then expanded into a total of 252 features by grouping the data and taking six statistical measurements of each group for each feature. A Random Forest Classifier was trained and evaluated using a leave-one-subject-out testing approach. The model achieved 94% average accuracy on the test data. Results indicate that the model performs well and could be used as part of a vehicle stress prevention system.


title: Visualizing nematic transition and nanoscale suppression of superconductivity in Fe(Te,Se)

abstract: The interplay of different electronic phases underlies the physics of unconventional superconductors. One of the most intriguing examples is a high-Tc superconductor FeTe1-xSex: it undergoes both a topological transition, linked to the electronic band inversion, and an electronic nematic phase transition, associated with rotation symmetry breaking, around the same critical composition xc where superconducting Tc peaks. At this regime, nematic fluctuations and symmetry-breaking strain could have an enormous impact, but this is yet to be fully explored. Using spectroscopic-imaging scanning tunneling microscopy, we study the electronic nematic transition in FeTe1-xSex as a function of composition. Near xc, we reveal the emergence of electronic nematicity in nanoscale regions. Interestingly, we discover that superconductivity is drastically suppressed in areas where static nematic order is the strongest. By analyzing atomic displacement in STM topographs, we find that small anisotropic strain can give rise to these strongly nematic localized regions. Our experiments reveal a tendency of FeTe1-xSex near x~0.45 to form puddles hosting static nematic order, suggestive of nematic fluctuations pinned by structural inhomogeneity, and demonstrate a pronounced effect of anisotropic strain on superconductivity in this regime.


title: Dataset of Propaganda Techniques of the State-Sponsored Information Operation of the People's Republic of China

abstract: The digital media, identified as computational propaganda provides a pathway for propaganda to expand its reach without limit. State-backed propaganda aims to shape the audiences' cognition toward entities in favor of a certain political party or authority. Furthermore, it has become part of modern information warfare used in order to gain an advantage over opponents. Most of the current studies focus on using machine learning, quantitative, and qualitative methods to distinguish if a certain piece of information on social media is propaganda. Mainly conducted on English content, but very little research addresses Chinese Mandarin content. From propaganda detection, we want to go one step further to provide more fine-grained information on propaganda techniques that are applied. In this research, we aim to bridge the information gap by providing a multi-labeled propaganda techniques dataset in Mandarin based on a state-backed information operation dataset provided by Twitter. In addition to presenting the dataset, we apply a multi-label text classification using fine-tuned BERT. Potentially this could help future research in detecting state-backed propaganda online especially in a cross-lingual context and cross platforms identity consolidation.


title: PolarStream: Streaming Lidar Object Detection and Segmentation with Polar Pillars

abstract: Recent works recognized lidars as an inherently streaming data source and showed that the end-to-end latency of lidar perception models can be reduced significantly by operating on wedge-shaped point cloud sectors rather then the full point cloud. However, due to use of cartesian coordinate systems these methods represent the sectors as rectangular regions, wasting memory and compute. In this work we propose using a polar coordinate system and make two key improvements on this design. First, we increase the spatial context by using multi-scale padding from neighboring sectors: preceding sector from the current scan and/or the following sector from the past scan. Second, we improve the core polar convolutional architecture by introducing feature undistortion and range stratified convolutions. Experimental results on the nuScenes dataset show significant improvements over other streaming based methods. We also achieve comparable results to existing non-streaming methods but with lower latencies. The code and pretrained models are available at \url{https://github.com/motional/polarstream}.


title: Uncovering the History of Cosmic Inflation from Anomalies in Cosmic Microwave Background Spectra

abstract: We propose an inflationary primordial feature model that can explain both the large and small-scale anomalies in the currently measured cosmic microwave background (CMB) anisotropy spectra, revealing a clip of adventurous history of the Universe during its primordial epoch. Although the model is currently statistically indistinguishable from the Standard Model, we show that future observations such as the Simons Observatory and LiteBIRD will complement each other in distinguishing the model differences due to their accurate E-mode polarization measurements, and the PICO mission, if funded, can put stringent constraints on all characteristic properties. The model predicts a signal of classical primordial standard clock, which can also be used to distinguish the inflation and alternative scenarios in a model-independent fashion.


title: ModMax meets Susy

abstract: We give a prescription for N=1 supersymmetrization of any (four-dimensional) nonlinear electrodynamics theory with a Lagrangian density satisfying a convexity condition that we relate to semi-classical unitarity. We apply it to the one-parameter ModMax extension of Maxwell electrodynamics that preserves both electromagnetic duality and conformal invariance, and its Born-Infeld-like generalization, proving that duality invariance is preserved. We also establish superconformal invariance of the superModMax theory by showing that its coupling to supergravity is super-Weyl invariant. The higher-derivative photino-field interactions that appear in any supersymmetric nonlinear electrodynamics theory are removed by an invertible nonlinear superfield redefinition.


title: A scalable multi-step least squares method for network identification with unknown disturbance topology

abstract: Identification methods for dynamic networks typically require prior knowledge of the network and disturbance topology, and often rely on solving poorly scalable non-convex optimization problems. While methods for estimating network topology are available in the literature, less attention has been paid to estimating the disturbance topology, i.e., the (spatial) noise correlation structure and the noise rank in a filtered white noise representation of the disturbance signal. In this work we present an identification method for dynamic networks, in which an estimation of the disturbance topology precedes the identification of the full dynamic network with known network topology. To this end we extend the multi-step Sequential Linear Regression and Weighted Null Space Fitting methods to deal with reduced rank noise, and use these methods to estimate the disturbance topology and the network dynamics in the full measurement situation. As a result, we provide a multi-step least squares algorithm with parallel computation capabilities and that rely only on explicit analytical solutions, thereby avoiding the usual non-convex optimizations involved. Consequently we consistently estimate dynamic networks of Box Jenkins model structure, while keeping the computational burden low. We provide a consistency proof that includes path-based data informativity conditions for allocation of excitation signals in the experimental design. Numerical simulations performed on a dynamic network with reduced rank noise clearly illustrate the potential of this method.


title: Named Entity Normalization Model Using Edge Weight Updating Neural Network: Assimilation Between Knowledge-Driven Graph and Data-Driven Graph

abstract: Discriminating the matched named entity pairs or identifying the entities' canonical forms are critical in text mining tasks. More precise named entity normalization in text mining will benefit other subsequent text analytic applications. We built the named entity normalization model with a novel Edge Weight Updating Neural Network. Our proposed model when tested on four different datasets achieved state-of-the-art results. We, next, verify our model's performance on NCBI Disease, BC5CDR Disease, and BC5CDR Chemical databases, which are widely used named entity normalization datasets in the bioinformatics field. We also tested our model with our own financial named entity normalization dataset to validate the efficacy for more general applications. Using the constructed dataset, we differentiate named entity pairs. Our model achieved the highest named entity normalization performances in terms of various evaluation metrics.


title: Attention mechanisms and deep learning for machine vision: A survey of the state of the art

abstract: With the advent of state of the art nature-inspired pure attention based models i.e. transformers, and their success in natural language processing (NLP), their extension to machine vision (MV) tasks was inevitable and much felt. Subsequently, vision transformers (ViTs) were introduced which are giving quite a challenge to the established deep learning based machine vision techniques. However, pure attention based models/architectures like transformers require huge data, large training times and large computational resources. Some recent works suggest that combinations of these two varied fields can prove to build systems which have the advantages of both these fields. Accordingly, this state of the art survey paper is introduced which hopefully will help readers get useful information about this interesting and potential research area. A gentle introduction to attention mechanisms is given, followed by a discussion of the popular attention based deep architectures. Subsequently, the major categories of the intersection of attention mechanisms and deep learning for machine vision (MV) based are discussed. Afterwards, the major algorithms, issues and trends within the scope of the paper are discussed.


title: MALib: A Parallel Framework for Population-based Multi-agent Reinforcement Learning

abstract: Population-based multi-agent reinforcement learning (PB-MARL) refers to the series of methods nested with reinforcement learning (RL) algorithms, which produces a self-generated sequence of tasks arising from the coupled population dynamics. By leveraging auto-curricula to induce a population of distinct emergent strategies, PB-MARL has achieved impressive success in tackling multi-agent tasks. Despite remarkable prior arts of distributed RL frameworks, PB-MARL poses new challenges for parallelizing the training frameworks due to the additional complexity of multiple nested workloads between sampling, training and evaluation involved with heterogeneous policy interactions. To solve these problems, we present MALib, a scalable and efficient computing framework for PB-MARL. Our framework is comprised of three key components: (1) a centralized task dispatching model, which supports the self-generated tasks and scalable training with heterogeneous policy combinations; (2) a programming architecture named Actor-Evaluator-Learner, which achieves high parallelism for both training and sampling, and meets the evaluation requirement of auto-curriculum learning; (3) a higher-level abstraction of MARL training paradigms, which enables efficient code reuse and flexible deployments on different distributed computing paradigms. Experiments on a series of complex tasks such as multi-agent Atari Games show that MALib achieves throughput higher than 40K FPS on a single machine with $32$ CPU cores; 5x speedup than RLlib and at least 3x speedup than OpenSpiel in multi-agent training tasks. MALib is publicly available at https://github.com/sjtu-marl/malib.


title: PC-DAN: Point Cloud based Deep Affinity Network for 3D Multi-Object Tracking (Accepted as an extended abstract in JRDB-ACT Workshop at CVPR21)

abstract: In recent times, the scope of LIDAR (Light Detection and Ranging) sensor-based technology has spread across numerous fields. It is popularly used to map terrain and navigation information into reliable 3D point cloud data, potentially revolutionizing the autonomous vehicles and assistive robotic industry. A point cloud is a dense compilation of spatial data in 3D coordinates. It plays a vital role in modeling complex real-world scenes since it preserves structural information and avoids perspective distortion, unlike image data, which is the projection of a 3D structure on a 2D plane. In order to leverage the intrinsic capabilities of the LIDAR data, we propose a PointNet-based approach for 3D Multi-Object Tracking (MOT).


title: A Cognitive Science perspective for learning how to design meaningful user experiences and human-centered technology

abstract: This paper reviews literature in cognitive science, human-computer interaction (HCI) and natural-language processing (NLP) to consider how analogical reasoning (AR) could help inform the design of communication and learning technologies, as well as online communities and digital platforms. First, analogical reasoning (AR) is defined, and use-cases of AR in the computing sciences are presented. The concept of schema is introduced, along with use-cases in computing. Finally, recommendations are offered for future work on using analogical reasoning and schema methods in the computing sciences.


title: Dataset for eye-tracking tasks

abstract: In recent years many different deep neural networks were developed, but due to a large number of layers in deep networks, their training requires a long time and a large number of datasets. Today is popular to use trained deep neural networks for various tasks, even for simple ones in which such deep networks are not required. The well-known deep networks such as YoloV3, SSD, etc. are intended for tracking and monitoring various objects, therefore their weights are heavy and the overall accuracy for a specific task is low. Eye-tracking tasks need to detect only one object - an iris in a given area. Therefore, it is logical to use a neural network only for this task. But the problem is the lack of suitable datasets for training the model. In the manuscript, we presented a dataset that is suitable for training custom models of convolutional neural networks for eye-tracking tasks. Using data set data, each user can independently pre-train the convolutional neural network models for eye-tracking tasks. This dataset contains annotated 10,000 eye images in an extension of 416 by 416 pixels. The table with annotation information shows the coordinates and radius of the eye for each image. This manuscript can be considered as a guide for the preparation of datasets for eye-tracking devices


title: A Framework to Counteract Suboptimal User-Behaviors in Exploratory Learning Environments: an Application to MOOCs

abstract: While there is evidence that user-adaptive support can greatly enhance the effectiveness of educational systems, designing such support for exploratory learning environments (e.g., simulations) is still challenging due to the open-ended nature of their interaction. In particular, there is little a priori knowledge of which student's behaviors can be detrimental to learning in such environments. To address this problem, we focus on a data-driven user-modeling framework that uses logged interaction data to learn which behavioral or activity patterns should trigger help during interaction with a specific learning environment. This framework has been successfully used to provide adaptive support in interactive learning simulations. Here we present a novel application of this framework we are working on, namely to Massive Open Online Courses (MOOCs), a form of exploratory environment that could greatly benefit from adaptive support due to the large diversity of their users, but typically lack of such adaptation. We describe an experiment aimed at investigating the value of our framework to identify student's behaviors that can justify adapting to, and report some preliminary results.


title: Long Term Object Detection and Tracking in Collaborative Learning Environments

abstract: Human activity recognition in videos is a challenging problem that has drawn a lot of interest, particularly when the goal requires the analysis of a large video database. AOLME project provides a collaborative learning environment for middle school students to explore mathematics, computer science, and engineering by processing digital images and videos. As part of this project, around 2200 hours of video data was collected for analysis. Because of the size of the dataset, it is hard to analyze all the videos of the dataset manually. Thus, there is a huge need for reliable computer-based methods that can detect activities of interest. My thesis is focused on the development of accurate methods for detecting and tracking objects in long videos. All the models are validated on videos from 7 different sessions, ranging from 45 minutes to 90 minutes. The keyboard detector achieved a very high average precision (AP) of 92% at 0.5 intersection over union (IoU). Furthermore, a combined system of the detector with a fast tracker KCF (159fps) was developed so that the algorithm runs significantly faster without sacrificing accuracy. For a video of 23 minutes having resolution 858X480 @ 30 fps, the detection alone runs at 4.7Xthe real-time, and the combined algorithm runs at 21Xthe real-time for an average IoU of 0.84 and 0.82, respectively. The hand detector achieved average precision (AP) of 72% at 0.5 IoU. The detection results were improved to 81% using optimal data augmentation parameters. The hand detector runs at 4.7Xthe real-time with AP of 81% at 0.5 IoU. The hand detection method was integrated with projections and clustering for accurate proposal generation. This approach reduced the number of false-positive hand detections by 80%. The overall hand detection system runs at 4Xthe real-time, capturing all the activity regions of the current collaborative group.


title: A Multi-Branch Hybrid Transformer Networkfor Corneal Endothelial Cell Segmentation

abstract: Corneal endothelial cell segmentation plays a vital role inquantifying clinical indicators such as cell density, coefficient of variation,and hexagonality. However, the corneal endothelium's uneven reflectionand the subject's tremor and movement cause blurred cell edges in theimage, which is difficult to segment, and need more details and contextinformation to release this problem. Due to the limited receptive field oflocal convolution and continuous downsampling, the existing deep learn-ing segmentation methods cannot make full use of global context andmiss many details. This paper proposes a Multi-Branch hybrid Trans-former Network (MBT-Net) based on the transformer and body-edgebranch. Firstly, We use the convolutional block to focus on local tex-ture feature extraction and establish long-range dependencies over space,channel, and layer by the transformer and residual connection. Besides,We use the body-edge branch to promote local consistency and to provideedge position information. On the self-collected dataset TM-EM3000 andpublic Alisarine dataset, compared with other State-Of-The-Art (SOTA)methods, the proposed method achieves an improvement.


abstract: Recent advancements in computational power and algorithms have enabled unabridged data (e.g., raw images or audio) to be used as input in some models (e.g., deep learning). However, the black box nature of such models reduces their likelihood of adoption by marketing scholars. Our paradigm of analysis, the Transparent Model of Unabridged Data (TMUD), enables researchers to investigate the inner workings of such black box models by incorporating an ex ante filtration module and an ex post experimentation module. We empirically demonstrate the TMUD by investigating the role of facial components and sexual dimorphism in face perceptions, which have implications for four marketing contexts: advertisement (perceptions of approachability, trustworthiness, and competence), brand (perceptions of whether a face represents a brand's typical customer), category (perceptions of whether a face represents a category's typical customer), and customer persona (perceptions of whether a face represents the persona of a brand's customer segment). Our results reveal new and useful findings that enrich the existing literature on face perception, most of which is based on abridged attributes (e.g., width of mouth). The TMUD has great potential to be a useful paradigm for generating theoretical insights and may encourage more marketing researchers and practitioners to use unabridged data.


title: Artificial Perceptual Learning: Image Categorization with Weak Supervision

abstract: Machine learning has achieved much success on supervised learning tasks with large sets of well-annotated training samples. However, in many practical situations, such strong and high-quality supervision provided by training data is unavailable due to the expensive and labor-intensive labeling process. Automatically identifying and recognizing object categories in a large volume of unlabeled images with weak supervision remains an important, yet unsolved challenge in computer vision. In this paper, we propose a novel machine learning framework, artificial perceptual learning (APL), to tackle the problem of weakly supervised image categorization. The proposed APL framework is constructed using state-of-the-art machine learning algorithms as building blocks to mimic the cognitive development process known as infant categorization. We develop and illustrate the proposed framework by implementing a wide-field fine-grain ecological survey of tree species over an 8,000-hectare area of the El Yunque rainforest in Puerto Rico. It is based on unlabeled high-resolution aerial images of the tree canopy. Misplaced ground-based labels were available for less than 1% of these images, which serve as the only weak supervision for this learning framework. We validate the proposed framework using a small set of images with high quality human annotations and show that the proposed framework attains human-level cognitive economy.


title: Allocating Stimulus Checks in Times of Crisis

abstract: We study the problem of allocating bailouts (stimulus, subsidy allocations) to people participating in a financial network subject to income shocks. We build on the financial clearing framework of Eisenberg and Noe that allows the incorporation of a bailout policy that is based on discrete bailouts motivated by the types of stimulus checks people receive around the world as part of COVID-19 economical relief plans. We show that optimally allocating such bailouts on a financial network in order to maximize a variety of social welfare objectives of this form is a computationally intractable problem. We develop approximation algorithms to optimize these objectives and establish guarantees for their approximation rations. Then, we incorporate multiple fairness constraints in the optimization problems and establish relative bounds on the solutions with versus without these constraints. Finally, we apply our methodology to a variety of data, both in the context of a system of large financial institutions with real-world data, as well as in a realistic societal context with financial interactions between people and businesses for which we use semi-artificial data derived from mobility patterns. Our results suggest that the algorithms we develop and study have reasonable results in practice and outperform other network-based heuristics. We argue that the presented problem through the societal-level lens could assist policymakers in making informed decisions on issuing subsidies.


title: Direct Servo Control from In-Sensor CNN Inference with A Pixel Processor Array

abstract: This work demonstrates direct visual sensory-motor control using high-speed CNN inference via a SCAMP-5 Pixel Processor Array (PPA). We demonstrate how PPAs are able to efficiently bridge the gap between perception and action. A binary Convolutional Neural Network (CNN) is used for a classic rock, paper, scissors classification problem at over 8000 FPS. Control instructions are directly sent to a servo motor from the PPA according to the CNN's classification result without any other intermediate hardware.


title: Neural Network Structure Design based on N-Gauss Activation Function

abstract: Recent work has shown that the activation function of the convolutional neural network can meet the Lipschitz condition, then the corresponding convolutional neural network structure can be constructed according to the scale of the data set, and the data set can be trained more deeply, more accurately and more effectively. In this article, we have accepted the experimental results and introduced the core block N-Gauss, N-Gauss, and Swish (Conv1, Conv2, FC1) neural network structure design to train MNIST, CIFAR10, and CIFAR100 respectively. Experiments show that N-Gauss gives full play to the main role of nonlinear modeling of activation functions, so that deep convolutional neural networks have hierarchical nonlinear mapping learning capabilities. At the same time, the training ability of N-Gauss on simple one-dimensional channel small data sets is equivalent to the performance of ReLU and Swish.


title: BPLF: A Bi-Parallel Linear Flow Model for Facial Expression Generation from Emotion Set Images

abstract: The flow-based generative model is a deep learning generative model, which obtains the ability to generate data by explicitly learning the data distribution. Theoretically its ability to restore data is stronger than other generative models. However, its implementation has many limitations, including limited model design, too many model parameters and tedious calculation. In this paper, a bi-parallel linear flow model for facial emotion generation from emotion set images is constructed, and a series of improvements have been made in terms of the expression ability of the model and the convergence speed in training. The model is mainly composed of several coupling layers superimposed to form a multi-scale structure, in which each coupling layer contains 1*1 reversible convolution and linear operation modules. Furthermore, this paper sorted out the current public data set of facial emotion images, made a new emotion data, and verified the model through this data set. The experimental results show that, under the traditional convolutional neural network, the 3-layer 3*3 convolution kernel is more conducive to extracte the features of the face images. The introduction of principal component decomposition can improve the convergence speed of the model.


title: An optimized Capsule-LSTM model for facial expression recognition with video sequences

abstract: To overcome the limitations of convolutional neural network in the process of facial expression recognition, a facial expression recognition model Capsule-LSTM based on video frame sequence is proposed. This model is composed of three networks includingcapsule encoders, capsule decoders and LSTM network. The capsule encoder extracts the spatial information of facial expressions in video frames. Capsule decoder reconstructs the images to optimize the network. LSTM extracts the temporal information between video frames and analyzes the differences in expression changes between frames. The experimental results from the MMI dataset show that the Capsule-LSTM model proposed in this paper can effectively improve the accuracy of video expression recognition.


title: Video-Based Inpatient Fall Risk Assessment: A Case Study

abstract: Inpatient falls are a serious safety issue in hospitals and healthcare facilities. Recent advances in video analytics for patient monitoring provide a non-intrusive avenue to reduce this risk through continuous activity monitoring. However, in-bed fall risk assessment systems have received less attention in the literature. The majority of prior studies have focused on fall event detection, and do not consider the circumstances that may indicate an imminent inpatient fall. Here, we propose a video-based system that can monitor the risk of a patient falling, and alert staff of unsafe behaviour to help prevent falls before they occur. We propose an approach that leverages recent advances in human localisation and skeleton pose estimation to extract spatial features from video frames recorded in a simulated environment. We demonstrate that body positions can be effectively recognised and provide useful evidence for fall risk assessment. This work highlights the benefits of video-based models for analysing behaviours of interest, and demonstrates how such a system could enable sufficient lead time for healthcare professionals to respond and address patient needs, which is necessary for the development of fall intervention programs.


title: Last passage isometries for the directed landscape

abstract: Consider the restriction of the directed landscape $\mathcal L(x, s; y, t)$ to a set of the form $\{x_1, \dots, x_k\} \times \{s_0\} \times \mathbb R \times \{t_0\}$. We show that on any such set, the directed landscape is given by a last passage problem across $k$ locally Brownian functions. The $k$ functions in this last passage isometry are built from certain marginals of the extended directed landscape. As applications of this construction, we show that the Airy difference profile is locally absolutely continuous with respect to Brownian local time, that the KPZ fixed point started from two narrow wedges has a Brownian-Bessel decomposition around its cusp point, and that the directed landscape is a function of its geodesic shapes.


title: On a nonlinear Laplace equation related to the boundary Yamabe problem in the upper-half space

abstract: We consider in this paper the nonlinear elliptic equation with Neumann boundary condition \begin{align*} \begin{cases} \Delta u=a|u|^{m-1}u\,\,\mbox{ in }\,\,\rnp\\ \dfrac{\partial u}{\partial t}=b|u|^{\eta-1}u+f\,\,\mbox{ on }\,\,\partial\rnp. \end{cases} \end{align*} For $a,b\neq 0$, $m>\frac{n+1}{n-1}$, $(n>1)$, $\eta=\frac{m+1}{2}$ and small data $f\in L^{\frac{nq}{n+1},\infty}(\partial\rnp)$, $q=\frac{(n+1)(m-1)}{m+1}$ we prove that the problem is solvable. More precisely, we establish existence, uniqueness and continuous dependence of solutions on the boundary data $f$ in the function space $\X^{q}_{\infty}$ where \[\|u\|_{\X^{q}_{\infty}}=\sup_{t>0}t^{\frac{n+1}{q}-1}\|u(\cdot,t)\|_{L^{\infty}(\partial\rnp)}+\|u\|_{L^{\frac{q(m+1)}{2},\infty}(\rnp)}+\|\nabla u\|_{L^{q,\infty}(\rnp)}. \] As a direct consequence, we obtain the local regularity property $C^{1,\nu}_{loc}$, $\nu\in (0,1)$ of these solutions as well as energy estimates for certain values of $m$. Boundary values decaying faster than $|x|^{-(m+1)/(m-1)}$, $x\in \rn\setminus\{0\}$ yield solvability and this decay property is shown to be sharp for positive nonlinearities. Moreover, we are able to show that solutions inherit qualitative features of the boundary data such as positivity, rotational symmetry with respect to the $(n+1)$-axis, radial monotonicity in the tangential variable and homogeneity. When $a,b>0$, the critical exponent $m_c$ for the existence of positive solutions is identified, $m_c=(n+1)/(n-1)$.


title: Full interpretable machine learning in 2D with inline coordinates

abstract: This paper proposed a new methodology for machine learning in 2-dimensional space (2-D ML) in inline coordinates. It is a full machine learning approach that does not require to deal with n-dimensional data in n-dimensional space. It allows discovering n-D patterns in 2-D space without loss of n-D information using graph representations of n-D data in 2-D. Specifically, it can be done with the inline based coordinates in different modifications, including static and dynamic ones. The classification and regression algorithms based on these inline coordinates were introduced. A successful case study based on a benchmark data demonstrated the feasibility of the approach. This approach helps to consolidate further a whole new area of full 2-D machine learning as a promising ML methodology. It has advantages of abilities to involve actively the end-users into the discovering of models and their justification. Another advantage is providing interpretable ML models.


title: Parabolic jet shape on parsec scales in high redshift AGN

abstract: Geometry of relativistic jets in active galaxies provides important information about mechanisms of launching, collimation and acceleration of plasma flow. We propose a new method to probe a boundary shape of a jet on parsec scales -- in the vicinity of its radio core. Apparent speed of an outflow is derived from variability time delays and core shifts measured at the same jet region, providing a self-consistent estimate of the Lorentz factor $\Gamma$. We link together the distance along the jet $z$ with its transverse size assuming a constant flow acceleration. Our results indicate that jets have parabolic shape and sustain an effective acceleration in the core region, consistent with the Lorentz factor dependency $\Gamma\propto z^{0.5}$. The proposed method can be applied to the sources observed at small viewing angles as well as to the distant sources when direct measurements are impossible due to a limited angular resolution.


title: Spontaneous fluctuation-symmetry breaking and the Landauer principle

abstract: We study the problem of the energetic cost of information erasure by looking at it through the lens of the Jarzynski equality. We observe that the Landauer bound, $\langle W \rangle \geq kT \ln 2$, on average dissipated work $\langle W \rangle$ associated to an erasure process, literally emerges from the underlying second law bound as formulated by Kelvin, $\langle W \rangle \geq 0$, as consequence of a spontaneous breaking of the Crooks-Tasaki fluctuation-symmetry, that accompanies logical irreversibility. We illustrate and corroborate this insight with numerical simulations of the process of information erasure performed on a 2D Ising ferromagnet.


title: Investigating Remote-sensing Techniques to Reveal Stealth Coronal Mass Ejections

abstract: Eruptions of coronal mass ejections (CMEs) from the Sun are usually associated with a number of signatures that can be identified in solar disc imagery. However, there are cases in which a CME that is well observed in coronagraph data is missing a clear low-coronal counterpart. These events have received attention during recent years, mainly as a result of the increased availability of multi-point observations, and are now known as 'stealth CMEs'. In this work, we analyse examples of stealth CMEs featuring various levels of ambiguity. All the selected case studies produced a large-scale CME detected by coronagraphs and were observed from at least one secondary viewpoint, enabling a priori knowledge of their approximate source region. To each event, we apply several image processing and geometric techniques with the aim to evaluate whether such methods can provide additional information compared to the study of "normal" intensity images. We are able to identify at least weak eruptive signatures for all events upon careful investigation of remote-sensing data, noting that differently processed images may be needed to properly interpret and analyse elusive observations. We also find that the effectiveness of geometric techniques strongly depends on the CME propagation direction with respect to the observers and the relative spacecraft separation. Being able to observe and therefore forecast stealth CMEs is of great importance in the context of space weather, since such events are occasionally the solar counterparts of so-called 'problem geomagnetic storms'.


title: Bounds of the spectral radius of the induced map on cohomology

abstract: In this paper we study the relationship between Lyapunov exponents and the induced map on cohomology for $C^{1}-$diffeomorphisms on compact manifolds. We show that if the induced map on cohomology has spectral radius strictly larger than 1, then the diffeomorphism has an invariant ergodic measure with at least one positive Lyapunov exponent. Furthermore, if the diffeomorphism also preserves a continuous volume form then it has an invariant ergodic measure with at least one positive and one negative Lyapunov exponent, in agreement with Shub's entropy conjecture. We also consider diffeomorphisms preserving a measure equivalent to volume. In this case we show that if the Lyapunov metric satisfies an integrability condition and the induced map on cohomology has spectral radius strictly larger than 1, then the diffeomorphism has non-zero Lyapunov exponents on a set of positive volume.


title: An Algorithm-Independent Measure of Progress for Linear Constraint Propagation

abstract: Propagation of linear constraints has become a crucial sub-routine in modern Mixed-Integer Programming (MIP) solvers. In practice, iterative algorithms with tolerance-based stopping criteria are used to avoid problems with slow or infinite convergence. However, these heuristic stopping criteria can pose difficulties for fairly comparing the efficiency of different implementations of iterative propagation algorithms in a real-world setting. Most significantly, the presence of unbounded variable domains in the problem formulation makes it difficult to quantify the relative size of reductions performed on them. In this work, we develop a method to measure -- independently of the algorithmic design -- the progress that a given iterative propagation procedure has made at a given point in time during its execution. Our measure makes it possible to study and better compare the behavior of bounds propagation algorithms for linear constraints. We apply the new measure to answer two questions of practical relevance: (i) We investigate to what extent heuristic stopping criteria can lead to premature termination on real-world MIP instances. (ii) We compare a GPU-parallel propagation algorithm against a sequential state-of-the-art implementation and show that the parallel version is even more competitive in a real-world setting than originally reported.


title: Connecting Large-Scale Velocity and Temperature Bursts with Small-Scale Intermittency in Stratified Turbulence

abstract: Non-Gaussian statistics of large-scale fields are routinely observed in data from atmospheric and oceanic campaigns and global models. Recent direct numerical simulations (DNSs) showed that large-scale intermittency in stably stratified flows is due to the emergence of sporadic, extreme events in the form of bursts in the vertical velocity and the temperature. This phenomenon results from the interplay between waves and turbulent motions, affecting mixing. We provide evidence of the enhancement of the classical small-scale (or internal) intermittency due to the emergence of large-scale drafts, connecting large- and small-scale bursts. To this aim we analyze a large set of DNSs of the stably stratified Boussinesq equations over a wide range of values of the Froude number ($Fr\approx 0.01-1$). The variation of the buoyancy field kurtosis with $Fr$ is similar to (though with smaller values than) the kurtosis of the vertical velocity, both showing a non-monotonic trend. We present a mechanism for the generation of extreme vertical drafts and vorticity enhancements which follows from the exact equations for field gradients.


title: Scalable and accurate multi-GPU based image reconstruction of large-scale ptychography data

abstract: While the advances in synchrotron light sources, together with the development of focusing optics and detectors, allow nanoscale ptychographic imaging of materials and biological specimens, the corresponding experiments can yield terabyte-scale large volumes of data that can impose a heavy burden on the computing platform. While Graphical Processing Units (GPUs) provide high performance for such large-scale ptychography datasets, a single GPU is typically insufficient for analysis and reconstruction. Several existing works have considered leveraging multiple GPUs to accelerate the ptychographic reconstruction. However, they utilize only Message Passing Interface (MPI) to handle the communications between GPUs. It poses inefficiency for the configuration that has multiple GPUs in a single node, especially while processing a single large projection, since it provides no optimizations to handle the heterogeneous GPU interconnections containing both low-speed links, e.g., PCIe, and high-speed links, e.g., NVLink. In this paper, we provide a multi-GPU implementation that can effectively solve large-scale ptychographic reconstruction problem with optimized performance on intra-node multi-GPU. We focus on the conventional maximum-likelihood reconstruction problem using conjugate-gradient (CG) for the solution and propose a novel hybrid parallelization model to address the performance bottlenecks in CG solver. Accordingly, we develop a tool called PtyGer (Ptychographic GPU(multiple)-based reconstruction), implementing our hybrid parallelization model design. The comprehensive evaluation verifies that PtyGer can fully preserve the original algorithm's accuracy while achieving outstanding intra-node GPU scalability.


title: Yb delafossites: unique exchange frustration of 4f spin 1/2 moments on a perfect triangular lattice

abstract: While the Heisenberg model for magnetic Mott insulators on planar lattice structures is comparatively well understood in the case of transition metal ions, the intrinsic spin-orbit entanglement of 4f magnetic ions on such lattices shows fascinating new physics largely due to corresponding strong anisotropies both in their single-ion and their exchange properties. We show here that the Yb delafossites, containing perfect magnetic Yb$^{3+}$ triangular lattice planes with pseudospin $s=1/2$ at low temperatures, are an ideal platform to study these new phenomena. Competing frustrated interactions may lead to an absence of magnetic order associated to a gapless spin liquid ground state with a huge linear specific heat exceeding that of many heavy fermions, whereas the application of a magnetic field induces anisotropic magnetic order with successive transitions into different long ranged ordered structures. In this comparative study, we discuss our experimental findings in terms of a unified crystal-field and exchange model. We combine electron paramagnetic resonance (EPR) experiments and results from neutron scattering with measurements of the magnetic susceptibility, isothermal magnetization up to full polarization, and specific heat to determine the relevant model parameters. The impact of the crystal field is discussed as well as the symmetry-compatible form of the exchange tensor, and we give explicit expressions for the anisotropic g factor, the temperature dependence of the susceptibility, the exchange-narrowed EPR linewidth and the saturation field.


title: F-T-LSTM based Complex Network for Joint Acoustic Echo Cancellation and Speech Enhancement

abstract: With the increasing demand for audio communication and online conference, ensuring the robustness of Acoustic Echo Cancellation (AEC) under the complicated acoustic scenario including noise, reverberation and nonlinear distortion has become a top issue. Although there have been some traditional methods that consider nonlinear distortion, they are still inefficient for echo suppression and the performance will be attenuated when noise is present. In this paper, we present a real-time AEC approach using complex neural network to better modeling the important phase information and frequency-time-LSTMs (F-T-LSTM), which scan both frequency and time axis, for better temporal modeling. Moreover, we utilize modified SI-SNR as cost function to make the model to have better echo cancellation and noise suppression (NS) performance. With only 1.4M parameters, the proposed approach outperforms the AEC-challenge baseline by 0.27 in terms of Mean Opinion Score (MOS).


title: Dynamic Gradient Aggregation for Federated Domain Adaptation

abstract: In this paper, a new learning algorithm for Federated Learning (FL) is introduced. The proposed scheme is based on a weighted gradient aggregation using two-step optimization to offer a flexible training pipeline. Herein, two different flavors of the aggregation method are presented, leading to an order of magnitude improvement in convergence speed compared to other distributed or FL training algorithms like BMUF and FedAvg. Further, the aggregation algorithm acts as a regularizer of the gradient quality. We investigate the effect of our FL algorithm in supervised and unsupervised Speech Recognition (SR) scenarios. The experimental validation is performed based on three tasks: first, the LibriSpeech task showing a speed-up of 7x and 6% word error rate reduction (WERR) compared to the baseline results. The second task is based on session adaptation providing 20% WERR over a powerful LAS model. Finally, our unsupervised pipeline is applied to the conversational SR task. The proposed FL system outperforms the baseline systems in both convergence speed and overall model performance.


title: Dual-Path Filter Network: Speaker-Aware Modeling for Speech Separation

abstract: Speech separation has been extensively studied to deal with the cocktail party problem in recent years. All related approaches can be divided into two categories: time-frequency domain methods and time domain methods. In addition, some methods try to generate speaker vectors to support source separation. In this study, we propose a new model called dual-path filter network (DPFN). Our model focuses on the post-processing of speech separation to improve speech separation performance. DPFN is composed of two parts: the speaker module and the separation module. First, the speaker module infers the identities of the speakers. Then, the separation module uses the speakers' information to extract the voices of individual speakers from the mixture. DPFN constructed based on DPRNN-TasNet is not only superior to DPRNN-TasNet, but also avoids the problem of permutation-invariant training (PIT).


title: A scalable helium gas cooling system for trapped-ion applications

abstract: Microfabricated ion-trap devices offer a promising pathway towards scalable quantum computing. Research efforts have begun to focus on the engineering challenges associated with developing large-scale ion-trap arrays and networks. However, increasing the size of the array and integrating on-chip electronics can drastically increase the power dissipation within the ion-trap chips. This leads to an increase in the operating temperature of the ion-trap and limits the device performance. Therefore, effective thermal management is an essential consideration for any large-scale architecture. Presented here is the development of a modular cooling system designed for use with multiple ion-trapping experiments simultaneously. The system includes an extensible cryostat that permits scaling of the cooling power to meet the demands of a large network. Following experimental testing on two independent ion-trap experiments, the cooling system is expected to deliver a net cooling power of 111 W at ~70 K to up to four experiments. The cooling system is a step towards meeting the practical challenges of operating large-scale quantum computers with many qubits.


title: The boundary of rank-one divisible convex sets

abstract: We prove that for any non-symmetric irreducible divisible convex set, the proximal limit set is the full projective boundary.


title: Non Gaussian Denoising Diffusion Models

abstract: Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underline noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with more degrees of freedom, could help the performance of such generative models. In this work, we investigate other types of noise distribution for the diffusion process. Specifically, we show that noise from Gamma distribution provides improved results for image and speech generation. Moreover, we show that using a mixture of Gaussian noise variables in the diffusion process improves the performance over a diffusion process that is based on a single distribution. Our approach preserves the ability to efficiently sample state in the training diffusion process while using Gamma noise and a mixture of noise.


title: Biomedical Entity Linking with Contrastive Context Matching

abstract: We introduce BioCoM, a contrastive learning framework for biomedical entity linking that uses only two resources: a small-sized dictionary and a large number of raw biomedical articles. Specifically, we build the training instances from raw PubMed articles by dictionary matching and use them to train a context-aware entity linking model with contrastive learning. We predict the normalized biomedical entity at inference time through a nearest-neighbor search. Results found that BioCoM substantially outperforms state-of-the-art models, especially in low-resource settings, by effectively using the context of the entities.


title: Scaling in the short-time approximation

abstract: We briefly review the concept of scaling and how it occurs in quasielastic electron and neutrino scattering from nuclei, and then the particular approach to scaling in the short-time approximation. We show that, while two-nucleon currents do significantly enhance the transverse electromagnetic response, they do not spoil scaling, but in fact enhance it. We provide scaling results obtained in the short-time approximation that verify this claim. The enhanced scaling is not ``accidental'' -- as claimed in Ref.~\cite{Benhar:2020jye} -- but rather reflects the dominant role played by pion exchange interactions and currents in the quasielastic regime.


title: Global Controllability for Quasilinear Non-negative Definite System of ODEs and SDEs

abstract: We consider exact and averaged control problem for a system of quasi-linear ODEs and SDEs with a non-negative definite symmetric matrix of the system. The strategy of the proof is the standard linearization of the system by fixing the function appearing in the nonlinear part of the system, and then applying the Leray-Schauder fixed point theorem. We shall also need the continuous induction arguments to prolong the control to the final state which is a novel approach in the field. This enables us to obtain controllability for arbitrarily large initial data (so called global controllability).


title: Scattering of two particles in a 1D lattice

abstract: This study concerns the two-body scattering of particles in a one-dimensional periodic potential. A convenient ansatz allows for the separation of center-of-mass and relative motion, leading to a discrete Schr\"odinger equation in the relative motion that resembles a tight-binding model. A lattice Green's function is used to develop the Lippmann-Schwinger equation, and ultimately derive a multi-band scattering K-matrix which is described in detail in the two-band approximation. Two distinct scattering lengths are defined according the limits of zero relative quasi-momentum at the top and bottom edges of the two-body collision band. Scattering resonances occur in the collision band when the energy is coincident with a bound state attached to another higher or lower band. Notably, repulsive on-site interactions in an energetically closed lower band lead to collision resonances in an excited band.


title: Limited-Information Maximum Likelihood based Model Selection Procedures for Binary Outcomes

abstract: Unmeasured covariates constitute one of the important problems in causal inference. Even if there are some unmeasured covariates, some instrumental variable methods such as a two-stage residual inclusion (2SRI) estimator, or a limited-information maximum likelihood (LIML) estimator can obtain an unbiased estimate for causal effects despite there being nonlinear outcomes such as binary outcomes; however, it requires that we specify not only a correct outcome model but also a correct treatment model. Therefore, detecting correct models is an important process. In this paper, we propose two model selection procedures: AIC-type and BIC-type, and confirm their properties. The proposed model selection procedures are based on a LIML estimator. We prove that a proposed BIC-type model selection procedure has model selection consistency, and confirm their properties of the proposed model selection procedures through simulation datasets.


title: Scenarios of future Indian electricity demand accounting for space cooling and electric vehicle adoption

abstract: India is expected to witness rapid growth in electricity use over the next two decades. Here, we introduce a custom regression model to project electricity consumption in India over the coming decades, which includes a bottom-up estimate of electricity consumption for two major growth drivers, air conditioning, and vehicle electrification. The model projections are available at a customizable level of spatial aggregation at an hourly temporal resolution, which makes them useful as inputs to long-term electricity infrastructure planning studies. The approach is used to develop electricity consumption data sets spanning various technology adoption and growth scenarios up to the year 2050 in five-year increments. The aim of the data is to provide a range of scenarios for India's demand growth given new technology adoption. With long-term hourly demand projections serving as an essential input for electricity infrastructure modeling, this data publication enables further work on energy efficiency, generation, and transmission expansion planning for a fast-growing and increasingly important region from a global climate mitigation perspective.


title: Gaussian Unitary Ensemble in random lozenge tilings

abstract: This paper establishes a universality result for scaling limits of uniformly random lozenge tilings of large domains. We prove that whenever a boundary of the domain has three adjacent straight segments inclined under 120 degrees to each other, the asymptotics of tilings near the middle segment is described by the GUE--corners process of random matrix theory. An important step in our argument is to show that fluctuations of the height function of random tilings on essentially arbitrary simply-connected domains of diameter $N$ have smaller magnitude than $N^{1/2}$.


title: Decision making under uncertainty for deploying battery storage as a non-wire alternative in distribution networks

abstract: The growing demand for electricity in emerging markets and developing economies (EMDE) such as India is causing loading and congestion problems on distribution networks, particularly in urban locations, that adversely impact sustainable development and economic growth. Electric utilities in these economies face unique constraints regarding raising capital required to upgrade their congested networks. Battery storage has emerged as a non-wire alternative (NWA) to feeder upgrades. This article presents a flexible valuation framework for battery storage use in distribution networks and its application in the context of EMDE distribution network planning. We evaluate the value of storage as an NWA using a multi-stage decision making process that combines system optimization with markov-decision processes (MDP) to identify the least-cost network upgrade strategy under demand growth uncertainty. When applied to feeders in Delhi, India, the approach highlights the cost-effectiveness of battery storage to manage load growth while deferring network investments. Across the low, medium and high battery storage capital cost projections for 2030, we estimate that 18 to 29 GWh of battery storage capacity could be deployed to defer 11,752 to 15,914 km of medium voltage distribution feeder lines that are loaded at 60\% or more of their ampere capacity in 2030, resulting in 12 to 16\% capital cost savings. Interestingly, the lowering storage capital costs does not always increase NWA storage deployment, due to network capacity constraints limiting opportunities for off-peak storage charging.


title: A biomathematical model of tumor response to radioimmunotherapy with $\alpha$PDL1 and $\alpha$CTLA4

abstract: There is evidence of synergy between radiotherapy and immunotherapy. Radiotherapy can increase liberation of tumor antigens, causing activation of antitumor T-cells. This effect can be boosted with immunotherapy. Radioimmunotherapy has potential to increase tumor control rates. Biomathematical models of response to radioimmunotherapy may help on understanding of the mechanisms affecting response, and assist clinicians on the design of optimal treatment strategies. In this work we present a biomathematical model of tumor response to radioimmunotherapy. The model uses the linear-quadratic response of tumor cells to radiation (or variation of it), and builds on previous developments to include the radiation-induced immune effect. We have focused this study on the combined effect of radiotherapy and $\alpha$PDL1/$\alpha$CTLA4 therapies. The model can fit preclinical data of volume dynamics and control obtained with different dose fractionations and $\alpha$PDL1/$\alpha$CTLA4. A biomathematical study of optimal combination strategies suggests that a good understanding of the involved biological delays, the biokinetics of the immunotherapy drug, and the interplay between them, may be of paramount importance to design optimal radioimmunotherapy schedules. Biomathematical models like the one we present can help to interpret experimental data on the synergy between radiotherapy and immunotherapy, and to assist in the design of more effective treatments.


title: No more glowing in the dark: How deep learning improves exposure date estimation in thermoluminescence dosimetry

abstract: The time- or temperature-resolved detector signal from a thermoluminescence dosimeter can reveal additional information about circumstances of an exposure to ionizing irradiation. We present studies using deep neural networks to estimate the date of a single irradiation with 12 mSv within a monitoring interval of 42 days from glow curves of novel TL-DOS personal dosimeters developed by the Materialpr\"ufungsamt NRW in cooperation with TU Dortmund University. Using a deep convolutional network, the irradiation date can be predicted from raw time-resolved glow curve data with an uncertainty of roughly 1-2 days on a 68% confidence level without the need for a prior transformation into temperature space and a subsequent glow curve deconvolution. This corresponds to a significant improvement in prediction accuracy compared to a prior publication, which yielded a prediction uncertainty of 2-4 days using features obtained from a glow curve deconvolution as input to a neural network.


title: Global Schauder theory for minimizers of the $H^s(\Omega)$ energy

abstract: We study the regularity of minimizers of the functional $\mathcal E(u):= [u]_{H^s(\Omega)}^2 +\int_\Omega fu$. This corresponds to understanding solutions for the regional fractional Laplacian in $\Omega\subset\mathbb R^N$. More precisely, we are interested on the global (up to the boundary) regularity of solutions, both in the case of free minimizers in $H^s(\Omega)$ (i.e., Neumann problem), or in the case of Dirichlet condition $u\in H^s_0(\Omega)$ when $s>\frac12$. Our main result establishes the sharp regularity of solutions in both cases: $u\in C^{2s+\alpha}(\overline\Omega)$ in the Neumann case, and $u/\delta^{2s-1}\in C^{1+\alpha}(\overline\Omega)$ in the Dirichlet case. Here, $\delta$ is the distance to $\partial\Omega$, and $\alpha<\alpha_s$, with $\alpha_s\in (0,1-s)$ and $2s+\alpha_s>1$. We also show the optimality of our result: these estimates fail for $\alpha>\alpha_s$, even when $f$ and $\partial\Omega$ are $C^\infty$.


title: Graph Contrastive Learning Automated

abstract: Self-supervised learning on graph-structured data has drawn recent interest for learning generalizable, transferable and robust representations from unlabeled graphs. Among many, graph contrastive learning (GraphCL) has emerged with promising representation learning performance. Unfortunately, unlike its counterpart on image data, the effectiveness of GraphCL hinges on ad-hoc data augmentations, which have to be manually picked per dataset, by either rules of thumb or trial-and-errors, owing to the diverse nature of graph data. That significantly limits the more general applicability of GraphCL. Aiming to fill in this crucial gap, this paper proposes a unified bi-level optimization framework to automatically, adaptively and dynamically select data augmentations when performing GraphCL on specific graph data. The general framework, dubbed JOint Augmentation Optimization (JOAO), is instantiated as min-max optimization. The selections of augmentations made by JOAO are shown to be in general aligned with previous "best practices" observed from handcrafted tuning: yet now being automated, more flexible and versatile. Moreover, we propose a new augmentation-aware projection head mechanism, which will route output features through different projection heads corresponding to different augmentations chosen at each training step. Extensive experiments demonstrate that JOAO performs on par with or sometimes better than the state-of-the-art competitors including GraphCL, on multiple graph datasets of various scales and types, yet without resorting to any laborious dataset-specific tuning on augmentation selection. We release the code at https://github.com/Shen-Lab/GraphCL_Automated.


title: Anomaly-free deformations of spherical general relativity coupled to matter

abstract: A systematic approach is developed in order to obtain spherically symmetric midisuperspace models that accept holonomy modifications in the presence of matter fields with local degrees of freedom. In particular, starting from the most general Hamiltonian quadratic in radial derivatives of the variables, we obtain a family of effective modified constraints that satisfy Dirac's deformation algebra, which encodes the covariance of general relativity, and show that (scale-dependent) holonomy corrections can be consistently implemented. In vacuum, the deformed anomaly-free Hamiltonian is explicitly written in terms of three free functions and we obtain a weak observable that can be interpreted as the mass of the model. Finally, as a particular example, we present a specific covariant polymeric model that remains regular for any value of the connection components. Some of its physical implications and the relation with previous studies in the literature are commented.


title: Maximizing Revenue with Adaptive Modulation and Multiple FECs in Flexible Optical Networks

abstract: Flexible optical networks (FONs) are being adopted to accommodate the increasingly heterogeneous traffic in today's Internet. However, in presence of high traffic load, not all offered traffic can be satisfied at all time. As carried traffic load brings revenues to operators, traffic blocking due to limited spectrum resource leads to revenue losses. In this study, given a set of traffic requests to be provisioned, we consider the problem of maximizing operator's revenue, subject to limited spectrum resource and physical layer impairments (PLIs), namely amplified spontaneous emission noise (ASE), self-channel interference (SCI), cross-channel interference (XCI), and node crosstalk. In FONs, adaptive modulation, multiple FEC, and the tuning of power spectrum density (PSD) can be effectively employed to mitigate the impact of PLIs. Hence, in our study, we propose a universal bandwidth-related impairment evaluation model based on channel bandwidth, which allows a performance analysis for different PSD, FEC and modulations. Leveraging this PLI model and a piecewise linear fitting function, we succeed to formulate the revenue maximization problem as a mixed integer linear program. Then, to solve the problem on larger network instances, a fast two-phase heuristic algorithm is also proposed, which is shown to be near-optimal for revenue maximization. Through simulations, we demonstrate that using adaptive modulation enables to significantly increase revenues in the scenario of high signal-to-noise ratio (SNR), where the revenue can even be doubled for high traffic load, while using multiple FECs is more profitable for scenarios with low SNR.


title: MLPerf Tiny Benchmark

abstract: Advancements in ultra-low-power tiny machine learning (TinyML) systems promise to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted and easily reproducible benchmark for these systems. To meet this need, we present MLPerf Tiny, the first industry-standard benchmark suite for ultra-low-power tiny machine learning systems. The benchmark suite is the collaborative effort of more than 50 organizations from industry and academia and reflects the needs of the community. MLPerf Tiny measures the accuracy, latency, and energy of machine learning inference to properly evaluate the tradeoffs between systems. Additionally, MLPerf Tiny implements a modular design that enables benchmark submitters to show the benefits of their product, regardless of where it falls on the ML deployment stack, in a fair and reproducible manner. The suite features four benchmarks: keyword spotting, visual wake words, image classification, and anomaly detection.


title: Carter-Penrose diagrams for emergent spacetime in axisymmetrically accreting black hole systems

abstract: For general relativistic, inviscid, axisymmetric flow around Kerr black hole one may choose different flow thickness. The stationary flow equations can be solved using methods of dynamical system to get transonic accretion flows , i.e, flow infalling in the blackhole that turns supersonic from subsonic with decreasing radial distance, or vice versa. This transonic flows are obtained by choosing the particular flow passing through critical points of phase portrait. For certain flow thickness like the one maintaining conical shape, the sonic point coincide with the critical point. But there are certain flows maintaining hydrostatic equilibrium, such as the one described by Novikov-Thorne, where the sonic point is not same as the critical point. We perturb the flow for both kind of flow and study the behaviour of linear perturbation which behaves like massless scalar field in some curved spacetime, known as, analogue space time. We draw the compactified causal structure, i.e, Penrose Carter diagram for both kind of analogue metric and prove that for both cases critical points are the acoustic horizons, whereas in the case where sonic points do not coincide with critical points, the sonic points are not the acoustic horizon, as one may expect from the definition of sound speed.


title: On the relation between the monotone Riemannian metrics on the space of Gibbs thermal states and the linear response theory

abstract: The proposed in J. Math. Phys. v.57,071903 (2016) analytical expansion of monotone (contractive) Riemannian metrics (called also quantum Fisher information(s)) in terms of moments of the dynamical structure factor (DSF) relative to an original intensive observable is reconsidered and extended. The new approach through the DSF which characterizes fully the set of monotone Riemannian metrics on the space of Gibbs thermal states is utilized to obtain an extension of the spectral presentation obtained for the Bogoliubov-Kubo-Mori metric (the generalized isothermal susceptibility) on the entire class of monotone Riemannian metrics. The obtained spectral presentation is the main point of our consideration. The last allows to present the one to one correspondence between monotone Riemannian metrics and operator monotone functions (which is a statement of the Petz theorem in the quantum information theory) in terms of the linear response theory. We show that monotone Riemannian metrics can be determined from the analysis of the infinite chain of equations of motion of the retarded Green's functions. Inequalities between the different metrics have been obtained as well. It is a demonstration that the analysis of information-theoretic problems has benefited from concepts of statistical mechanics and might cross-fertilize or extend both directions, and vice versa. We illustrate the presented approach on the calculation of the entire class of monotone (contractive) Riemannian metrics on the examples of some simple but instructive systems employed in various physical problems.


title: On the origin of the correspondence between classical and quantum integrable theories

abstract: If we start from certain functional relations as definition of a quantum integrable theory, then we can derive from them a linear integral equation. It can be extended, by introducing dynamical variables, to become an equation with the form of Marchenko's. Then, we derive from the latter a classical (differential) Lax pair. We exemplify our method by focusing on the massive version of the ODE/IM (Ordinary Differential Equations/Integrable Models) correspondence from Quantum sine-Gordon (sG) with many moduli/masses to the classical sinh-Gordon (shG) equation, so describing, in a particular case, some super-symmetric gauge theories and the $AdS_3$ strong coupling scattering amplitudes/Wilson loops. Yet, we present it in a way which reveals its generality of application. In fact, we give some hints on how it works for spin chains.


title: Shadow of axisymmetric, stationary and asymptotically flat black holes in the presence of plasma

abstract: We study the shadow produced by a class of rotating black holes surrounded by plasma. The metric for these black holes arises by applying the Newman-Janis algorithm to a family of spherically symmetric spacetimes, which includes several well known geometries as special cases. We derive a general expression for the shape of the shadow in the case that the plasma frequency leads to a separable Hamilton-Jacobi equation for light. We present two examples in which we obtain the shadow contours and the observables resulting from them. In one, we analyze Kerr-Newman-like geometries, including braneworld and Horndeski gravity black holes, while in the other, we consider scalar-tensor 4D Einstein-Gauss-Bonnet gravity spacetimes. In both cases, we find that the presence of plasma leads to a smaller and less deformed shadow.


title: $\varepsilon\,$-contact structures and six-dimensional supergravity

abstract: We introduce the concept of $\varepsilon\,$-contact metric structures on oriented (pseudo-)Riemannian three-manifolds, which encompasses the usual Riemannian contact metric, Lorentzian contact metric and para-contact metric structures, but which also allows the possibility for the Reeb vector field to be null. We investigate in more detail this latter case, which we call null contact structure. We observe that it is possible to extend in a natural and meaningful way both the Sasaki and K-contact conditions for null-contact structures, but we find that they are not equivalent conditions, in contradistinction to the situation for non-lightlike Reeb vector fields. Finally, we define the notion of $\varepsilon\eta\,$-Einstein structures and we discover that appropriate direct products of these structures produce solutions of six-dimensional minimal supergravity coupled to a tensor multiplet with constant dilaton.


title: On the Adimensional Scale Invariant Steffensen (ASIS) Method

abstract: Dimensionality of parameters and variables is a fundamental issue in physics but mostly ignored from a mathematical point of view. Diffculties arising from dimensional inconsistence are overcome by scaling analysis and, often, both concepts, dimensionality and scaling, are confused. In the particular case of iterative methods for solving non-linear equations, dimensionality and scaling affects their robutness: while some classical methods, such as Newton, are adimensional and scale independent, some other iterations as Steffensen's are not; their convergence depends on the scaling, and their evaluation needs a dimensional congruence. In this paper we introduce the concept of adimensional form of a function in order to study the behavior of iterative methods, thus correcting, if possible, some pathological features. From this adimensional form we will devise an adimensional and scale invariant method based on Steffensen's which we will call ASIS method.


title: Poincar\'e series for surfaces with boundary

abstract: We show that the Poincar\'e series counting orthogeodesics of a negatively curved surface with totally geodesic boundary extends meromorphically to the whole complex plane, as well as the series counting geodesic arcs linking two points; we also give their value at zero.


title: Improving third-generation leptoquark searches with combined signals and boosted top

abstract: Search strategies for the third-generation leptoquarks (LQs) are distinct from other LQ searches, especially when they decay to a top quark and a $\tau$ lepton. We investigate the cases of all TeV-scale scalar and vector LQs that decay to either a top-tau pair (charge-$1/3$ and $5/3$ LQs) or a top-neutrino pair (charge-$2/3$ LQs). One can then use the boosted top (which can be tagged efficiently using jet-substructure techniques) and high-$p_{\rm T}$ $\tau$ leptons to search for these LQs. We consider two search channels with either one or two taus along with at least one hadronically decaying boosted top quark. We estimate the high luminosity LHC (HL-LHC) search prospects of these LQs by considering both symmetric and asymmetric pair and single production processes. Our selection criteria are optimised to retain events from both pair and single production processes. The combined signal has better prospects than the traditional searches. We include new three-body single production processes to enhance the single production contributions to the combined signal. We identify the interference effect that appears in the dominant single production channel of charge-$1/3$ scalar LQ ($S^{1/3}$). This interference is constructive if $S^{1/3}$ is weak-triplet and destructive, for a singlet one. As a result, their LHC prospects differ appreciably.


title: A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

abstract: A physics informed neural network (PINN) incorporates the physics of a system by satisfying its boundary value problem through a neural network's loss function. The PINN approach has shown great success in approximating the map between the solution of a partial differential equation (PDE) and its spatio-temporal input. However, for strongly non-linear and higher order partial differential equations PINN's accuracy reduces significantly. To resolve this problem, we propose a novel PINN scheme that solves the PDE sequentially over successive time segments using a single neural network. The key idea is to re-train the same neural network for solving the PDE over successive time segments while satisfying the already obtained solution for all previous time segments. Thus it is named as backward compatible PINN (bc-PINN). To illustrate the advantages of bc-PINN, we have used the Cahn Hilliard and Allen Cahn equations, which are widely used to describe phase separation and reaction diffusion systems. Our results show significant improvement in accuracy over the PINN method while using a smaller number of collocation points. Additionally, we have shown that using the phase space technique for a higher order PDE could further improve the accuracy and efficiency of the bc-PINN scheme.


title: Physical Mechanism of Superconductivity Part II Superconductivity and Superfluidity

abstract: The transition mechanism of metal-insulator in metal oxides is discussed in detail, which is a part of the mechanism of superconductivity. Through the study of magic angle twisted bilayer graphene superconductor and other new findings on superconductivity, we further demonstrate that the physical mechanism of superconductivity proposed in Part I is the only correct way to handle the properties of superconductivity in various materials. We propose that superfluid helium consists of normal liquid helium mixed with high-energy helium atoms. Based on this new model, all peculiar features discovered in superfluid helium can be truly understood, such as the climb of superfluid helium on the container's wall, the fountain effect, the discontinuity of specific heat capacity at phase transition point, and the maintaining mass current in a ring-shaped container. We demonstrate that the high-energy particles play a driving force role in both superconductors and superfluid helium, and therefore dominate their properties.


title: Recursive Refinement Network for Deformable Lung Registration between Exhale and Inhale CT Scans

abstract: Unsupervised learning-based medical image registration approaches have witnessed rapid development in recent years. We propose to revisit a commonly ignored while simple and well-established principle: recursive refinement of deformation vector fields across scales. We introduce a recursive refinement network (RRN) for unsupervised medical image registration, to extract multi-scale features, construct normalized local cost correlation volume and recursively refine volumetric deformation vector fields. RRN achieves state of the art performance for 3D registration of expiratory-inspiratory pairs of CT lung scans. On DirLab COPDGene dataset, RRN returns an average Target Registration Error (TRE) of 0.83 mm, which corresponds to a 13% error reduction from the best result presented in the leaderboard. In addition to comparison with conventional methods, RRN leads to 89% error reduction compared to deep-learning-based peer approaches.


title: The Exact Spectral Derivative Discretization Finite Difference (ESDDFD) Method for Wave Models: A Universal Wave View Through Natural Fractional / Fractal Derivative Representations (or View Lens Shops for The Exponential Wave Universe)

abstract: A wave view of the universe is proposed in which each natural phenomenon is equipped with its own unique natural viewing lens. A self-sameness modeling principle and its systematic application in Fourier-Laplace transform space is proposed as a novel, universal discrete modeling paradigm for advection-diffusion-reaction equations (ADREs) across non-integer derivatives, time scales, and wave spectral signatures. Its implementation is a novel exact spectral derivative discretization finite difference method (ESDDFD), a way for crafting wave viewing lenses by obtaining discrete wave models from ADRE models. The template for building these lenses come in the form of natural derivative representations obtained from the wave signature probability distribution function and its harmonic oscillation in FL transform space; use of the ESDDFD method in the discrete numerical modeling of wave equations requires no a-priori theory of any mathematical derivative. A major mathematical consequence of this viewpoint is that all notions of the mathematical integer or non-integer derivatives have representation as limits of such natural derivative representations; this and other consequences are discussed and a discretization of a simple integer derivative diffusion-reaction equation is presented to illustrate the method. The resulting view lenses, in the form of ESDDFD models, work well in detecting both local and non-local Debye or Kohlrausch-Williams-Watts exponential patterns; only Brownian motion and sub-diffusion are discussed in the present article.


title: Measuring the repertoire of age-related behavioral changes in Drosophila melanogaster

abstract: Aging affects almost all aspects of an organism -- its morphology, its physiology, its behavior. Isolating which biological mechanisms are regulating these changes, however, has proven difficult, potentially due to our inability to characterize the full repertoire of an animal's behavior across the lifespan. Using data from fruit flies (D. melanogaster) we measure the full repertoire of behaviors as a function of age. We observe a sexually dimorphic pattern of changes in the behavioral repertoire during aging. Although the stereotypy of the behaviors and the complexity of the repertoire overall remains relatively unchanged, we find evidence that the observed alterations in behavior can be explained by changing the fly's overall energy budget, suggesting potential connections between metabolism, aging, and behavior.


title: Neuroevolution-Enhanced Multi-Objective Optimization for Mixed-Precision Quantization

abstract: Mixed-precision quantization is a powerful tool to enable memory and compute savings of neural network workloads by deploying different sets of bit-width precisions on separate compute operations. In this work, we present a flexible and scalable framework for automated mixed-precision quantization that concurrently optimizes task performance, memory compression, and compute savings through multi-objective evolutionary computing. Our framework centers on Neuroevolution-Enhanced Multi-Objective Optimization (NEMO), a novel search method, which combines established search methods with the representational power of neural networks. Within NEMO, the population is divided into structurally distinct sub-populations, or species, which jointly create the Pareto frontier of solutions for the multi-objective problem. At each generation, species perform separate mutation and crossover operations, and are re-sized in proportion to the goodness of their contribution to the Pareto frontier. In our experiments, we define a graph-based representation to describe the underlying workload, enabling us to deploy graph neural networks trained by NEMO via neuroevolution, to find Pareto optimal configurations for MobileNet-V2, ResNet50 and ResNeXt-101-32x8d. Compared to the state-of-the-art, we achieve competitive results on memory compression and superior results for compute compression. Further analysis reveals that the graph representation and the species-based approach employed by NEMO are critical to finding optimal solutions.


title: Dynamic Asymmetric Causality Tests with an Application

abstract: Testing for causation, defined as the preceding impact of the past values of one variable on the current value of another one when all other pertinent information is accounted for, is increasingly utilized in empirical research of the time-series data in different scientific disciplines. A relatively recent extension of this approach has been allowing for potential asymmetric impacts since it is harmonious with the way reality operates in many cases according to Hatemi-J (2012). The current paper maintains that it is also important to account for the potential change in the parameters when asymmetric causation tests are conducted, as there exists a number of reasons for changing the potential causal connection between variables across time. The current paper extends therefore the static asymmetric causality tests by making them dynamic via the usage of subsamples. An application is also provided consistent with measurable definitions of economic or financial bad as well as good news and their potential interaction across time.


title: Improving Metric Dimensionality Reduction with Distributed Topology

abstract: We propose a novel approach to dimensionality reduction combining techniques of metric geometry and distributed persistent homology, in the form of a gradient-descent based method called DIPOLE. DIPOLE is a dimensionality-reduction post-processing step that corrects an initial embedding by minimizing a loss functional with both a local, metric term and a global, topological term. By fixing an initial embedding method (we use Isomap), DIPOLE can also be viewed as a full dimensionality-reduction pipeline. This framework is based on the strong theoretical and computational properties of distributed persistent homology and comes with the guarantee of almost sure convergence. We observe that DIPOLE outperforms popular methods like UMAP, t-SNE, and Isomap on a number of popular datasets, both visually and in terms of precise quantitative metrics.


title: Direct Observation of the Scale Relation between Density of States and Pairing Gap in a Dirty Superconductor

abstract: Theories and experiments on dirty superconductors are sophisticated but important for both fundamentals and applications. It becomes more challenging when magnetic fields are present, because the field distribution, the electron density of states, and the superconducting pairing potentials are nonuniform. Here we present tunneling microspectroscopic experiments on NbC single crystals and show that NbC is a homogeneous dirty superconductor. When applying magnetic fields to the sample, we observe that the zero-energy local density of states and the pairing energy gap follow an explicit scale relation proposed by de Gennes for homogeneous dirty superconductors in high magnetic fields. Surprisingly, our experimental findings suggest that the validity of the scale relation extends to magnetic field strengths far below the upper critical field and call for new nonperturbative understanding of this fundamental property in dirty superconductors. On the practical side, we use the observed scale relation to drive a simple and straightforward experimental scheme for extracting the superconducting coherence length of a dirty superconductor in magnetic fields.


title: Magic Layouts: Structural Prior for Component Detection in User Interface Designs

abstract: We present Magic Layouts; a method for parsing screenshots or hand-drawn sketches of user interface (UI) layouts. Our core contribution is to extend existing detectors to exploit a learned structural prior for UI designs, enabling robust detection of UI components; buttons, text boxes and similar. Specifically we learn a prior over mobile UI layouts, encoding common spatial co-occurrence relationships between different UI components. Conditioning region proposals using this prior leads to performance gains on UI layout parsing for both hand-drawn UIs and app screenshots, which we demonstrate within the context an interactive application for rapidly acquiring digital prototypes of user experience (UX) designs.


title: A Semi-Implicit Meshless Method for Incompressible Flows in Complex Geometries

abstract: We present an exponentially convergent semi-implicit meshless algorithm for the solution of Navier-Stokes equations in complex domains. The algorithm discretizes partial derivatives at scattered points using radial basis functions as interpolants. Higher-order polynomials are appended to polyharmonic splines (PHS-RBF) and a collocation method is used to derive the interpolation coefficients. The interpolating kernels are then differentiated and the partial-differential equations are satisfied by collocation at the scattered points. The PHS-RBF interpolation is shown to be exponentially convergent with discretization errors decreasing as a high power of a representative distance between points. We present here a semi-implicit algorithm for time-dependent and steady state fluid flows in complex domains. At each time step, several iterations are performed to converge the momentum and continuity equations. A Poisson equation for pressure corrections is formulated by imposing divergence free condition on the iterated velocity field. At each time step, the momentum and pressure correction equations are repeatedly solved until the velocities and pressure converge to a pre-specified tolerance. We have demonstrated the convergence and discretization accuracy of the algorithm for two model problems and simulated three other complex problems. In all cases, the algorithm is stable for Courant numbers in excess of ten. The algorithm has the potential to accurately and efficiently solve many fluid flow and heat transfer problems in complex domains. An open source code Meshless Multi-Physics Software (MeMPhyS) is available for interested users of the algorithm.


title: Delving Deep into the Generalization of Vision Transformers under Distribution Shifts

abstract: Vision Transformers (ViTs) have achieved impressive performance on various vision tasks, yet their generalization under distribution shifts (DS) is rarely understood. In this work, we comprehensively study the out-of-distribution (OOD) generalization of ViTs. For systematic investigation, we first present a taxonomy of DS. We then perform extensive evaluations of ViT variants under different DS and compare their generalization with Convolutional Neural Network (CNN) models. Important observations are obtained: 1) ViTs learn weaker biases on backgrounds and textures, while they are equipped with stronger inductive biases towards shapes and structures, which is more consistent with human cognitive traits. Therefore, ViTs generalize better than CNNs under DS. With the same or less amount of parameters, ViTs are ahead of corresponding CNNs by more than 5% in top-1 accuracy under most types of DS. 2) As the model scale increases, ViTs strengthen these biases and thus gradually narrow the in-distribution and OOD performance gap. To further improve the generalization of ViTs, we design the Generalization-Enhanced ViTs (GE-ViTs) from the perspectives of adversarial learning, information theory, and self-supervised learning. By comprehensively investigating these GE-ViTs and comparing with their corresponding CNN models, we observe: 1) For the enhanced model, larger ViTs still benefit more for the OOD generalization. 2) GE-ViTs are more sensitive to the hyper-parameters than their corresponding CNN models. We design a smoother learning strategy to achieve a stable training process and obtain performance improvements on OOD data by 4% from vanilla ViTs. We hope our comprehensive study could shed light on the design of more generalizable learning architectures.


title: Dynamical analogue spacetimes in non-relativistic flows

abstract: Analogue gravity models describe linear fluctuations of fluids as a massless scalar field propagating on stationary acoustic spacetimes constructed from the background flow. In this paper, we establish that this paradigm generalizes to arbitrary order nonlinear perturbations propagating on dynamical analogue spacetimes. Our results hold for all inviscid, spherically symmetric and barotropic non-relativistic flows in the presence of an external conservative force. We demonstrate that such fluids always admit a dynamical description governed by a coupled pair of wave and continuity equations. We provide an iterative approach to solve these equations about any known stationary solution to all orders in perturbation. In the process, we reveal that there exists a dynamical acoustic spacetime on which fluctuations of the mass accretion rate propagate. The dynamical acoustic spacetime is shown to have a well defined causal structure and curvature. In addition, we find a classical fluctuation relation for the acoustic horizon of the spacetime that admit scenarios wherein the horizon can grow as well as recede, with the latter being a result with no known analogue in black holes. As an example, we numerically investigate the Bondi flow accreting solution subject to exponentially damped time dependent perturbations. We find that second and higher order classical perturbations possess an acoustic horizon that oscillates and changes to a new stable size at late times. In particular, the case of a receding acoustic horizon is realized through `low frequency' perturbations. We discuss our results in the context of more general analogue models and its potential implications on astrophysical accretion flows.


title: Variational Quantum Eigensolver with Reduced Circuit Complexity

abstract: The variational quantum eigensolver (VQE) is one of the most promising algorithms to find eigenvalues and eigenvectors of a given Hamiltonian on noisy intermediate-scale quantum (NISQ) devices. A particular application is to obtain ground or excited states of molecules. The practical realization is currently limited by the complexity of quantum circuits. Here we present a novel approach to reduce quantum circuit complexity in VQE for electronic structure calculations. Our algorithm, called ClusterVQE, splits the initial qubit space into subspaces (qubit clusters) which are further distributed on individual (shallower) quantum circuits. The clusters are obtained based on quantum mutual information reflecting maximal entanglement between qubits, whereas entanglement between different clusters is taken into account via a new "dressed" Hamiltonian. ClusterVQE therefore allows exact simulation of the problem by using fewer qubits and shallower circuit depth compared to standard VQE at the cost of additional classical resources. In addition, a new gradient measurement method without using an ancillary qubit is also developed in this work. Proof-of-principle demonstrations are presented for several molecular systems based on quantum simulators as well as an IBM quantum device with accompanying error mitigation. The efficiency of the new algorithm is comparable to or even improved over qubit-ADAPT-VQE and iterative Qubit Coupled Cluster (iQCC), state-of-the-art circuit-efficient VQE methods to obtain variational ground state energies of molecules on NISQ hardware. Above all, the new ClusterVQE algorithm simultaneously reduces the number of qubits and circuit depth, making it a potential leader for quantum chemistry simulations on NISQ devices.


title: Fast symplectic integrator for Nesterov-type acceleration method

abstract: In this paper, explicit stable integrators based on symplectic and contact geometries are proposed for a non-autonomous ordinarily differential equation (ODE) found in improving convergence rate of Nesterov's accelerated gradient method. Symplectic geometry is known to be suitable for describing Hamiltonian mechanics, and contact geometry is known as an odd-dimensional counterpart of symplectic geometry. Moreover, a procedure, called symplectization, is a known way to construct a symplectic manifold from a contact manifold, yielding Hamiltonian systems from contact ones. It is found in this paper that a previously investigated non-autonomous ODE can be written as a contact Hamiltonian system. Then, by symplectization of a non-autonomous contact Hamiltonian vector field expressing the non-autonomous ODE, novel symplectic integrators are derived. Because the proposed symplectic integrators preserve hidden symplectic and contact structures in the ODE, they should be more stable than the Runge-Kutta method. Numerical experiments demonstrate that, as expected, the second-order symplectic integrator is stable and high convergence rates are achieved.