title: Data-aided Sensing where Communication and Sensing Meet: An Introduction

abstract: Since there are a number of Internet-of-Things (IoT) applications that need to collect data sets from a large number of sensors or devices in real-time, sensing and communication need to be integrated for efficient uploading from devices. In this paper, we introduce the notion of data-aided sensing (DAS) where a base station (BS) utilizes a subset of data that is already uploaded and available to select the next device for efficient data collection or sensing. Thus, using DAS, certain tasks in IoT applications, including federated learning, can be completed by uploading from a small number of selected devices. Two different types of DAS are considered: one is centralized DAS and the other is distributed DAS. In centralized DAS, the BS decides the uploading order, while each device can decide when to upload its own local data set among multiple uploading rounds in distributed DAS. In distributed DAS, random access is employed where the access probability of each device is decided according to its local measurement for efficient uploading.


title: Comparative Review of Malware Analysis Methodologies

abstract: To fight against the evolution of malware and its development, the specific methodologies that are applied by the malware analysts are crucial. Yet, this is something often overlooked in the relevant bibliography or in the formal and informal training of the relevant professionals. There are only two generic and all-encompassing structured methodologies for Malware Analysis (MA) - SAMA and MARE. The question is whether they are adequate and there is no need for another one or whether there is no such need at all. This paper will try to answer the above and it will contribute in the following ways: it will present, compare and dissect those two malware analysis methodologies, it will present their capacity for analysing modern malware by applying them on a random modern specimen and finally, it will conclude on whether there is a procedural optimization for malware analysis over the evolution of these two methodologies.


title: Sum-of-Squares Certificates for Vizing's Conjecture via Determining Gr\"obner Bases

abstract: The famous open Vizing conjecture claims that the domination number of the Cartesian product graph of two graphs $G$ and $H$ is at least the product of the domination numbers of $G$ and $H$. Recently Gaar, Krenn, Margulies and Wiegele used the graph class $\mathcal{G}$ of all graphs with $n_\mathcal{G}$ vertices and domination number $k_\mathcal{G}$ and reformulated Vizing's conjecture as the problem that for all graph classes $\mathcal{G}$ and $\mathcal{H}$ the Vizing polynomial is sum-of-squares (SOS) modulo the Vizing ideal. By solving semidefinite programs (SDPs) and clever guessing they derived SOS-certificates for some values of $k_\mathcal{G}$, $n_\mathcal{G}$, $k_\mathcal{H}$, and $n_\mathcal{H}$. In this paper, we consider their approach for $k_\mathcal{G} = k_\mathcal{H} = 1$. For this case we are able to derive the unique reduced Gr\"obner basis of the Vizing ideal. Based on this, we deduce the minimum degree $(n_\mathcal{G} + n_\mathcal{H} - 1)/2$ of an SOS-certificate for Vizing's conjecture, which is the first result of this kind. Furthermore, we present a method to find certificates for graph classes $\mathcal{G}$ and $\mathcal{H}$ with $n_\mathcal{G} + n_\mathcal{H} -1 = d$ for general $d$, which is again based on solving SDPs, but does not depend on guessing and depends on much smaller SDPs. We implement our new method in SageMath and give new SOS-certificates for all graph classes $\mathcal{G}$ and $\mathcal{H}$ with $k_\mathcal{G}=k_\mathcal{H}=1$ and $n_\mathcal{G} + n_\mathcal{H} \leq 15$.


title: Multinational Address Parsing: A Zero-Shot Evaluation

abstract: Address parsing consists of identifying the segments that make up an address, such as a street name or a postal code. Because of its importance for tasks like record linkage, address parsing has been approached with many techniques, the latest relying on neural networks. While these models yield notable results, previous work on neural networks has only focused on parsing addresses from a single source country. This paper explores the possibility of transferring the address parsing knowledge acquired by training deep learning models on some countries' addresses to others with no further training in a zero-shot transfer learning setting. We also experiment using an attention mechanism and a domain adversarial training algorithm in the same zero-shot transfer setting to improve performance. Both methods yield state-of-the-art performance for most of the tested countries while giving good results to the remaining countries. We also explore the effect of incomplete addresses on our best model, and we evaluate the impact of using incomplete addresses during training. In addition, we propose an open-source Python implementation of some of our trained models.


title: Passenger Network Ridership Model Through a BRT System, the case of TransMilenio in Bogot\'a

abstract: We present a ridership model of individual trajectories of users within a public transport network for which there are several different routes between origin and destiny and for which the automatic fare collection data does not include information about the exit station; only card identification and time of entry into the system. This model is implemented in the case of the Troncal component of TransMilenio, the BRT system that is the backbone of public transport in Bogot\'a. The granularity of the data allows to identify the occupation of every bus within the system at any particular day. As a validation, we compare the average bus occupation of two particular days, 17 of May of 2020 and the 1 of December of 2020.


title: A New Classification Model for the ZTF Catalog of Periodic Variable Stars

abstract: Using the second data release from the Zwicky Transient Facility (ZTF, Bellm et al. 2019), Chen et al. (2020) created a ZTF Catalog of Periodic Variable Stars (ZTF CPVS) of 781, 602 periodic variables stars (PVSs) with 11 class labels. Here, we provide a new classification model of PVSs in the ZTF CPVS using a convolutional variational autoencoder and hierarchical random forest. We cross-match the sky-coordinate of PVSs in the ZTF CPVS with those presented in the SIMBAD catalog. We identify non-stellar objects that are not previously classified, including extragalactic objects such as Quasi-Stellar Objects, Active Galactic Nuclei, supernovae and planetary nebulae. We then create a new labelled training set with 13 classes in two levels. We obtain a reasonable level of completeness (> 90 %) for certain classes of PVSs, although we have poorer completeness in other classes (~ 40 % in some cases). Our new labels for the ZTF CPVS are available via Zenodo Cheung et al. (2021).


title: Auxiliary Learning for Self-Supervised Video Representation via Similarity-based Knowledge Distillation

abstract: Despite the outstanding success of self-supervised pretraining methods for video representation learning, they generalise poorly when the unlabeled dataset for pretraining is small or the domain difference between unlabelled data in source task (pretraining) and labeled data in target task (finetuning) is significant. To mitigate these issues, we propose a novel approach to complement self-supervised pretraining via an auxiliary pretraining phase, based on knowledge similarity distillation, auxSKD, for better generalisation with a significantly smaller amount of video data, e.g. Kinetics-100 rather than Kinetics-400. Our method deploys a teacher network that iteratively distills its knowledge to the student model by capturing the similarity information between segments of unlabelled video data. The student model meanwhile solves a pretext task by exploiting this prior knowledge. We also introduce a novel pretext task, Video Segment Pace Prediction or VSPP, which requires our model to predict the playback speed of a randomly selected segment of the input video to provide more reliable self-supervised representations. Our experimental results show superior results to the state of the art on both UCF101 and HMDB51 datasets when pretraining on K100 in apple-to-apple comparisons. Additionally, we show that our auxiliary pretraining, auxSKD, when added as an extra pretraining phase to recent state of the art self-supervised methods (i.e. VCOP, VideoPace, and RSPNet), improves their results on UCF101 and HMDB51. Our code is available at https://github.com/Plrbear/auxSKD.


title: Spectral analysis for compressible quantum fluids

abstract: Turbulent fluid dynamics typically involves excitations on many different length scales. Classical incompressible fluids can be cleanly represented in Fourier space enabling spectral analysis of energy cascades and other turbulence phenomena. In quantum fluids, additional phase information and singular behaviour near vortex cores thwarts the direct extension of standard spectral techniques. We develop a formal and numerical spectral analysis for $U(1)$ symmetry-breaking quantum fluids suitable for analyzing turbulent flows, with specific application to the Gross-Pitaevskii fluid. Our analysis builds naturally on the canonical approach to spectral analysis of velocity fields in compressible quantum fluids, and establishes a clear correspondence between energy spectral densities, power spectral densities, and autocorrelation functions, applicable to energy residing in velocity, quantum pressure, interaction, and potential energy of the fluid. Our formulation includes all quantum phase information and also enables arbitrary resolution spectral analysis, a valuable feature for numerical analysis. A central vortex in a trapped planar Bose-Einstein condensate provides an analytically tractable example with spectral features of interest in both the infrared and ultraviolet regimes. Sampled distributions modelling the dipole gas, plasma, and clustered regimes exhibit velocity correlation length increasing with vortex energy, consistent with known qualitative behaviour across the vortex clustering transition. The spectral analysis of compressible quantum fluids presented here offers a rigorous tool for analysing quantum features of superfluid turbulence in atomic or polariton condensates.

categories: cond-mat.quant-gas math-ph math.MP quant-ph


title: A deep learning model for data-driven discovery of functional connectivity

abstract: Functional connectivity (FC) studies have demonstrated the overarching value of studying the brain and its disorders through the undirected weighted graph of fMRI correlation matrix. Most of the work with the FC, however, depends on the way the connectivity is computed, and further depends on the manual post-hoc analysis of the FC matrices. In this work we propose a deep learning architecture BrainGNN that learns the connectivity structure as part of learning to classify subjects. It simultaneously applies a graphical neural network to this learned graph and learns to select a sparse subset of brain regions important to the prediction task. We demonstrate the model's state-of-the-art classification performance on a schizophrenia fMRI dataset and demonstrate how introspection leads to disorder relevant findings. The graphs learned by the model exhibit strong class discrimination and the sparse subset of relevant regions are consistent with the schizophrenia literature.


title: Unsupervised Representation Learning via Neural Activation Coding

abstract: We present neural activation coding (NAC) as a novel approach for learning deep representations from unlabeled data for downstream applications. We argue that the deep encoder should maximize its nonlinear expressivity on the data for downstream predictors to take full advantage of its representation power. To this end, NAC maximizes the mutual information between activation patterns of the encoder and the data over a noisy communication channel. We show that learning for a noise-robust activation code increases the number of distinct linear regions of ReLU encoders, hence the maximum nonlinear expressivity. More interestingly, NAC learns both continuous and discrete representations of data, which we respectively evaluate on two downstream tasks: (i) linear classification on CIFAR-10 and ImageNet-1K and (ii) nearest neighbor retrieval on CIFAR-10 and FLICKR-25K. Empirical results show that NAC attains better or comparable performance on both tasks over recent baselines including SimCLR and DistillHash. In addition, NAC pretraining provides significant benefits to the training of deep generative models. Our code is available at https://github.com/yookoon/nac.


title: A Kerr/CFT Correspondence in Twistor Space

abstract: Ingoing and outgoing principal null geodesics in Kerr spacetimes are characterized as part of parametrized families of strings in complex Kerr geometry and are associated with holomorphic curves in twistor space with help of the Kerr theorem. They are defined on 2-dimensional twistor manifolds, one for outgoing and one for ingoing principal null congruences, and are solutions of free twistor string models on these 2-dimensional twistor manifolds. Such a twistor string model implies a conformal field theory and, assuming the applicability of the Cardy formula, agreement with the Bekenstein-Hawking area law can be achieved depending on the effective central charge and temperature. A couple of (ambi)twistor string candidate models are examined.


title: DeepFace-EMD: Re-ranking Using Patch-wise Earth Mover's Distance Improves Out-Of-Distribution Face Identification

abstract: Face identification (FI) is ubiquitous and drives many high-stake decisions made by law enforcement. State-of-the-art FI approaches compare two images by taking the cosine similarity between their image embeddings. Yet, such an approach suffers from poor out-of-distribution (OOD) generalization to new types of images (e.g., when a query face is masked, cropped, or rotated) not included in the training set or the gallery. Here, we propose a re-ranking approach that compares two faces using the Earth Mover's Distance on the deep, spatial features of image patches. Our extra comparison stage explicitly examines image similarity at a fine-grained level (e.g., eyes to eyes) and is more robust to OOD perturbations and occlusions than traditional FI. Interestingly, without finetuning feature extractors, our method consistently improves the accuracy on all tested OOD queries: masked, cropped, rotated, and adversarial while obtaining similar results on in-distribution images.


title: fastball: A fast algorithm to sample bipartite graphs with fixed degree sequences

abstract: Many applications require randomly sampling bipartite graphs with fixed degrees, or randomly sampling incidence matrices with fixed row and column sums. Although several sampling algorithms exist, the ``curveball'' algorithm is the most efficient with an asymptotic time complexity of O(n log n), and has been proven to sample uniformly at random. In this paper, we introduce the ``fastball'' algorithm, which adopts a similar approach but has an asymptotic time complexity of O(n). We show that a C++ implementation of fastball randomly samples large bipartite graphs with fixed degrees faster than curveball, and illustrate the value of this faster algorithm in the context of the fixed degree sequence model for backbone extraction.


title: Triggering tearing in a forming current sheet with the mirror instability

abstract: We study the time-dependent formation and evolution of a current sheet (CS) in a magnetized, collisionless, high-beta plasma using hybrid-kinetic particle-in-cell simulations. An initially tearing-stable Harris sheet is frozen into a persistently driven incompressible flow so that its characteristic thickness gradually decreases in time. As the CS thins, the strength of the reconnecting field increases, and adiabatic invariance in the inflowing fluid elements produces a field-biased pressure anisotropy with excess perpendicular pressure. At large plasma beta, this anisotropy excites the mirror instability, which deforms the reconnecting field on ion-Larmor scales and dramatically reduces the effective thickness of the CS. Tearing modes whose wavelengths are comparable to that of the mirrors then become unstable, triggering reconnection on smaller scales and at earlier times than would have occurred if the thinning CS were to have retained its Harris profile. A novel method for identifying and tracking X-points is introduced, yielding X-point separations that are initially intermediate between the perpendicular and parallel mirror wavelengths in the upstream plasma. These mirror-stimulated tearing modes ultimately grow and merge to produce island widths comparable to the CS thickness, an outcome we verify across a range of CS formation timescales and initial CS widths. Our results may find their most immediate application in the tearing disruption of magnetic folds generated by turbulent dynamo in weakly collisional, high-beta, astrophysical plasmas.


title: The b-symbol weight hierarchy of the Kasami codes

abstract: The symbol-pair read channel was first proposed by Cassuto and Blaum. Later, Yaakobi et al. generalized it to the $b$-symbol read channel. It is motivated by the limitations of the reading process in high density data storage systems. One main task in $b$-symbol coding theory is to determine the $b$-symbol weight hierarchy of codes. In this paper, we study the $b$-symbol weight hierarchy of the Kasami codes, which are well known for their applications to construct sequences with optimal correlation magnitudes. The complete symbol-pair weight distribution of the Kasami codes is determined.


title: Probing light vector mediators with coherent scattering at future facilities

abstract: Future experiments dedicated to the detection of Coherent Elastic Neutrino-Nucleus Scattering may be powerful tools in probing light new physics. In this paper we study the sensitivity on light $Z'$ mediators of two proposed experiments: a directional low pressure Time Projection Chamber detector, $\nu$BDX-DRIFT, that will utilize neutrinos produced at the Long Baseline Neutrino Facility, and several possible experiments to be installed at the European Spallation Source. We compare the results obtained with existing limits from fixed-target, accelerator, solar neutrino and reactor experiments. Furthermore, we show that these experiments have the potential to test unexplored regions that, in some case, could explain the anomalous magnetic moment of the muon or peculiar spectral features in the cosmic neutrino spectrum observed by IceCube.


title: A Robust Completed Local Binary Pattern (RCLBP) for Surface Defect Detection

abstract: In this paper, we present a Robust Completed Local Binary Pattern (RCLBP) framework for a surface defect detection task. Our approach uses a combination of Non-Local (NL) means filter with wavelet thresholding and Completed Local Binary Pattern (CLBP) to extract robust features which are fed into classifiers for surface defects detection. This paper combines three components: A denoising technique based on Non-Local (NL) means filter with wavelet thresholding is established to denoise the noisy image while preserving the textures and edges. Second, discriminative features are extracted using the CLBP technique. Finally, the discriminative features are fed into the classifiers to build the detection model and evaluate the performance of the proposed framework. The performance of the defect detection models are evaluated using a real-world steel surface defect database from Northeastern University (NEU). Experimental results demonstrate that the proposed approach RCLBP is noise robust and can be applied for surface defect detection under varying conditions of intra-class and inter-class changes and with illumination changes.


title: The resource cost of large scale quantum computing

abstract: This thesis deals with the problematics of the scalability of fault-tolerant quantum computing. This question is studied under the angle of estimating the resources needed to set up such computers. What we call a resource is, in principle, very general; it could be the power, the energy, the total bandwidth allocated to the different qubits... However, we mainly focus on the energetic cost of quantum computing. In particular, we develop an inter-disciplinary approach that allows to minimize the resources required to implement algorithms on quantum computers. By asking to find the minimum amount of resources required to perform a computation under the constraint that the algorithm provides a correct answer with a targeted accuracy, it is possible to optimize the whole computer in order to minimize the resources spent, while being sure to have a correct answer with a high probability. We apply this approach to a complete model fault-tolerant quantum computer based on superconducting qubits. Our results indicate that for algorithms implemented on thousands of logical qubits, our method makes it possible to reduce the energetic cost by orders of magnitudes in regimes where, without optimizing, the power consumption could be close to the gigawatt. This work illustrates that the energetic cost of quantum computing should be a criterion in itself, allowing to evaluate the scaling potential of a given quantum computer technology. It also illustrates that optimizing the architecture of a quantum computer, via inter-disciplinary methods, including algorithms, error correction, qubit physics, engineering aspects, such as the ones that we propose, can prove to be a powerful tool, clearly improving the scaling potential of quantum computers. Finally, we provide general hints about how to make fault-tolerant quantum computers energy efficient.


title: Accelerating Understanding of Scientific Experiments with End to End Symbolic Regression

abstract: We consider the problem of learning free-form symbolic expressions from raw data, such as that produced by an experiment in any scientific domain. Accurate and interpretable models of scientific phenomena are the cornerstone of scientific research. Simple yet interpretable models, such as linear or logistic regression and decision trees often lack predictive accuracy. Alternatively, accurate blackbox models such as deep neural networks provide high predictive accuracy, but do not readily admit human understanding in a way that would enrich the scientific theory of the phenomenon. Many great breakthroughs in science revolve around the development of parsimonious equational models with high predictive accuracy, such as Newton's laws, universal gravitation, and Maxwell's equations. Previous work on automating the search of equational models from data combine domain-specific heuristics as well as computationally expensive techniques, such as genetic programming and Monte-Carlo search. We develop a deep neural network (MACSYMA) to address the symbolic regression problem as an end-to-end supervised learning problem. MACSYMA can generate symbolic expressions that describe a dataset. The computational complexity of the task is reduced to the feedforward computation of a neural network. We train our neural network on a synthetic dataset consisting of data tables of varying length and varying levels of noise, for which the neural network must learn to produce the correct symbolic expression token by token. Finally, we validate our technique by running on a public dataset from behavioral science.


title: Thermodynamic role of main reaction pathway and multi-body information flow in membrane transport

abstract: The two classes of membrane transport, namely, secondary active and passive transport, are understood as different reaction pathways in the same protein structure, described by the 16-state model in this paper. To quantify the thermodynamic difference between secondary active transport and passive transport, we extend the second law of information thermodynamics of the autonomous demon in the four-state model composed of two subsystems to the 16-state model composed of four subsystems representing the membrane transport. We reduce the 16 states to 4 states and derive the coarse-grained second law of information thermodynamics, which provides an upper bound of the free energy transport by the coarse-grained information flow. We also derive an upper bound on the free energy transport by the multi-body information flow representing the two-body or four-body correlations in the 16-state model by exploiting the cycle decomposition. The coarse-grained information flow and the multi-body information flows express the quantitative difference between secondary active and passive transport. The numerical analysis shows that the coarse-grained information flow is positive for secondary active transport and negative for passive transport. The four-body correlation is dominant in the multi-body information flows for secondary active transport. In contrast, the two-body correlation is dominant for passive transport. This result shows that both the sign of the coarse-grained information flow and the difference of the four-body correlation and the two-body correlation explain the difference of the free energy transport in secondary active and passive transport.


title: Ionized carbon around IRC +10216

abstract: Asymptotic giant branch (AGB)stars create a rich inventory of molecules in their envelopes as they lose mass during later stages of their evolution. These molecules cannot survive the conditions in interstellar space, where they are exposed to ultraviolet photons of the interstellar radiation field. As a result, daughter molecules are the ones injected into space, and a halo of those molecules is predicted to exist around cool evolved stars. The most abundant molecule in the envelopes other than H2 is CO, which dissociates into C that is rapidly ionized in a halo around the star that is optically thin to the interstellar radiation field. We develop the specific predictions of the ionized carbon halo size and column density for the well-studied, nearby star IRC +10216. We compare those models to observations of the [C II] 157.7 micron far-infrared fine-structure line using SOFIA and Herschel. The combination of bright emission toward the star and upper limits to extended [C II] is inconsistent with any standard model. The presence of [C II] toward the star requires some dissociation and ionization in the inner part of the outflow, possibly due to a hot companion star. The lack of extended [C II] emission requires that daughter products from CO photodissociation in the outer envelope remain cold. The [C II] profile toward the star is asymmetric, with the blue-shifted absorption due to the cold outer envelope.


title: A semi-group approach to Principal Component Analysis

abstract: Principal Component Analysis (PCA) is a well known procedure to reduce intrinsic complexity of a dataset, essentially through simplifying the covariance structure or the correlation structure. We introduce a novel algebraic, model-based point of view and provide in particular an extension of the PCA to distributions without second moments by formulating the PCA as a best low rank approximation problem. In contrast to hitherto existing approaches, the approximation is based on a kind of spectral representation, and not on the real space. Nonetheless, the prominent role of the eigenvectors is here reduced to define the approximating surface and its maximal dimension. In this perspective, our approach is close to the original idea of Pearson (1901) and hence to autoencoders. Since variable selection in linear regression can be seen as a special case of our extension, our approach gives some insight, why the various variable selection methods, such as forward selection and best subset selection, cannot be expected to coincide. The linear regression model itself and the PCA regression appear as limit cases.


title: Natural orbitals for the ab initio no-core configuration interaction approach

abstract: Ab initio no-core configuration interaction (NCCI) calculations for the nuclear many-body problem have traditionally relied upon an antisymmetrized product (Slater determinant) basis built from harmonic oscillator orbitals. The accuracy of such calculations is limited by the finite dimensions which are computationally feasible for the truncated many-body space. We therefore seek to improve the accuracy obtained for a given basis size by optimizing the choice of single-particle orbitals. Natural orbitals, which diagonalize the one-body density matrix, provide a basis which maximizes the occupation of low-lying orbitals, thus accelerating convergence in a configuration-interaction basis, while also possibly providing physical insight into the single-particle structure of the many-body wave function. We describe the implementation of natural orbitals in the NCCI framework, and examine the nature of the natural orbitals thus obtained, the properties of the resulting many-body wave functions, and the convergence of observables. After taking $^3\mathrm{He}$ as an illustrative testbed, we explore aspects of NCCI calculations with natural orbitals for the ground state of the $p$-shell neutron halo nucleus $^6\mathrm{He}$.


title: Quantum Frames of Reference and the Noncommutative Values of Observables

abstract: Based on a recent relational formulation of quantum reference frame transformations, especially with a case of quantum spatial translations in particular, we analyzed how the `value' of an observable for a fixed state change. That is the exact analog of the classical description, for example, of the value of the $x$-coordinate for a particle decrease by 2 units when we perform a translation of the reference frame putting the new origin at $x=2$. The essence of the quantum reference frame transformations is to have the quantum fluctuations, and even entanglement, of the physical object which serves as the (new) reference frame, taken into account. We illustrate how the recently introduced notion of the noncommutative values of quantum observables gives such a definite description successfully. Formulations, and an analysis of a case example in qubit systems, of analog transformations for observables with a discrete or finite spectrum is also presented. Issues about the evolving picture of the symmetry system of all quantum reference frame transformations discussed.


title: Boundary Control and Estimation for Under-Balanced Drilling with Uncertain Reservoir Parameters

abstract: In under-balanced drilling, the bottom-hole pressure is kept below pore pressure, causing pressure dependent influx of reservoir gas into the wellbore that makes the system unstable at low drawdowns. In this paper we propose a feedback controller which stabilizes the system around an arbitrary pressure setpoint, using only topside measurement, and assuming unknown reservoir parameters. A particular challenge with this problem is the distributed and highly nonlinear nature of the system dynamics. As the control model we use the ``reduced Drift Flux Model'' which models gas-liquid flow as a nonlinear transport equation with a non-local integral source term. The observer estimates the distributed gas concentration, downhole pressure and reservoir parameters by solving the system dynamics backwards relative to how the gas rises in the well. The control inputs are then constructed by designing target states over the next sampling period and again solving reversed dynamics to obtain the required topside pressures. The resulting controller is implemented with a 2 minute zero-order hold to accommodate the actuation limitation situation on an actual drilling rig. The results are illustrated in simulations with a industry standard Drift Flux formulation as the plant model.


title: The Origin and Value of Disagreement Among Data Labelers: A Case Study of the Individual Difference in Hate Speech Annotation

abstract: Human annotated data is the cornerstone of today's artificial intelligence efforts, yet data labeling processes can be complicated and expensive, especially when human labelers disagree with each other. The current work practice is to use majority-voted labels to overrule the disagreement. However, in the subjective data labeling tasks such as hate speech annotation, disagreement among individual labelers can be difficult to resolve. In this paper, we explored why such disagreements occur using a mixed-method approach - including interviews with experts, concept mapping exercises, and self-reporting items - to develop a multidimensional scale for distilling the process of how annotators label a hate speech corpus. We tested this scale with 170 annotators in a hate speech annotation task. Results showed that our scale can reveal facets of individual differences among annotators (e.g., age, personality, etc.), and these facets' relationships to an annotator's final label decision of an instance. We suggest that this work contributes to the understanding of how humans annotate data. The proposed scale can potentially improve the value of the currently discarded minority-vote labels.


title: Estimating Quality of Transmission in a Live Production Network using Machine Learning

abstract: We demonstrate QoT estimation in a live network utilizing neural networks trained on synthetic data spanning a large parameter space. The ML-model predicts the measured lightpath performance with <0.5dB SNR error over a wide configuration range.


title: Contact Force Mediated Rapid Deposition of Colloidal Microspheres Flowing Over Microstructured Barriers

abstract: Deposition of particles while flowing past constrictions is a ubiquitous phenomenon observed in diverse systems. Some common examples are jamming of salt crystals near the orifice of saltshakers, clogging of filter systems, gridlock in vehicular traffic etc. Our work investigates the deposition events of colloidal microspheres flowing over microstructured barriers in microfluidic devices. The interplay of DLVO, contact and hydrodynamic forces in facilitating rapid deposition of microspheres is discussed. Noticeably, a decrease in the electrostatic repulsion among microspheres leads to linear chain formations, whereas an increase in roughness results in rapid deposition.


title: Image classifiers can not be made robust to small perturbations

abstract: The sensitivity of image classifiers to small perturbations in the input is often viewed as a defect of their construction. We demonstrate that this sensitivity is a fundamental property of classifiers. For any arbitrary classifier over the set of $n$-by-$n$ images, we show that for all but one class it is possible to change the classification of all but a tiny fraction of the images in that class with a perturbation of size $O(n^{1/\max{(p,1)}})$ when measured in any $p$-norm for $p \geq 0$. We then discuss how this phenomenon relates to human visual perception and the potential implications for the design considerations of computer vision systems.


title: Feasibility study of quantum computing using trapped electrons

abstract: We investigate the feasibility of using electrons in a linear Paul trap as qubits in a future quantum computer. We discuss the necessary experimental steps to realize such a device through a concrete design proposal, including trapping, cooling, electronic detection, spin readout and single and multi-qubit gate operations. Numeric simulations indicate that two-qubit Bell-state fidelities of order 99.99% can be achieved assuming reasonable experimental parameters.


title: Relating transformers to models and neural representations of the hippocampal formation

abstract: Many deep neural network architectures loosely based on brain networks have recently been shown to replicate neural firing patterns observed in the brain. One of the most exciting and promising novel architectures, the Transformer neural network, was developed without the brain in mind. In this work, we show that transformers, when equipped with recurrent position encodings, replicate the precisely tuned spatial representations of the hippocampal formation; most notably place and grid cells. Furthermore, we show that this result is no surprise since it is closely related to current hippocampal models from neuroscience. We additionally show the transformer version offers dramatic performance gains over the neuroscience version. This work continues to bind computations of artificial and brain networks, offers a novel understanding of the hippocampal-cortical interaction, and suggests how wider cortical areas may perform complex tasks beyond current neuroscience models such as language comprehension.


title: DeepDiagnosis: Automatically Diagnosing Faults and Recommending Actionable Fixes in Deep Learning Programs

abstract: Deep Neural Networks (DNNs) are used in a wide variety of applications. However, as in any software application, DNN-based apps are afflicted with bugs. Previous work observed that DNN bug fix patterns are different from traditional bug fix patterns. Furthermore, those buggy models are non-trivial to diagnose and fix due to inexplicit errors with several options to fix them. To support developers in locating and fixing bugs, we propose DeepDiagnosis, a novel debugging approach that localizes the faults, reports error symptoms and suggests fixes for DNN programs. In the first phase, our technique monitors a training model, periodically checking for eight types of error conditions. Then, in case of problems, it reports messages containing sufficient information to perform actionable repairs to the model. In the evaluation, we thoroughly examine 444 models -53 real-world from GitHub and Stack Overflow, and 391 curated by AUTOTRAINER. DeepDiagnosis provides superior accuracy when compared to UMLUAT and DeepLocalize. Our technique is faster than AUTOTRAINER for fault localization. The results show that our approach can support additional types of models, while state-of-the-art was only able to handle classification ones. Our technique was able to report bugs that do not manifest as numerical errors during training. Also, it can provide actionable insights for fix whereas DeepLocalize can only report faults that lead to numerical errors during training. DeepDiagnosis manifests the best capabilities of fault detection, bug localization, and symptoms identification when compared to other approaches.


title: Evaluation of Static Vulnerability Detection Tools with Java Cryptographic API Benchmarks

abstract: Several studies showed that misuses of cryptographic APIs are common in real-world code (e.g., Apache projects and Android apps). There exist several open-sourced and commercial security tools that automatically screen Java programs to detect misuses. To compare their accuracy and security guarantees, we develop two comprehensive benchmarks named CryptoAPI-Bench and ApacheCryptoAPI-Bench. CryptoAPI-Bench consists of 181 unit test cases that cover basic cases, as well as complex cases, including interprocedural, field sensitive, multiple class test cases, and path sensitive data flow of misuse cases. The benchmark also includes correct cases for testing false-positive rates. The ApacheCryptoAPI-Bench consists of 121 cryptographic cases from 10 Apache projects. We evaluate four tools, namely, SpotBugs, CryptoGuard, CrySL, and Coverity using both benchmarks. We present their performance and comparative analysis. The ApacheCryptoAPI-Bench also examines the scalability of the tools. Our benchmarks are useful for advancing state-of-the-art solutions in the space of misuse detection.


title: Presentation Attack Detection Methods based on Gaze Tracking and Pupil Dynamic: A Comprehensive Survey

abstract: Purpose of the research: In the biometric community, visible human characteristics are popular and viable for verification and identification on mobile devices. However, imposters are able to spoof such characteristics by creating fake and artificial biometrics to fool the system. Visible biometric systems have suffered a high-security risk of presentation attack. Methods: In the meantime, challenge-based methods, in particular, gaze tracking and pupil dynamic appear to be more secure methods than others for contactless biometric systems. We review the existing work that explores gaze tracking and pupil dynamic liveness detection. The principal results: This research analyzes various aspects of gaze tracking and pupil dynamic presentation attacks, such as state-of-the-art liveness detection algorithms, various kinds of artifacts, the accessibility of public databases, and a summary of standardization in this area. In addition, we discuss future work and the open challenges to creating a secure liveness detection based on challenge-based systems.


title: A QoT Estimation Method using EGN-assisted Machine Learning for Network Planning Applications

abstract: An ML model based on precomputed per-channel SCI is proposed. Due to its superior accuracy over closed-form GN, an average SNR gain of 1.1 dB in an end-to-end link optimization and a 40% reduction in required lightpaths to meet traffic requests in a network planning scenario are shown.


title: Exact modifications on a vacuum spacetime due to a gradient bumblebee field at its vacuum expectation value

abstract: This work belongs to the context of the standard-model extension, in which a Lorentz symmetry violation is induced by a bumblebee field as it acquires a nonzero vacuum expectation value. The mathematical formulation of a generic bumblebee model and its associated dynamical equations are presented. Then, these equations are considered for the vacuum and a substantial simplification is performed for the particular case of a gradient bumblebee field at its vacuum expectation value. After some further manipulation, a method to easily find solutions to the model is developed, in which the exact effect on the spacetime description due to the presence of this bumblebee field is explicitly provided. As some examples, the method is applied to determine the implications of the bumblebee field on the Schwarzschild spacetime and also on a rotating one. A previously published solution is recovered and some new ones are obtained. In the rotating situation, a simple solution is found which contains both the Kerr solution and the already published one as special cases. It is also shown its distinguished surfaces are still given by the same corresponding expressions for the Kerr solution. In conclusion, the mathematical improvement made is considered to be a significant contribution to the theory as a powerful tool to investigate its many aspects and consequences.


title: A Transferable Approach for Partitioning Machine Learning Models on Multi-Chip-Modules

abstract: Multi-Chip-Modules (MCMs) reduce the design and fabrication cost of machine learning (ML) accelerators while delivering performance and energy efficiency on par with a monolithic large chip. However, ML compilers targeting MCMs need to solve complex optimization problems optimally and efficiently to achieve this high performance. One such problem is the multi-chip partitioning problem where compilers determine the optimal partitioning and placement of operations in tensor computation graphs on chiplets in MCMs. Partitioning ML graphs for MCMs is particularly hard as the search space grows exponentially with the number of chiplets available and the number of nodes in the neural network. Furthermore, the constraints imposed by the underlying hardware produce a search space where valid solutions are extremely sparse. In this paper, we present a strategy using a deep reinforcement learning (RL) framework to emit a possibly invalid candidate partition that is then corrected by a constraint solver. Using the constraint solver ensures that RL encounters valid solutions in the sparse space frequently enough to converge with fewer samples as compared to non-learned strategies. The architectural choices we make for the policy network allow us to generalize across different ML graphs. Our evaluation of a production-scale model, BERT, on real hardware reveals that the partitioning generated using RL policy achieves 6.11% and 5.85% higher throughput than random search and simulated annealing. In addition, fine-tuning the pre-trained RL policy reduces the search time from 3 hours to only 9 minutes, while achieving the same throughput as training RL policy from scratch.


title: Vision-Cloud Data Fusion for ADAS: A Lane Change Prediction Case Study

abstract: With the rapid development of intelligent vehicles and Advanced Driver-Assistance Systems (ADAS), a new trend is that mixed levels of human driver engagements will be involved in the transportation system. Therefore, necessary visual guidance for drivers is vitally important under this situation to prevent potential risks. To advance the development of visual guidance systems, we introduce a novel vision-cloud data fusion methodology, integrating camera image and Digital Twin information from the cloud to help intelligent vehicles make better decisions. Target vehicle bounding box is drawn and matched with the help of the object detector (running on the ego-vehicle) and position information (received from the cloud). The best matching result, a 79.2% accuracy under 0.7 intersection over union threshold, is obtained with depth images served as an additional feature source. A case study on lane change prediction is conducted to show the effectiveness of the proposed data fusion methodology. In the case study, a multi-layer perceptron algorithm is proposed with modified lane change prediction approaches. Human-in-the-loop simulation results obtained from the Unity game engine reveal that the proposed model can improve highway driving performance significantly in terms of safety, comfort, and environmental sustainability.


title: Theoretical model for the description of a single quantum dot using geometry

abstract: An alternative model to describe the electronic and thermal properties of quantum dot based on triangle geometry is proposed. The model predicts characteristics and limitations of the system by controlling the magnetic field and temperature, and the other parameters involved.


title: A Radio Polarisation Study of Magnetic Fields in the Small Magellanic Cloud

abstract: Observing the magnetic fields of low-mass interacting galaxies tells us how they have evolved over cosmic time and their importance in galaxy evolution. We have measured the Faraday rotation of 80 extra-galactic radio sources behind the Small Magellanic Cloud (SMC) using the CSIRO Australia Telescope Compact Array (ATCA) with a frequency range of 1.4 -- 3.0 GHz. Both the sensitivity of our observations and the source density are an order of magnitude improvement on previous Faraday rotation measurements of this galaxy. The SMC generally produces negative rotation measures (RMs) after accounting for the Milky Way foreground contribution, indicating that it has a mean coherent line-of-sight magnetic field strength of $-0.3\pm0.1\mu$G, consistent with previous findings. We detect signatures of magnetic fields extending from the north and south of the Bar of the SMC. The random component of the SMC magnetic field has a strength of $\sim 5\mu$G with a characteristic size-scale of magneto-ionic turbulence $< 250$ pc, making the SMC like other low-mass interacting galaxies. The magnetic fields of the SMC and Magellanic Bridge appear similar in direction and strength, hinting at a connection between the two fields as part of the hypothesised `pan-Magellanic' magnetic field.


title: Efficient labeling algorithms for adjacent quadratic shortest paths

abstract: In this article, we study the Adjacent Quadratic Shortest Path Problem (AQSPP), which consists in finding the shortest path on a directed graph when its total weight component also includes the impact of consecutive arcs. We provide a formal description of the AQSPP and propose an extension of Dijkstra's algorithm (that we denote aqD) for solving AQSPPs in polynomial-time and provide a proof for its correctness under some mild assumptions. Furthermore, we introduce an adjacent quadratic A* algorithm (that we denote aqA*) with a backward search for cost-to-go estimation to speed up the search. We assess the performance of both algorithms by comparing their relative performance with benchmark algorithms from the scientific literature and carry out a thorough collection of sensitivity analysis of the methods on a set of problem characteristics using randomly generated graphs. Numerical results suggest that: (i) aqA* outperforms all other algorithms, with a performance being about 75 times faster than aqD and the fastest alternative; (ii) the proposed solution procedures do not lose efficiency when the magnitude of quadratic costs vary; (iii) aqA* and aqD are fastest on random graph instances, compared with benchmark algorithms from scientific literature. We conclude the numerical experiments by presenting a stress test of the AQSPP in the context of real grid graph instances, with sizes up to $16 \times 10^6$ nodes, $64 \times 10^6$ arcs, and $10^9$ quadratic arcs.


title: Asymptotic MIMO Channel Model for Diffusive MC with Fully-absorbing Receivers

abstract: This letter introduces an analytical model that gives the asymptotic cumulative number of molecules absorbed by spherical receivers in a diffusive multiple-input multiple-output (MIMO) molecular communication (MC) system with pointwise transmitters. In the proposed model, the reciprocal effect among the fully absorbing (FA) receivers is described by using the concept of fictitious pointwise negative source of molecules, the best position of which for each spherical receiver being defined by its absorption barycenter. We show that there is an agreement between the proposed asymptotic model and the numerical solution of the exact analytical model from the literature that describes the interaction among the receivers, which is solved for a sufficient long time. We resort to numerical solution because for the exact model there is no analytical solution apart for the case of one transmitter and two receivers. We demonstrate that the barycenter tends to coincide with the center of the FA receivers in the temporal asymptotic case.


title: Rheology of 2D vertex model

abstract: The mechanical properties of tissues play an essential role for all tissue properties such as cell division, and differentiation or morphogenesis. Here, we study theoretically the rheology of 2-dimensional epithelial tissues described by a discrete vertex-like model, using an analytical coarsegrained continuum formulation. We show that epithelial tissues are most often shear-thinning under constant shear rate, and in certain circumstances cross over from shear thickening at low shear rates to shear thinning at high shear rates. We give an analytical expression of the tissue response in an oscillating strain experiment in the linear regime, and calculate it numerically in the non-linear regime. When the tissue is supported by an oscillating substrate, it reorients depending on frequency and substrate's Poisson's ratio. Reorientation could be gradual or abrupt, depending on tissue and substrate parameters, and the configuration phase space exhibits a tricritical point.


title: Factorizations in reciprocal Puiseux monoids

abstract: A Puiseux monoid is an additive submonoid of the real line consisting of rationals. We say that a Puiseux monoid is reciprocal if it can be generated by the reciprocals of the terms of a strictly increasing sequence of pairwise relatively primes positive integers. We say that a commutative and cancellative (additive) monoid is atomic if every non-invertible element $x$ can be written as a sum of irreducibles. The number of irreducibles in this sum is called a length of $x$. In this paper, we identify and investigate generalized classes of reciprocal Puiseux monoids that are atomic. Moreover, for the atomic monoids in the identified classes, we study the ascending chain condition on principal ideals and also the sets of lengths of their elements.


title: Prediction of orbital selective Mott phases and block magnetic states in the quasi-one-dimensional iron chain Ce$_2$O$_2$FeSe$_2$ under hole and electron doping

abstract: The recent detailed study of quasi-one-dimensional iron-based ladders, with the $3d$ iron electronic density $n = 6$, has unveiled surprises, such as orbital-selective phases. However, similar studies for $n=6$ iron chains are still rare. Here, a three-orbital electronic Hubbard model was constructed to study the magnetic and electronic properties of the quasi-one-dimensional $n=6$ iron chain Ce$_2$O$_2$FeSe$_2$, with focus on the effect of doping. Specifically, introducing the Hubbard $U$ and Hund $J_{H}$ couplings and studying the model via the density matrix renormalization group, we report the ground-state phase diagram varying the electronic density away from $n=6$. For the realistic Hund coupling $J_{H}/U = 1/4$, several electronic phases were obtained, including a metal, orbital-selective Mott, and Mott insulating phases. Doping away from the parent phase, the competition of many tendencies leads to a variety of magnetic states, such as ferromagnetism, as well as several antiferromagnetic and magnetic "block" phases. In the hole-doping region, two different interesting orbital-selective Mott phases were found: OSMP1 (with one localized orbital and two itinerant orbitals) and OSMP2 (with two localized orbitals and one itinerant orbital). Moreover, charge disproportionation phenomena were found in special doping regions. We argue that our predictions can be tested by simple modifications in the original chemical formula of Ce$_2$O$_2$FeSe$_2$.


title: Counterexamples for the fractal Schr\"odinger convergence problem with an intermediate space trick

abstract: We construct counterexamples for the fractal Schr\"odinger convergence problem by combining a fractal extension of Bourgain's counterexample and the intermediate space trick of Du--Kim--Wang--Zhang. We confirm that the same regularity as Du's counterexamples for weighted $L^2$ restriction estimates is achieved for the convergence problem. To do so, we need to construct the set of divergence explicitly and compute its Hausdorff dimension, for which we use the Mass Transference Principle, a technique originated from Diophantine approximation.


title: Covariant Star Product on Semi-Conformally Flat Noncommutative Calabi-Yau Manifolds and Noncommutative Topological Index Theorem

abstract: A differential geometric version of noncommutative topological index theorem is worked out for covariant star products on noncommutative vector bundles. For start, a noncommutative manifold is considered as a product space X = Y * Z, wherein Y is a closed manifold, and Z is a flat Calabi-Yau m-fold. Also a semi-conformally flat metric is considered for X which leads to a dynamical noncommutative spacetime from the viewpoint of noncommutative gravity. Based on the Kahler form of Z the noncommutative star product is defined covariantly on vector bundles over X. This covariant star product leads to the celebrated Groenewold-Moyal product for trivial vector bundles and their flat connections, such as C^\infty(X). Hereby, the noncommutative characteristic classes are defined properly and the noncommutative Chern-Weil theory is established by considering the covariant star product and the superconnection formalism. Finally, the index of the noncommutative version of elliptic operators is studied and the noncommutative topological index theorem is stated accordingly.


title: Ground state separability and criticality in interacting many-particle systems

abstract: We analyze exact ground state (GS) separability in general $N$ particle systems with two-site couplings. General necessary and sufficient conditions for full separability, in the form of one and two-site eigenvalue equations, are first derived. The formalism is then applied to a class of $SU(n)$-type interacting systems, where each constituent has access to $n$ local levels, and where the total number parity of each level is preserved. Explicit factorization conditions for parity-breaking GS's are obtained, which generalize those for $XYZ$ spin systems and correspond to a fundamental GS multilevel parity transition where the lowest $2^{n-1}$ energy levels cross. We also identify a multicritical factorization point with exceptional high degeneracy proportional to $N^{n-1}$, arising when the total occupation number of each level is preserved, in which any uniform product state is an exact GS. Critical entanglement properties (like full range pairwise entanglement) are shown to emerge in the immediate vicinity of factorization. Illustrative examples are provided.


title: Uniform foliations with Reeb components

abstract: A foliation on a compact manifold is uniform if each pair of leaves of the induced foliation on the universal cover are at finite Hausdorff distance from each other. We study uniform foliations with Reeb components. We give examples of such foliations on a family of closed $3-$manifolds with infinite fundamental group. Furthermore, we prove some results concerning the behavior of a uniform foliation with Reeb components on general $3-$manifolds.


title: GreenPCO: An Unsupervised Lightweight Point Cloud Odometry Method

abstract: Visual odometry aims to track the incremental motion of an object using the information captured by visual sensors. In this work, we study the point cloud odometry problem, where only the point cloud scans obtained by the LiDAR (Light Detection And Ranging) are used to estimate object's motion trajectory. A lightweight point cloud odometry solution is proposed and named the green point cloud odometry (GreenPCO) method. GreenPCO is an unsupervised learning method that predicts object motion by matching features of consecutive point cloud scans. It consists of three steps. First, a geometry-aware point sampling scheme is used to select discriminant points from the large point cloud. Second, the view is partitioned into four regions surrounding the object, and the PointHop++ method is used to extract point features. Third, point correspondences are established to estimate object motion between two consecutive scans. Experiments on the KITTI dataset are conducted to demonstrate the effectiveness of the GreenPCO method. It is observed that GreenPCO outperforms benchmarking deep learning methods in accuracy while it has a significantly smaller model size and less training time.


title: Manipulation of spin orientation via ferroelectric switching in Fe-doped Bi2WO6 from first principles

abstract: Atomic-scale control of spins by electric fields is highly desirable for future technological applications. Magnetically-doped Aurivillius-phase oxides present one route to achieve this, with magnetic ions substituted into the ferroelectric structure at dilute concentrations, resulting in spin-charge coupling. However, there has been minimal exploration of the ferroelectric switching pathways in this materials class, limiting predictions of the influence of an electric field on the magnetic spins in the structure. Here, we determine the ferroelectric switching pathways of the end member of the Aurivilius phase family, Bi2WO6, using a combination of group theoretic analysis and density functional theory calculations. We find that in the ground state P21ab phase, a two-step switching pathway via C2 and Cm intermediate phases provides the lowest energy barrier. Considering iron substitutions on the W-site in Bi2WO6, we determine the spin easy axis. By tracking the change in spin directionality during ferroelectric switching, we find that a 90 degree switch in the polarization direction leads to a 112 degree reorientation of the spin easy axis. The low symmetry crystal-field environment of Bi2WO6 and magnetoelastic coupling on the magnetic dopant provide a route to spin control via and applied electric field.


title: Symmetry and shape coexistence in 10Be

abstract: Within the low-lying spectrum of 10Be, multiple rotational bands are found, with strikingly different moments of inertia. A proposed interpretation has been that these bands variously represent triaxial rotation and prolate axially-deformed rotation. The bands are well-reproduced in ab initio no-core configuration interaction (NCCI) calculations. We use the calculated wave functions to elucidate the nuclear shapes underlying these bands, by examining the Elliott SU(3) symmetry content of these wave functions. The ab initio results support an interpretation in which the ground-state band, along with an accompanying K=2 side band, represent a triaxial rotor, arising from an SU(3) irreducible representation in the 0 hbar omega space. Then, the lowest excited K=0 band represents a prolate rotor, arising from an SU(3) irreducible representation in the 2 hbar omega space.


title: Peaceful coexistence of thermal equilibrium and the emergence of time

abstract: We consider a quantum Universe composed by a small system S and a large environment. It has been demonstrated that, for the vast majority of randomly chosen wave-functions of the Universe satisfying a total energy constraint, the reduced density matrix of the system S is given by the canonical statistical distribution. Here, through the Page and Wootters mechanism, we show that time and non-equilibrium dynamics can emerge as a consequence of the entanglement between the system and the environment present in the (randomly chosen) global wave-function of the Universe. The clock is provided by the environment, which ticks the temporal evolution of S. The paradox of the peaceful coexistence of statistical equilibrium and non-equilibrium dynamics is solved by identifying the trace over the environment degrees of freedom with the temporal trace over the entire history of the system S.


title: Exploring compact binary populations with the Einstein Telescope

abstract: The Einstein Telescope (ET), a wide-band, future third generation gravitational wave detector, is expected to have detection rates of $\sim 10^5 - 10^6$ binary black hole (BBH) detections and $\sim 7 \times 10^4$ binary neutron star (BNS) detections in one year. The coalescence of compact binaries with a total mass of 20 - 100 $M_{\odot}$, typical of BH-BH or BH-NS binaries, will be visible up to redshift $z\approx 20$ and even higher, thus facilitating the understanding of the dark era of the Universe preceding the birth of the first stars. The ET will therefore be a crucial instrument for population studies. We analysed the compact binaries originating in stars from (i) Population (Pop) I+II, (ii) Pop III, and (iii) globular clusters (GCs), with the single ET instrument, using the ET-D design sensitivity for the analysis. We estimated the constraints on the chirp mass, redshift, and merger rate as function of redshift for these classes of compact object binaries. We conclude that the ET as a single instrument is capable of detecting and distinguishing different compact binary populations separated in chirp mass - redshift space. While compact binaries originating in stars from Pop III are clearly distinguishable, owing to the separation in chirp mass - redshift space, the other two populations, Pop I+II, and GCs, can be distinguished with just 500 detections, corresponding to an observation time of $\sim 1$ hr. The mass distribution characteristics of such different compact binary populations can also be estimated with the single ET instrument.


title: Parity-mixed coupled-cluster formalism for computing parity-violating amplitudes

abstract: We formulate a parity-mixed coupled-cluster (PM-CC) approach for high-precision calculations of parity non-conserving amplitudes in mono-valent atoms. Compared to the conventional formalism which uses parity-proper (PP) one-electron orbitals, the PM-CC method is built using parity-mixed (PM) orbitals. The PM orbitals are obtained by solving the Dirac-Hartree-Fock equation with the electron-nucleus electroweak interaction included (PM-DHF). There are several advantages to such a PM-CC formulation: (i) reduced role of correlations, as for the most experimentally-accurate to date ${}^{133}{\rm Cs}\,$ $6S_{1/2}-7S_{1/2}$ transition, the PM-DHF result is only 3% away from the accurate many-body value, while the conventional DHF result is off by 18%; (ii) avoidance of directly summing over intermediate states in expressions for parity non-conserving amplitudes which reduces theoretical uncertainties associated with highly-excited and core-excited intermediate states, and (iii) relatively straightforward upgrade of existing and well-tested large-scale PP-CC codes. We reformulate the CC method in terms of the PM-DHF basis and demonstrate that the cluster amplitudes are complex numbers with opposite parity real and imaginary parts. We then use this fact to map out a strategy through which the new PM-CC scheme may be implemented.


title: Unusual Dynamical Properties of Disordered Polaritons in Micocavities

abstract: The strong light-matter interaction in microcavities gives rise to intriguing phenomena, such as cavity-mediated transport that can potentially overcome the Anderson localization. Yet, an accurate theoretical treatment is challenging as the matter (e.g.,molecules) are subject to large energetic disorder. In this article, we develop the Green's function solution to the Fano-Anderson model and use the exact analytical solution to quantify the effects of energetic disorder on the spectral and transport properties in microcavities. Starting from microscopic equation of motions, we derive an effective non-Hermitian Hamiltonian and predict a set of scaling laws: (i) The complex eigen-energies of the effective Hamiltonian exhibit an exceptional point, which leads to underdamped coherent dynamics in the weak disorder regime, where the decay rate increases with disorder, and overdamped incoherent dynamics in the strong disorder regime, where the slow decay rate decreases with disorder. (ii) The total density of states of disordered ensembles can be exactly partitioned into the cavity, bright-state and dark-state local density of states, which are determined by the complex eigen solutions and can be measured via spectroscopy. (iii) The cavity-mediated relaxation and transport dynamics are intimately related such that the energy-resolved relaxation and transport rates are proportional to the cavity local density of states. The ratio of the disorder averaged relaxation and transport rates equals the molecule number, which can be interpreted as a result of a quantum random walk. (iv) A turnover in the rates as a function of disorder or molecule density can be explained in terms of the overlap of the disorder distribution function and the cavity local density of states. These findings reveal the significant impact of the dark states on the transport properties of disordered ensembles in cavities.


title: Simultaneous sampling of multiple transition channels using adaptive paths of collective variables

abstract: We present a molecular simulation method to simultaneously find multiple transition pathways, and their associated free-energy profiles. The scheme extends path-metadynamics (PMD) [Phys. Rev. Lett. 109, 020601 (2012)] with multiple paths and repulsive walkers (multiPMD). We illustrate multiPMD for two C7eq-to-C7ax paths in Ace-Ala-Nme and six PPII-to-PPII paths in Ace-(Pro)4-Nme. We also show a scheme to render an interpretable "PathMap", showing the free energy ridges between paths, as well as the branching and merging of the transition channels. MultiPMD is a flexible and promising method for systems with competing or controversial pathways, which appear in many biomolecular systems, including proteins and nucleic acids.


title: Data-driven forward-inverse problems for Yajima-Oikawa system using deep learning with parameter regularization

abstract: We investigate data-driven forward-inverse problems for Yajima-Oikawa (YO) system by employing two technologies which improve the performance of neural network in deep physics-informed neural network (PINN), namely neuron-wise locally adaptive activation functions and $L^2$ norm parameter regularization. Indeed, we not only recover three different forms of vector rogue waves (RWs) by means of three distinct initial-boundary value conditions in the forward problem of YO system, including bright-bright RWs, intermediate-bright RWs and dark-bright RWs, but also study the inverse problem of YO system by using training data with different noise intensity. In order to deal with the problem that the capacity of learning unknown parameters is not ideal when the PINN with only locally adaptive activation functions utilizes training data with noise interference in the inverse problem of YO system, thus we introduce $L^2$ norm regularization, which can drive the weights closer to origin, into PINN with locally adaptive activation functions, then find that the PINN model with two strategies shows amazing training effect by using training data with noise interference to investigate the inverse problem of YO system.


title: Semantic OcTree Mapping and Shannon Mutual Information Computation for Robot Exploration

abstract: Autonomous robot operation in unstructured and unknown environments requires efficient techniques for mapping and exploration using streaming range and visual observations. Information-based exploration techniques, such as Cauchy-Schwarz quadratic mutual information (CSQMI) and fast Shannon mutual information (FSMI), have successfully achieved active binary occupancy mapping with range measurements. However, as we envision robots performing complex tasks specified with semantically meaningful concepts, it is necessary to capture semantics in the measurements, map representation, and exploration objective. This work presents Semantic octree mapping and Shannon Mutual Information (SSMI) computation for robot exploration. We develop a Bayesian multi-class mapping algorithm based on an octree data structure, where each voxel maintains a categorical distribution over semantic classes. We derive a closed-form efficiently-computable lower bound of the Shannon mutual information between a multi-class octomap and a set of range-category measurements using semantic run-length encoding of the sensor rays. The bound allows rapid evaluation of many potential robot trajectories for autonomous exploration and mapping. We compare our method against state-of-the-art exploration techniques and apply it in a variety of simulated and real-world experiments.


title: Asteroseismology of $\beta$ Cephei stars: The stellar inferences tested in hare and hound exercises

abstract: The $\beta$ Cephei pulsators are massive main-sequence stars, presenting low radial-order modes. These modes probe in particular the chemical gradient at the edge of the convective core. They hence give constraints on macroscopic processes, such as hydrodynamic or magnetic instabilities. Yet, it is not clear to what extent the seismic inferences depend on the physics employed for the stellar modelling or on the observational dataset. We investigate the observational constraints which are necessary to provide accurate constraints on the mixing processes in $\beta$ Cephei stars. We explore the importance of the identification of the angular degree of modes. Depending on the quality of the seismic dataset and the classical constraints, we estimate the precision achievable with asteroseismology. We propose a method extending the forward approach classically used to model $\beta$ Cephei stars The probability distributions of the asteroseismic-derived stellar parameters are obtained. With these distributions, we provide a systemic way to estimate the errors of the modelling. A particular effort is made to also include the theoretical uncertainties of the models. We then estimate the accuracy and precision of asteroseismology for $\beta$ Cephei stars in a series of hare and hound exercises. The exercises show that a set of four to five oscillation frequencies with an identified angular degree already leads to accurate inferences on the stellar parameters. Without the identification of the modes, the addition of other classical observational constraints allow to succeed the seismic modelling. When the micro-physics of the star and stellar models used for the modelling differ, the constraints derived on the internal structure remain valid if expressed in terms of acoustic variables. The characterisation of the mixing processes at the boundary of the convective core remain model-dependent.


title: Critical gravitational collapse of a non-minimally coupled scalar field

abstract: We study the critical gravitational collapse of a massless scalar field non-minimally coupled to gravity, using a quadratic coupling function with a strength parameter $\xi$. We concentrate on critical phenomena of type II, and determine with an accuracy of at least $10^{-12}$ the value of the critical amplitude for collapse to a black hole, as well as the values of the critical and echoing exponents. Obtaining such high accuracy in the critical amplitude requires us to do a coordinate radial transformation that effectively increases resolution near the central regions by a factor of at least $10^3$. As expected, we find that for the case of small coupling the critical behaviour is very similar to that of a minimally coupled scalar field. On the other hand, for high coupling the dynamics become so violent that we need to introduce a special slicing condition, known as the shock-avoiding slicing condition, in order to avoid gauge pathologies that would otherwise cause our simulations to fail. With this new gauge condition we are able to perform high accuracy simulations even in the strong coupling regime, where we find that the critical and echoing exponents become significantly smaller, and that the echoing behavior is richer and can not be modelled by a single harmonic.


title: Light Nuclei Collectivity from $\sqrt{s_{\rm NN}}$ = 3 GeV Au+Au Collisions at RHIC

abstract: In high-energy heavy-ion collisions, partonic collectivity is evidenced by the constituent quark number scaling of elliptic flow anisotropy for identified hadrons. A breaking of this scaling and dominance of baryonic interactions is found for identified hadron collective flow measurements in $\sqrt{s_{\rm NN}}$ = 3 GeV Au+Au collisions. In this paper, we report measurements of the first- and second-order azimuthal anisotropic parameters, $v_1$ and $v_2$, of light nuclei ($d$, $t$, $^{3}$He, $^{4}$He) produced in $\sqrt{s_{\rm NN}}$ = 3 GeV Au+Au collisions at the STAR experiment. An atomic mass number scaling is found in the measured $v_1$ slopes of light nuclei at mid-rapidity. For the measured $v_2$ magnitude, a strong rapidity dependence is observed. Unlike $v_2$ at higher collision energies, the $v_2$ values at mid-rapidity for all light nuclei are negative and no scaling is observed with the atomic mass number. Calculations by the Jet AA Microscopic Transport Model (JAM), with baryonic mean-field plus nucleon coalescence, are in good agreement with our observations, implying baryonic interactions dominate the collective dynamics in 3 GeV Au+Au collisions at RHIC.


title: Understanding probability and irreversibility in the Mori-Zwanzig projection operator formalism

abstract: Explaining the emergence of stochastic irreversible macroscopic dynamics from time-reversible deterministic microscopic dynamics is one of the key problems in philosophy of physics. The Mori-Zwanzig projection operator formalism, which is one of the most important methods of modern nonequilibrium statistical mechanics, allows for a systematic derivation of irreversible transport equations from reversible microdynamics and thus provides a useful framework for understanding this issue. However, discussions of the Mori-Zwanzig formalism in philosophy of physics tend to focus on simple variants rather than on the more sophisticated ones used in modern physical research. In this work, I will close this gap by studying the problems of probability and irreversibility using the example of Grabert's time-dependent projection operator formalism. This allows to give a more solid mathematical foundation to various concepts from the philosophical literature, in particular Wallace's simple dynamical conjecture and Robertson's theory of autonomous macrodynamics. Moreover, I will explain how the Mori-Zwanzig formalism allows to resolve the tension between epistemic and ontic approaches to probability in statistical mechanics. Finally, I argue that the debate which interventionists and coarse-grainers should really be having is related not to the question why there is equilibration at all, but why it has the quantitative form it is found to have in experiments.


title: Nanogrid Power Management Based on Fuzzy Logic Controller

abstract: The transport industry is undergoing unprecedented technological change. In the automotive sector, the voices of progress are, among other things, linked to the partial or total electrification of vehicles. Thanks to bi-directional charging technology, electric vehicles (EV) could significantly improve their homeowners' energy balance. For islanded household buildings where a supplementary turbine generator and photovoltaic (PV) generator are the main supplies, it is crucial to minimize the running costs and maximize the use of the PV power. In this paper, a supervisory controller based on fuzzy logic is proposed to utilize the battery in the EV, while parking, as an interactive element to replace the auxiliary turbine and to assure that the battery power and energy do not exceed their design limits and maintaining a stable power flow. The nanogrid considered in this paper consists of a PV, EV battery, load and a turbine supplementary unit. The fuzzy logic controller alters the AC bus frequency, which is used by the local controllers of the parallel units to curtail the power generated by the PV or to supplement the power from the turbine unit. The proposed FLC performance is verified by Matlab simulation.


title: The Z-eigenpairs of orthogonally diagonalizable symmetric tensors

abstract: In this paper, we focus on a special class of symmetric tensors, which can be orthogonally diagonalizable, and investigate their Z-eigenpairs problem. We show that the eigenpairs can be uniformly expressed using several basic eigenpairs, and the number of all the eigenpairs is uniquely determined by the order and rank of the symmetric tensor. In addition, we exploit the local optimality of each eigenpair by checking the second-order necessary condition.


title: CoMP Enhanced Subcarrier and Power Allocation for Multi-Numerology based 5G-NR Networks

abstract: With proliferation of fifth generation (5G) new radio (NR) technology, it is expected to meet the requirement of diverse traffic demands. We have designed a coordinated multi-point (CoMP) enhanced flexible multi-numerology (MN) for 5G-NR networks to improve the network performance in terms of throughput and latency. We have proposed a CoMP enhanced joint subcarrier and power allocation (CESP) scheme which aims at maximizing sum rate under the considerations of transmit power limitation and guaranteed quality-of-service (QoS) including throughput and latency restrictions. By employing difference of two concave functions (D.C.) approximation and abstract Lagrangian duality method, we theoretically transform the original non-convex nonlinear problem into a solvable maximization problem. Moreover, the convergence of our proposed CESP algorithm with D.C. approximation is analytically derived with proofs, and is further validated via numerical results. Simulation results demonstrated that our proposed CESP algorithm outperforms the conventional non-CoMP and single numerology mechanisms along with other existing benchmarks in terms of lower latency and higher throughput under the scenarios of uniform and edge users.


title: Learning to Localize, Grasp, and Hand Over Unmodified Surgical Needles

abstract: Robotic Surgical Assistants (RSAs) are commonly used to perform minimally invasive surgeries by expert surgeons. However, long procedures filled with tedious and repetitive tasks such as suturing can lead to surgeon fatigue, motivating the automation of suturing. As visual tracking of a thin reflective needle is extremely challenging, prior work has modified the needle with nonreflective contrasting paint. As a step towards automation of a suturing subtask without modifying the needle, we propose HOUSTON: Handoff of Unmodified, Surgical, Tool-Obstructed Needles, a problem and algorithm that uses a learned active sensing policy with a stereo camera to localize and align the needle into a visible and accessible pose for the other arm. To compensate for robot positioning and needle perception errors, the algorithm then executes a high-precision grasping motion that uses multiple cameras. In physical experiments using the da Vinci Research Kit (dVRK), HOUSTON successfully passes unmodified surgical needles with a success rate of 96.7% and is able to perform handover sequentially between the arms 32.4 times on average before failure. On needles unseen in training, HOUSTON achieves a success rate of 75 - 92.9%. To our knowledge, this work is the first to study handover of unmodified surgical needles. See https://tinyurl.com/houston-surgery for additional materials.


title: Co-Hopfian virtually free groups and elementary equivalence

abstract: We prove that two co-Hopfian finitely generated virtually free groups are elementarily equivalent if and only if they are isomorphic. We also prove that co-Hopfian finitely generated virtually free groups are homogeneous in the sense of model theory.


title: Skyrmion Dynamics in the Presence of Deformation

abstract: Magnetic skyrmions are topological spin textures promising for future high-density and nonvolatile memory. It is crucial to understand the current-driven skyrmion dynamics in the presence of deformation, of which an analytical model, however, remains elusive. Here we extend Thiele's model by considering both the radial and tangential forces. Our model attributes the skyrmion deformation to the current-induced rotational symmetry breaking, which includes magnetization canting and domain wall width variation. Our predictions of skyrmion radius and nonlinear dynamics are consistent with micromagnetic simulation results. Besides, we show that by applying an in-plane magnetic field, the deformation of a skyrmion can be suppressed, and even the compression of a skyrmion can be achieved. Our model provides a generic way to analyze the skyrmion deformation and may inspire applications based on nonlinear skyrmion dynamics.


title: Existence and convergence of the Beris-Edwards system with general Landau-de Gennes energy

abstract: In this paper, we investigate the Beris-Edwards system for both biaxial and uniaxial $Q$-tensors with a general Landau-de Gennes energy density depending on four non-zero elastic constants. We prove existence of the strong solution of the Beris-Edwards system for uniaxial $Q$-tensors up to a maximal time. Furthermore, we prove that the strong solutions of the Beris-Edwards system for biaxial $Q$-tensors converge smoothly to the solution of the Beris-Edwards system for uniaxial $Q$-tensors up to its maximal existence time.


title: Active Sensing for Communications by Learning

abstract: This paper proposes a deep learning approach to a class of active sensing problems in wireless communications in which an agent sequentially interacts with an environment over a predetermined number of time frames to gather information in order to perform a sensing or actuation task for maximizing some utility function. In such an active learning setting, the agent needs to design an adaptive sensing strategy sequentially based on the observations made so far. To tackle such a challenging problem in which the dimension of historical observations increases over time, we propose to use a long short-term memory (LSTM) network to exploit the temporal correlations in the sequence of observations and to map each observation to a fixed-size state information vector. We then use a deep neural network (DNN) to map the LSTM state at each time frame to the design of the next measurement step. Finally, we employ another DNN to map the final LSTM state to the desired solution. We investigate the performance of the proposed framework for adaptive channel sensing problems in wireless communications. In particular, we consider the adaptive beamforming problem for mmWave beam alignment and the adaptive reconfigurable intelligent surface sensing problem for reflection alignment. Numerical results demonstrate that the proposed deep active sensing strategy outperforms the existing adaptive or nonadaptive sensing schemes.


title: Experimental Characterization of Fault-Tolerant Circuits in Small-Scale Quantum Processors

abstract: Experiments conducted on open-access cloud-based IBM Quantum devices are presented for characterizing their fault tolerance using $[4,2,2]$-encoded gate sequences. Up to 100 logical gates are activated in the IBMQ Bogota and IBMQ Santiago devices and we found that a $[4,2,2]$ code's logical gate set may be deemed fault-tolerant for gate sequences larger than 10 gates. However, certain circuits did not satisfy the fault tolerance criterion. In some cases, the encoded-gate sequences show a high error rate that is lower bounded at $\approx 0.1$, whereby the error inherent in these circuits cannot be mitigated by classical post-selection. A comparison of the experimental results to a simple error model reveals that the dominant gate errors cannot be readily represented by the popular Pauli error model. Finally, it is most accurate to assess the fault tolerance criterion when the circuits tested are restricted to those that give rise to an output state with a low dimension.


title: Interface engineering of ferroelectricity in thin films of thiophosphate ABP 2 X 6 (A = Cu, Ag; B = In, Bi, Cr, V; and X = S, Se)

abstract: Two-dimensional ferroelectrics (FEs) are promising in the miniaturization of memory devices with ultra-high-density data storage and low power consumption. However, many thiophosphate monolayers, i.e., analogs of CuInP$_2$S$_6$ and referred to as ABP$_2$X$_6$, lose ferroelectricity and instead exhibit an antiferroelectric (AFE) or paraelectric ordering. We propose to tune the AFE ABP$_2$X$_6$ monolayers into the FE ordering through interface engineering. The mechanism is that there are couplings between the charge polarizations of the ABP$_2$X$_6$ monolayers and the local dipoles as well as the induced electronic polarizations in the substrate which have a tendency to stabilize the FE ordering. We further perform first-principles calculations for CuInP$_2$Se$_6$ and CuCrP$_2$S$_6$ monolayers and their van der Waals heterostructures. We find that an AFE CuInP$_2$Se$_6$ monolayer becomes FE as interfaced with graphene, MoS$_2$, and h-BN monolayers. In contrast, the CuCrP$_2$S$_6$ monolayer remains AFE since there is a large energy difference between the AFE and FE phases. Interfacing it with a MoTe$_2$ monolayer induces a metal-insulator transition for the heterostructure, whereas interfacing with a polar surface MgO(111) can drive it into FE. The interfacing effect can also be used to manipulate the FE properties of ABP$_2$X$_6$ multilayers. We further find that the AFE-to-FE transition is electrically switchable in these systems. In particular, it is accompanied by an indirect-direct band-gap transition for the CuInP$_2$Se$_6$ monolayer. Our study offers an effective approach to tune the FE and electronic properties of ABP$_2$X$_6$ thin films for applications in electronics and optoelectronics.


title: Renormalization of dispersion in electron-doped bilayer cuprate superconductors

abstract: The renormalization of the electrons in cuprate superconductors is characterized by the kink in the quasiparticle dispersion. Here the bilayer coupling effect on the quasiparticle dispersion kink in the electron-doped bilayer cuprate superconductors is studied based on the kinetic-energy-driven superconductivity. It is shown that the kink in the quasiparticle dispersion is present all around the electron Fermi surface, as the quasiparticle dispersion kink in the single-layer case. However, in comparison with the corresponding single-layer case, the kink effect in the quasiparticle dispersion at around the antinodal region becomes the most pronounced, indicating that the kink effect in the quasiparticle dispersion at around the antinodal region is enhanced by the bilayer coupling.


title: CoMP-Enhanced Flexible Functional Split for Mixed Services in Beyond 5G Wireless Networks

abstract: With explosively escalating service demands, beyond fifth generation (B5G) aims to realize various requirements for multi-service networks, i.e., higher performance of mixed enhanced mobile broadband (eMBB) and ultra-reliable low-latency communication (URLLC) services than 5G. To flexibly serve diverse traffic, various functional split options (FSOs) are specified by 5G protocols enabling different network functions. In order to improve signal qualities for edge users, we consider FSO-based coordinated multi-point (CoMP) transmission as a prominent technique capable of supporting high traffic demands. However, due to conventional confined hardware processing capability, a processor sharing (PS) model is introduced to deal with high latency for multi-service FSO-based networks. Therefore, it becomes essential to assign CoMP-enhanced functional split modes under PS model. A more tractable FSO-based network in terms of ergodic rate and reliability is derived by stochastic geometry approach. Moreover, we have proposed CoMP-enhanced functional split mode allocation (CFSMA) scheme to adaptively assign FSOs to provide enhanced mixed throughput and latency-aware services. The simulation results have validated analytical derivation and demonstrated that the proposed CFSMA scheme optimizes system spectrum efficiency while guaranteeing stringent latency requirement. The proposed CFSMA scheme with the designed PS FFS-CoMP system outperforms the benchmarks of conventional FCFS scheduling, non-FSO network, fixed FSOs, and limited available FSO selections in open literature.


title: Broadening the convergence domain of Seventh-order method satisfying Lipschitz and H\"{o}lder conditions

abstract: In this paper, the local convergence analysis of the multi-step seventh order method is presented for solving nonlinear equations assuming that the first-order Fr\'echet derivative belongs to the Lipschitz class. The significance of our work is that it avoids the standard practice of Taylor expansion thereby, extends the applicability of the scheme by applying the technique based on the first-order derivative only. Also, this study provides radii of balls of convergence, the error bounds in terms of distances in addition to the uniqueness of the solution. Furthermore, generalization of this analysis satisfying H\"{o}lder continuity condition is provided since it is more relaxed than Lipschitz continuity condition. We have considered some numerical examples and computed the radii of the convergence balls.


title: Automated optimization of convergence parameters in plane wave density functional theory calculations via a tensor decomposition-based uncertainty quantification

abstract: First principles approaches have revolutionized our ability in using computers to predict, explore and design materials. A major advantage commonly associated with these approaches is that they are fully parameter free. However, numerically solving the underlying equations requires to choose a set of convergence parameters. With the advent of high-throughput calculations it becomes exceedingly important to achieve a truly parameter free approach. Utilizing uncertainty quantification (UQ) and tensor decomposition we derive a numerically highly efficient representation of the statistical and systematic error in the multidimensional space of the convergence parameters. Based on this formalism we implement a fully automated approach that requires as input the target accuracy rather than convergence parameters. The performance and robustness of the approach are shown by applying it to a large set of elements crystallizing in a cubic fcc lattice.


title: String Cosmology and the Breakdown of Local Effective Field Theory

abstract: Most current cosmological models of the very early universe are based on local point particle effective field theories coupled to gravity. I will discuss some conceptual limitations of this approach and argue that an improved description of the early universe needs to go beyond this framework. I will outline a couple of ideas based on superstring theory.


title: Best Arm Identification under Additive Transfer Bandits

abstract: We consider a variant of the best arm identification (BAI) problem in multi-armed bandits (MAB) in which there are two sets of arms (source and target), and the objective is to determine the best target arm while only pulling source arms. In this paper, we study the setting when, despite the means being unknown, there is a known additive relationship between the source and target MAB instances. We show how our framework covers a range of previously studied pure exploration problems and additionally captures new problems. We propose and theoretically analyze an LUCB-style algorithm to identify an $\epsilon$-optimal target arm with high probability. Our theoretical analysis highlights aspects of this transfer learning problem that do not arise in the typical BAI setup, and yet recover the LUCB algorithm for single domain BAI as a special case.


title: Hyper-parameter optimization based on soft actor critic and hierarchical mixture regularization

abstract: Hyper-parameter optimization is a crucial problem in machine learning as it aims to achieve the state-of-the-art performance in any model. Great efforts have been made in this field, such as random search, grid search, Bayesian optimization. In this paper, we model hyper-parameter optimization process as a Markov decision process, and tackle it with reinforcement learning. A novel hyper-parameter optimization method based on soft actor critic and hierarchical mixture regularization has been proposed. Experiments show that the proposed method can obtain better hyper-parameters in a shorter time.


title: Diffeomorphically Learning Stable Koopman Operators

abstract: System representations inspired by the infinite-dimensional Koopman operator (generator) are increasingly considered for predictive modeling. Due to the operator's linearity, a range of nonlinear systems admit linear predictor representations - allowing for simplified prediction, analysis and control. However, finding meaningful finite-dimensional representations for prediction is difficult as it involves determining features that are both Koopman-invariant (evolve linearly under the dynamics) as well as relevant (spanning the original state) - a generally unsupervised problem. In this work, we present Koopmanizing Flows - a novel continuous-time framework for supervised learning of linear predictors for a class of nonlinear dynamics. In our model construction a latent diffeomorphically related linear system unfolds into a linear predictor through the composition with a monomial basis. The lifting, its linear dynamics and state reconstruction are learned simultaneously, while an unconstrained parameterization of Hurwitz matrices ensures asymptotic stability regardless of the operator approximation accuracy. The superior efficacy of Koopmanizing Flows is demonstrated in comparison to a state-of-the-art method on the well-known LASA handwriting benchmark.


title: Supplementary Feedforward Voltage Control in a Reconfigurable Distribution Network

abstract: Network reconfiguration (NR) has attracted much attention due to its ability to convert conventional distribution networks (DNs) into self-healing grids. This paper proposes a new strategy for real-time voltage regulation (VR) in a reconfigurable DN, whereby optimal feedforward control of synchronous and inverter-based distributed generators (DGs) is achieved in coordination with the operation of feeder line switches (SWs). This enables preemptive compensation of upcoming deviations in DN voltages caused by NR-aided load restoration. A robust optimization problem is formulated using a dynamic analytical model of NR to design the feedforward voltage controllers (FVCs) that minimize voltage deviations with respect to the H infinity norm. Errors in the estimates of DG parameters and load demands are reflected in the design of optimal FVCs through polytopic uncertainty modeling, further improving the robustness of the proposed VR strategy. Small-signal analysis and case studies are conducted, demonstrating the effectiveness of the optimal robust FVCs in improving real-time VR when NR is activated for load restoration. The performances of the proposed FVCs are also verified under various operating conditions of a reconfigurable DN, characterized principally by SW operations, network parameter errors, and communication time delays.


title: Improving Knowledge Graph Representation Learning by Structure Contextual Pre-training

abstract: Representation learning models for Knowledge Graphs (KG) have proven to be effective in encoding structural information and performing reasoning over KGs. In this paper, we propose a novel pre-training-then-fine-tuning framework for knowledge graph representation learning, in which a KG model is firstly pre-trained with triple classification task, followed by discriminative fine-tuning on specific downstream tasks such as entity type prediction and entity alignment. Drawing on the general ideas of learning deep contextualized word representations in typical pre-trained language models, we propose SCoP to learn pre-trained KG representations with structural and contextual triples of the target triple encoded. Experimental results demonstrate that fine-tuning SCoP not only outperforms results of baselines on a portfolio of downstream tasks but also avoids tedious task-specific model design and parameter training.