title: RGB-D Salient Object Detection via 3D Convolutional Neural Networks

abstract: RGB-D salient object detection (SOD) recently has attracted increasing research interest and many deep learning methods based on encoder-decoder architectures have emerged. However, most existing RGB-D SOD models conduct feature fusion either in the single encoder or the decoder stage, which hardly guarantees sufficient cross-modal fusion ability. In this paper, we make the first attempt in addressing RGB-D SOD through 3D convolutional neural networks. The proposed model, named RD3D, aims at pre-fusion in the encoder stage and in-depth fusion in the decoder stage to effectively promote the full integration of RGB and depth streams. Specifically, RD3D first conducts pre-fusion across RGB and depth modalities through an inflated 3D encoder, and later provides in-depth feature fusion by designing a 3D decoder equipped with rich back-projection paths (RBPP) for leveraging the extensive aggregation ability of 3D convolutions. With such a progressive fusion strategy involving both the encoder and decoder, effective and thorough interaction between the two modalities can be exploited and boost the detection accuracy. Extensive experiments on six widely used benchmark datasets demonstrate that RD3D performs favorably against 14 state-of-the-art RGB-D SOD approaches in terms of four key evaluation metrics. Our code will be made publicly available: https://github.com/PPOLYpubki/RD3D.


title: Between Synchrony and Turbulence: Intricate Hierarchies of Coexistence Patterns

abstract: Coupled oscillators, even identical ones, display a wide range of behaviours, among them synchrony and incoherence. The 2002 discovery of so-called chimera states, states of coexisting synchronized and unsynchronized oscillators, provided a possible link between the two and definitely showed that different parts of the same ensemble can sustain qualitatively different forms of motion. Here, we demonstrate that globally coupled identical oscillators can express a range of coexistence patterns more comprehensive than chimeras. A hierarchy of such states evolves from the fully synchronized solution in a series of cluster-splittings. At the far end of this hierarchy, the states further collide with their own mirror-images in phase space -- rendering the motion chaotic, destroying some of the clusters and thereby producing even more intricate coexistence patterns. A sequence of such attractor collisions can ultimately lead to full incoherence of only single asynchronous oscillators. Chimera states, with one large synchronized cluster and else only single oscillators, are found to be just one step in this transition from low- to high-dimensional dynamics.


title: Periodic Index Theory and Equivariant Torus Signature

abstract: We deduce an index jump formula for first order elliptic complexes over end-periodic manifolds, which generalizes the corresponding result for the DeRham complex. In the case of the anti-self-dual DeRham complex, we define the periodic rho invariant for a class of $4$-manifolds, and identify it with the periodic spectral flow of this complex. As an application, we prove the equivalence (under a mild homological assumption) of two signatures invariants defined by means of Yang-Mills theory and geometric topology respectively for essentially embedded tori in homology $S^1 \times S^3$. We also prove a surgery formula for the singular Furuta-Ohta invariant, which corresponds to a potential exact triangle of singular instanton homology for knots.


title: Process-Level Representation of Scientific Protocols with Interactive Annotation

abstract: We develop Process Execution Graphs (PEG), a document-level representation of real-world wet lab biochemistry protocols, addressing challenges such as cross-sentence relations, long-range coreference, grounding, and implicit arguments. We manually annotate PEGs in a corpus of complex lab protocols with a novel interactive textual simulator that keeps track of entity traits and semantic constraints during annotation. We use this data to develop graph-prediction models, finding them to be good at entity identification and local relation extraction, while our corpus facilitates further exploration of challenging long-range relations.


title: AirWare: Utilizing Embedded Audio and Infrared Signals for In-Air Hand-Gesture Recognition

abstract: We introduce AirWare, an in-air hand-gesture recognition system that uses the already embedded speaker and microphone in most electronic devices, together with embedded infrared proximity sensors. Gestures identified by AirWare are performed in the air above a touchscreen or a mobile phone. AirWare utilizes convolutional neural networks to classify a large vocabulary of hand gestures using multi-modal audio Doppler signatures and infrared (IR) sensor information. As opposed to other systems which use high frequency Doppler radars or depth cameras to uniquely identify in-air gestures, AirWare does not require any external sensors. In our analysis, we use openly available APIs to interface with the Samsung Galaxy S5 audio and proximity sensors for data collection. We find that AirWare is not reliable enough for a deployable interaction system when trying to classify a gesture set of 21 gestures, with an average true positive rate of only 50.5% per gesture. To improve performance, we train AirWare to identify subsets of the 21 gestures vocabulary based on possible usage scenarios. We find that AirWare can identify three gesture sets with average true positive rate greater than 80% using 4--7 gestures per set, which comprises a vocabulary of 16 unique in-air gestures.


title: Decay amplitudes to three hadrons from finite-volume matrix elements

abstract: We derive relations between finite-volume matrix elements and infinite-volume decay amplitudes, for processes with three spinless, degenerate and either identical or non-identical particles in the final state. This generalizes the Lellouch-L\"uscher relation for two-particle decays and provides a strategy for extracting three-hadron decay amplitudes using lattice QCD. Unlike for two particles, even in the simplest approximation, one must solve integral equations to obtain the physical decay amplitude, a consequence of the nontrivial finite-state interactions. We first derive the result in a simplified theory with three identical particles, and then present the generalizations needed to study phenomenologically relevant three-pion decays. The specific processes we discuss are the CP-violating $K \to 3\pi$ weak decay, the isospin-breaking $\eta \to 3\pi$ QCD transition, and the electromagnetic $\gamma^*\to 3\pi$ amplitudes that enter the calculation of the hadronic vacuum polarization contribution to muonic $g-2$.


title: Incorporating Expert Guidance in Epidemic Forecasting

abstract: Forecasting influenza like illnesses (ILI) has rapidly progressed in recent years from an art to a science with a plethora of data-driven methods. While these methods have achieved qualified success, their applicability is limited due to their inability to incorporate expert feedback and guidance systematically into the forecasting framework. We propose a new approach leveraging the Seldonian optimization framework from AI safety and demonstrate how it can be adapted to epidemic forecasting. We study two types of guidance: smoothness and regional consistency of errors, where we show that by its successful incorporation, we are able to not only bound the probability of undesirable behavior to happen, but also to reduce RMSE on test data by up to 17%.


title: D-Net: Siamese based Network with Mutual Attention for Volume Alignment

abstract: Alignment of contrast and non-contrast-enhanced imaging is essential for the quantification of changes in several biomedical applications. In particular, the extraction of cartilage shape from contrast-enhanced Computed Tomography (CT) of tibiae requires accurate alignment of the bone, currently performed manually. Existing deep learning-based methods for alignment require a common template or are limited in rotation range. Therefore, we present a novel network, D-net, to estimate arbitrary rotation and translation between 3D CT scans that additionally does not require a prior standard template. D-net is an extension to the branched Siamese encoder-decoder structure connected by new mutual non-local links, which efficiently capture long-range connections of similar features between two branches. The 3D supervised network is trained and validated using preclinical CT scans of mouse tibiae with and without contrast enhancement in cartilage. The presented results show a significant improvement in the estimation of CT alignment, outperforming the current comparable methods.


title: Assessing the Impact: Does an Improvement to a Revenue Management System Lead to an Improved Revenue?

abstract: Airlines and other industries have been making use of sophisticated Revenue Management Systems to maximize revenue for decades. While improving the different components of these systems has been the focus of numerous studies, estimating the impact of such improvements on the revenue has been overlooked in the literature despite its practical importance. Indeed, quantifying the benefit of a change in a system serves as support for investment decisions. This is a challenging problem as it corresponds to the difference between the generated value and the value that would have been generated keeping the system as before. The latter is not observable. Moreover, the expected impact can be small in relative value. In this paper, we cast the problem as counterfactual prediction of unobserved revenue. The impact on revenue is then the difference between the observed and the estimated revenue. The originality of this work lies in the innovative application of econometric methods proposed for macroeconomic applications to a new problem setting. Broadly applicable, the approach benefits from only requiring revenue data observed for origin-destination pairs in the network of the airline at each day, before and after a change in the system is applied. We report results using real large-scale data from Air Canada. We compare a deep neural network counterfactual predictions model with econometric models. They achieve respectively 1% and 1.1% of error on the counterfactual revenue predictions, and allow to accurately estimate small impacts (in the order of 2%).


title: Learning From Revisions: Quality Assessment of Claims in Argumentation at Scale

abstract: Assessing the quality of arguments and of the claims the arguments are composed of has become a key task in computational argumentation. However, even if different claims share the same stance on the same topic, their assessment depends on the prior perception and weighting of the different aspects of the topic being discussed. This renders it difficult to learn topic-independent quality indicators. In this paper, we study claim quality assessment irrespective of discussed aspects by comparing different revisions of the same claim. We compile a large-scale corpus with over 377k claim revision pairs of various types from kialo.com, covering diverse topics from politics, ethics, entertainment, and others. We then propose two tasks: (a) assessing which claim of a revision pair is better, and (b) ranking all versions of a claim by quality. Our first experiments with embedding-based logistic regression and transformer-based neural networks show promising results, suggesting that learned indicators generalize well across topics. In a detailed error analysis, we give insights into what quality dimensions of claims can be assessed reliably. We provide the data and scripts needed to reproduce all results.


title: Self-similar solutions to the Hesse flow

abstract: We define a Hesse soliton, that is, a self-similar solution to the Hesse flow on Hessian manifolds. On information geometry, the $e$-connection and the $m$-connection are important, which do not coincide with the Levi-Civita one. Therefore, it is interesting to consider a Hessian manifold with a flat connection which does not coincide with the Levi-Civita one. We call it a proper Hessian manifold. In this paper, we show that any compact proper Hesse soliton is expanding and any non-trivial compact gradient Hesse soliton is proper. Furthermore, we show that the dual space of a Hesse-Einstein manifold can be understood as a Hesse soliton.


title: Black Hole - Neutron Star Binary Mergers: The Imprint of Tidal Deformations and Debris

abstract: The increase in the sensitivity of gravitational wave interferometers will bring additional detections of binary black hole and double neutron star mergers. It will also very likely add many merger events of black hole - neutron star binaries. Distinguishing mixed binaries from binary black holes mergers for high mass ratios could be challenging because in this situation the neutron star coalesces with the black hole without experiencing significant disruption. To investigate the transition of mixed binary mergers into those behaving more like binary black hole coalescences, we present results from merger simulations for different mass ratios. We show how the degree of deformation and disruption of the neutron star impacts the inspiral and merger dynamics, the properties of the final black hole, the accretion disk formed from the circularization of the tidal debris, the gravitational waves, and the strain spectrum and mismatches. The results also show the effectiveness of the initial data method that generalizes the Bowen-York initial data for black hole punctures to the case of binaries with neutron star companions.


title: The emergence of visual semantics through communication games

abstract: The emergence of communication systems between agents which learn to play referential signalling games with realistic images has attracted a lot of attention recently. The majority of work has focused on using fixed, pretrained image feature extraction networks which potentially bias the information the agents learn to communicate. In this work, we consider a signalling game setting in which a `sender' agent must communicate the information about an image to a `receiver' who must select the correct image from many distractors. We investigate the effect of the feature extractor's weights and of the task being solved on the visual semantics learned by the models. We first demonstrate to what extent the use of pretrained feature extraction networks inductively bias the visual semantics conveyed by emergent communication channel and quantify the visual semantics that are induced. We then go on to explore ways in which inductive biases can be introduced to encourage the emergence of semantically meaningful communication without the need for any form of supervised pretraining of the visual feature extractor. We impose various augmentations to the input images and additional tasks in the game with the aim to induce visual representations which capture conceptual properties of images. Through our experiments, we demonstrate that communication systems which capture visual semantics can be learned in a completely self-supervised manner by playing the right types of game. Our work bridges a gap between emergent communication research and self-supervised feature learning.


title: Multi-task Learning Approach for Automatic Modulation and Wireless Signal Classification

abstract: Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum management, and secure communications. Consequently, it will become a key enabler with the emerging fifth-generation (5G) and beyond 5G communications, Internet of Things networks, among others. State-of-the-art studies in wireless signal recognition have only focused on a single task which in many cases is insufficient information for a system to act on. In this work, for the first time in the wireless communication domain, we exploit the potential of deep neural networks in conjunction with multi-task learning (MTL) framework to simultaneously learn modulation and signal classification tasks. The proposed MTL architecture benefits from the mutual relation between the two tasks in improving the classification accuracy as well as the learning efficiency with a lightweight neural network model. Additionally, we consider the problem of heterogeneous wireless signals such as radar and communication signals in the electromagnetic spectrum. Accordingly, we have shown how the proposed MTL model outperforms several state-of-the-art single-task learning classifiers while maintaining a lighter architecture and performing two signal characterization tasks simultaneously. Finally, we also release the only known open heterogeneous wireless signals dataset that comprises of radar and communication signals with multiple labels.


title: Consistent specification testing under spatial dependence

abstract: We propose a series-based nonparametric specification test for a regression function when data are spatially dependent, the `space' being of a general economic or social nature. Dependence can be parametric, parametric with increasing dimension, semiparametric or any combination thereof, thus covering a vast variety of settings. These include spatial error models of varying types and levels of complexity. Under a new smooth spatial dependence condition, our test statistic is asymptotically standard normal. To prove the latter property, we establish a central limit theorem for quadratic forms in linear processes in an increasing dimension setting. Finite sample performance is investigated in a simulation study, with a bootstrap method also justified and illustrated, and empirical examples illustrate the test with real-world data.


title: Ridge approximation for thin nematic polymer networks

abstract: Nematic polymer networks (NPNs) are nematic elastomers within which the nematic director is enslaved to the elastic deformation. The elastic free energy of a NPN sheet of thickness $h$ has both stretching and bending components (the former scaling like h, the latter scaling like $h^3$). NPN sheets bear a director field $\mathbf{m}$ imprinted in them (usually, uniformly throughout their thickness); they can be activated by changing the nematic order (e.g. by illumination or heating). This paper illustrates an attempt to compute the bending energy of a NPN sheet and to show which role it can play in determining the activated shape. Our approach is approximate: the activated surface consists of flat sectors connected by ridges, where the unit normal jumps and the bending energy is concentrated. By increasing the number of ridges, we should get closer to the real situation, where the activated surface is smooth and the bending energy is distributed on it. The method is applied to a disk with imprinted a spiraling hedgehog. It is shown that upon activation the disk, like a tiny hand, is able to grab a rigid lamina.


title: Regions of Attraction Estimation using Level SetMethod for Complex Network System

abstract: Many complex engineering systems network together functional elements and balance demand loads (e.g.information on data networks, electric power on grids). This allows load spikes to be shifted and avoid a local overload. In mobile wireless networks, base stations(BSs) receive data demand and shift high loads to neighbouring BSs to avoid the outage. The stability of cascade load balancing is important because unstable networks can cause high inefficiency. The research challenge is to prove the stability conditions for any arbitrarily large, complex, and dynamic network topology, and for any balancing dynamic function. Our previous work has proven the conditions for stability for stationary networks near equilibrium for any load balancing dynamic and topology. Most current analyses in dynamic complex networks linearize the system around the fixed equilibrium solutions. This approach is insufficient for dynamic networks with changing equilibrium and estimating the Region of Attraction(ROA) is needed. The novelty of this paper is that we compress this high-dimensional system and use Level Set Methods (LSM) to estimate the ROA. Our results show how we can control the ROA via network topology (local degree control) as a way to configure the mobility of transceivers to ensure the preservation of stable load balancing.


title: On the Performance of Image Recovery in Massive MIMO Communications

abstract: Massive MIMO (Multiple Input Multiple Output) has demonstrated as a potential candidate for 5G-and-beyond wireless networks. Instead of using Gaussian signals as most of the previous works, this paper makes a novel contribution by investigating the transmission quality of image data by utilizing the Massive MIMO technology. We first construct a framework to decode the image signal from the noisy received data in the uplink Massive MIMO transmission by utilizing the alternating direction method of multipliers (ADMM) approach. Then, a low-pass filter is exploited to enhance the efficiency of the remaining noise and artifacts reduction in the recovered image. Numerical results demonstrate the necessity of a post-filtering process in enhancing the quality of image recovery.


title: Registration-based model reduction in complex two-dimensional geometries

abstract: We present a general -- i.e., independent of the underlying equation -- registration procedure for parameterized model order reduction. Given the spatial domain $\Omega \subset \mathbb{R}^2$ and the manifold $\mathcal{M}= \{ u_{\mu} : \mu \in \mathcal{P} \}$ associated with the parameter domain $\mathcal{P} \subset \mathbb{R}^P$ and the parametric field $\mu \mapsto u_{\mu} \in L^2(\Omega)$, our approach takes as input a set of snapshots $\{ u^k \}_{k=1}^{n_{\rm train}} \subset \mathcal{M}$ and returns a parameter-dependent bijective mapping ${\Phi}: \Omega \times \mathcal{P} \to \mathbb{R}^2$: the mapping is designed to make the mapped manifold $\{ u_{\mu} \circ {\Phi}_{\mu}: \, \mu \in \mathcal{P} \}$ more amenable for linear compression methods. In this work, we extend and further analyze the registration approach proposed in [Taddei, SISC, 2020]. The contributions of the present work are twofold. First, we extend the approach to deal with annular domains by introducing a suitable transformation of the coordinate system. Second, we discuss the extension to general two-dimensional geometries: towards this end, we introduce a spectral element approximation, which relies on a partition $\{ \Omega_{q} \}_{q=1} ^{N_{\rm dd}}$ of the domain $\Omega$ such that $\Omega_1,\ldots,\Omega_{N_{\rm dd}}$ are isomorphic to the unit square. We further show that our spectral element approximation can cope with parameterized geometries. We present rigorous mathematical analysis to justify our proposal; furthermore, we present numerical results for a heat-transfer problem in an annular domain, a potential flow past a rotating symmetric airfoil, and an inviscid transonic compressible flow past a non-symmetric airfoil, to demonstrate the effectiveness of our method.


title: VConstruct: Filling Gaps in Chl-a Data Using a Variational Autoencoder

abstract: Remote sensing of Chlorophyll-a is vital in monitoring climate change. Chlorphyll-a measurements give us an idea of the algae concentrations in the ocean, which lets us monitor ocean health. However, a common problem is that the satellites used to gather the data are commonly obstructed by clouds and other artifacts. This means that time series data from satellites can suffer from spatial data loss. There are a number of algorithms that are able to reconstruct the missing parts of these images to varying degrees of accuracy, with Data INterpolating Empirical Orthogonal Functions (DINEOF) being the current standard. However, DINEOF is slow, suffers from accuracy loss in temporally homogenous waters, reliant on temporal data, and only able to generate a single potential reconstruction. We propose a machine learning approach to reconstruction of Chlorophyll-a data using a Variational Autoencoder (VAE). Our accuracy results to date are competitive with but slightly less accurate than DINEOF. We show the benefits of our method including vastly decreased computation time and ability to generate multiple potential reconstructions. Lastly, we outline our planned improvements and future work.


title: Discrete Choice Analysis with Machine Learning Capabilities

abstract: This paper discusses capabilities that are essential to models applied in policy analysis settings and the limitations of direct applications of off-the-shelf machine learning methodologies to such settings. Traditional econometric methodologies for building discrete choice models for policy analysis involve combining data with modeling assumptions guided by subject-matter considerations. Such considerations are typically most useful in specifying the systematic component of random utility discrete choice models but are typically of limited aid in determining the form of the random component. We identify an area where machine learning paradigms can be leveraged, namely in specifying and systematically selecting the best specification of the random component of the utility equations. We review two recent novel applications where mixed-integer optimization and cross-validation are used to algorithmically select optimal specifications for the random utility components of nested logit and logit mixture models subject to interpretability constraints.


title: Filtered formal groups, Cartier duality, and derived algebraic geometry

abstract: We develop a notion of formal groups in the filtered setting and describe a duality relating these to a specified class of filtered Hopf algebras. We then study a deformation to the normal cone construction in the setting of derived algebraic geometry. Applied to the unit section of a formal group $\widehat{\mathbb{G}}$, this provides a $\mathbb{G}_m$-equivariant degeneration of $\widehat{\mathbb{G}}$ to its tangent Lie algebra. We prove a unicity result on complete filtrations, which, in particular, identifies the resulting filtration on the coordinate algebra of this deformation with the adic filtration on the coordinate algebra of $\widehat{\mathbb{G}}$. We use this in a special case, together with the aforementioned notion of Cartier duality, to recover the filtration on the filtered circle of [MRT19]. Finally, we investigate some properties of $\widehat{\mathbb{G}}$-Hochschild homology set out in loc. cit., and describe "lifts" of these invariants to the setting of spectral algebraic geometry.


title: Generative Autoencoder Kernels on Deep Learning for Brain Activity Analysis

abstract: Deep Learning (DL) is a two-step classification model that consists feature learning, generating feature representations using unsupervised ways and the supervised learning stage at the last step of model using at least two hidden layers on the proposed structures by fully connected layers depending on of the artificial neural networks. The optimization of the predefined classification parameters for the supervised models eases reaching the global optimality with exact zero training error. The autoencoder (AE) models are the highly generalized ways of the unsupervised stages for the DL to define the output weights of the hidden neurons with various representations. As alternatively to the conventional Extreme Learning Machines (ELM) AE, Hessenberg decomposition-based ELM autoencoder (HessELM-AE) is a novel kernel to generate different presentations of the input data within the intended sizes of the models. The aim of the study is analyzing the performance of the novel Deep AE kernel for clinical availability on electroencephalogram (EEG) with stroke patients. The slow cortical potentials (SCP) training in stroke patients during eight neurofeedback sessions were analyzed using Hilbert-Huang Transform. The statistical features of different frequency modulations were fed into the Deep ELM model for generative AE kernels. The novel Deep ELM-AE kernels have discriminated the brain activity with high classification performances for positivity and negativity tasks in stroke patients.


title: Strong $B_{QQ'}^*B_{QQ'}V$ vertices and the radiative decays of $B_{QQ}^* \to B_{QQ}\gamma$ in the light-cone sum rules

abstract: The strong coupling constants of spin-3/2 to spin-1/2 doubly heavy baryon transitions with light vector mesons are estimated within the light-cone QCD sum rules method. Moreover, using the vector-meson dominance ans\"atz, the widths of radiative decays $B_{QQ}^* \to B_{QQ} \gamma$ are calculated. The results for the said decay widths are compared to the predictions of other approaches.


title: Superiorities of Deep Extreme Learning Machines against Convolutional Neural Networks

abstract: Deep Learning (DL) is a machine learning procedure for artificial intelligence that analyzes the input data in detail by increasing neuron sizes and number of the hidden layers. DL has a popularity with the common improvements on the graphical processing unit capabilities. Increasing number of the neuron sizes at each layer and hidden layers is directly related to the computation time and training speed of the classifier models. The classification parameters including neuron weights, output weights, and biases need to be optimized for obtaining an optimum model. Most of the popular DL algorithms require long training times for optimization of the parameters with feature learning progresses and back-propagated training procedures. Reducing the training time and providing a real-time decision system are the basic focus points of the novel approaches. Deep Extreme Learning machines (Deep ELM) classifier model is one of the fastest and effective way to meet fast classification problems. In this study, Deep ELM model, its superiorities and weaknesses are discussed, the problems that are more suitable for the classifiers against Convolutional neural network based DL algorithms.


title: COVID-19 Outbreak Prediction and Analysis using Self Reported Symptoms

abstract: It is crucial for policymakers to understand the community prevalence of COVID-19 so combative resources can be effectively allocated and prioritized during the COVID-19 pandemic. Traditionally, community prevalence has been assessed through diagnostic and antibody testing data. However, despite the increasing availability of COVID-19 testing, the required level has not been met in most parts of the globe, introducing a need for an alternative method for communities to determine disease prevalence. This is further complicated by the observation that COVID-19 prevalence and spread varies across different spatial, temporal, and demographics. In this study, we understand trends in the spread of COVID-19 by utilizing the results of self-reported COVID-19 symptoms surveys as an alternative to COVID-19 testing reports. This allows us to assess community disease prevalence, even in areas with low COVID-19 testing ability. Using individually reported symptom data from various populations, our method predicts the likely percentage of the population that tested positive for COVID-19. We do so with a Mean Absolute Error (MAE) of 1.14 and Mean Relative Error (MRE) of 60.40\% with 95\% confidence interval as (60.12, 60.67). This implies that our model predicts +/- 1140 cases than the original in a population of 1 million. In addition, we forecast the location-wise percentage of the population testing positive for the next 30 days using self-reported symptoms data from previous days. The MAE for this method is as low as 0.15 (MRE of 23.61\% with 95\% confidence interval as (23.6, 13.7)) for New York. We present an analysis of these results, exposing various clinical attributes of interest across different demographics. Lastly, we qualitatively analyze how various policy enactments (testing, curfew) affect the prevalence of COVID-19 in a community.


title: A new interval-based aggregation approach based on bagging and Interval Agreement Approach (IAA) in ensemble learning

abstract: The main aim in ensemble learning is using multiple individual classifiers outputs rather than one classifier output to aggregate them for more accurate classification. Generating an ensemble classifier generally is composed of three steps: selecting the base classifier, applying a sampling strategy to generate different individual classifiers and aggregation the classifiers outputs. This paper focuses on the classifiers outputs aggregation step and presents a new interval-based aggregation modeling using bagging resampling approach and Interval Agreement Approach (IAA) in ensemble learning. IAA is an interesting and practical aggregation approach in decision making which was introduced to combine decision makers opinions when they present their opinions by intervals. In this paper, in addition to implementing a new aggregation approach in ensemble learning, we designed some experiments to encourage researchers to use interval modeling in ensemble learning because it preserves more uncertainty and this leads to more accurate classification. For this purpose, we compared the results of implementing the proposed method to the majority vote as the most common and successful aggregation function in the literature on 10 medical data sets to show the better performance of the interval modeling and the proposed interval-based aggregation function in binary classification when it comes to ensemble learning. The results confirm the good performance of our proposed approach.


title: A scalable approach for developing clinical risk prediction applications in different hospitals

abstract: Objective: Machine learning algorithms are now widely used in predicting acute events for clinical applications. While most of such prediction applications are developed to predict the risk of a particular acute event at one hospital, few efforts have been made in extending the developed solutions to other events or to different hospitals. We provide a scalable solution to extend the process of clinical risk prediction model development of multiple diseases and their deployment in different Electronic Health Records (EHR) systems. Materials and Methods: We defined a generic process for clinical risk prediction model development. A calibration tool has been created to automate the model generation process. We applied the model calibration process at four hospitals, and generated risk prediction models for delirium, sepsis and acute kidney injury (AKI) respectively at each of these hospitals. Results: The delirium risk prediction models achieved area under the receiver-operating characteristic curve (AUROC) ranging from 0.82 to 0.95 over different stages of a hospital stay on the test datasets of the four hospitals. The sepsis models achieved AUROC ranging from 0.88 to 0.95, and the AKI models achieved AUROC ranging from 0.85 to 0.92. Discussion: The scalability discussed in this paper is based on building common data representations (syntactic interoperability) between EHRs stored in different hospitals. Semantic interoperability, a more challenging requirement that different EHRs share the same meaning of data, e.g. a same lab coding system, is not mandated with our approach. Conclusions: Our study describes a method to develop and deploy clinical risk prediction models in a scalable way. We demonstrate its feasibility by developing risk prediction models for three diseases across four hospitals.


title: A Search Method for Large Polarization Kernels

abstract: A new search method for large polarization kernels is proposed. The algorithm produces a kernel with given partial distances by employing depth-first search combined with some methods which reduce the search space. Using the proposed method, we improved almost all existing lower bounds on the maximum rate of polarization for kernels of size from 17 to 27. We also obtained kernels which admit low complexity processing by the recently proposed recursive trellis algorithm. Numerical results demonstrate the advantage of polar codes with the proposed kernels compared with shortened polar codes and polar codes with small kernels.


title: Probing $\mu$eV ALPs with future LHAASO observation of AGN $\gamma$-ray spectra

abstract: Axion-like particles (ALPs) are predicted in some well-motivated theories beyond the Standard Model. The TeV gamma-rays from active galactic nuclei (AGN) suffer attenuation by the pair production interactions with the cosmic background light (EBL/CMB) during its travel to the earth. The attenuation can be circumvented through photon-ALP conversions in the AGN and Galaxy magnetic-field, and a flux enhancement is expected to arise in the observed spectrum. In this work, we study the potential of the AGN gamma-ray spectrum for energy up to above 100\,TeV to probe ALP-parameter space at around $\mu$eV, where the coupling $g_{a\gamma}$ is so far relatively weakly constrained. We find the nearby and bright sources, Mrk\,501, IC\,310 and M\,87, are suitable for our objective. Assuming an intrinsic spectrum exponential cutoff energy, we extrapolate the observed spectra of these sources up to above 100\,TeV by the models with/without ALPs. For $g_{a\gamma}\gtrsim 2\times$$10^{-11} \rm GeV^{-1}$ with $m_{a}\lesssim0.5\,\mu$eV, the flux at around 100\,TeV predicted by the ALP model can be enhanced more than an order of magnitude than that from the standard absorption, and could be detected by LHAASO. Our result is subject to the uncertainty from the intrinsic cutoff energy and the AGN lobe (or plume) magnetic-field. For an optimistic estimation, the constraint can be improved to $g_{a\gamma}\gtrsim 2\times$$10^{-11} \rm GeV^{-1}$ with $m_{a}\lesssim1\,\mu$eV. This require further observations on these sources by the forthcoming CTA, LHAASO, SWGO and so on.


title: Rigidity of topological entropy of boundary maps associated to Fuchsian groups

abstract: Given a closed, orientable surface of constant negative curvature and genus $g \ge 2$, we study a family of generalized Bowen-Series boundary maps and prove the following rigidity result: in this family the topological entropy is constant and depends only on the genus of the surface. We give an explicit formula for this entropy and show that the value of the topological entropy also stays constant in the Teichm\"uller space of the surface. The proofs use conjugation to maps of constant slope.


title: Equidistribution in Families of Abelian Varieties and Uniformity

abstract: Using equidistribution techniques from Arakelov theory as well as recent results obtained by Dimitrov, Gao, and Habegger, we deduce uniform results on the Manin-Mumford and the Bogomolov conjecture. For each given integer $g \geq 2$, we prove that the number of torsion points lying on a smooth complex algebraic curve of genus $g$ embedded into its Jacobian is uniformly bounded. Complementing other recent work of Dimitrov, Gao, and Habegger, we obtain a rather uniform version of the Mordell conjecture as well. In particular, the number of rational points on a smooth algebraic curve defined over a number field can be bounded solely in terms of its genus and the Mordell-Weil rank of its Jacobian.


title: TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics

abstract: Tasks, Datasets and Evaluation Metrics are important concepts for understanding experimental scientific papers. However, most previous work on information extraction for scientific literature mainly focuses on the abstracts only, and does not treat datasets as a separate type of entity (Zadeh and Schumann, 2016; Luan et al., 2018). In this paper, we present a new corpus that contains domain expert annotations for Task (T), Dataset (D), Metric (M) entities on 2,000 sentences extracted from NLP papers. We report experiment results on TDM extraction using a simple data augmentation strategy and apply our tagger to around 30,000 NLP papers from the ACL Anthology. The corpus is made publicly available to the community for fostering research on scientific publication summarization (Erera et al., 2019) and knowledge discovery.


title: Extraction of the multiplicity dependence of Multiparton Interactions from LHC pp data using Machine Learning techniques

abstract: Over the last years, Machine Learning (ML) methods have been successfully applied to a wealth of problems in high-energy physics. For instance, in a previous work we have reported that using ML techniques one can extract the Multiparton Interactions (MPI) activity from minimum-bias pp data. Using the available LHC data on transverse momentum spectra as a function of multiplicity, we reported the average number of MPI ($\langle N_{\rm mpi} \rangle$) for minimum-bias pp collisions at $\sqrt{s}=5.02$ and 13\,TeV. In this work, we apply the same analysis to a new set of data. We report that $\langle N_{\rm mpi} \rangle$ amounts to $3.98 \pm 1.01$ for minimum-bias pp collisions at $\sqrt{s}=7$\,TeV. These complementary results suggest a modest center-of-mass energy dependence of $\langle N_{\rm mpi} \rangle$. The study is further extended aimed at extracting the multiplicity dependence of $\langle N_{\rm mpi} \rangle$ for the three center-of-mass energies. We show that our results qualitatively agree with existing ALICE measurements sensitive to MPI. Namely, $\langle N_{\rm mpi} \rangle$ increases approximately linearly with the charged-particle multiplicity. But, it deviates from the linear dependence at large charged-particle multiplicities. The deviation from the linear trend can be explained in terms of a bias towards harder processes given the multiplicity selection at mid-pseudorapidity. The results reported in this paper provide additional evidence of the presence of MPI in pp collisions, and they can be useful for a better understanding of the heavy-ion-like behaviour observed in pp data.


title: Proline isomerization regulates the phase behavior of elastin-like polypeptides in water

abstract: Responsiveness of polypeptides and polymers in aqueous solution plays an important role in biomedical applications and in designing advanced functional materials. Elastin-like polypeptides (ELPs) are a well-known class of synthetic intrinsically disordered proteins (IDPs), which exhibit a lower critical solution temperature (LCST) in pure water. The LCST transition can be further tuned by proline isomerization. Here, we study and compare the influence of cis/trans proline isomerization on the collapse of single ELPs in aqueous solution. Our results reveal that cis isomers play an important role in tuning the phase behavior of ELPs by hindering peptide-water hydrogen bonding while promoting intramolecular interactions.


title: Emergent Communication under Competition

abstract: The literature in modern machine learning has only negative results for learning to communicate between competitive agents using standard RL. We introduce a modified sender-receiver game to study the spectrum of partially-competitive scenarios and show communication can indeed emerge in a competitive setting. We empirically demonstrate three key takeaways for future research. First, we show that communication is proportional to cooperation, and it can occur for partially competitive scenarios using standard learning algorithms. Second, we highlight the difference between communication and manipulation and extend previous metrics of communication to the competitive case. Third, we investigate the negotiation game where previous work failed to learn communication between independent agents (Cao et al., 2018). We show that, in this setting, both agents must benefit from communication for it to emerge; and, with a slight modification to the game, we demonstrate successful communication between competitive agents. We hope this work overturns misconceptions and inspires more research in competitive emergent communication.


title: Revisiting Linformer with a modified self-attention with linear complexity

abstract: Although Transformer models such as Google's BERT and OpenAI's GPT-3 are successful in many natural language processing tasks, training and deploying these models are costly and inefficient.Even if pre-trained models are used, deploying these models still remained a challenge due to their large size. Apart from deployment, these models take higher time during inference restricting user-friendliness. The main bottleneck is self-attention which uses quadratic time and space with respect to the sequence length. In order to reduce the quadratic time complexity of the self-attention mechanism, Linformer by Facebook's AI research team was introduced where they showed that the self-attention mechanism can be approximated by a low-rank matrix and exploiting this finding, a new method for self-attention with linear time and space complexity was proposed by them. In the Linformer, the time complexity depends on the projection mapping dimension which acts as a hyperparameter and affects the performance of the model, tuning this hyperparameter can be time-consuming. In this paper, I proposed an alternative method for self-attention with linear complexity in time and space and is independent of the projection mapping dimension. Since this method works for long sequences this can be used for images as well as audios.


title: High-Quality Vocoding Design with Signal Processing for Speech Synthesis and Voice Conversion

abstract: This Ph.D. thesis focuses on developing a system for high-quality speech synthesis and voice conversion. Vocoder-based speech analysis, manipulation, and synthesis plays a crucial role in various kinds of statistical parametric speech research. Although there are vocoding methods which yield close to natural synthesized speech, they are typically computationally expensive, and are thus not suitable for real-time implementation, especially in embedded environments. Therefore, there is a need for simple and computationally feasible digital signal processing algorithms for generating high-quality and natural-sounding synthesized speech. In this dissertation, I propose a solution to extract optimal acoustic features and a new waveform generator to achieve higher sound quality and conversion accuracy by applying advances in deep learning. The approach remains computationally efficient. This challenge resulted in five thesis groups, which are briefly summarized below.


title: QFold: Quantum Walks and Deep Learning to Solve Protein Folding

abstract: Predicting the 3D structure of proteins is one of the most important problems in current biochemical research. In this article, we explain how to combine recent deep learning advances with the well known technique of quantum walks applied to a Metropolis algorithm. The result, QFold, is a fully scalable hybrid quantum algorithm that, in contrast to previous quantum approaches, does not require a lattice model simplification and instead relies on the much more realistic assumption of parameterization in terms of torsion angles of the amino acids. We compare it with its classical analog for different annealing schedules and find a polynomial quantum advantage, and implement a minimal realization of the quantum Metropolis in the IBMQ Casablanca quantum system.


title: Deep Epidemiological Modeling by Black-box Knowledge Distillation: An Accurate Deep Learning Model for COVID-19

abstract: An accurate and efficient forecasting system is imperative to the prevention of emerging infectious diseases such as COVID-19 in public health. This system requires accurate transient modeling, lower computation cost, and fewer observation data. To tackle these three challenges, we propose a novel deep learning approach using black-box knowledge distillation for both accurate and efficient transmission dynamics prediction in a practical manner. First, we leverage mixture models to develop an accurate, comprehensive, yet impractical simulation system. Next, we use simulated observation sequences to query the simulation system to retrieve simulated projection sequences as knowledge. Then, with the obtained query data, sequence mixup is proposed to improve query efficiency, increase knowledge diversity, and boost distillation model accuracy. Finally, we train a student deep neural network with the retrieved and mixed observation-projection sequences for practical use. The case study on COVID-19 justifies that our approach accurately projects infections with much lower computation cost when observation data are limited.


title: PAWLS: PDF Annotation With Labels and Structure

abstract: Adobe's Portable Document Format (PDF) is a popular way of distributing view-only documents with a rich visual markup. This presents a challenge to NLP practitioners who wish to use the information contained within PDF documents for training models or data analysis, because annotating these documents is difficult. In this paper, we present PDF Annotation with Labels and Structure (PAWLS), a new annotation tool designed specifically for the PDF document format. PAWLS is particularly suited for mixed-mode annotation and scenarios in which annotators require extended context to annotate accurately. PAWLS supports span-based textual annotation, N-ary relations and freeform, non-textual bounding boxes, all of which can be exported in convenient formats for training multi-modal machine learning models. A read-only PAWLS server is available at https://pawls.apps.allenai.org/ and the source code is available at https://github.com/allenai/pawls.


title: On a class of integrable Hamiltonian equations in 2+1 dimensions

abstract: We classify integrable Hamiltonian equations in 3D with the Hamiltonian operator d/dx, where the Hamiltonian density h(u, w) is a function of two variables: dependent variable u and the non-locality w such that w_x=u_y. Based on the method of hydrodynamic reductions, the integrability conditions are derived (in the form of an involutive PDE system for the Hamiltonian density h). We show that the generic integrable density is expressed in terms of the Weierstrass elliptic functions. Dispersionless Lax pairs, commuting flows and dispersive deformations of the resulting equations are also discussed.


title: Polycaprolactone/graphite nanoplates composite nanopapers

abstract: Nanopapers based on graphene and related materials were recently proposed for application in heat spreader applications. To overcome typical limitations in brittleness of such materials, this work addressed the combination of graphite nanoplatelets (GNP) with a soft, tough and crystalline polymer, acting as an efficient binder between nanoplates. With this aim, polycaprolactone (PCL) was selected and exploited in this paper. The crystalline organization of PCL within the nanopaper was studied to investigate the effect of polymer confinement between GNP. Thermomechanical properties were studied by dynamic mechanical analyses at variable temperature and creep measurements at high temperature, demonstrating superior resistance at temperatures well above PCL melting. Finally, the heat conduction properties on the nanopapers were evaluated, resulting in outstanding values above 150 Wm-1K-1.


title: Reinforcement Learning Based Temporal Logic Control with Soft Constraints Using Limit-deterministic Generalized Buchi Automata

abstract: This paper studies the control synthesis of motion planning subject to uncertainties. The uncertainties are considered in robot motions and environment properties, giving rise to the probabilistic labeled Markov decision process (PL-MDP). A Model-Free Reinforcement The learning (RL) method is developed to generate a finite-memory control policy to satisfy high-level tasks expressed in linear temporal logic (LTL) formulas. Due to uncertainties and potentially conflicting tasks, this work focuses on infeasible LTL specifications, where a relaxed LTL constraint is developed to allow the agent to revise its motion plan and take violations of original tasks into account for partial satisfaction. And a novel automaton is developed to improve the density of accepting rewards and enable deterministic policies. We proposed an RL framework with rigorous analysis that is guaranteed to achieve multiple objectives in decreasing order: 1) satisfying the acceptance condition of relaxed product MDP and 2) reducing the violation cost over long-term behaviors. We provide simulation and experimental results to validate the performance.


title: Finding unstable periodic orbits: a hybrid approach with polynomial optimization

abstract: We present a novel method to compute unstable periodic orbits (UPOs) that optimize the infinite-time average of a given quantity for polynomial ODE systems. The UPO search procedure relies on polynomial optimization to construct nonnegative polynomials whose sublevel sets approximately localize parts of the optimal UPO, and that can be used to implement a simple yet effective control strategy to reduce the UPO's instability. Precisely, we construct a family of controlled ODE systems parameterized by a scalar $k$ such that the original ODE system is recovered for $k = 0$, and such that the optimal orbit is less unstable, or even stabilized, for $k>0$. Periodic orbits for the controlled system can be more easily converged with traditional methods and numerical continuation in $k$ allows one to recover optimal UPOs for the original system. The effectiveness of this approach is illustrated on three low-dimensional ODE systems with chaotic dynamics.


title: Transition from shear-dominated to Rayleigh-Taylor turbulence

abstract: Turbulent mixing layers in nature are often characterized by the presence of a mean shear and an unstable buoyancy gradient between two streams of different velocity. Depending on the relative strength of shear versus buoyancy, either the former or the latter may dominate the turbulence and mixing between the two streams. In this paper, we present a phenomenological theory that leads to the identification of two distinct turbulent regimes: an early regime, dominated by the mean shear, and a later regime dominated by the buoyancy. The main theoretical result consists of the identification of a cross-over time-scale that discerns between the shear- and the buoyancy-dominated turbulence. This cross-over time depends on three large-scale constants of the flow, namely the buoyancy difference, the velocity difference between the two streams, and the gravitational acceleration. We validate our theory against direct numerical simulations (DNSs) of a temporal turbulent mixing layer compounded with an unstable stratification. We observe that the cross-over time correctly predicts the transition from shear to buoyancy driven turbulence, in terms of turbulent kinetic energy production, energy spectra scaling and mixing layer thickness.


title: Bounds on the heat transfer rate via passive advection

abstract: In heat exchangers, an incompressible fluid is heated initially and cooled at the boundary. The goal is to transfer the heat to the boundary as efficiently as possible. In this paper we study a related steady version of this problem where a steadily stirred fluid is uniformly heated in the interior and cooled on the boundary. For a given large P\'eclet number, how should one stir to minimize some norm of the temperature? This version of the problem was previously studied by Marcotte, Doering et\ al.\ (SIAM Appl.\ Math '18) in a disk, where the authors used matched asymptotics to show that when the P\'eclet number, $\pe$, is sufficiently large one can stir the fluid in a manner that ensures the total heat is $O(1/\pe)$. In this paper we confirm their results with rigorous proofs, and also provide an almost matching lower bound. For simplicity, we work on the infinite strip instead of the unit disk and the proof uses probabilistic techniques.


title: H\"older regularity and convergence for a non-local model of nematic liquid crystals in the large-domain limit

abstract: We consider a non-local free energy functional, modelling a competition between entropy and pairwise interactions reminiscent of the second order virial expansion, with applications to nematic liquid crystals as a particular case. We build on previous work on understanding the behaviour of such models within the large-domain limit, where minimisers converge to minimisers of a quadratic elastic energy with manifold-valued constraint, analogous to harmonic maps. We extend this work to establish H\"older bounds for (almost-)minimisers on bounded domains, and demonstrate stronger convergence of (almost)-minimisers away from the singular set of the limit solution. The proof techniques bear analogy with recent work of singularly perturbed energy functionals, in particular in the context of the Ginzburg-Landau and Landau-de Gennes models.


title: Precise Calibration of the One-Loop Trispectrum in the Effective Field Theory of Large Scale Structure

abstract: The Large-Scale Structure (LSS) of the universe has the potential to provide decisive answers to the remaining open questions in cosmology. Early attempts at modelling it analytically focused on using perturbation theory. However, small-scale effects introduced by gravitational collapse cannot be described perturbatively and this failure of perturbation theory is reflected even on the largest scales. The Effective Field Theory of Large Scale Structure (EFTofLSS) has emerged as a consistent method for describing LSS on large scales by introducing counterterms that account for the effects of small-scale dynamics. So far studies of the EFT have mostly focused on the two and three point functions with little attention devoted to the four point function or trispectrum. The trispectrum probes cubic interactions arising from non-linear clustering, biasing, and primordial non-Gaussianities, and constitutes a key element of the covariance matrix of the power spectrum. In this paper, we present explicit calibrations of the EFT counterterms for the one-loop trispectrum. Specifically, we find clear evidence for non-zero EFT corrections. We define two one-parameter ans\"{a}tze for the counterterm of the one-loop propagator and show that they provide a good correction to the residual at scales below k~0.07 h/Mpc. We then take the amplitudes of the linear and quadratic counterkernels calculated in our previous paper on the bispectrum and use them in the remaining counterterms, establishing consistency of the counterterms in the two, three and four point function. We also show that the commonly used EdS approximation for the growth of the density fields leads to errors that are of the same magnitude as loop corrections to the trispectrum on large scales.


title: Fundamental solutions and Hadamard states for a scalar field with arbitrary boundary conditions on an asymptotically AdS spacetimes

abstract: We consider the Klein-Gordon operator on an $n$-dimensional asymptotically anti-de Sitter spacetime $(M,g)$ together with arbitrary boundary conditions encoded by a self-adjoint pseudodifferential operator on $\partial M$ of order up to $2$. Using techniques from $b$-calculus and a propagation of singularities theorem, we prove that there exist advanced and retarded fundamental solutions, characterizing in addition their structural and microlocal properties. We apply this result to the problem of constructing Hadamard two-point distributions. These are bi-distributions which are weak bi-solutions of the underlying equations of motion with a prescribed form of their wavefront set and whose anti-symmetric part is proportional to the difference between the advanced and the retarded fundamental solutions. In particular, under a suitable restriction of the class of admissible boundary conditions and setting to zero the mass, we prove their existence extending to the case under scrutiny a deformation argument which is typically used on globally hyperbolic spacetimes with empty boundary.


title: The Shifting Sands of Motivation: Revisiting What Drives Contributors in Open Source

abstract: Open Source Software (OSS) has changed drastically over the last decade, with OSS projects now producing a large ecosystem of popular products, involving industry participation, and providing professional career opportunities. But our field's understanding of what motivates people to contribute to OSS is still fundamentally grounded in studies from the early 2000s. With the changed landscape of OSS, it is very likely that motivations to join OSS have also evolved. Through a survey of 242 OSS contributors, we investigate shifts in motivation from three perspectives: (1) the impact of the new OSS landscape, (2) the impact of individuals' personal growth as they become part of OSS communities, and (3) the impact of differences in individuals' demographics. Our results show that some motivations related to social aspects and reputation increased in frequency and that some intrinsic and internalized motivations, such as learning and intellectual stimulation, are still highly relevant. We also found that contributing to OSS often transforms extrinsic motivations to intrinsic, and that while experienced contributors often shift toward altruism, novices often shift toward career, fun, kinship, and learning. OSS projects can leverage our results to revisit current strategies to attract and retain contributors, and researchers and tool builders can better support the design of new studies and tools to engage and support OSS development.


title: Transferable Interactiveness Knowledge for Human-Object Interaction Detection

abstract: Human-Object Interaction (HOI) detection is an important problem to understand how humans interact with objects. In this paper, we explore interactiveness knowledge which indicates whether a human and an object interact with each other or not. We found that interactiveness knowledge can be learned across HOI datasets and bridge the gap between diverse HOI category settings. Our core idea is to exploit an interactiveness network to learn the general interactiveness knowledge from multiple HOI datasets and perform Non-Interaction Suppression (NIS) before HOI classification in inference. On account of the generalization ability of interactiveness, interactiveness network is a transferable knowledge learner and can be cooperated with any HOI detection models to achieve desirable results. We utilize the human instance and body part features together to learn the interactiveness in hierarchical paradigm, i.e., instance-level and body part-level interactivenesses. Thereafter, a consistency task is proposed to guide the learning and extract deeper interactive visual clues. We extensively evaluate the proposed method on HICO-DET, V-COCO, and a newly constructed PaStaNet-HOI dataset. With the learned interactiveness, our method outperforms state-of-the-art HOI detection methods, verifying its efficacy and flexibility. Code is available at https://github.com/DirtyHarryLYL/Transferable-Interactiveness-Network.


title: The Role of Cost in the Integration of Security Features in Integrated Circuits for Smart Cards

abstract: This essay investigates the role of cost in the development and production of secure integrated circuits. Initially, I make a small introduction on hardware attacks on smart cards and some of the reasons behind them. Subsequently, I introduce the production phases of chips that are integrated to smart cards and try to identify the costs affecting each one of them. I proceed to identify how adding security features on such integrated circuits may affect the costs of their development and production. I then make a more thorough investigation on the costs of developing a hardware attack for such chips and try to estimate the potential damages and losses of such an attack. I also go on to examine potential ways of reducing the cost of production for secure chips, while identifying the difficulties in adopting them. This essay ends with the conclusion that adding security features to chips meant to be used for secure applications is well worth it, because the costs of developing attacks are of comparable amounts to the costs of developing and producing a chip and the potential damages and losses caused by such attacks can be way higher than these costs. Therefore, although the production and development of integrated circuits come at a certain cost and security introduces further additional costs, security is inherently unavoidable in such chips. Finally, I additionally identify that security is an evolving concept and does not aim to make a chip totally impenetrable, as this may be impossible, but to lower the potential risks, including that of being compromised, to acceptable levels. Thus, a balance needs be found between the level of security and the levels of cost and risk.


title: Statics and Dynamics of Space-Charge-Layers in Polarized Inorganic Solid Electrolytes

abstract: The quest for safe high-energy batteries with "5V-class" cathodes and lithium metal anodes drives research into solid electrolytes. However, reasons for the large charge transfer resistances -- the major bottleneck of all-solid-state batteries -- are still debated. In this article, we explore the processes in incompressible solid electrolytes between blocking electrodes by theory-based continuum modeling and numerical simulations. We investigate the experimentally observed wide space-charge-zones in solid electrolytes, which are a possible cause for the high interfacial resistances. On time scales relevant for battery applications, we reduce our model equations. Analytic and numeric calculations predict and study the actual structure of space-charge-layers in solid electrolytes. To illustrate these dynamics and validate our model, computational results are presented and compared with experimental observations. Analog to semiconductors, we determine the material dependent, asymmetric space-charge-layer width in the low temperature limit approximately. This allows us to make an explicit statement about the influence of defect concentrations and dielectric properties on the width of the space-charge-layers in homogeneous solid electrolytes.


title: Modeling stellar abundance patterns resulting from the addition of earthlike planetary material

abstract: The literature on precision differential abundances (PDAs) in stars is extensive. Surveys include sun-like stars in the solar neighborhood, binary systems, and Galactic clusters. Numerous references as well as a discussion of relevant mechanisms may be found in papers by Ramirez, et al. (2019) and Nagar, et al. (2020). A strong impetus for this work is the probability that the abundances have been influenced by exoplanetary systems and their evolution. We calculate the resulting differential abundances ([El/H]) assuming a given amount of material with the composition of the bulk earth (Wang, et al. 2018) was added to the stellar convection zone of a dwarf G-type star. The mass of the convection zone is uncertain and variable, depending on the spectral type. Here, we assume a mass of $5\cdot 10^{31}$ gm for the stellar convection zone (SCZ). This is 0.025 $M_\odot$ (Pinsonneault, et al. 2001, Chambers, 2010). For other SCZ masses, the parameters must be adjusted accordingly. In general, the sunlike star will not have exactly the solar composition. This contingency is roughly taken into account in our model. An appendix discusses issues of volatility and condensation temperature.


title: Exploiting Symmetry Reduces the Cost of Training QAOA

abstract: A promising approach to the practical application of the Quantum Approximate Optimization Algorithm (QAOA) is finding QAOA parameters classically in simulation and sampling the solutions from QAOA with optimized parameters on a quantum computer. Doing so requires repeated evaluations of QAOA energy in simulation. We propose a novel approach for accelerating the evaluation of QAOA energy by leveraging the symmetry of the problem. We show a connection between classical symmetries of the objective function and the symmetries of the terms of the cost Hamiltonian with respect to the QAOA energy. We show how by considering only the terms that are not connected by symmetry, we can significantly reduce the cost of evaluating the QAOA energy. Our approach is general and applies to any known subgroup of symmetries and is not limited to graph problems. Our results are directly applicable to nonlocal QAOA generalization RQAOA. We outline how available fast graph automorphism solvers can be leveraged for computing the symmetries of the problem in practice. We implement the proposed approach on the MaxCut problem using a state-of-the-art tensor network simulator and a graph automorphism solver on a benchmark of 48 graphs with up to 10,000 nodes. Our approach provides an improvement for $p=1$ on $71.7\%$ of the graphs considered, with a median speedup of $4.06$, on a benchmark where $62.5\%$ of the graphs are known to be hard for automorphism solvers.


title: Nonequilibrium thermomechanics of Gaussian phase packet crystals: application to the quasistatic quasicontinuum method

abstract: The quasicontinuum method was originally introduced to bridge across length scales -- from atomistics to significantly larger continuum scales -- thus overcoming a key limitation of classical atomic-scale simulation techniques while solely relying on atomic-scale input (in the form of interatomic potentials). An associated challenge lies in bridging across time scales to overcome the time scale limitations of atomistics. To address the biggest challenge, bridging across both length and time scales, only a few techniques exist, and most of those are limited to conditions of constant temperature. Here, we present a new strategy for the space-time coarsening of an atomistic ensemble, which introduces thermomechanical coupling. We investigate the quasistatics and dynamics of a crystalline solid described as a lattice of lumped correlated Gaussian phase packets occupying atomic lattice sites. By definition, phase packets account for the dynamics of crystalline lattices at finite temperature through the statistical variances of atomic momenta and positions. We show that momentum-space correlation allows for an exchange between potential and kinetic contributions to the crystal's Hamiltonian. Consequently, local adiabatic heating due to atomic site motion is captured. Moreover, within the quasistatic approximation the governing equations reduce to the minimization of thermodynamic potentials such as Helmholtz free energy (depending on the fixed variables), and they yield the local equation of state. We further discuss opportunities for describing atomic-level thermal transport using the correlated Gaussian phase packet formulation and the importance of interatomic correlations. Such a formulation offers a promising avenue for a finite-temperature non-equilibrium quasicontinuum method that may be combined with thermal transport models.

categories: cond-mat.mes-hall physics.atom-ph physics.class-ph physics.comp-ph


title: Design and Fabrication of Metamaterial Anti-Reflection Coatings for the Simons Observatory

abstract: The Simons Observatory (SO) will be a cosmic microwave background (CMB) survey experiment with three small-aperture telescopes and one large-aperture telescope, which will observe from the Atacama Desert in Chile. In total, SO will field over 60,000 transition-edge sensor (TES) bolometers in six spectral bands centered between 27 and 280 GHz in order to achieve the sensitivity necessary to measure or constrain numerous cosmological quantities, as outlined in The Simons Observatory Collaboration et al. (2019). These telescopes require 33 highly transparent, large aperture, refracting optics. To this end, we developed mechanically robust, highly efficient, metamaterial anti-reflection (AR) coatings with octave bandwidth coverage for silicon optics up to 46 cm in diameter for the 22-55, 75-165, and 190-310 GHz bands. We detail the design, the manufacturing approach to fabricate the SO lenses, their performance, and possible extensions of metamaterial AR coatings to optical elements made of harder materials such as alumina.


title: Discovery of an insulating ferromagnetic phase of electrons in two dimensions

abstract: This is a commentary on two papers (PNAS 117 (51) 32244-32250 (2020) and arXiv:2011.06721), which observed a series of ordering transitions in a strongly correlated two-dimensional electron system confined to a AlAs quantum well. We summarize the main discoveries (electron nematicity, insulating ferromagnetism, etc.) of them and speculate on $T-r_s$ phase diagram based on theoretical considerations.


title: Channel Estimation via Successive Denoising in MIMO OFDM Systems: A Reinforcement Learning Approach

abstract: In general, reliable communication via multiple-input multiple-output (MIMO) orthogonal frequency division multiplexing (OFDM) requires accurate channel estimation at the receiver. The existing literature largely focuses on denoising methods for channel estimation that depend on either (i) channel analysis in the time-domain with prior channel knowledge or (ii) supervised learning techniques which require large pre-labeled datasets for training. To address these limitations, we present a frequency-domain denoising method based on a reinforcement learning framework that does not need a priori channel knowledge and pre-labeled data. Our methodology includes a new successive channel denoising process based on channel curvature computation, for which we obtain a channel curvature magnitude threshold to identify unreliable channel estimates. Based on this process, we formulate the denoising mechanism as a Markov decision process, where we define the actions through a geometry-based channel estimation update, and the reward function based on a policy that reduces mean squared error (MSE). We then resort to Q-learning to update the channel estimates. Numerical results verify that our denoising algorithm can successfully mitigate noise in channel estimates. In particular, our algorithm provides a significant improvement over the practical least squares (LS) estimation method and provides performance that approaches that of the ideal linear minimum mean square error (LMMSE) estimation with perfect knowledge of channel statistics.


title: Fractional boundary charges with quantized slopes in interacting one- and two-dimensional systems

abstract: We study fractional boundary charges (FBCs) for two classes of strongly interacting systems. First, we study strongly interacting nanowires subjected to a periodic potential with a period that is a rational fraction of the Fermi wavelength. For sufficiently strong interactions, the periodic potential leads to the opening of a charge density wave gap at the Fermi level. The FBC then depends linearly on the phase offset of the potential with a quantized slope determined by the period. Furthermore, different possible values for the FBC at a fixed phase offset label different degenerate ground states of the system that cannot be connected adiabatically. Next, we turn to the fractional quantum Hall effect (FQHE) at odd filling factors $\nu=1/(2l+1)$, where $l$ is an integer. For a Corbino disk threaded by an external flux, we find that the FBC depends linearly on the flux with a quantized slope that is determined by the filling factor. Again, the FBC has $2l+1$ different branches that cannot be connected adiabatically, reflecting the $(2l+1)$-fold degeneracy of the ground state. These results allow for several promising and strikingly simple ways to probe strongly interacting phases via boundary charge measurements.


title: Magnetized Reissner-Nordstrom-Taub-NUT spacetime and microscopic entropy

abstract: We present a novel solution describing magnetized spacetime outside a massive object with electric charge equipped with NUT parameter. To get the solution, we employ the Ernst magnetization to the Reissner-Nordstrom-Taub-NUT spacetime as the seed. After discussing some physical aspects of the spacetime, we show that the extremal entropy of a magnetized Reissner-Nordstrom-Taub-NUT black hole can be reproduced by using the Cardy formula.


title: Homogeneous superconducting gap in DBCO synthesized by oxide molecular beam epitaxy

abstract: Much of what is known about high-temperature cuprate superconductors stems from studies based on two surface analytical tools, angle-resolved photoemission spectroscopy (ARPES) and spectroscopic imaging scanning tunneling microscopy (SI-STM). A question of general interest is whether and when the surface properties probed by ARPES and SI-STM are representative of the intrinsic properties of bulk materials. We find this question is prominent in thin films of a rarely studied cuprate DBCO. We synthesize DBCO films by oxide molecular beam epitaxy and study them by in situ ARPES and SI-STM. Both ARPES and SI-STM show that the surface DBCO layer is different from the bulk of the film. It is heavily underdoped, while the doping level in the bulk is close to optimal doping evidenced by bulk-sensitive mutual inductance measurements. ARPES shows the typical electronic structure of a heavily underdoped CuO2 plane and two sets of one-dimensional bands originating from the CuO chains with one of them gapped. SI-STM reveals two different energy scales in the local density of states, with one corresponding to the superconductivity and the other one to the pseudogap. While the pseudogap shows large variations over the length scale of a few nanometers, the superconducting gap is very homogeneous. This indicates that the pseudogap and superconductivity are of different origins.


title: Maximum Number of Almost Similar Triangles in the Plane

abstract: A triangle $T'$ is $\varepsilon$-similar to another triangle $T$ if their angles pairwise differ by at most $\varepsilon$. Given a triangle $T$, $\varepsilon>0$ and $n\in\mathbb{N}$, B\'ar\'any and F\"uredi asked to determine the maximum number of triangles $h(n,T,\varepsilon)$ being $\varepsilon$-similar to $T$ in a planar point set of size $n$. We show that for almost all triangles $T$ there exists $\varepsilon=\varepsilon(T)>0$ such that $h(n,T,\varepsilon)=n^3/24 (1+o(1))$. Exploring connections to hypergraph Tur\'an problems, we use flag algebras and stability techniques for the proof.


abstract: Recent work on promoting cooperation in multi-agent learning has resulted in many methods which successfully promote cooperation at the cost of becoming more vulnerable to exploitation by malicious actors. We show that this is an unavoidable trade-off and propose an objective which balances these concerns, promoting both safety and long-term cooperation. Moreover, the trade-off between safety and cooperation is not severe, and you can receive exponentially large returns through cooperation from a small amount of risk. We study both an exact solution method and propose a method for training policies that targets this objective, Accumulating Risk Capital Through Investing in Cooperation (ARCTIC), and evaluate them in iterated Prisoner's Dilemma and Stag Hunt.


title: Weave Realizability for D-type

abstract: We study exact Lagrangian fillings of Legendrian links of $D_n$-type in the standard contact 3-sphere. The main result is the existence of a Lagrangian filling, represented by a weave, such that any algebraic quiver mutation of the associated intersection quiver can be realized as a geometric weave mutation. The method of proof is via Legendrian weave calculus and a construction of appropriate 1-cycles whose geometric intersections realize the required algebraic intersection numbers. In particular, we show that in $D$-type, each cluster chart of the moduli of microlocal rank-1 sheaves is induced by at least one embedded exact Lagrangian filling. Hence, the Legendrian links of $D_n$-type have at least as many Hamiltonian isotopy classes of Lagrangian fillings as cluster seeds in the $D_n$-type cluster algebra, and their geometric exchange graph for Lagrangian disk surgeries contains the cluster exchange graph of $D_n$-type.


title: Testing Scalable Bell Inequalities for Quantum Graph States on IBM Quantum Devices

abstract: Testing and verifying imperfect multi-qubit quantum devices are important as such noisy quantum devices are widely available today. Bell inequalities are known useful for testing and verifying the quality of the quantum devices from their nonlocal quantum states and local measurements. There have been many experiments demonstrating the violations of Bell inequalities but they are limited in the number of qubits and the types of quantum states. We report violations of Bell inequalities on IBM Quantum devices based on the scalable and robust inequalities maximally violated by graph states as proposed by Baccari et al. (Ref.[1]). The violations are obtained from the quantum states of path graphs up to 57 and 21 qubits on the 65-qubit and 27-qubit IBM Quantum devices, respectively, and from those of star graphs up to 8 and 7 qubits with error mitigation on the same devices. We are able to show violations of the inequalities on various graph states by constructing low-depth quantum circuits producing them, and by applying the readout error mitigation technique. We also point out that quantum circuits for star graph states of size N can be realized with circuits of depth $O(\sqrt n)$ on subdivided honeycomb lattices which are the topology of the 65-qubit IBM Quantum device. Our experiments show encouraging results on the ability of existing quantum devices to prepare entangled quantum states, and provide experimental evidences on the benefit of scalable Bell inequalities for testing them.


title: Detection of Bidirectional System-Environment Information Exchanges

abstract: Quantum memory effects can be related to a bidirectional exchange of information between an open system and its environment, which in turn modifies the state and dynamical behavior of the last one. Nevertheless, non-Markovianity can also be induced by environments whose dynamics is not affected during the system evolution, implying the absence of any physical information exchange. An unsolved open problem in the formulation of quantum memory measures is the apparent impossibility of discerning between both paradigmatic cases. Here, we present an operational scheme that, based on the outcomes of successive measurements processes performed over the system of interest, allows to distinguishing between both kinds of memory effects. The method accurately detects bidirectional information flows in diverse dissipative and dephasing non-Markovian open system dynamics.


title: Heterotic solitons on four-manifolds

abstract: We investigate four-dimensional Heterotic solitons, defined as a particular class of solutions of the equations of motion of Heterotic supergravity on a four-manifold $M$. Heterotic solitons depend on a parameter $\kappa$ and consist of a Riemannian metric $g$, a metric connection with skew torsion $H$ on $TM$ and a closed one-form $\varphi$ on $M$ satisfying a differential system. In the limit $\kappa \to 0$, Heterotic solitons reduce to a class of generalized Ricci solitons and can be considered as a higher-order curvature modification of the latter. If the torsion $H$ is equal to the Hodge dual of $\varphi$, Heterotic solitons consist of either flat tori or closed Einstein-Weyl structures on manifolds of type $S^1\times S^3$ as introduced by P. Gauduchon. We prove that the moduli space of such closed Einstein-Weyl structures is isomorphic to the product of $\mathbb{R}$ with a certain finite quotient of the Cartan torus of the isometry group of the typical fiber of a natural fibration $M\to S^1$. We also consider the associated space of essential infinitesimal deformations, which we prove to be obstructed. More generally, we characterize several families of Heterotic solitons as suspensions of certain three-manifolds with prescribed constant principal Ricci curvatures, amongst which we find hyperbolic manifolds, manifolds covered by $\widetilde{\mathrm{Sl}}(2,\mathbb{R})$ and E$(1,1)$ or certain Sasakian three-manifolds. These solutions exhibit a topological dependence in the string slope parameter $\kappa$ and yield, to the best of our knowledge, the first examples of Heterotic compactification backgrounds not locally isomorphic to supersymmetric compactification backgrounds.


title: Deformations of asymptotically conical Spin(7)-manifolds

abstract: We consider the moduli space $\mathcal{M}_{\nu}$ of torsion-free, asymptotically conical (AC) Spin(7)-structures which are defined on the same manifold and asymptotic to the same Spin(7)-cone with decay rate $\nu<0$. We show that $\mathcal{M}_{\nu}$ is an orbifold if $\nu$ is a generic rate in the non-$L^2$ regime $(-4,0)$. Infinitesimal deformations are given by topological data and solutions to a non-elliptic first-order PDE system on the compact link of the asymptotic cone. As an application, we show that the classical Bryant-Salamon metric on the bundle of positive spinors on $S^4$ has no continuous deformations as an AC Spin(7)-metric.


title: Energy per particle of nuclear and neutron matter from subleading chiral three-nucleon interactions

abstract: We derive from the subleading contributions to the chiral three-nucleon interaction [published in Phys.~Rev.~C77, 064004 (2008) and Phys.~Rev.~C84, 054001 (2011)] their first-order contributions to the energy per particle of isospin-symmetric nuclear matter and pure neutron matter in an analytical way. For the variety of short-range and long-range terms that constitute the subleading chiral 3N-force the pertinent closed 3-ring, 2-ring, and 1-ring diagrams are evaluated. While 3-ring diagrams vanish by a spin-trace and the results for 2-ring diagrams can be given in terms of elementary functions of the ratio Fermi-momentum over pion mass, one ends up in most cases for the closed 1-ring diagrams with one-parameter integrals. The same treatment is applied to the subsubleading chiral three-nucleon interactions as far as these have been constructed up to now.


title: Weak quasi-factorization for the Belavkin-Staszewski relative entropy

abstract: Quasi-factorization-type inequalities for the relative entropy have recently proven to be fundamental in modern proofs of modified logarithmic Sobolev inequalities for quantum spin systems. In this paper, we show some results of weak quasi-factorization for the Belavkin-Staszewski relative entropy, i.e. upper bounds for the BS-entropy between two bipartite states in terms of the sum of two conditional BS-entropies, up to some multiplicative and additive factors.


title: Calibrating the negative interpretation

abstract: The minimum classical extension S$^{+g}$ of a classically sound theory S based on intuitionistic logic, defined by adding to S the Gentzen negative interpretations of its mathematical axioms, contains a faithful translation S$^g$ of the classical version S + (--A -> A) of S. S$^g$ may be called the classical content of S. First and second order intuitionistic arithmetic contain their classical contents, but intuitionistic recursive analysis cannot prove the negative interpretation of its quantifier-free countable choice axiom. Variants of Kuroda's double negation shift principle (including the G\"odel-Dyson-Kreisel axiom equivalent to the weak completeness of intuitionistic predicate logic), and doubly negated characteristic function principles, provide neat characterizations of the minimum classical extensions of classically sound subsystems of Kleene's intuitionistic analysis I. Two-sorted basic constructive recursive mathematics contains its classical content. Bishop's constructive analysis has the same classical content as the neutral subsystem B of Kleene's I. By a result of Vafeiadou, minimum classical extensions of consistent, classically unsound theories (such as I) depend essentially on omega-models of their classically consistent subtheories.


title: Ricci de Turck flow on incomplete manifolds

abstract: In this paper we construct a Ricci de Turck flow on any incomplete Riemannian manifold with bounded curvature. The central property of the flow is that it stays uniformly equivalent to the initial incomplete Riemannian metric, and in that sense preserves any given initial singularity structure. Together with the corresponding result by Shi for complete manifolds, this gives that any (complete or incomplete) manifold of bounded curvature can be evolved by the Ricci de Turck flow for a short time.


title: 2-generated axial algebras of Monster type

abstract: In this paper we provide the basic setup for a project, initiated by Felix Rehren, aiming at classifying all $2$-generated primitive axial agebras of Monster type $(\alpha, \beta)$. We first revise Rehren's construction of an initial object in the cathegory of primitive $n$-generated axial algebras giving a formal one, filling some gaps and, though correcting some inaccuracies, confirm Rehren's results. Then we focus on $2$-generated algebras which naturally part into three cases: the two critical cases $\alpha=2\beta$ and $\alpha=4\beta$, and the generic case (i.e. all the rest). About these cases, which will be dealt in detail in subsequent papers, we give bounds on the dimensions (the generic case already treated by Rehen) and classify all 2-generated primitive axial algebras of Monster type $(\alpha, \beta)$ over $\mathbb Q(\alpha, \beta)$ for $\alpha$ and $\beta$ algebraically independent indeterminates over $\mathbb Q$. Finally we restrict to the $2$-generated Majorana algebras (i.e. when $\alpha=\frac{1}{4}$ and $\beta=\frac{1}{32}$), showing that these fall precisely into the nine isomorphism types of the Norton-Sakuma algebras.


title: Conjugator length in Thompson's groups

abstract: We prove Thompson's group $F$ has quadratic conjugator length function. That is, for any two conjugate elements of $F$ of length $n$ or less, there exists an element of $F$ of length $O(n^2)$ that conjugates one to the other. Moreover, there exist conjugate pairs of elements of $F$ of length at most $n$ such that the shortest conjugator between them has length $\Omega(n^2)$. This latter statement holds for $T$ and $V$ as well.


title: Terminus: A Versatile Simulator for Space-based Telescopes

abstract: Space-based telescopes offer unparalleled opportunities for characterising exoplanets, Solar System bodies and stellar objects. However, observatories in low Earth orbits (e.g. Hubble, CHEOPS, Twinkle and an ever increasing number of cubesats) cannot always be continuously pointed at a target due to Earth obscuration. For exoplanet observations consisting of transit, or eclipse, spectroscopy this causes gaps in the light curve, which reduces the information content and can diminish the science return of the observation. Terminus, a time-domain simulator, has been developed to model the occurrence of these gaps to predict the potential impact on future observations. The simulator is capable of radiometrically modelling exoplanet observations as well as producing light curves and spectra. Here, Terminus is baselined on the Twinkle mission but the model can be adapted for any space-based telescope and is especially applicable to those in a low-Earth orbit. Terminus also has the capability to model observations of other targets such as asteroids or brown dwarfs.


title: Multi-Time Attention Networks for Irregularly Sampled Time Series

abstract: Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health records, which are sparse, irregularly sampled, and multivariate. In this paper, we propose a new deep learning framework for this setting that we call Multi-Time Attention Networks. Multi-Time Attention Networks learn an embedding of continuous-time values and use an attention mechanism to produce a fixed-length representation of a time series containing a variable number of observations. We investigate the performance of this framework on interpolation and classification tasks using multiple datasets. Our results show that the proposed approach performs as well or better than a range of baseline and recently proposed models while offering significantly faster training times than current state-of-the-art methods.


title: Second- and third-order optical susceptibilities in bidimensional semiconductors near excitons states

abstract: Semiconducting Transition Metal Dichalcogenides (TMDs) have significant nonlinear optical effects. In this work we have used second-harmonic generation (SHG) and the four-wave mixing (FWM) spectroscopy in resonance with the excitons in MoS2, MoSe2, and WS2 monolayers to characterize the nonlinear optical properties of these materials. We show that trions and excitons are responsible for enhancing the nonlinear optical response, and determine the exciton and trion energies by comparing with the photoluminescence spectra. Moreover, we extract the second and third order optical sheet susceptibility near exciton energies and compare with values found in the literature. We also demonstrate the ability to generate different nonlinear effects in a wide spectral range in the visible region for monolayer MoS2, opening the possibility of using two-dimensional materials for nonlinear optoelectronic and photonic applications.


title: Identity-aware Graph Neural Networks

abstract: Message passing Graph Neural Networks (GNNs) provide a powerful modeling framework for relational data. However, the expressive power of existing GNNs is upper-bounded by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test, which means GNNs that are not able to predict node clustering coefficients and shortest path distances, and cannot differentiate between different d-regular graphs. Here we develop a class of message passing GNNs, named Identity-aware Graph Neural Networks (ID-GNNs), with greater expressive power than the 1-WL test. ID-GNN offers a minimal but powerful solution to limitations of existing GNNs. ID-GNN extends existing GNN architectures by inductively considering nodes' identities during message passing. To embed a given node, ID-GNN first extracts the ego network centered at the node, then conducts rounds of heterogeneous message passing, where different sets of parameters are applied to the center node than to other surrounding nodes in the ego network. We further propose a simplified but faster version of ID-GNN that injects node identity information as augmented node features. Altogether, both versions of ID-GNN represent general extensions of message passing GNNs, where experiments show that transforming existing GNNs to ID-GNNs yields on average 40% accuracy improvement on challenging node, edge, and graph property prediction tasks; 3% accuracy improvement on node and graph classification benchmarks; and 15% ROC AUC improvement on real-world link prediction tasks. Additionally, ID-GNNs demonstrate improved or comparable performance over other task-specific graph networks.


title: Efficacy of simple continuum models for diverse granular intrusions

abstract: Granular intrusion is commonly observed in natural and human-made settings. Unlike typical solids and fluids, granular media can simultaneously display fluid-like and solid-like characteristics in a variety of intrusion scenarios. This multi-phase behavior increases the difficulty of accurately modeling these and other yielding (or flowable) materials. Micro-scale modeling methods, such as DEM (Discrete Element Method), capture this behavior by modeling the media at the grain scale, but there is often interest in the macro-scale characterizations of such systems. We examine the efficacy of a macro-scale continuum approach in modeling and understanding the physics of various macroscopic phenomena in a variety of granular intrusion cases using two basic frictional yielding constitutive models. We compare predicted granular force response and material flow to experimental data in four quasi-2D intrusion cases: (1) depth-dependent force response in horizontal submerged-intruder motion; (2) separation dependent drag variation in parallel-plate vertical-intrusion; (3) initial-density-dependent drag fluctuations in free surface plowing, and (4) flow zone development during vertical plate intrusions in under-compacted granular media. Our continuum modeling approach captures the flow process and drag forces while providing key meso- and macro-scopic insights. The modeling results are then compared to experimental data. Our study highlights how continuum modeling approaches provide an alternative for efficient modeling as well as a conceptual understanding of various granular intrusion phenomena.


title: Reconfigurable Intelligent Surface for Massive Connectivity

abstract: With the rapid development of Internet of Things (IoT), massive machine-type communication has become a promising application scenario, where a large number of devices transmit sporadically to a base station (BS). Reconfigurable intelligent surface (RIS) has been recently proposed as an innovative new technology to achieve energy efficiency and coverage enhancement by establishing favorable signal propagation environments, thereby improving data transmission in massive connectivity. Nevertheless, the BS needs to detect active devices and estimate channels to support data transmission in RIS-assisted massive access systems, which yields unique challenges. This paper shall consider an RIS-assisted uplink IoT network and aims to solve the RIS-related activity detection and channel estimation problem, where the BS detects the active devices and estimates the separated channels of the RIS-to-device link and the RIS-to-BS link. Due to limited scattering between the RIS and the BS, we model the RIS-to-BS channel as a sparse channel. As a result, by simultaneously exploiting both the sparsity of sporadic transmission in massive connectivity and the RIS-to-BS channels, we formulate the RIS-related activity detection and channel estimation problem as a sparse matrix factorization problem. Furthermore, we develop an approximate message passing (AMP) based algorithm to solve the problem based on Bayesian inference framework and reduce the computational complexity by approximating the algorithm with the central limit theorem and Taylor series arguments. Finally, extensive numerical experiments are conducted to verify the effectiveness and improvements of the proposed algorithm.