title: Approaching Digital Humanities at the University: a Cultural Challenge

abstract: The University of Bologna has a long tradition in Digital Humanities, both at the level of research and teaching. In this article, we want to introduce some experiences in developing new educational models based on the idea of transversal learning, collaborative approaches and projects-oriented outputs, together with the definition of research fields within this vast domain, accompanied by practical examples. The creation of an international master's degree (DHDK), a PhD (CHeDE) and a research centre (/DH.arc) are the results of refining our notion of Digital Humanities in a new bidirectional way: to reflect on computational methodologies and models in the cultural sphere and to suggest a cultural approach to Informatics.


title: Spin-wave dynamics in the KCeS2 delafossite: A theoretical description of powder inelastic neutron-scattering data

abstract: Layered rare-earth delafossites $ARX_2$ with $R$ = Yb(III) or Ce(III) have received a lot of interest as potential hosts for a quantum spin-liquid ground state. Some systems of this family that show no long-range order down to the lowest measured temperatures, such as NaYbO$_2$, NaYbS$_2$, and NaYbSe$_2$, are presumed to be in a quantum spin-liquid state. However, other isostructural compounds are known to order antiferromagnetically at subkelvin temperatures. Among them, KCeS$_2$ exhibits stripe-$yz$ magnetic order in the triangular-lattice planes that sets in below 400 mK. Here we investigate the spin-wave spectrum of this ordered phase with powder inelastic neutron scattering and describe it using a model Hamiltonian obtained from first-principles calculations based on the complete $|J,m_J\rangle$ multiplet description of the Ce sites with an anisotropic nearest-neighbor exchange interaction. Combing the current understanding of the exchange interaction in the systems with the effects of texturing in the powder, we have been able to model the inelastic neutron scattering spectrum with high fidelity.


title: Single-Particle Quantum Mechanics of the Free Klein-Gordon Equation with Lorentz Violation

abstract: In spite of its problems with interactions, the first-quantized Klein-Gordon equation is a satisfactory theory of free spinless particles. Moreover, the usual theory may be extended to describe Lorentz-violating behavior, of the same types that exist can in second-quantized scalar field theories. However, because the construction of the theory requires a restriction to positive-energy modes, the Hilbert space inner product and the position operator depend explicitly on the form of the Lorentz violation.


title: Learning to Solve Multiple-TSP with Time Window and Rejections via Deep Reinforcement Learning

abstract: We propose a manager-worker framework based on deep reinforcement learning to tackle a hard yet nontrivial variant of Travelling Salesman Problem (TSP), \ie~multiple-vehicle TSP with time window and rejections (mTSPTWR), where customers who cannot be served before the deadline are subject to rejections. Particularly, in the proposed framework, a manager agent learns to divide mTSPTWR into sub-routing tasks by assigning customers to each vehicle via a Graph Isomorphism Network (GIN) based policy network. A worker agent learns to solve sub-routing tasks by minimizing the cost in terms of both tour length and rejection rate for each vehicle, the maximum of which is then fed back to the manager agent to learn better assignments. Experimental results demonstrate that the proposed framework outperforms strong baselines in terms of higher solution quality and shorter computation time. More importantly, the trained agents also achieve competitive performance for solving unseen larger instances.


title: Deep Variational Free Energy Approach to Dense Hydrogen

abstract: We developed a deep generative model-based variational free energy approach to the equations of state of dense hydrogen. We employ a normalizing flow network to model the proton Boltzmann distribution and a fermionic neural network to model the electron wave function at given proton positions. By jointly optimizing the two neural networks we reached a comparable variational free energy to the previous coupled electron-ion Monte Carlo calculation. The predicted equation of state of dense hydrogen under planetary conditions is denser than the findings of ab initio molecular dynamics calculation and empirical chemical model. Moreover, direct access to the entropy and free energy of dense hydrogen opens new opportunities in planetary modeling and high-pressure physics research.


title: Analysis of Self-Attention Head Diversity for Conformer-based Automatic Speech Recognition

abstract: Attention layers are an integral part of modern end-to-end automatic speech recognition systems, for instance as part of the Transformer or Conformer architecture. Attention is typically multi-headed, where each head has an independent set of learned parameters and operates on the same input feature sequence. The output of multi-headed attention is a fusion of the outputs from the individual heads. We empirically analyze the diversity between representations produced by the different attention heads and demonstrate that the heads become highly correlated during the course of training. We investigate a few approaches to increasing attention head diversity, including using different attention mechanisms for each head and auxiliary training loss functions to promote head diversity. We show that introducing diversity-promoting auxiliary loss functions during training is a more effective approach, and obtain WER improvements of up to 6% relative on the Librispeech corpus. Finally, we draw a connection between the diversity of attention heads and the similarity of the gradients of head parameters.


title: Feynman-Kac formula for BSDEs with jumps and time delayed generators associated to path-dependent nonlinear Kolmogorov equations

abstract: We consider a system of Forward Backward Stochastic Differential Equations (FBSDEs), with time delayed generator and driven by L\`evy-type noise. We establish a non linear Feynman Kac representation formula associating the solution given by the FBSDEs-system to the solution of a path dependent nonlinear Kolmogorov equation with both delay and jumps. Obtained results are then applied to study a generalization of the so-called Large Investor Problem where the stock price evolves according to a jump-diffusion dynamic.


title: Indefinite and Bidirectional Near Infrared Nanocrystal Photoswitching

abstract: Materials whose luminescence can be switched by optical stimulation drive technologies ranging from superresolution imaging1-4, nanophotonics5, and optical data storage6-8, to targeted pharmacology, optogenetics, and chemical reactivity9. These photoswitchable probes, including organic fluorophores and proteins, are prone to photodegradation, and often require phototoxic doses of ultraviolet (UV) or visible light. Colloidal inorganic nanoparticles have significant stability advantages over existing photoswitchable materials, but the ability to switch emission bidirectionally, particularly with NIR light, has not been reported with nanoparticles. Here, we present 2-way, near-infrared (NIR) photoswitching of avalanching nanoparticles (ANPs), showing full optical control of upconverted emission using phototriggers in the NIR-I and NIR-II spectral regions useful for subsurface imaging. Employing single-step photodarkening10-13 and photobrightening12,14-18, we demonstrate indefinite photoswitching of individual nanoparticles (>1000 cycles over 7 h) in ambient or aqueous conditions without measurable photodegradation. Critical steps of the photoswitching mechanism are elucidated by modeling and by measuring the photon avalanche properties of single ANPs in both bright and dark states. Unlimited, reversible photoswitching of ANPs enables indefinitely rewritable 2D and 3D multi-level optical patterning of ANPs, as well as optical nanoscopy with sub-{\AA} localization superresolution that allows us to distinguish individual ANPs within tightly packed clusters.


title: A solution to the degree-d twisted rabbit problem

abstract: We solve generalizations of Hubbard's twisted rabbit problem for analogues of the rabbit polynomial of degree $d\geq 2$. The twisted rabbit problem asks: when a certain quadratic polynomial, called the Douady Rabbit polynomial, is twisted by a cyclic subgroup of a mapping class group, to which polynomial is the resulting map equivalent (as a function of the power of the generator)? The solution to the original quadratic twisted rabbit problem, given by Bartholdi--Nekrashevych, depended on the 4-adic expansion of the power of the mapping class by which we twist. In this paper, we provide a solution that depends on the $d^2$-adic expansion of the power of the mapping class element by which we twist.


title: Study of Spherical Array Target for Long-Baseline Neutrino Experiment

abstract: Spherical Array Target was studied by implementing the geometry in LBNE's Beam Simulation source code g4lbne version v3r2p4 and Monte Carlo. To compare with Nominal LBNE target, unoscillated Far Detector neutrino flux was produced using different parameters: sphere diameter 17mm and 13mm, different longitudinal positions, two interaction length and less, beam size R/3 and 1.7mm, and beam offset from 50 $\mu$m to 1mm. The 1.86 interaction length (901mm), 17mm diameter target, with beam size 1.7mm gives higher $\nu_{\mu}$ flux up to 10\% from 0-3.5 GeV, and suppresses flux up to 70\% at energy higher than 3.5 GeV.


title: Evaluating individualized treatment effect predictions: a model-based perspective on discrimination and calibration assessment

abstract: In recent years, there has been a growing interest in the prediction of individualized treatment effects. While there is a rapidly growing literature on the development of such models, there is little literature on the evaluation of their performance. In this paper, we aim to facilitate the validation of prediction models for individualized treatment effects. The estimands of interest are defined as based on the potential outcomes framework, which facilitates a comparison of existing and novel measures. In particular, we examine existing measures of measures of discrimination for benefit (variations of the c-for-benefit), and propose model-based extensions to the treatment effect setting for discrimination and calibration metrics that have a strong basis in outcome risk prediction. The main focus is on randomized trial data with binary endpoints and on models that provide individualized treatment effect predictions and potential outcome predictions. We use simulated data to provide insight into the characteristics of the examined discrimination and calibration statistics under consideration, and further illustrate all methods in a trial of acute ischemic stroke treatment. The results show that the proposed model-based statistics had the best characteristics in terms of bias and accuracy. While resampling methods adjusted for the optimism of performance estimates in the development data, they had a high variance across replications that limited their accuracy. Therefore, individualized treatment effect models are best validated in independent data. To aid implementation, a software implementation of the proposed methods was made available in R.


title: Strongly-ordered infrared limits for subtraction counterterms from factorisation

abstract: After a brief introduction to the problem of subtraction of infrared divergences for high-order collider observables, we present a preliminary study of strongly-ordered soft and collinear multiple radiation from the point of view of factorisation. We show that the matrix elements of fields and Wilson lines that describe soft and collinear radiation in factorised scattering amplitudes can be re-factorised in strongly-ordered limits, providing a systematic method to compute them, to characterise their singularity structure, and to build local subtraction counterterms for strongly-ordered configurations. Our results provide tools for a detailed organisation of subtraction algorithms, in principle to all orders in perturbation theory.


title: VL-Taboo: An Analysis of Attribute-based Zero-shot Capabilities of Vision-Language Models

abstract: Vision-language models trained on large, randomly collected data had significant impact in many areas since they appeared. But as they show great performance in various fields, such as image-text-retrieval, their inner workings are still not fully understood. The current work analyses the true zero-shot capabilities of those models. We start from the analysis of the training corpus assessing to what extent (and which of) the test classes are really zero-shot and how this correlates with individual classes performance. We follow up with the analysis of the attribute-based zero-shot learning capabilities of these models, evaluating how well this classical zero-shot notion emerges from large-scale webly supervision. We leverage the recently released LAION400M data corpus as well as the publicly available pretrained models of CLIP, OpenCLIP, and FLAVA, evaluating the attribute-based zero-shot capabilities on CUB and AWA2 benchmarks. Our analysis shows that: (i) most of the classes in popular zero-shot benchmarks are observed (a lot) during pre-training; (ii) zero-shot performance mainly comes out of models' capability of recognizing class labels, whenever they are present in the text, and a significantly lower performing capability of attribute-based zeroshot learning is only observed when class labels are not used; (iii) the number of the attributes used can have a significant effect on performance, and can easily cause a significant performance decrease.


title: Quantum noise spectroscopy as an incoherent imaging problem

abstract: I point out the mathematical correspondence between an incoherent imaging model proposed by my group in the study of quantum-inspired superresolution [Tsang, Nair, and Lu, Physical Review X 6, 031033 (2016)] and a noise spectroscopy model also proposed by us [Tsang and Nair, Physical Review A 86, 042115 (2012); Ng et al., Physical Review A 93, 042121 (2016)]. Both can be regarded as random displacement models, where the probability measure for the random displacement depends on unknown parameters. The spatial-mode demultiplexing (SPADE) method proposed for imaging is analogous to the spectral photon counting method proposed in Ng et al. (2016) for optical phase noise spectroscopy -- Both methods are discrete-variable measurements that are superior to direct displacement measurements (direct imaging or homodyne detection) and can achieve the respective quantum limits. Inspired by SPADE, I propose a modification of spectral photon counting when the input field is squeezed -- simply unsqueeze the output field before spectral photon counting. I show that this method is quantum-optimal and far superior to homodyne detection for both parameter estimation and detection, thus solving the open problems in Tsang and Nair (2012) and Ng et al. (2016).


title: On floating point precision in computational fluid dynamics using OpenFOAM

abstract: Thanks to the computational power of modern cluster machines, numerical simulations can provide, with an unprecedented level of details, new insights into fluid mechanics. However, taking full advantage of this hardware remains challenging since data communication remains a significant bottleneck to reaching peak performances. Reducing floating point precision is a simple and effective way to reduce data movement and improve the computational speed of most applications. Nevertheless, special care needs to be taken to ensure the quality and convergence of computed solutions, especially when dealing with complex fluid simulations. In this work, we analyse the impact of reduced (single and mixed compared to double) precision on computational performance and accuracy for computational fluid dynamics. Using the open source library OpenFOAM, we consider incompressible, compressible, and multiphase fluid solvers for testing on relevant benchmarks for flows in the laminar and turbulent regime and in the presence of shock waves. Computational gain and changes in the scalability of applications in reduced precision are also discussed. In particular, an ad hoc theoretical model for the strong scaling allows us to interpret and understand the observed behaviors, as a function of floating point precision and hardware specifics. Finally, we show how reduced precision can significantly speed up a hybrid CPU-GPU implementation, made available to OpenFOAM end-users recently, that simply relies on a GPU linear algebra solver developed by hardware vendors.


title: A Systematic Error in the Internal Friction Measurement of Coatings for Gravitational Waves Detectors

abstract: Low internal friction coatings are key components of advanced technologies such as optical atomic clocks and high-finesse optical cavity and often lie at the forefront of the most advanced experiments in Physics. Notably, increasing the sensitivity of gravitational-wave detectors depends in a very large part on developing new coatings, which entails developing more suitable methods and models to investigate their loss angle. In fact, the most sensitive region of the detection band in such detectors is limited by the coating thermal noise, which is related to the loss angle of the coating. Until now, models which describe only ideal physical properties have been adopted, wondering about the use of one or more loss angles to describe the mechanical properties of coatings. Here we show the presence of a systematic error ascribed to inhomogeneity of the sample at its edges in measuring the coating loss angle. We present a model for disk-shaped resonators, largely used in loss angle measurements, and we compare the theory with measurements showing how this systematic error impacts on the accuracy with which the loss model parameters are known.


title: Online Continual Learning via the Meta-learning Update with Multi-scale Knowledge Distillation and Data Augmentation

abstract: Continual learning aims to rapidly and continually learn the current task from a sequence of tasks. Compared to other kinds of methods, the methods based on experience replay have shown great advantages to overcome catastrophic forgetting. One common limitation of this method is the data imbalance between the previous and current tasks, which would further aggravate forgetting. Moreover, how to effectively address the stability-plasticity dilemma in this setting is also an urgent problem to be solved. In this paper, we overcome these challenges by proposing a novel framework called Meta-learning update via Multi-scale Knowledge Distillation and Data Augmentation (MMKDDA). Specifically, we apply multiscale knowledge distillation to grasp the evolution of long-range and short-range spatial relationships at different feature levels to alleviate the problem of data imbalance. Besides, our method mixes the samples from the episodic memory and current task in the online continual training procedure, thus alleviating the side influence due to the change of probability distribution. Moreover, we optimize our model via the meta-learning update resorting to the number of tasks seen previously, which is helpful to keep a better balance between stability and plasticity. Finally, our experimental evaluation on four benchmark datasets shows the effectiveness of the proposed MMKDDA framework against other popular baselines, and ablation studies are also conducted to further analyze the role of each component in our framework.


title: Bit-Line Computing for CNN Accelerators Co-Design in Edge AI Inference

abstract: By supporting the access of multiple memory words at the same time, Bit-line Computing (BC) architectures allow the parallel execution of bit-wise operations in-memory. At the array periphery, arithmetic operations are then derived with little additional overhead. Such a paradigm opens novel opportunities for Artificial Intelligence (AI) at the edge, thanks to the massive parallelism inherent in memory arrays and the extreme energy efficiency of computing in-situ, hence avoiding data transfers. Previous works have shown that BC brings disruptive efficiency gains when targeting AI workloads, a key metric in the context of emerging edge AI scenarios. This manuscript builds on these findings by proposing an end-to-end framework that leverages BC-specific optimizations to enable high parallelism and aggressive compression of AI models. Our approach is supported by a novel hardware module performing real-time decoding, as well as new algorithms to enable BC-friendly model compression. Our hardware/software approach results in a 91% energy savings (for a 1% accuracy degradation constraint) regarding state-of-the-art BC computing approaches.


title: Convergent, with rates, methods for normalized infinity Laplace, and related, equations

abstract: We propose a monotone, and consistent numerical scheme for the approximation of the Dirichlet problem for the normalized Infinity Laplacian, which could be related to the family of so--called two--scale methods. We show that this method is convergent, and prove rates of convergence. These rates depend not only on the regularity of the solution, but also on whether or not the right hand side vanishes. Some extensions to this approach, like obstacle problems and symmetric Finsler norms are also considered.


title: On the collective properties of quantum media

abstract: We discuss the hydrodynamic representation of a wide class of quantum media exhibiting similar elementary excitations and dispersion properties. The representation covers quantum systems characterized by any type of (long-range) self-interaction, associated with an arbitrary potential. It also accounts for possible nonlinearities, which may arise e.g., due to short-range interactions (collisions) in the case of bosons, or from the Pauli exclusion principle for fermions. The approach equally applies to various physical scenarios, such as self-gravitating quantum media (e.g., dark matter), quantum plasmas, Bose-Einstein condensates, and non-condensed cold atomic clouds. We discuss the formal analogies that can be drawn between these different systems and how they can be used to realize laboratory experiments emulating gravitational phenomena, especially in the context of alternative theories of gravity. To substantiate our point, we elaborate more closely on the case of non-minimal matter-curvature coupling gravity theories.


title: D-Lite: Navigation-Oriented Compression of 3D Scene Graphs for Multi-Robot Collaboration

abstract: For a multi-robot team that collaboratively explores an unknown environment, it is of vital importance that collected information is efficiently shared among robots in order to support exploration and navigation tasks. Practical constraints of wireless channels, such as limited bandwidth, urge robots to carefully select information to be transmitted. In this paper, we consider the case where environmental information is modeled using a 3D Scene Graph, a hierarchical map representation that describes both geometric and semantic aspects of the environment. Then, we leverage graph-theoretic tools, namely graph spanners, to design greedy algorithms that efficiently compress 3D Scene Graphs with the aim of enabling communication between robots under bandwidth constraints. Our compression algorithms are navigation-oriented in that they are designed to approximately preserve shortest paths between locations of interest, while meeting a user-specified communication budget constraint. The effectiveness of the proposed algorithms is demonstrated in synthetic robot navigation experiments in a realistic simulator. A video abstract is available at https://youtu.be/nKYXU5VC6A8.


title: CU-Net: Real-Time High-Fidelity Color Upsampling for Point Clouds

abstract: Point cloud upsampling is essential for high-quality augmented reality, virtual reality, and telepresence applications, due to the capture, processing, and communication limitations of existing technologies. Although geometry upsampling to densify a point cloud's coordinates has been well studied, the upsampling of the color attributes has been largely overlooked. In this paper, we propose CU-Net, the first deep-learning point cloud color upsampling model that enables low latency and high visual fidelity operation. CU-Net achieves linear time and space complexity by leveraging a feature extractor based on sparse convolution and a color prediction module based on neural implicit function. Therefore, CU-Net is theoretically guaranteed to be more efficient than most existing methods with quadratic complexity. Experimental results demonstrate that CU-Net can colorize a photo-realistic point cloud with nearly a million points in real time, while having notably better visual performance than baselines. Besides, CU-Net can adapt to arbitrary upsampling ratios and unseen objects without retraining. Our source code is available at https://github.com/UMass-LIDS/cunet.


title: Generate synthetic samples from tabular data

abstract: Generating new samples from data sets can mitigate extra expensive operations, increased invasive procedures, and mitigate privacy issues. These novel samples that are statistically robust can be used as a temporary and intermediate replacement when privacy is a concern. This method can enable better data sharing practices without problems relating to identification issues or biases that are flaws for an adversarial attack.


title: Analysing the Predictivity of Features to Characterise the Search Space

abstract: Exploring search spaces is one of the most unpredictable challenges that has attracted the interest of researchers for decades. One way to handle unpredictability is to characterise the search spaces and take actions accordingly. A well-characterised search space can assist in mapping the problem states to a set of operators for generating new problem states. In this paper, a landscape analysis-based set of features has been analysed using the most renown machine learning approaches to determine the optimal feature set. However, in order to deal with problem complexity and induce commonality for transferring experience across domains, the selection of the most representative features remains crucial. The proposed approach analyses the predictivity of a set of features in order to determine the best categorization.


title: Software and techniques for VLBI data processing and analysis

abstract: Very-long-baseline interferometry (VLBI) is a challenging observational technique, which requires in-depth knowledge about radio telescope instrumentation, interferometry, and the handling of noisy data. The reduction of the raw data is mostly left to the scientists and demands the use of complex algorithms implemented in comprehensive software packages. The correct application of these algorithms necessitates a good understanding of the underlying techniques and physics that are at play. The verification of the processed data produced by the algorithms demands a thorough understanding of the underlying interferometric VLBI measurements. This review describes the latest techniques and algorithms that scientists should know about when analyzing VLBI data.


title: Patching Weak Convolutional Neural Network Models through Modularization and Composition

abstract: Despite great success in many applications, deep neural networks are not always robust in practice. For instance, a convolutional neuron network (CNN) model for classification tasks often performs unsatisfactorily in classifying some particular classes of objects. In this work, we are concerned with patching the weak part of a CNN model instead of improving it through the costly retraining of the entire model. Inspired by the fundamental concepts of modularization and composition in software engineering, we propose a compressed modularization approach, CNNSplitter, which decomposes a strong CNN model for $N$-class classification into $N$ smaller CNN modules. Each module is a sub-model containing a part of the convolution kernels of the strong model. To patch a weak CNN model that performs unsatisfactorily on a target class (TC), we compose the weak CNN model with the corresponding module obtained from a strong CNN model. The ability of the weak CNN model to recognize the TC can thus be improved through patching. Moreover, the ability to recognize non-TCs is also improved, as the samples misclassified as TC could be classified as non-TCs correctly. Experimental results with two representative CNNs on three widely-used datasets show that the averaged improvement on the TC in terms of precision and recall are 12.54% and 2.14%, respectively. Moreover, patching improves the accuracy of non-TCs by 1.18%. The results demonstrate that CNNSplitter can patch a weak CNN model through modularization and composition, thus providing a new solution for developing robust CNN models.


title: Automatic Segmentation of the Great Arteries for Computational Hemodynamic Assessment

abstract: Background: Computational fluid dynamics (CFD) is increasingly used to assess blood flow conditions in patients with congenital heart disease (CHD). This requires patient-specific anatomy, usually obtained from segmented 3D cardiovascular magnetic resonance (CMR) images. However, segmentation is time-consuming and needs expert input. This study aims to develop and validate a machine learning (ML) method for segmentation of the aorta and pulmonary arteries (PAs) for CFD studies. Methods: 90 CHD patients were retrospectively selected for this study. 3D CMR images were manually segmented to obtain ground-truth (GT) background, aorta and PA labels. These were used to train and optimize a U-Net model. Segmentation performance was primarily evaluated using Dice score. CFD simulations were set up from GT and ML segmentations using a semi-automatic meshing and simulation pipeline. Pressure and velocity fields were computed, and a mean average percentage error (MAPE) was calculated for each vessel pair. A secondary observer (SO) segmented the test dataset to assess inter-observer variability. Friedman tests were used to compare segmentation metrics and flow field errors. Results: The model's Dice score (ML vs GT) was 0.945 for the aorta and 0.885 for the PAs. Differences with the inter-observer Dice score (SO vs GT) and ML vs SO Dice scores were not statistically significant for either aorta or PAs. The ML vs GT MAPEs for pressure and velocity in the aorta were 10.1% and 4.1% respectively, and for the PAs 14.6% and 6.3%, respectively. Inter-observer (SO vs GT) and ML vs SO pressure and velocity MAPEs were of a similar magnitude to ML vs GT. Conclusions: The proposed method can successfully segment the great vessels for CFD, with errors similar to inter-observer variability. This reduces the time and effort needed for CFD analysis, making it more attractive for routine clinical use.


title: Reduced relative quantum entropy

abstract: We introduce the notion of reduced relative quantum entropy and prove that it is convex. This result is then used to give a simplified proof of a theorem of Lieb and Seiringer.


title: APTx: better activation function than MISH, SWISH, and ReLU's variants used in deep learning

abstract: Activation Functions introduce non-linearity in the deep neural networks. This nonlinearity helps the neural networks learn faster and efficiently from the dataset. In deep learning, many activation functions are developed and used based on the type of problem statement. ReLU's variants, SWISH, and MISH are goto activation functions. MISH function is considered having similar or even better performance than SWISH, and much better than ReLU. In this paper, we propose an activation function named APTx which behaves similar to MISH, but requires lesser mathematical operations to compute. The lesser computational requirements of APTx does speed up the model training, and thus also reduces the hardware requirement for the deep learning model.


title: LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning

abstract: Can foundation models be guided to execute tasks involving legal reasoning? We believe that building a benchmark to answer this question will require sustained collaborative efforts between the computer science and legal communities. To that end, this short paper serves three purposes. First, we describe how IRAC-a framework legal scholars use to distinguish different types of legal reasoning-can guide the construction of a Foundation Model oriented benchmark. Second, we present a seed set of 44 tasks built according to this framework. We discuss initial findings, and highlight directions for new tasks. Finally-inspired by the Open Science movement-we make a call for the legal and computer science communities to join our efforts by contributing new tasks. This work is ongoing, and our progress can be tracked here: https://github.com/HazyResearch/legalbench.


title: Plus constructions, plethysm, and unique factorization categories with applications to graphs and operad-like theories

abstract: Plus constructions are at the nexus of relative bimodules, indexed enrichments, modules over functors and graphical calculus. We define several of these in different settings. The first takes a category to a monoidal category and the second is an endofunctor for monoidal categories. There are localized and unital versions of these constructions. These serve three main purposes. The first is to define a notion that generalizes modules over algebras to monoidal functors and modules. This is realized via indexed enrichment. The second is to provide a theory of twists, and the third is to classify relative bimodules over a given groupoid. In this guise they classify bi-module monoids with respect to a plethysm products over a the homomorphisms of a category thought of as a bi-module of the underlying groupoid. The presented plus constructions generalize the plus construction for Feynman categories and explain the appearance of the plethysm monoid definition for operads, properads and props. To this end we introduce a new notion of unique factorization category (UFC) and show that the plus construction of a hereditary UFC is a Feynman category. Just as finite sets are the fundamental indexing Feynman category cospans are the fundamental indexing category hereditary UFC. We give a local presentation of these constructions as well as a global description of the morphisms and a graphical version using decorated groupoid colored graphs. We furthermore consider an enriched setting. The global presentation utilizes pasting diagram from 2-categories or equivalently double categories, which is of independent interest. The graphical description is a consequence of the local definition. In the special case of a UFC there is also a formalism with groupoid colored graphs. In both cases levels appear when one adds units, which clarifies their role in this type of construction.


title: What You See is What You Grasp: User-Friendly Grasping Guided by Near-eye-tracking

abstract: This work presents a next-generation human-robot interface that can infer and realize the user's manipulation intention via sight only. Specifically, we develop a system that integrates near-eye-tracking and robotic manipulation to enable user-specified actions (e.g., grasp, pick-and-place, etc), where visual information is merged with human attention to create a mapping for desired robot actions. To enable sight guided manipulation, a head-mounted near-eye-tracking device is developed to track the eyeball movements in real-time, so that the user's visual attention can be identified. To improve the grasping performance, a transformer based grasp model is then developed. Stacked transformer blocks are used to extract hierarchical features where the volumes of channels are expanded at each stage while squeezing the resolution of feature maps. Experimental validation demonstrates that the eye-tracking system yields low gaze estimation error and the grasping system yields promising results on multiple grasping datasets. This work is a proof of concept for gaze interaction-based assistive robot, which holds great promise to help the elder or upper limb disabilities in their daily lives. A demo video is available at https://www.youtube.com/watch?v=yuZ1hukYUrM


title: Role of long-range van der Waals interaction in the coefficient of static friction

abstract: To investigate the role of long-range van der Waals interactions in static friction, we derive an analytic expression for the coefficient of static friction $\mu_s$ between two thin layers of polarizable materials under zero load. For simplicity, we model the surface roughness with sinusoidal corrugations and calculate the interaction energy perturbatively up to the second order in corrugation amplitude. The ratio of corresponding maximum lateral Casimir force to normal Casimir force is defined as the coefficient of static friction, which is found to be independent of the dielectric properties of the materials. It depends on the geometric properties, like interlayer separation, corrugation amplitude, and wavelength of the corrugation. As a proof of concept, our predicted values of $\mu_s$ for the 2D van der Waals materials graphene and hexagonal boron nitride are in reasonable agreement with previously reported values in the literature. This simplistic model could be generalized by incorporating other forces, such as the frequency-dependent contributions of van der Waals interactions and electrostatic interactions.


title: Phonon-induced breakdown of Thouless pumping in the Rice-Mele-Holstein model

abstract: Adiabatic and periodic variation of the lattice parameters can make it possible to transport charge through a system even without net external electric or magnetic fields, known as Thouless charge pumping. The amount of charge pumped in a cycle is quantized and entirely determined by the system's topology, which is robust against perturbations such as disorder and interactions. However, coupling to the environment may play a vital role in topological transport in many-body systems. We study the topological Thouless pumping, where the charge carriers interact with local optical phonons. The semi-classical multi-trajectory Ehrenfest method is employed to treat the phonon trajectories classically and charge carriers quantum mechanically. We find a breakdown of the quantized charge transport in the presence of phonons. It happens for any finite electron-phonon coupling strength at the resonance condition when the pumping frequency matches the phonon frequency, and it takes finite phonon coupling strength away from the resonance. Moreover, there exist parameter regimes with non-quantized negative and positive charge transport. The modified effective pumping path due to electron-phonon coupling accurately explains the underlying physics. In the large coupling regime where the pumping disappears, the phonons are found to eliminate the staggering of the onsite potentials, which is necessary for the pumping protocol. Finally, we present a stability diagram of quantized pumping as a function of time period of pumping and phonon coupling strength.


title: Clustering-based Imputation for Dropout Buyers in Large-scale Online Experimentation

abstract: In online experimentation, appropriate metrics (e.g., purchase) provide strong evidence to support hypotheses and enhance the decision-making process. However, incomplete metrics are frequently occurred in the online experimentation, making the available data to be much fewer than the planned online experiments (e.g., A/B testing). In this work, we introduce the concept of dropout buyers and categorize users with incomplete metric values into two groups: visitors and dropout buyers. For the analysis of incomplete metrics, we propose a clustering-based imputation method using $k$-nearest neighbors. Our proposed imputation method considers both the experiment-specific features and users' activities along their shopping paths, allowing different imputation values for different users. To facilitate efficient imputation of large-scale data sets in online experimentation, the proposed method uses a combination of stratification and clustering. The performance of the proposed method is compared to several conventional methods in both simulation studies and a real online experiment at eBay.


title: A Stakeholder-Centered View on Fairness in Music Recommender Systems

abstract: Our narrative literature review acknowledges that, although there is an increasing interest in recommender system fairness in general, the music domain has received relatively little attention in this regard. However, addressing fairness of music recommender systems (MRSs) is highly important because the performance of these systems considerably impacts both the users of music streaming platforms and the artists providing music to those platforms. The distinct needs that these stakeholder groups may have, and the different aspects of fairness that therefore should be considered, make for a challenging research field with ample opportunities for improvement. The review first outlines current literature on MRS fairness from the perspective of each stakeholder and the stakeholders combined, and then identifies promising directions for future research. The two open questions arising from the review are as follows: (i) In the MRS field, only limited data is publicly available to conduct fairness research; most datasets either originate from the same source or are proprietary (and, thus, not widely accessible). How can we address this limited data availability? (ii) Overall, the review shows that the large majority of works analyze the current situation of MRS fairness, whereas only few works propose approaches to improve it. How can we move forward to a focus on improving fairness aspects in these recommender systems? At FAccTRec '22, we emphasize the specifics of addressing RS fairness in the music domain.


title: Non-cosmological, Non-Doppler Relativistic Frequency Shift over Astronomical Distances

abstract: We investigate in detail an apparently unnoticed consequence of special relativity. It consists in time dilation/contraction and frequency shift for emitted light affecting accelerated reference frames at astronomical distances from an inertial observer. The frequency shift is non-cosmological and non-Doppler in nature. We derive the main formulae and compare their predictions with the astronomical data available for Proxima Centauri. We found no correspondence with observations. Since the implications of the new time dilation/contraction and frequency shift are blatantly paradoxical, we do not expect to find one. By all indications, we are dealing with a genuine, and not a merely apparent, relativity paradox.


title: A Scalable Recommendation Engine for New Users and Items

abstract: In many digital contexts such as online news and e-tailing with many new users and items, recommendation systems face several challenges: i) how to make initial recommendations to users with little or no response history (i.e., cold-start problem), ii) how to learn user preferences on items (test and learn), and iii) how to scale across many users and items with myriad demographics and attributes. While many recommendation systems accommodate aspects of these challenges, few if any address all. This paper introduces a Collaborative Filtering (CF) Multi-armed Bandit (B) with Attributes (A) recommendation system (CFB-A) to jointly accommodate all of these considerations. Empirical applications including an offline test on MovieLens data, synthetic data simulations, and an online grocery experiment indicate the CFB-A leads to substantial improvement on cumulative average rewards (e.g., total money or time spent, clicks, purchased quantities, average ratings, etc.) relative to the most powerful extant baseline methods.


title: Hierarchical Conversational Preference Elicitation with Bandit Feedback

abstract: The recent advances of conversational recommendations provide a promising way to efficiently elicit users' preferences via conversational interactions. To achieve this, the recommender system conducts conversations with users, asking their preferences for different items or item categories. Most existing conversational recommender systems for cold-start users utilize a multi-armed bandit framework to learn users' preference in an online manner. However, they rely on a pre-defined conversation frequency for asking about item categories instead of individual items, which may incur excessive conversational interactions that hurt user experience. To enable more flexible questioning about key-terms, we formulate a new conversational bandit problem that allows the recommender system to choose either a key-term or an item to recommend at each round and explicitly models the rewards of these actions. This motivates us to handle a new exploration-exploitation (EE) trade-off between key-term asking and item recommendation, which requires us to accurately model the relationship between key-term and item rewards. We conduct a survey and analyze a real-world dataset to find that, unlike assumptions made in prior works, key-term rewards are mainly affected by rewards of representative items. We propose two bandit algorithms, Hier-UCB and Hier-LinUCB, that leverage this observed relationship and the hierarchical structure between key-terms and items to efficiently learn which items to recommend. We theoretically prove that our algorithm can reduce the regret bound's dependency on the total number of items from previous work. We validate our proposed algorithms and regret bound on both synthetic and real-world data.


title: Verified Compositions of Neural Network Controllers for Temporal Logic Control Objectives

abstract: This paper presents a new approach to design verified compositions of Neural Network (NN) controllers for autonomous systems with tasks captured by Linear Temporal Logic (LTL) formulas. Particularly, the LTL formula requires the system to reach and avoid certain regions in a temporal/logical order. We assume that the system is equipped with a finite set of trained NN controllers. Each controller has been trained so that it can drive the system towards a specific region of interest while avoiding others. Our goal is to check if there exists a temporal composition of the trained NN controllers - and if so, to compute it - that will yield composite system behaviors that satisfy a user-specified LTL task for any initial system state belonging to a given set. To address this problem, we propose a new approach that relies on a novel integration of automata theory and recently proposed reachability analysis tools for NN-controlled systems. We note that the proposed method can be applied to other controllers, not necessarily modeled by NNs, by appropriate selection of the reachability analysis tool. We focus on NN controllers due to their lack of robustness. The proposed method is demonstrated on navigation tasks for aerial vehicles.


title: User recommendation system based on MIND dataset

abstract: Nowadays, it's a very significant way for researchers and other individuals to achieve their interests because it provides short solutions to satisfy their demands. Because there are so many pieces of information on the internet, news recommendation systems allow us to filter content and deliver it to the user in proportion to his desires and interests. RSs have three techniques: content-based filtering, collaborative filtering, and hybrid filtering. We will use the MIND dataset with our system, which was collected in 2019, the big challenge in this dataset because there is a lot of ambiguity and complex text processing. In this paper, will present our proposed recommendation system. The core of our system we have used the GloVe algorithm for word embeddings and representation. Besides, the Multi-head Attention Layer calculates the attention of words, to generate a list of recommended news. Finally, we achieve good results more than some other related works in AUC 71.211, MRR 35.72, nDCG@5 38.05, and nDCG@10 44.45.


title: Evaluation of cross section of elastic scattering for non-relativistic and relativistic particles by means of fundamental scattering formulas

abstract: In evaluating differential cross section of elastic scattering, different theories were applied to low-momentum and relativistic particles. For low-momentum motion, Lippmann-Schwinger scattering equation was applied, called fundamental formula; while for relativistic particles, a general scattering theory was used which calculates S matrix. In this paper, Lippmann-Schwinger equation is applied uniformly to both low-momentum and relativistic particles. The cross sections are valuated to the first order of Born approximation. One-body time-independent Green's functions for relativistic free particles are given. Compared to the general scattering theory, the fundamental theory has a clearer physical picture and the approximations made are more explicit.


title: How the Higgs potential got its shape

abstract: String-localized quantum field theory allows renormalizable couplings involving massive vector bosons, without invoking negative-norm states and compensating ghosts. We analyze the most general coupling of a massive vector boson to a scalar field, and find that the scalar field necessarily comes with a quartic potential which has the precise shape of the shifted Higgs potential. In other words: the shape of the Higgs potential has not to be assumed, but arises as a consistency condition among fundamental principles of QFT: Hilbert space, causality, and covariance. The consistency can be achieved by relaxing the localization properties of auxiliary quantities, including interacting charged fields, while observable fields and the S-matrix are not affected. This is an instance of the "L-V formalism" - a novel model-independent scheme that can be used as a tool to "renormalize the non-renormalizable" by adding a total derivative to the interaction.


title: Extensions of Lorentzian Hawking--Page Solutions with Null Singularities, Spacelike Singularities, and Cauchy horizons of Taub--NUT type

abstract: Starting from the Hawking--Page solutions, we consider the corresponding Lorentzian cone metrics. These represent cone interior scale-invariant vacuum solutions, defined in the chronological past of the scaling origin. We extend the Lorentzian Hawking--Page solutions to the cone exterior region in the class of $(4+1)$-dimensional scale-invariant vacuum solutions with an $SO(3)\times U(1)$ isometry, using the Kaluza--Klein reduction and the methods of Christodoulou. We prove that each Lorentzian Hawking--Page solution has extensions with a null curvature singularity, extensions with a spacelike curvature singularity, and extensions with a null Cauchy horizon of Taub--NUT type. These are all the possible extensions within our symmetry class. The extensions to spacetimes with a null curvature singularity can be used to construct $(4+1)$-dimensional asymptotically flat vacuum spacetimes with locally naked singularities, where the null curvature singularity is not preceded by trapped surfaces. We prove the instability of such locally naked singularities using the blue-shift effect of Christodoulou.


title: Unconventional Resistivity Scaling in Topological Semimetal CoSi

abstract: Nontrivial band topologies in semimetals lead to robust surface states that can contribute dominantly to the total conduction. This may result in reduced resistivity with decreasing feature size contrary to conventional metals, which may highly impact the semiconductor industry. Here we study the resistivity scaling of a representative topological semimetal CoSi using realistic band structures and Green's function methods. We show that there exists a critical thickness d_c dividing different scaling trends. Above d_c, when the defect density is low such that surface conduction dominates, resistivity reduces with decreasing thickness; when the defect density is high such that bulk conduction dominates, resistivity increases in as conventional metals. Below d_c, the persistent remnants of the surface states give rise to decreasing resistivity down to the ultrathin limit, unlike in topological insulators. The observed CoSi scaling can apply to broad classes of topological semimetals, providing guidelines for materials screening and engineering. Our study shows that topological semimetals bear the potential of overcoming the resistivity scaling challenges in back-end-of-line interconnect applications.


title: Testing The Existence of Single Photons

abstract: We demonstrated the existence of single photon by counting correlation of laser output of a birefringent $\beta$-Barium Borate (BBO) crystal. The best result of anti-correlation parameter violates the classical prediction for wavelike behavior of light by 80 standard deviations.


title: A Valid Quantization of The Particle in a Box Field Theory, and Well Beyond

abstract: The usual particle in a box is turned into a field theory, and its behavior is examined using canonical and affine quantizations. The resulting leads to a valid affine quantization of the particle in a box field theory, which points toward further valid quantizations of more realistic field theory models.


title: Inclusive Production Cross Sections at N3LO

abstract: We present for the first time the inclusive cross section for associated Higgs boson production with a massive gauge boson at next-to-next-to-next-to-leading order in QCD. Furthermore, we introduce n3loxs, a public, numerical program for the evaluation of inclusive cross sections at the third order in the strong coupling constant. Our tool allows to derive predictions for charged- and neutral-current Drell-Yan production, gluon- and bottom-quark-fusion Higgs boson production and Higgs boson associated production with a heavy gauge boson. We discuss perturbative and parton distribution function (PDF) uncertainties of the aforementioned processes. We perform a comparison of global PDF sets for a variety of process including associated Higgs boson production and observe $1\sigma$ deviations among predictions for several processes.


title: Neutron Production via Electron Capture by Coherent Protons

abstract: I consider coherent vibrational states of the quantum plasmas formed by the conduction electrons and protons inside a metal hydride. Such states can interact coherently through weak interaction to produce neutrons at very low energy. The existence of the vibrational coherent states is supported by a recent theoretical analysis showing that these configurations are characterized by an energy gap of the order of 1 eV per particle compared to the incoherent configurations and are therefore dynamically stable. When excited coherently, these configurations are able to transfer their energy, enabling highly energetic mechanisms. In this paper I show how it is possible to produce neutrons through such a coherent mechanism. The produced neutrons are essentially at rest and remain confined within the metal. The theory developed allows for the theoretical calculation of the production rate of neutrons.


title: Validation of classical modeling of single-photon pulse propagation

abstract: "It is well-known to those who know it" that single-photon interference experiments can be modeled classically [S. Barnett, arXiv:2207.14632 (2022)]. When a single-photon light pulse was split by a biprism good agreement with a classical fit was obtained and the photon was counted only once, consistent with a probabilistic interpr.etation [V. Jacques et al, Eur. Phys. J. D 35, 561 (2002)]. A justification for this "well know result of Quantum Optics" is implicit in [M. Hawton, Phys. Rev A 104, 052211 (2021)] where a real covariant field describing a single photon is first quantized. Here the theoretical basis of this result is reviewed and the theory is extended to multiphoton states and QED Fock space. The crucial role of the CPT theorem in coupling to charged matter and resolution of the photon localization problem is discussed.


title: Characterizing the Performance of Node-Aware Strategies for Irregular Point-to-Point Communication on Heterogeneous Architectures

abstract: Supercomputer architectures are trending toward higher computational throughput due to the inclusion of heterogeneous compute nodes. These multi-GPU nodes increase on-node computational efficiency, while also increasing the amount of data to be communicated and the number of potential data flow paths. In this work, we characterize the performance of irregular point-to-point communication with MPI on heterogeneous compute environments through performance modeling, demonstrating the limitations of standard communication strategies for both device-aware and staging-through-host communication techniques. Presented models suggest staging communicated data through host processes then using node-aware communication strategies for high inter-node message counts. Notably, the models also predict that node-aware communication utilizing all available CPU cores to communicate inter-node data leads to the most performant strategy when communicating with a high number of nodes. Model validation is provided via a case study of irregular point-to-point communication patterns in distributed sparse matrix-vector products. Importantly, we include a discussion on the implications model predictions have on communication strategy design for emerging supercomputer architectures.


title: What is a combinatorial interpretation?

abstract: In this survey we discuss the notion of combinatorial interpretation in the context of Algebraic Combinatorics and related areas. We approach the subject from the Computational Complexity perspective. We review many examples, state a workable definition, discuss many open problems, and present recent results on the subject.


title: On group invariants determined by modular group algebras: even versus odd characteristic

abstract: Let $p$ be a an odd prime and let $G$ be a finite $p$-group with cyclic commutator subgroup $G'$. We prove that the exponent and the abelianization of the centralizer of $G'$ in $G$ are determined by the group algebra of $G$ over any field of characteristic $p$. If, additionally, $G$ is $2$-generated then almost all the numerical invariants determining $G$ up to isomorphism are determined by the same group algebras; as a consequence the isomorphism type of the centralizer of $G'$ is determined. These claims are known to be false for $p=2$.


title: Interpolating geometries and the stretched dS$_2$ horizon

abstract: We investigate dilaton-gravity models whose solutions contain a large portion of the static patch of dS$_2$. The thermodynamic properties of these theories are considered both in the presence of a finite Dirichlet wall, as well as for asymptotically near-AdS$_2$ boundaries. We show that under certain circumstances such geometries, including those endowed with an asymptotically near-AdS$_2$ boundary, can be locally and even globally thermodynamically stable within particular temperature regimes. First order phase transitions reminiscent of the Hawking-Page transition are discussed. For judiciously chosen models, the near-AdS$_2$ boundary can be viewed as a completion of the stretched cosmological dS$_2$ horizon. We speculate on candidate microphysical models.


title: Exact solutions for vector phase matching conditions in nonlinear uniaxial crystals

abstract: The strongly transcendental equations of vector phase matching are transformed into a fourth order polynomial equation that admits analytical solution. The real roots of this equation provide the optical axis orientations that are useful for efficient down-conversion in nonlinear uniaxial crystals. The production of entangled photon pairs is discussed in both collinear and non-collinear configurations of the spontaneous parametric down conversion (SPDC) process. Degenerate and non-degenerate cases are also distinguished. As a practical example, SPDC processes of type-I and type-II are studied for beta-barium-borate (BBO) crystals. The predictions are in very good agreement with experimental measurements already reported in the literature, and include theoretical results of other authors as particular cases. Some properties that seem to be exclusive to BBO crystals are reported, the experimental verification of the latter would allow a better characterization of these crystals.


title: High Performance Dataframes from Parallel Processing Patterns

abstract: The data science community today has embraced the concept of Dataframes as the de facto standard for data representation and manipulation. Ease of use, massive operator coverage, and popularization of R and Python languages have heavily influenced this transformation. However, most widely used serial Dataframes today (R, pandas) experience performance limitations even while working on even moderately large data sets. We believe that there is plenty of room for improvement by investigating the generic distributed patterns of dataframe operators. In this paper, we propose a framework that lays the foundation for building high performance distributed-memory parallel dataframe systems based on these parallel processing patterns. We also present Cylon, as a reference runtime implementation. We demonstrate how this framework has enabled Cylon achieving scalable high performance. We also underline the flexibility of the proposed API and the extensibility of the framework on different hardware. To the best of our knowledge, Cylon is the first and only distributed-memory parallel dataframe system available today.


title: High-Resolution Laser Spectroscopy of a Functionalized Aromatic Molecule

abstract: We present a high-resolution laser spectroscopic study of the $\tilde{A}\,^2B_2- \tilde{X}\,^2A_1$ and $\tilde{B}\,^2B_1- \tilde{X}\,^2A_1$ transitions of calcium (I) phenoxide, CaOPh (CaOC$_6$H$_5$). The rotationally resolved band systems are analyzed using an effective Hamiltonian model and are accurately modeled as independent perpendicular ($b$- or $c$-type) transitions. The structure of calcium monophenoxide is compared to previously observed Ca-containing radicals and implications for direct laser cooling are discussed. This work demonstrates that functionalization of aromatic molecules with optical cycling centers can preserve many of the properties needed for laser-based control.


title: Entity Tagging: Extracting Entities in Text Without Mention Supervision

abstract: Detection and disambiguation of all entities in text is a crucial task for a wide range of applications. The typical formulation of the problem involves two stages: detect mention boundaries and link all mentions to a knowledge base. For a long time, mention detection has been considered as a necessary step for extracting all entities in a piece of text, even if the information about mention spans is ignored by some downstream applications that merely focus on the set of extracted entities. In this paper we show that, in such cases, detection of mention boundaries does not bring any considerable performance gain in extracting entities, and therefore can be skipped. To conduct our analysis, we propose an "Entity Tagging" formulation of the problem, where models are evaluated purely on the set of extracted entities without considering mentions. We compare a state-of-the-art mention-aware entity linking solution against GET, a mention-agnostic sequence-to-sequence model that simply outputs a list of disambiguated entities given an input context. We find that these models achieve comparable performance when trained both on a fully and partially annotated dataset across multiple benchmarks, demonstrating that GET can extract disambiguated entities with strong performance without explicit mention boundaries supervision.


title: Spin-flip induced superfluidity in a ring of spinful hard-core bosons

abstract: The t - J Hamiltonian of the spinful hard-core bosonic ring in the Nagaoka limit is solved. The energy spectrum becomes quantized due to presence of spin, where each energy level corresponds to a cyclic permutation state of the spin chains. The ground state is true ferromagnetic when the ring contains N = 2, 3 spinful hard-core bosons; for all other N it is a mixture of the ferromagnetic and non-ferromagnetic states. This behaviour is different from the fermionic ring, where ground state is true ferromagnetic only for N = 3. It is shown that the intrinsic spin generated gauge fields are analogous to the synthetic gauge fields generated by rotation of either the condensate or the confining potential. It is argued that the low lying excited levels of the spin flipped states intrinsically support the superfluidity. Possible ways to experimentally verify these results are also discussed.


title: AGT correspondence, (q-)Painlev\`e equations and matrix models

abstract: Painlev\`e equation for conformal blocks is a combined corollary of integrability and Ward identities, which can be explicitly revealed in the matrix model realization of AGT relations. We demonstrate this in some detail, both for $q$-Painlev\`e equations for the $q$-Virasoro conformal block, or AGT dual gauge theory in $5d$, and for ordinary Painlev\`e equations, or AGT dual gauge theory in $4d$. Especially interesting is the continuous limit from $5d$ to $4d$ and its description at the level of equations for eight $\tau$-functions. Half of these equations are governed by integrability and another half by Ward identities.


title: High-order coupling of shear and sonic continua in JET plasmas

abstract: A recent model coupling the shear-Alfv\'{e}n and acoustic continua, which depends strongly on the equilibrium shaping and on elongation in particular, is employed to explain the properties of Alfv\'{e}nic activity observed on JET plasmas below but close to the typical frequency of toroidicity-induced Alfv\'{e}n eigenmodes (TAEs). The frequency gaps predicted by the model result from high-order harmonics of the geodesic field-line curvature caused by plasma shaping (as opposed to lower-order toroidicity) and give rise to high-order geodesic acoustic eigenmodes (HOGAEs), their frequency value being close to one-half of the TAEs one. The theoretical predictions of HOGAE frequency and radial location are found to be in fair agreement with measurements in JET experiments, including magnetic, reflectometry and soft x-ray data. The stability of the observed HOGAEs is evaluated with the linear hybrid MHD/drift-kinetic code CASTOR-K, taking into account the energetic-ion populations produced by the NBI and ICRH heating systems. Wave-particle resonances, along with drive/damping mechanisms, are also discussed in order to understand the conditions leading to HOGAEs destabilization in JET plasmas.


title: Mandator and Sporades: Robust Wide-Area Consensus with Efficient Request Dissemination

abstract: Consensus algorithms are deployed in the wide area to achieve high availability for geographically replicated applications. Wide-area consensus is challenging due to two main reasons: (1) low throughput due to the high latency overhead of client request dissemination and (2) network asynchrony that causes consensus protocols to lose liveness. In this paper, we propose Mandator and Sporades, a modular state machine replication algorithm that enables high performance and resiliency in the wide-area setting. To address the high client request dissemination overhead challenge, we propose Mandator, a novel consensus-agnostic asynchronous dissemination layer. Mandator separates client request dissemination from the critical path of consensus to obtain high performance. Composing Mandator with Multi-Paxos (Mandator-Paxos) delivers significantly high throughput under synchronous networks. However, under asynchronous network conditions, Mandator-Paxos loses liveness which results in high latency. To achieve low latency and robustness under asynchrony, we propose Sporades, a novel omission fault-tolerant consensus algorithm. Sporades consists of two modes of operations -- synchronous and asynchronous -- that always ensure liveness. The combination of Mandator and Sporades (Mandator-Sporades) provides a robust and high-performing state machine replication system. We implement and evaluate Mandator-Sporades in a wide-area deployment running on Amazon EC2. Our evaluation shows that in the synchronous execution, Mandator-Sporades achieves 300k tx/sec throughput in less than 900ms latency, outperforming Multi-Paxos, EPaxos and Rabia by 650\% in throughput, at a modest expense of latency. Furthermore, we show that Mandator-Sporades outperforms Mandator-Paxos, Multi-Paxos, and EPaxos in the face of targeted distributed denial-of-service attacks.


title: Warm $\beta$-exponential inflation and the Swampland Conjectures

abstract: We investigate theoretical and observational aspects of a warm inflation scenario driven by the $\beta$-exponential potential, which generalizes the well-known power law inflation. In such a scenario, the decay of the inflaton field into radiation happens during the inflationary phase. In our study, we consider a dissipation coefficient ($\Gamma$) with cubic dependence on the temperature ($T$) and investigate the consequences in the inflationary dynamics, focusing on the impact on the spectral index $n_s$, its running $n_{run}$ and tensor-to-scalar ratio $r$. We find it possible to realize inflation in agreement with current cosmic microwave background data in weak and strong dissipation regimes. We also investigate theoretical aspects of the model in light of the swampland conjectures, as warm inflation in the strong dissipation regime has been known as a way to satisfy the three conditions currently discussed in the literature. We find that when $\Gamma\propto T^3$, the $\beta$-exponential model can be accommodated into the conjectures.


title: Twisting cubic rabbits

abstract: We solve an infinite family of twisted polynomial problems that are cubic generalizations of Hubbard's twisted rabbit problem. We show how the result of twisting by a power of a certain Dehn twist depends on the 9-adic expansion of the power. For the cubic rabbit with three post-critical points, we also give an algorithmic solution to the twisting problem for the full pure mapping class group.


title: On topological data analysis for SHM; an introduction to persistent homology

abstract: This paper aims to discuss a method of quantifying the 'shape' of data, via a methodology called topological data analysis. The main tool within topological data analysis is persistent homology; this is a means of measuring the shape of data, from the homology of a simplicial complex, calculated over a range of values. The required background theory and a method of computing persistent homology is presented here, with applications specific to structural health monitoring. These results allow for topological inference and the ability to deduce features in higher-dimensional data, that might otherwise be overlooked. A simplicial complex is constructed for data for a given distance parameter. This complex encodes information about the local proximity of data points. A singular homology value can be calculated from this simplicial complex. Extending this idea, the distance parameter is given for a range of values, and the homology is calculated over this range. The persistent homology is a representation of how the homological features of the data persist over this interval. The result is characteristic to the data. A method that allows for the comparison of the persistent homology for different data sets is also discussed.


title: SEER: Sustainable E-commerce with Environmental-impact Rating

abstract: With online shopping gaining massive popularity over the past few years, e-commerce platforms can play a significant role in tackling climate change and other environmental problems. In this study, we report that the "attitude-behavior" gap identified by prior sustainable consumption literature also exists in an online setting. We propose SEER, a concept design for online shopping websites to help consumers make more sustainable choices. We introduce explainable environmental impact ratings to increase knowledge, trust, and convenience for consumers willing to purchase eco-friendly products. In our quasi-randomized case-control experiment with 98 subjects across the United States, we found that the case group using SEER demonstrates significantly more eco-friendly consumption behavior than the control group using a traditional e-commerce setting. While there are challenges in generating reliable explanations and environmental ratings for products, if implemented, in the United States alone, SEER has the potential to reduce approximately 2.88 million tonnes of carbon emission every year.


title: The Symmetry Principle in Condensed Matter Physics (I)

abstract: Symmetry distills the simplicity of natural laws from the complexity of physical phenomena. The symmetry principle is of vital importance in various aspects of modern physics, including analyzing atomic spectra, determining fundamental interactions in the Standard Model, and unifying physics at different energy scales. In this chapter, novel applications of this principle are reviewed in condensed matter physics and cold atom physics for exploring new states of matter.


title: Tailoring Molecules for Protein Pockets: a Transformer-based Generative Solution for Structured-based Drug Design

abstract: Structure-based drug design is drawing growing attentions in computer-aided drug discovery. Compared with the virtual screening approach where a pre-defined library of compounds are computationally screened, de novo drug design based on the structure of a target protein can provide novel drug candidates. In this paper, we present a generative solution named TamGent (Target-aware molecule generator with Transformer) that can directly generate candidate drugs from scratch for a given target, overcoming the limits imposed by existing compound libraries. Following the Transformer framework (a state-of-the-art framework in deep learning), we design a variant of Transformer encoder to process 3D geometric information of targets and pre-train the Transformer decoder on 10 million compounds from PubChem for candidate drug generation. Systematical evaluation on candidate compounds generated for targets from DrugBank shows that both binding affinity and drugability are largely improved. TamGent outperforms previous baselines in terms of both effectiveness and efficiency. The method is further verified by generating candidate compounds for the SARS-CoV-2 main protease and the oncogenic mutant KRAS G12C. The results show that our method not only re-discovers previously verified drug molecules , but also generates novel molecules with better docking scores, expanding the compound pool and potentially leading to the discovery of novel drugs.


title: Meta-Gradients in Non-Stationary Environments

abstract: Meta-gradient methods (Xu et al., 2018; Zahavy et al., 2020) offer a promising solution to the problem of hyperparameter selection and adaptation in non-stationary reinforcement learning problems. However, the properties of meta-gradients in such environments have not been systematically studied. In this work, we bring new clarity to meta-gradients in non-stationary environments. Concretely, we ask: (i) how much information should be given to the learned optimizers, so as to enable faster adaptation and generalization over a lifetime, (ii) what meta-optimizer functions are learned in this process, and (iii) whether meta-gradient methods provide a bigger advantage in highly non-stationary environments. To study the effect of information provided to the meta-optimizer, as in recent works (Flennerhag et al., 2021; Almeida et al., 2021), we replace the tuned meta-parameters of fixed update rules with learned meta-parameter functions of selected context features. The context features carry information about agent performance and changes in the environment and hence can inform learned meta-parameter schedules. We find that adding more contextual information is generally beneficial, leading to faster adaptation of meta-parameter values and increased performance over a lifetime. We support these results with a qualitative analysis of resulting meta-parameter schedules and learned functions of context features. Lastly, we find that without context, meta-gradients do not provide a consistent advantage over the baseline in highly non-stationary environments. Our findings suggest that contextualizing meta-gradients can play a pivotal role in extracting high performance from meta-gradients in non-stationary settings.


title: Attenuated gravitational radiation

abstract: The hypothesis of an alternative way of obtaining gravitational waves is the physical motivation of this article. Using the linear field approximation and a symmetry transformation of the affine connection, new field equations and new gauge conditions have been obtained. Solutions to these field equations have been considered in the empty space and in the wave zone, and in both of them the oscillation amplitudes of their solutions are attenuated exponentially. We expect that these solutions can be useful for building more sophisticated gravitational wave models, and also as an impulse for researching further symmetry transformations of general relativity.


title: BER Performance of Photon Counting PPM vs. DPSK for Satellite Communications

abstract: Expressions for the BER of M-ary PPM & biphase DPSK modulations in the presence of noise are derived using analytical, statistical methods. The PPM expression is verified via Poisson statistics based simulation. BER expressions are then applied to a representative set of receiving telescope & sky spectral radiance parameters in order to assess performance of PPM & DPSK relative to one another. Finally, efficiency & additional considerations are discussed.


title: Generalised Local Extra Dimensions as a Basis for the Elementary Structure of Matter

abstract: A central aim of theoretical physics is to account for the structure of matter at the most elementary level as underlying the Standard Model of particle physics, and ideally also as a basis for a substantial dark sector, as distributed in 4-dimensional spacetime. A broad class of theories augment the global 4-dimensional spacetime arena itself to a higher-dimensional spacetime structure, with the properties of matter then deriving from the properties of the extra spatial dimensions. We motivate an alternative approach in which we begin with the local structure of 4-dimensional spacetime and augment the local form for a proper time interval. The symmetries and properties of the residual components, over the local 4-dimensional spacetime form, are found to exhibit appropriate features to account for the visible Standard Model sector while in parallel direct connections can also be identified with dark sector models.


title: A noncommutative Bishop peak interpolation-set theorem

abstract: We prove a noncommutative version of Bishop's peak interpolation-set theorem.


title: New near-analytical path to the threshold size of spherical random lasing via geometric-distribution-probability weighting of the diffusive photon fluence rate

abstract: We demonstrate a new near-analytical path to the threshold-size of random-lasing for the case of a uniform and isotropic-scattering sphere. We assess a geometric-distribution-probability (GDP) weighted integration of the diffusion-equation derived time-dependent photon fluence-rate at a spherical boundary, in response to uniform, synchronous, and Delta-functional photon generations within the sphere. The GDP weights the contribution of the modeled Delta-functional photon sources to the temporal behavior of the photon fluence rate at the spherical boundary-domain based on the line-of-sight distance between the modeled-photon source and the same field point. The integral manifests a bi-phasic pattern versus time with a global minimum followed by an exponential growth. The line-of-sight length that corresponds to the time of global minimum decreases monotonically as the size of the sphere increases. The condition that this line-of-sight length equaling the radius of the sphere is hypothesized to indicate a threshold whereby the medium can sustain the growth of the photon fluence-rate at the boundary over time. This threshold line-of-sight length is assessed over a gain/scattering ratio of [0.001, 10000] covering the diffusive to quasi-ballistic regimes. The threshold line-of-sight length applied with a simple empirical gain/scattering ratio predicts the threshold size over the diffusive region and outperforms the threshold size given by the eigen-mode-decomposition in the semi-ballistic region, when compared to the radiative transfer approach. The method sheds new insights to amplified diffusion process in a scattering medium with gain.


title: Quantum modeling for injection of carriers coupled to a bath of vibration modes : application to hot and cold charge transfer states in organic solar cells

abstract: We develop a quantum model for the injection of carriers in a material that presents strong electron-vibration coupling. This model, which can be solved numerically, is applied to the organic solar cells for which the electron transfer at the donor acceptor interface is an essential step. We analyze how the electron-hole interaction and the nature of the recombination process impact the electron transfer. In particular this model explains, on a quantum basis, how one can get high injection yield with a cold charge transfer state as often observed experimentally.


title: Investigating the role of partonic and hadronic dynamics in mass splitting of elliptic anisotropy in p-Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV

abstract: The mass ordering of $v_{2}^{hadron}$ is regarded as one of the key signatures of collective behaviour in ultra relativistic heavy ion collisions. This observation has been found to be in compliance with the hydrodynamical response of a strongly interacting system to the initial spatial anisotropy. Flow co-efficients measured with identified particles in p-Pb/d-Au collisions have shown similar mass-splitting of $v_{2}^{hadron}$ indicating towards the presence of collective dynamics in small collision systems. Arguably, small size in the overlap geometry of such colliding systems may not be suitable for hydrodynamical treatment that demands an early thermalization. Studies based on a multi phase transport model suggests that elliptic or triangular anisotropy is primarily due to escape mechanism of partons rather than hydro like collectivity and mass ordering of $v_{2}^{hadron}$ can be generated from coalescence dynamics as implemented in string melting version of AMPT even when parton azimuthal directions are randomized. In this work, studies have been performed on p-Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV using AMPT model which has been found to explain the elliptic and traingular flow in such a system where escape mechanism is the dominant source of flow generation. We report that the mass splitting of $v_{2}^{hadron}$ can originate independently both at the partonic and hadronic level in the string melting version of the AMPT model.


title: PET image denoising based on denoising diffusion probabilistic models

abstract: Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a normal distribution into a specific data distribution based on iterative refinements. In this work, we proposed and evaluated different DDPM-based methods for PET image denoising. Under the DDPM framework, one way to perform PET image denoising is to provide the PET image and/or the prior image as the network input. Another way is to supply the prior image as the input with the PET image included in the refinement steps, which can fit for scenarios of different noise levels. 120 18F-FDG datasets and 140 18F-MK-6240 datasets were utilized to evaluate the proposed DDPM-based methods. Quantification show that the DDPM-based frameworks with PET information included can generate better results than the nonlocal mean and Unet-based denoising methods. Adding additional MR prior in the model can help achieve better performance and further reduce the uncertainty during image denoising. Solely relying on MR prior while ignoring the PET information can result in large bias. Regional and surface quantification shows that employing MR prior as the network input while embedding PET image as a data-consistency constraint during inference can achieve the best performance. In summary, DDPM-based PET image denoising is a flexible framework, which can efficiently utilize prior information and achieve better performance than the nonlocal mean and Unet-based denoising methods.


title: Borch: A Deep Universal Probabilistic Programming Language

abstract: Ever since the Multilayered Perceptron was first introduced the connectionist community has struggled with the concept of uncertainty and how this could be represented in these types of models. This past decade has seen a lot of effort in trying to join the principled approach of probabilistic modeling with the scalable nature of deep neural networks. While the theoretical benefits of this consolidation are clear, there are also several important practical aspects of these endeavors; namely to force the models we create to represent, learn, and report uncertainty in every prediction that is made. Many of these efforts have been based on extending existing frameworks with additional structures. We present Borch, a scalable deep universal probabilistic programming language, built on top of PyTorch. The code is available for download and use in our repository https://gitlab.com/desupervised/borch.


title: The Role of Explanatory Value in Natural Language Processing

abstract: A key aim of science is explanation, yet the idea of explaining language phenomena has taken a backseat in mainstream Natural Language Processing (NLP) and many other areas of Artificial Intelligence. I argue that explanation of linguistic behaviour should be a main goal of NLP, and that this is not the same as making NLP models explainable. To illustrate these ideas, some recent models of human language production are compared with each other. I conclude by asking what it would mean for NLP research and institutional policies if our community took explanatory value seriously, while heeding some possible pitfalls.


title: Computational Sarcasm Analysis on Social Media: A Systematic Review

abstract: Sarcasm can be defined as saying or writing the opposite of what one truly wants to express, usually to insult, irritate, or amuse someone. Because of the obscure nature of sarcasm in textual data, detecting it is difficult and of great interest to the sentiment analysis research community. Though the research in sarcasm detection spans more than a decade, some significant advancements have been made recently, including employing unsupervised pre-trained transformers in multimodal environments and integrating context to identify sarcasm. In this study, we aim to provide a brief overview of recent advancements and trends in computational sarcasm research for the English language. We describe relevant datasets, methodologies, trends, issues, challenges, and tasks relating to sarcasm that are beyond detection. Our study provides well-summarized tables of sarcasm datasets, sarcastic features and their extraction methods, and performance analysis of various approaches which can help researchers in related domains understand current state-of-the-art practices in sarcasm detection.


title: Proving a directed analogue of the Gy\'arf\'as-Sumner conjecture for orientations of $P_4$

abstract: An oriented graph is a digraph that does not contain a directed cycle of length two. An (oriented) graph $D$ is $H$-free if $D$ does not contain $H$ as an induced sub(di)graph. The Gy\'arf\'as-Sumner conjecture is a widely-open conjecture on simple graphs, which states that for any forest $F$, there is some function $f$ such that every $F$-free graph $G$ with clique number $\omega(G)$ has chromatic number at most $f(\omega(G))$. Aboulker, Charbit, and Naserasr [Extension of Gy\'arf\'as-Sumner Conjecture to Digraphs; E-JC 2021] proposed an analogue of this conjecture to the dichromatic number of oriented graphs. The dichromatic number of a digraph $D$ is the minimum number of colors required to color the vertex set of $D$ so that no directed cycle in $D$ is monochromatic. Aboulker, Charbit, and Naserasr's $\overrightarrow{\chi}$-boundedness conjecture states that for every oriented forest $F$, there is some function $f$ such that every $F$-free oriented graph $D$ has dichromatic number at most $f(\omega(D))$, where $\omega(D)$ is the size of a maximum clique in the graph underlying $D$. In this paper, we perform the first step towards proving Aboulker, Charbit, and Naserasr's $\overrightarrow{\chi}$-boundedness conjecture by showing that it holds when $F$ is any orientation of a path on four vertices.


title: Comparative analysis of segmentation and generative models for fingerprint retrieval task

abstract: Biometric Authentication like Fingerprints has become an integral part of the modern technology for authentication and verification of users. It is pervasive in more ways than most of us are aware of. However, these fingerprint images deteriorate in quality if the fingers are dirty, wet, injured or when sensors malfunction. Therefore, extricating the original fingerprint by removing the noise and inpainting it to restructure the image is crucial for its authentication. Hence, this paper proposes a deep learning approach to address these issues using Generative (GAN) and Segmentation models. Qualitative and Quantitative comparison has been done between pix2pixGAN and cycleGAN (generative models) as well as U-net (segmentation model). To train the model, we created our own dataset NFD - Noisy Fingerprint Dataset meticulously with different backgrounds along with scratches in some images to make it more realistic and robust. In our research, the u-net model performed better than the GAN networks


title: Closed string field theory without the level-matching condition

abstract: In formulating covariant closed string field theories, we have always used closed string fields with the level-matching condition. Recently, open superstring field theories including the Ramond sector were constructed, and one approach was to use open superstring fields with a constraint analogous to the level-matching condition for closed string fields. There is another approach developed by Sen, where no constraints are imposed on open superstring fields but additional free string fields are introduced so that covariant kinetic terms for the Ramond sector were constructed. Motivated by this development, we construct closed string field theory without imposing the level-matching condition on the closed string field, while we introduce an additional free string field. This is the first implementation of general covariance in the context of string theory without using the level-matching condition. We explicitly expand the string fields up to the level relevant to massless fields, and we confirm the equivalence to the theory with the level-matching condition up to decoupled free fields.


title: Thermodynamic approach to liquid-to-glass transformation as an arrest transition in polydisperse solution

abstract: Thermodynamic multi-component solution solidification approach to liquid-to-glass transition is proposed and actual mechanisms underlying vitrification, other than viscous slowdown, are identified. Due to polydisperse aggregation in liquid state, glass-forming liquids, irrespective of chemical composition, appear to be mixtures of various quasi-components whose thermodynamic quantities shall be expressed not in terms of molar concentrations of actual chemical components, but in terms of relative concentrations of dominant structural units. Thermodynamically, any glass-former is expected to behave as multi-component solution and solidify in continuous temperature range between apparent liquidus and solidus temperatures that can be identified as glass-transition range. Using extended irreversible thermodynamics of polydisperse solutions it is demonstrated that upon quenching, diffusional and Brownian mass transport in such solutions is negated within heat removal timescale, which results in dynamical arrest of nucleation and growth in clusters and solid-liquid phase separation. Rapid solution solidification proceeds via successive cluster freezing in continuous temperature range, in line with cluster size dispersity, which can be described in terms of percolation in static polydisperse fractal ensemble where glass transition temperature naturally emerges as percolation threshold. Multi-component solution solidification framework is shown to be reconcilable qualitatively and quantitatively with the Mode Coupling - Random First Order Transition scenario. Finally, it is demonstrated that liquid-to-glass transformation is thermodynamic liquid-to-solid phase transition, glassy state of matter appears to be solid supersaturated solution of defects in otherwise perfect matrix, and the true equilibrium structure which glass is unable access is a crystalline one.


title: Tractable hierarchies of convex relaxations for polynomial optimization on the nonnegative orthant

abstract: We consider polynomial optimization problems (POP) on a semialgebraic set contained in the nonnegative orthant (every POP on a compact set can be put in this format by a simple translation of the origin). Such a POP can be converted to an equivalent POP by squaring each variable. Using even symmetry and the concept of factor width, we propose a hierarchy of semidefinite relaxations based on the extension of P\'olya's Positivstellensatz by Dickinson-Povh. As its distinguishing and crucial feature, the maximal matrix size of each resulting semidefinite relaxation can be chosen arbitrarily and in addition, we prove that the sequence of values returned by the new hierarchy converges to the optimal value of the original POP at the rate $O(\varepsilon^{-c})$ if the semialgebraic set has nonempty interior. When applied to (i) robustness certification of multi-layer neural networks and (ii) computation of positive maximal singular values, our method based on P\'olya's Positivstellensatz provides better bounds and runs several hundred times faster than the standard Moment-SOS hierarchy.


title: Generalized dimension truncation error analysis for high-dimensional numerical integration: lognormal setting and beyond

abstract: Partial differential equations (PDEs) with uncertain or random inputs have been considered in many studies of uncertainty quantification. In forward uncertainty quantification, one is interested in analyzing the stochastic response of the PDE subject to input uncertainty, which usually involves solving high-dimensional integrals of the PDE output over a sequence of stochastic variables. In practical computations, one typically needs to discretize the problem in several ways: approximating an infinite-dimensional input random field with a finite-dimensional random field, spatial discretization of the PDE using, e.g., finite elements, and approximating high-dimensional integrals using cubatures such as quasi-Monte Carlo methods. In this paper, we focus on the error resulting from dimension truncation of an input random field. We show how Taylor series can be used to derive theoretical dimension truncation rates for a wide class of problems and we provide a simple checklist of conditions that a parametric mathematical model needs to satisfy in order for our dimension truncation error bound to hold. Some of the novel features of our approach include that our results are applicable to non-affine parametric operator equations, dimensionally-truncated conforming finite element discretized solutions of parametric PDEs, and even compositions of PDE solutions with smooth nonlinear quantities of interest. As a specific application of our method, we derive an improved dimension truncation error bound for elliptic PDEs with lognormally parameterized diffusion coefficients. Numerical examples support our theoretical findings.


title: Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyond

abstract: Homophily is a graph property describing the tendency of edges to connect similar nodes; the opposite is called heterophily. It is often believed that heterophilous graphs are challenging for standard message-passing graph neural networks (GNNs), and much effort has been put into developing efficient methods for this setting. However, there is no universally agreed-upon measure of homophily in the literature. In this work, we show that commonly used homophily measures have critical drawbacks preventing the comparison of homophily levels across different datasets. For this, we formalize desirable properties for a proper homophily measure and verify which measures satisfy which properties. In particular, we show that a measure that we call adjusted homophily satisfies more desirable properties than other popular homophily measures while being rarely used in graph machine learning literature. Then, we go beyond the homophily-heterophily dichotomy and propose a new characteristic that allows one to further distinguish different sorts of heterophily. The proposed label informativeness (LI) characterizes how much information a neighbor's label provides about a node's label. We prove that this measure satisfies important desirable properties. We also observe empirically that LI better agrees with GNN performance compared to homophily measures, which confirms that it is a useful characteristic of the graph structure.