title: Reinforcement Learning with History-Dependent Dynamic Contexts

abstract: We introduce Dynamic Contextual Markov Decision Processes (DCMDPs), a novel reinforcement learning framework for history-dependent environments that generalizes the contextual MDP framework to handle non-Markov environments, where contexts change over time. We consider special cases of the model, with a focus on logistic DCMDPs, which break the exponential dependence on history length by leveraging aggregation functions to determine context transitions. This special structure allows us to derive an upper-confidence-bound style algorithm for which we establish regret bounds. Motivated by our theoretical results, we introduce a practical model-based algorithm for logistic DCMDPs that plans in a latent space and uses optimism over history-dependent features. We demonstrate the efficacy of our approach on a recommendation task (using MovieLens data) where user behavior dynamics evolve in response to recommendations.


title: Normal forms for principal Poisson Hamiltonian spaces

abstract: We prove a normal form theorem for principal Hamiltonian actions on Poisson manifolds around the zero locus of the moment map. The local model is the generalization to Poisson geometry of the classical minimal coupling construction from symplectic geometry of Sternberg and Weinstein. Further, we show that the result implies that the quotient Poisson manifold is linearizable, and we show how to extend the normal form to other values of the moment map.


title: Critical exponent and sharp lifespan estimates for semilinear third-order evolution equations

abstract: We study semilinear third-order (in time) evolution equations with fractional Laplacian $(-\Delta)^{\sigma}$ and power nonlinearity $|u|^p$, which was proposed by Bezerra-Carvalho-Santos [2] recently. In this manuscript, we obtain a new critical exponent $p=p_{\mathrm{crit}}(n,\sigma):=1+\frac{6\sigma}{\max\{3n-4\sigma,0\}}$ for $n\leqslant\frac{10}{3}\sigma$. Precisely, the global (in time) existence of small data Sobolev solutions is proved for the supercritical case $p>p_{\mathrm{crit}}(n,\sigma)$, and weak solutions blow up in finite time even for small data if $1<p\leqslant p_{\mathrm{crit}}(n,\sigma)$. Furthermore, to more accurately describe the blow-up time, we derive new and sharp upper bound as well as lower bound estimates for the lifespan in the subcritical case and the critical case.


title: Lived Experience Matters: Automatic Detection of Stigma on Social Media Toward People Who Use Substances

abstract: Stigma toward people who use substances (PWUS) is a leading barrier to seeking treatment.Further, those in treatment are more likely to drop out if they experience higher levels of stigmatization. While related concepts of hate speech and toxicity, including those targeted toward vulnerable populations, have been the focus of automatic content moderation research, stigma and, in particular, people who use substances have not. This paper explores stigma toward PWUS using a data set of roughly 5,000 public Reddit posts. We performed a crowd-sourced annotation task where workers are asked to annotate each post for the presence of stigma toward PWUS and answer a series of questions related to their experiences with substance use. Results show that workers who use substances or know someone with a substance use disorder are more likely to rate a post as stigmatizing. Building on this, we use a supervised machine learning framework that centers workers with lived substance use experience to label each Reddit post as stigmatizing. Modeling person-level demographics in addition to comment-level language results in a classification accuracy (as measured by AUC) of 0.69 -- a 17% increase over modeling language alone. Finally, we explore the linguist cues which distinguish stigmatizing content: PWUS substances and those who don't agree that language around othering ("people", "they") and terms like "addict" are stigmatizing, while PWUS (as opposed to those who do not) find discussions around specific substances more stigmatizing. Our findings offer insights into the nature of perceived stigma in substance use. Additionally, these results further establish the subjective nature of such machine learning tasks, highlighting the need for understanding their social contexts.


title: Sensing aided Channel Estimation in Wideband Millimeter-Wave MIMO Systems

abstract: In this work, the uplink channel estimation problem is considered for a millimeter wave (mmWave) multi-input multi-output (MIMO) system. It is well known that pilot overhead and computation complexity in estimating the channel increases with the number of antennas and the bandwidth. To overcome this, the proposed approach allows the channel estimation at the base station to be aided by the sensing information. The sensing information contains an estimate of scatterers locations in an environment. A simultaneous weighting orthogonal matching pursuit (SWOMP) - sparse Bayesian learning (SBL) algorithm is proposed that efficiently incorporates this sensing information in the communication channel estimation procedure. The proposed framework can cope with scenarios where a) scatterers present in the sensing information are not associated with the communication channel and b) imperfections in the scatterers' location. Simulation results show that the proposed sensing aided channel estimation algorithm can obtain good wideband performance only at the cost of fractional pilot overhead. Finally, the Cramer-Rao Bound (CRB) for the angle estimation and multipath channel gains in the SBL is derived, providing valuable insights into the local identifiability of the proposed algorithms.


title: Calculating spin-lattice interactions in ferro- and antiferromagnets: the role of symmetry, dimension and frustration

abstract: Recently, the interplay between spin and lattice degrees of freedom has gained a lot of attention due to its importance for various fundamental phenomena as well as for spintronic and magnonic applications. Examples are ultrafast angular momentum transfer between the spin and lattice subsystems during ultrafast demagnetization, frustration driven by structural distortions in transition metal oxides, or in acoustically driven spin-wave resonances. In this work, we provide a systematic analysis of spin-lattice interactions for ferro- and antiferromagnetic materials and focus on the role of lattice symmetries and dimensions, magnetic order, and the relevance of spin-lattice interactions for angular momentum transfer as well as magnetic frustration. For this purpose, we use a recently developed scheme which allows an efficient calculation of spin-lattice interaction tensors from first principles. In addition to that, we provide a more accurate and self consistent scheme to calculate ab initio spin lattice interactions by using embedded clusters which allows to benchmark the performance of the scheme introduced previously.


title: Anomalous Scaling of Aeolian Sand Transport Reveals Coupling to Bed Rheology

abstract: Predicting transport rates of windblown sand is a central problem in aeolian research, with implications for climate, environmental, and planetary sciences. Though studied since the 1930s, the underlying many-body dynamics is still incompletely understood, as underscored by the recent empirical discovery of an unexpected third-root scaling in the particle-fluid density ratio. Here, by means of grain-scale simulations and analytical modeling, we elucidate how a complex coupling between grain-bed collisions and granular creep within the sand bed yields a dilatancy-enhanced bed erodibility. Our minimal saltation model robustly predicts both the observed scaling and a new undersaturated steady transport state that we confirm by simulations for rarefied atmospheres.


title: Quivers, Flow Trees, and Log Curves

abstract: Donaldson-Thomas (DT) invariants of a quiver with potential can be expressed in terms of simpler attractor DT invariants by a universal formula. The coefficients in this formula are calculated combinatorially using attractor flow trees. In this paper, we prove that these coefficients are genus 0 log Gromov--Witten invariants of $d$-dimensional toric varieties, where $d$ is the number of vertices of the quiver. This result follows from a log-tropical correspondence theorem which relates $(d-2)$-dimensional families of tropical curves obtained as universal deformations of attractor flow trees, and rational log curves in toric varieties.


title: Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning

abstract: Federated Learning (FL) recently emerges as a paradigm to train a global machine learning model across distributed clients without sharing raw data. Knowledge Graph (KG) embedding represents KGs in a continuous vector space, serving as the backbone of many knowledge-driven applications. As a promising combination, federated KG embedding can fully take advantage of knowledge learned from different clients while preserving the privacy of local data. However, realistic problems such as data heterogeneity and knowledge forgetting still remain to be concerned. In this paper, we propose FedLU, a novel FL framework for heterogeneous KG embedding learning and unlearning. To cope with the drift between local optimization and global convergence caused by data heterogeneity, we propose mutual knowledge distillation to transfer local knowledge to global, and absorb global knowledge back. Moreover, we present an unlearning method based on cognitive neuroscience, which combines retroactive interference and passive decay to erase specific knowledge from local clients and propagate to the global model by reusing knowledge distillation. We construct new datasets for assessing realistic performance of the state-of-the-arts. Extensive experiments show that FedLU achieves superior results in both link prediction and knowledge forgetting.


title: Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification

abstract: Existing image augmentation methods consist of two categories: perturbation-based methods and generative methods. Perturbation-based methods apply pre-defined perturbations to augment an original image, but only locally vary the image, thus lacking image diversity. In contrast, generative methods bring more image diversity in the augmented images but may not preserve semantic consistency, thus incorrectly changing the essential semantics of the original image. To balance image diversity and semantic consistency in augmented images, we propose SGID, a Semantic-guided Generative Image augmentation method with Diffusion models for image classification. Specifically, SGID employs diffusion models to generate augmented images with good image diversity. More importantly, SGID takes image labels and captions as guidance to maintain semantic consistency between the augmented and original images. Experimental results show that SGID outperforms the best augmentation baseline by 1.72% on ResNet-50 (from scratch), 0.33% on ViT (ImageNet-21k), and 0.14% on CLIP-ViT (LAION-2B). Moreover, SGID can be combined with other image augmentation baselines and further improves the overall performance. We demonstrate the semantic consistency and image diversity of SGID through quantitative human and automated evaluations, as well as qualitative case studies.


title: TeV-scale leptoquark searches at the LHC and their E$_6$SSM Interpretation

abstract: We perform a model-independent search for leptoquarks (LQs) at the Large Hadron Collider through their pair-production and subsequent decay into $t\bar t \tau\tau$ intermediate states. We show that, assuming full luminosity of the Run 2, a fully hadronic signal emerging from this intermediate state can surpass in sensitivity the established searches relying on leptons in the final state. Our conclusion is supported by a thorough Monte-Carlo analysis, and we advocate the deployment of our proposed search channel in the proper experimental setting of the Run 3. Furthermore, in order to highlight the full scope of this approach for constraining LQ theories, we interpret our results in the context of the string-inspired Exceptional Supersymmetric Standard Model, which naturally predicts the $S_1-$type scalar LQ states that we analyse here.


title: An Inexact Deflected Subgradient Algorithm in Infinite Dimensional spaces

abstract: We propose a duality scheme for solving constrained nonsmooth and nonconvex optimization problems in a reflexive Banach space. We establish strong duality for a very general type of augmented Lagrangian, in which we assume a less restrictive type of coercivity on the augmenting function. We solve the dual problem (in a Hilbert space) using a deflected subgradient method via this general augmented Lagrangian. We provide two choices of step-size for the method. For both choices, we prove that every weak accumulation point of the primal sequence is a primal solution. We also prove strong convergence of the dual sequence.


title: GDB: Gated convolutions-based Document Binarization

abstract: Document binarization is a key pre-processing step for many document analysis tasks. However, existing methods can not extract stroke edges finely, mainly due to the fair-treatment nature of vanilla convolutions and the extraction of stroke edges without adequate supervision by boundary-related information. In this paper, we formulate text extraction as the learning of gating values and propose an end-to-end gated convolutions-based network (GDB) to solve the problem of imprecise stroke edge extraction. The gated convolutions are applied to selectively extract the features of strokes with different attention. Our proposed framework consists of two stages. Firstly, a coarse sub-network with an extra edge branch is trained to get more precise feature maps by feeding a priori mask and edge. Secondly, a refinement sub-network is cascaded to refine the output of the first stage by gated convolutions based on the sharp edge. For global information, GDB also contains a multi-scale operation to combine local and global features. We conduct comprehensive experiments on ten Document Image Binarization Contest (DIBCO) datasets from 2009 to 2019. Experimental results show that our proposed methods outperform the state-of-the-art methods in terms of all metrics on average and achieve top ranking on six benchmark datasets.


title: Quantum computation: Efficient network partitioning for large scale critical infrastructures

abstract: Quantum computers are emerging as a viable alternative to tackle certain computational problems that are challenging for classical computers. With the rapid development of quantum hardware such as those based on trapped ions, there is practical motivation for identifying risk management problems that are efficiently solvable with these systems. Here we focus on network partitioning as a means for analyzing risk in critical infrastructures and present a quantum approach for its implementation. It is based on the potential speedup quantum computers can provide in the identification of eigenvalues and eigenvectors of sparse graph Laplacians, a procedure which is constrained by time and memory on classical computers.


title: X-ReID: Cross-Instance Transformer for Identity-Level Person Re-Identification

abstract: Currently, most existing person re-identification methods use Instance-Level features, which are extracted only from a single image. However, these Instance-Level features can easily ignore the discriminative information due to the appearance of each identity varies greatly in different images. Thus, it is necessary to exploit Identity-Level features, which can be shared across different images of each identity. In this paper, we propose to promote Instance-Level features to Identity-Level features by employing cross-attention to incorporate information from one image to another of the same identity, thus more unified and discriminative pedestrian information can be obtained. We propose a novel training framework named X-ReID. Specifically, a Cross Intra-Identity Instances module (IntraX) fuses different intra-identity instances to transfer Identity-Level knowledge and make Instance-Level features more compact. A Cross Inter-Identity Instances module (InterX) involves hard positive and hard negative instances to improve the attention response to the same identity instead of different identity, which minimizes intra-identity variation and maximizes inter-identity variation. Extensive experiments on benchmark datasets show the superiority of our method over existing works. Particularly, on the challenging MSMT17, our proposed method gains 1.1% mAP improvements when compared to the second place.


title: AONN: An adjoint-oriented neural network method for all-at-once solutions of parametric optimal control problems

abstract: Parametric optimal control problems governed by partial differential equations (PDEs) are widely found in scientific and engineering applications. Traditional grid-based numerical methods for such problems generally require repeated solutions of PDEs with different parameter settings, which is computationally prohibitive especially for problems with high-dimensional parameter spaces. Although recently proposed neural network methods make it possible to obtain the optimal solutions simultaneously for different parameters, challenges still remain when dealing with problems with complex constraints. In this paper, we propose AONN, an adjoint-oriented neural network method, to overcome the limitations of existing approaches in solving parametric optimal control problems. In AONN, the neural networks are served as parametric surrogate models for the control, adjoint and state functions to get the optimal solutions all at once. In order to reduce the training difficulty and handle complex constraints, we introduce an iterative training framework inspired by the classical direct-adjoint looping (DAL) method so that penalty terms arising from the Karush-Kuhn-Tucker (KKT) system can be avoided. Once the training is done, parameter-specific optimal solutions can be quickly computed through the forward propagation of the neural networks, which may be further used for analyzing the parametric properties of the optimal solutions. The validity and efficiency of AONN is demonstrated through a series of numerical experiments with problems involving various types of parameters.


title: Cross-Frequency Time Series Meta-Forecasting

abstract: Meta-forecasting is a newly emerging field which combines meta-learning and time series forecasting. The goal of meta-forecasting is to train over a collection of source time series and generalize to new time series one-at-a-time. Previous approaches in meta-forecasting achieve competitive performance, but with the restriction of training a separate model for each sampling frequency. In this work, we investigate meta-forecasting over different sampling frequencies, and introduce a new model, the Continuous Frequency Adapter (CFA), specifically designed to learn frequency-invariant representations. We find that CFA greatly improves performance when generalizing to unseen frequencies, providing a first step towards forecasting over larger multi-frequency datasets.


title: FGSI: Distant Supervision for Relation Extraction method based on Fine-Grained Semantic Information

abstract: The main purpose of relation extraction is to extract the semantic relationships between tagged pairs of entities in a sentence, which plays an important role in the semantic understanding of sentences and the construction of knowledge graphs. In this paper, we propose that the key semantic information within a sentence plays a key role in the relationship extraction of entities. We propose the hypothesis that the key semantic information inside the sentence plays a key role in entity relationship extraction. And based on this hypothesis, we split the sentence into three segments according to the location of the entity from the inside of the sentence, and find the fine-grained semantic features inside the sentence through the intra-sentence attention mechanism to reduce the interference of irrelevant noise information. The proposed relational extraction model can make full use of the available positive semantic information. The experimental results show that the proposed relation extraction model improves the accuracy-recall curves and P@N values compared with existing methods, which proves the effectiveness of this model.


title: Sparse Resource Allocation for Spreading Processes on Temporal-Switching Networks

abstract: Spreading processes, e.g. epidemics, wildfires and rumors, are often modeled on static networks. However, their underlying network structures, e.g. changing contacts in social networks, different weather forecasts for wildfires, are due to ever-changing circumstances inherently time-varying in nature. In this paper, we therefore, propose an optimization framework for sparse resource allocation for control of spreading processes over temporal networks with known connectivity patterns. We use convex optimization, in particular exponential cone programming, and dynamic programming techniques to bound and minimize the risk of an undetected outbreak by allocating budgeted resources each time step. We demonstrate with misinformation, epidemic and wildfire examples how the method can provide targeted allocation of resources.


title: Improving Prediction Backward-Compatiblility in NLP Model Upgrade with Gated Fusion

abstract: When upgrading neural models to a newer version, new errors that were not encountered in the legacy version can be introduced, known as regression errors. This inconsistent behavior during model upgrade often outweighs the benefits of accuracy gain and hinders the adoption of new models. To mitigate regression errors from model upgrade, distillation and ensemble have proven to be viable solutions without significant compromise in performance. Despite the progress, these approaches attained an incremental reduction in regression which is still far from achieving backward-compatible model upgrade. In this work, we propose a novel method, Gated Fusion, that promotes backward compatibility via learning to mix predictions between old and new models. Empirical results on two distinct model upgrade scenarios show that our method reduces the number of regression errors by 62% on average, outperforming the strongest baseline by an average of 25%.


title: Testing Neutrino Dipole Portal by Long-lived Particle Detectors at the LHC

abstract: We discuss the potential of using detectors aimed for searching long-lived particles~(LLP) at the high-luminosity LHC run, to probe the neutrino dipole models. This is achieved by taking the heavy neutral leptons~(HNL) of the models as candidates of the LLPs. Taking into account the dipole couplings to the weak bosons, $d_{W,Z}$, which control the production of the HNLs at the LHC, we discuss the reach on the electromagnetic dipole couplings, $d_\gamma$, by searching for a single high-energy photon at LLP detectors. Four typical scenarios are considered in this paper, scenario A, B with $d_{W}=0$ or $d_{Z}=0$, and scenario C, D with $d_{W,Z}\gg d_\gamma$. We show the sensitivity on $d_\gamma$, can be fairly different depending on the relations between the $d_{W,Z}$ and $d_\gamma$. And the LLP detectors can potentially extend the sensitivity on dipole couplings during the High-luminosity runs of the LHC in certain scenarios.


title: HAFFET: Hybrid Analytic Flux FittEr for Transients

abstract: The progenitors for many types of supernovae (SNe) are still unknown, and an approach to diagnose their physical origins is to investigate the light curve brightness and shape of a large set of SNe. However, it is often difficult to compare and contrast the existing sample studies due to differences in their approaches and assumptions, for example in how to eliminate host galaxy extinction, and this might lead to systematic errors when comparing the results. We therefore introduce the Hybrid Analytic Flux FittEr for Transients (haffet), a Python-based software package that can be applied to download photometric and spectroscopic data for transients from open online sources, derive bolometric light curves, and fit them to semi-analytical models for estimation of their physical parameters. In a companion study, we have investigated a large collection of SNe Ib and Ic observed with the Zwicky Transient Facility (ZTF) with haffet, and here we detail the methodology and the software package to encourage more users. As large-scale surveys such as ZTF and LSST continue to discover increasing numbers of transients, tools such as haffet will be critical for enabling rapid comparison of models against data in statistically consistent, comparable and reproducable ways. Additionally, haffet is created with a Graphical User Interface mode, which we hope will boost the efficiency and make the usage much easier.


title: Evaluating Large Language Models in Theory of Mind Tasks

abstract: Eleven Large Language Models (LLMs) were assessed using a custom-made battery of false-belief tasks, considered a gold standard in testing Theory of Mind (ToM) in humans. The battery included 640 prompts spread across 40 diverse tasks, each one including a false-belief scenario, three closely matched true-belief control scenarios, and the reversed versions of all four. To solve a single task, a model needed to correctly answer 16 prompts across all eight scenarios. Smaller and older models solved no tasks; GPT-3-davinci-003 (from November 2022) and ChatGPT-3.5-turbo (from March 2023) solved 20% of the tasks; ChatGPT-4 (from June 2023) solved 75% of the tasks, matching the performance of six-year-old children observed in past studies. We explore the potential interpretation of these findings, including the intriguing possibility that ToM, previously considered exclusive to humans, may have spontaneously emerged as a byproduct of LLMs' improving language skills.


title: Probing the $Hgg$ coupling through the jet charge correlation in Higgs boson decay

abstract: The effective coupling of the Higgs boson to gluons determines the production rate of the Higgs boson at the LHC and plays a crucial role to measure the Higgs properties. In this paper, we propose a novel method to extract the Higgs gluon gauge coupling information at the future lepton colliders, by utilizing the jet charge asymmetry of the two leading jets from the Higgs boson decay. Owing to the jet charge correlation nature of the Higgs decay products, we demonstrate that this asymmetry value would be close to one for the signal $H\to gg$, while it is always larger than one for the dominated backgrounds. With the help of the jet charge information, it is possible to constrain the Higgs gluon effective coupling very well in the future Higgs factory and this conclusion is not sensitive to the jet charge parameter $\kappa$.


title: Semicontinuous maps on module varieties

abstract: We study semicontinuous maps on varieties of modules over finite-dimensional algebras. We prove that truncated Euler maps are upper or lower semicontinuous. This implies that $g$-vectors and $E$-invariants of modules are upper semicontinuous. We also discuss inequalities of generic values of some upper semicontinuous maps.


title: The Born Rule -- Axiom or Result?

abstract: The Born rule is part of the collapse axiom in the standard version of quantum theory, as presented by standard textbooks on the subject. We show here that its signature quadratic dependence follows from a single additional physical assumption beyond the other axioms - namely, that the probability of a particular measurement outcome (the state $\phi_k$, say) is independent of the choice of observable to be measured, so long as one of its eigenstates corresponds to that outcome. We call this assumption ``observable independence.'' As a consequence, the Born rule cannot be completely eliminated from the list of axioms, but it can, in principle, be reduced to a more physical statement. Our presentation is suitable for advanced undergraduates or graduate students who have taken a standard course in quantum theory. It does not depend on any particular interpretation of the theory.


title: Reconstructing the cosmological density and velocity fields from redshifted galaxy distributions using V-net

abstract: The distribution of matter that is measured through galaxy redshift and peculiar velocity surveys can be harnessed to learn about the physics of dark matter, dark energy, and the nature of gravity. To improve our understanding of the matter of the Universe, we can reconstruct the full density and velocity fields from the galaxies that act as tracer particles. In this paper, we use the simulated halos as proxies for the galaxies. We use a convolutional neural network, a V-net, trained on numerical simulations of structure formation to reconstruct the density and velocity fields. We find that, with detailed tuning of the loss function, the V-net could produce better fits to the density field in the high-density and low-density regions, and improved predictions for the probability distribution of the amplitudes of the velocities. However, the weights will reduce the precision of the estimated $\beta$ parameter. We also find that the redshift-space distortions of the halo catalogue do not significantly contaminate the reconstructed real-space density and velocity field. We estimate the velocity field $\beta$ parameter by comparing the peculiar velocities of halo catalogues to the reconstructed velocity fields, and find the estimated $\beta$ values agree with the fiducial value at the 68\% confidence level.


title: AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis

abstract: Can machines recording an audio-visual scene produce realistic, matching audio-visual experiences at novel positions and novel view directions? We answer it by studying a new task -- real-world audio-visual scene synthesis -- and a first-of-its-kind NeRF-based approach for multimodal learning. Concretely, given a video recording of an audio-visual scene, the task is to synthesize new videos with spatial audios along arbitrary novel camera trajectories in that scene. We propose an acoustic-aware audio generation module that integrates prior knowledge of audio propagation into NeRF, in which we implicitly associate audio generation with the 3D geometry and material properties of a visual environment. Furthermore, we present a coordinate transformation module that expresses a view direction relative to the sound source, enabling the model to learn sound source-centric acoustic fields. To facilitate the study of this new task, we collect a high-quality Real-World Audio-Visual Scene (RWAVS) dataset. We demonstrate the advantages of our method on this real-world dataset and the simulation-based SoundSpaces dataset.


title: MOMA:Distill from Self-Supervised Teachers

abstract: Contrastive Learning and Masked Image Modelling have demonstrated exceptional performance on self-supervised representation learning, where Momentum Contrast (i.e., MoCo) and Masked AutoEncoder (i.e., MAE) are the state-of-the-art, respectively. In this work, we propose MOMA to distill from pre-trained MoCo and MAE in a self-supervised manner to collaborate the knowledge from both paradigms. We introduce three different mechanisms of knowledge transfer in the propsoed MOMA framework. : (1) Distill pre-trained MoCo to MAE. (2) Distill pre-trained MAE to MoCo (3) Distill pre-trained MoCo and MAE to a random initialized student. During the distillation, the teacher and the student are fed with original inputs and masked inputs, respectively. The learning is enabled by aligning the normalized representations from the teacher and the projected representations from the student. This simple design leads to efficient computation with extremely high mask ratio and dramatically reduced training epochs, and does not require extra considerations on the distillation target. The experiments show MOMA delivers compact student models with comparable performance to existing state-of-the-art methods, combining the power of both self-supervised learning paradigms. It presents competitive results against different benchmarks in computer vision. We hope our method provides an insight on transferring and adapting the knowledge from large-scale pre-trained models in a computationally efficient way.


title: Minimally modified gravity with auxiliary constraints formalism

abstract: We investigate the possibility of reducing the number of degrees of freedom (d.o.f.) starting from generic metric theories of gravity by introducing multiple auxiliary constraints (ACs), under the restriction of retaining spatial covariance as a gauge symmetry. Arbitrary numbers of scalar-, vector- and tensor-type ACs are considered a priori, yet we find that no vector- and tensor-type constraints should be introduced, and that scalar-type ACs should be no more than four for the purpose of constructing minimally modified gravity (MMG) theories which propagate only two tensorial d.o.f., like general relativity (GR). Through a detailed Hamiltonian analysis, we exhaust all the possible classifications of ACs and find out the corresponding minimalizing and symmetrizing conditions for obtaining the MMG theories. In particular, no condition is required in the case of four ACs, hence in this case the theory can couple with matter consistently and naturally. To illustrate our formalism, we build a concrete model for this specific case by using the Cayley-Hamilton theorem and derive the dispersion relation of the gravitational waves, which is subject to constraints from the observations.


title: Reducing ANN-SNN Conversion Error through Residual Membrane Potential

abstract: Spiking Neural Networks (SNNs) have received extensive academic attention due to the unique properties of low power consumption and high-speed computing on neuromorphic chips. Among various training methods of SNNs, ANN-SNN conversion has shown the equivalent level of performance as ANNs on large-scale datasets. However, unevenness error, which refers to the deviation caused by different temporal sequences of spike arrival on activation layers, has not been effectively resolved and seriously suffers the performance of SNNs under the condition of short time-steps. In this paper, we make a detailed analysis of unevenness error and divide it into four categories. We point out that the case of the ANN output being zero while the SNN output being larger than zero accounts for the largest percentage. Based on this, we theoretically prove the sufficient and necessary conditions of this case and propose an optimization strategy based on residual membrane potential to reduce unevenness error. The experimental results show that the proposed method achieves state-of-the-art performance on CIFAR-10, CIFAR-100, and ImageNet datasets. For example, we reach top-1 accuracy of 64.32\% on ImageNet with 10-steps. To the best of our knowledge, this is the first time ANN-SNN conversion can simultaneously achieve high accuracy and ultra-low-latency on the complex dataset. Code is available at https://github.com/hzc1208/ANN2SNN\_SRP.


title: Interpolation for Robust Learning: Data Augmentation on Wasserstein Geodesics

abstract: We propose to study and promote the robustness of a model as per its performance through the interpolation of training data distributions. Specifically, (1) we augment the data by finding the worst-case Wasserstein barycenter on the geodesic connecting subpopulation distributions of different categories. (2) We regularize the model for smoother performance on the continuous geodesic path connecting subpopulation distributions. (3) Additionally, we provide a theoretical guarantee of robustness improvement and investigate how the geodesic location and the sample size contribute, respectively. Experimental validations of the proposed strategy on \textit{four} datasets, including CIFAR-100 and ImageNet, establish the efficacy of our method, e.g., our method improves the baselines' certifiable robustness on CIFAR10 up to $7.7\%$, with $16.8\%$ on empirical robustness on CIFAR-100. Our work provides a new perspective of model robustness through the lens of Wasserstein geodesic-based interpolation with a practical off-the-shelf strategy that can be combined with existing robust training methods.


title: Knowledge-enhanced Neural Machine Reasoning: A Review

abstract: Knowledge-enhanced neural machine reasoning has garnered significant attention as a cutting-edge yet challenging research area with numerous practical applications. Over the past few years, plenty of studies have leveraged various forms of external knowledge to augment the reasoning capabilities of deep models, tackling challenges such as effective knowledge integration, implicit knowledge mining, and problems of tractability and optimization. However, there is a dearth of a comprehensive technical review of the existing knowledge-enhanced reasoning techniques across the diverse range of application domains. This survey provides an in-depth examination of recent advancements in the field, introducing a novel taxonomy that categorizes existing knowledge-enhanced methods into two primary categories and four subcategories. We systematically discuss these methods and highlight their correlations, strengths, and limitations. Finally, we elucidate the current application domains and provide insight into promising prospects for future research.


title: Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Models

abstract: The field of data visualisation has long aimed to devise solutions for generating visualisations directly from natural language text. Research in Natural Language Interfaces (NLIs) has contributed towards the development of such techniques. However, the implementation of workable NLIs has always been challenging due to the inherent ambiguity of natural language, as well as in consequence of unclear and poorly written user queries which pose problems for existing language models in discerning user intent. Instead of pursuing the usual path of developing new iterations of language models, this study uniquely proposes leveraging the advancements in pre-trained large language models (LLMs) such as ChatGPT and GPT-3 to convert free-form natural language directly into code for appropriate visualisations. This paper presents a novel system, Chat2VIS, which takes advantage of the capabilities of LLMs and demonstrates how, with effective prompt engineering, the complex problem of language understanding can be solved more efficiently, resulting in simpler and more accurate end-to-end solutions than prior approaches. Chat2VIS shows that LLMs together with the proposed prompts offer a reliable approach to rendering visualisations from natural language queries, even when queries are highly misspecified and underspecified. This solution also presents a significant reduction in costs for the development of NLI systems, while attaining greater visualisation inference abilities compared to traditional NLP approaches that use hand-crafted grammar rules and tailored models. This study also presents how LLM prompts can be constructed in a way that preserves data security and privacy while being generalisable to different datasets. This work compares the performance of GPT-3, Codex and ChatGPT across a number of case studies and contrasts the performances with prior studies.


title: Ultra-Low Power Neuromorphic Obstacle Detection Using a Two-Dimensional Materials-Based Subthreshold Transistor

abstract: Accurate, timely and selective detection of moving obstacles is crucial for reliable collision avoidance in autonomous robots. The area- and energy-inefficiency of CMOS-based spiking neurons for obstacle detection can be addressed through the reconfigurable, tunable and low-power operation capabilities of emerging two-dimensional (2D) materials-based devices. We present an ultra-low power spiking neuron built using an electrostatically tuned dual-gate transistor with an ultra-thin and generic 2D material channel. The 2D subthreshold transistor (2D-ST) is carefully designed to operate under low-current subthreshold regime. Carrier transport has been modelled via over-the-barrier thermionic and Fowler-Nordheim contact barrier tunnelling currents over a wide range of gate and drain biases. Simulation of a neuron circuit designed using the 2D-ST with 45 nm CMOS technology components shows high energy efficiency of ~3.5 pJ/spike and biomimetic class-I as well as oscillatory spiking. It also demonstrates complex neuronal behaviors such as spike-frequency adaptation and post-inhibitory rebound that are crucial for dynamic visual systems. Lobula giant movement detector (LGMD) is a collision-detecting biological neuron found in locusts. Our neuron circuit can generate LGMD-like spiking behavior and detect obstacles at an energy cost of <100 pJ. Further, it can be reconfigured to distinguish between looming and receding objects with high selectivity.


title: Matrix Estimation for Individual Fairness

abstract: In recent years, multiple notions of algorithmic fairness have arisen. One such notion is individual fairness (IF), which requires that individuals who are similar receive similar treatment. In parallel, matrix estimation (ME) has emerged as a natural paradigm for handling noisy data with missing values. In this work, we connect the two concepts. We show that pre-processing data using ME can improve an algorithm's IF without sacrificing performance. Specifically, we show that using a popular ME method known as singular value thresholding (SVT) to pre-process the data provides a strong IF guarantee under appropriate conditions. We then show that, under analogous conditions, SVT pre-processing also yields estimates that are consistent and approximately minimax optimal. As such, the ME pre-processing step does not, under the stated conditions, increase the prediction error of the base algorithm, i.e., does not impose a fairness-performance trade-off. We verify these results on synthetic and real data.


title: Unsupervised Ensemble Methods for Anomaly Detection in PLC-based Process Control

abstract: Programmable logic controller (PLC) based industrial control systems (ICS) are used to monitor and control critical infrastructure. Integration of communication networks and an Internet of Things approach in ICS has increased ICS vulnerability to cyber-attacks. This work proposes novel unsupervised machine learning ensemble methods for anomaly detection in PLC-based ICS. The work presents two broad approaches to anomaly detection: a weighted voting ensemble approach with a learning algorithm based on coefficient of determination and a stacking-based ensemble approach using isolation forest meta-detector. The two ensemble methods were analyzed via an open-source PLC-based ICS subjected to multiple attack scenarios as a case study. The work considers four different learning models for the weighted voting ensemble method. Comparative performance analyses of five ensemble methods driven diverse base detectors are presented. Results show that stacking-based ensemble method using isolation forest meta-detector achieves superior performance to previous work on all performance metrics. Results also suggest that effective unsupervised ensemble methods, such as stacking-based ensemble having isolation forest meta-detector, can robustly detect anomalies in arbitrary ICS datasets. Finally, the presented results were validated by using statistical hypothesis tests.


title: An example derived from Lorenz attractor

abstract: We consider a DA-type surgery of the famous Lorenz attractor in dimension 4. This kind of surgeries have been firstly used by Smale [S] and Ma\~n\'e [M1] to give important examples in the study of partially hyperbolic systems. Our construction gives the first example of a singular chain recurrence class which is Lyapunov stable, away from homoclinic tangencies and exhibits robustly heterodimensional cycles. Moreover, the chain recurrence class has the following interesting property: there exists robustly a 2-dimensional sectionally expanding subbundle (containing the flow direction) of the tangent bundle such that it is properly included in a subbundle of the finest dominated splitting for the tangent flow.


title: Semilinear elliptic equations involving fractional Hardy operators

abstract: Our aim in this article is to study semilinear elliptic equations involving a fractional Hardy operator, an absorption and a Radon source in a weighted distributional sense. We show various scenarios, produced by the combined effect of the fractional Hardy potential, the growth of the absorption term and the concentration of the measure, in which existence and uniqueness results holds.


title: Single-shot polarization-resolved ultrafast mapping photography

abstract: Single-shot ultrafast optical imaging plays a very important role in the detection of transient scenes, especially in capturing irreversible or stochastic dynamic scenes. To break the limit of time response speed of electronic devices, such as charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) detectors, ultrafast optical imaging techniques usually convert the time information of a transient scene into the wavelength, angle, space or spatial frequency of the illumination light in previous studies. In this work, we propose a novel polarization-resolved ultrafast mapping photography (PUMP) technique by converting the time information into the polarization. Here, the spatiotemporal information of a dynamic scene is loaded into a rotationally polarized illumination laser pulse, and a polarization filtering in imaging detection and a deconvolution algorithm in image reconstruction are used to extract the original dynamic scene. In our PUMP system, the temporal resolution is 850 fs, the spatial resolution is 28.5 lp/mm at 700 micrometer by 700 micrometer field of view, and the number of frames is 16. By using PUMP, a spatiotemporal dynamics of femtosecond laser ablation in an indium tin oxide film on glass substrate is successfully captured. PUMP provides a new solution for measuring the transient scenes in a snapshot, which will bring a very wide range of applications in the field of ultrafast science.


title: GRANDE: a neural model over directed multigraphs with application to anti-money laundering

abstract: The application of graph representation learning techniques to the area of financial risk management (FRM) has attracted significant attention recently. However, directly modeling transaction networks using graph neural models remains challenging: Firstly, transaction networks are directed multigraphs by nature, which could not be properly handled with most of the current off-the-shelf graph neural networks (GNN). Secondly, a crucial problem in FRM scenarios like anti-money laundering (AML) is to identify risky transactions and is most naturally cast into an edge classification problem with rich edge-level features, which are not fully exploited by the prevailing GNN design that follows node-centric message passing protocols. In this paper, we present a systematic investigation of design aspects of neural models over directed multigraphs and develop a novel GNN protocol that overcomes the above challenges via efficiently incorporating directional information, as well as proposing an enhancement that targets edge-related tasks using a novel message passing scheme over an extension of edge-to-node dual graph. A concrete GNN architecture called GRANDE is derived using the proposed protocol, with several further improvements and generalizations to temporal dynamic graphs. We apply the GRANDE model to both a real-world anti-money laundering task and public datasets. Experimental evaluations show the superiority of the proposed GRANDE architecture over recent state-of-the-art models on dynamic graph modeling and directed graph modeling.


title: Amazon Last-Mile Delivery Trajectory Prediction Using Hierarchical TSP with Customized Cost Matrix

abstract: In response to the Amazon Last-Mile Routing Challenge, Team Permission Denied proposes a hierarchical Travelling Salesman Problem (TSP) optimization with a customized cost matrix. The higher level TSP solves for the zone sequence while the lower level TSP solves the intra-zonal stop sequence. The cost matrix is modified to account for routing patterns beyond the shortest travel time. Lastly, some post-processing is done to edit the sequence to match commonly observed routing patterns, such as when travel times are similar, drivers usually start with stops with more packages than those with fewer packages. The model is tested on 1223 routes that are randomly selected out of the training set and the score is 0.0381. On the 13 routes in the given model apply set, the score was 0.0375.


title: Three-Wave and Four-Wave Interactions in the $4d$ Einstein Gauss-Bonnet (EGB) and Lovelock Theories

abstract: We derive the conformal constraints satisfied by classical vertices of a (Einstein) Gauss-Bonnet theory around flat space, in general dimensions and at $d=4$ (4d EGB). In $4d$ EGB they are obtained by a singular limit of the integral of the Euler-Poincar\`e density. Our analysis exploits the relation between this theory and the conformal anomaly action, which allows to uncover some interesting features of the GB vertex at cubic and quartic level. If we introduce a conformal decomposition of the metric, the resulting theory can be formulated in two different versions, which are regularization dependent, a local one which is quartic in the dilaton field, and a nonlocal one, with a quadratic dilaton. The nonlocal version is derived by a finite redefinition of the GB density with the inclusion of a $(d-4)R^2$ correction, before performing the singular $d\to 4$ limit. In the local version of the theory, we show how the independent dynamics of the metric and of the dilaton are interwinded by a classical trace identity. Three-gravitational wave interactions can be organised in a nontrivial way by using directly the nonlocal 4d EGB version of the theory. This is possible thanks to the consistency of such formulation - only up to 3-point functions - directly inherited from the conformal anomaly (Riegert) action. The constraints satisfied by the vertices are classical, hierarchical Ward identities. At quartic level, similar relations are derived, borrowing from the analysis of the counterterms of the 4T correlators of the conformal anomaly action, as defined by a perturbative expansion. For $d\neq 4$ these constraints hold also for Lovelock actions. They can be extended to higher order topological invariants in such class of theories.


title: HardSATGEN: Understanding the Difficulty of Hard SAT Formula Generation and A Strong Structure-Hardness-Aware Baseline

abstract: Industrial SAT formula generation is a critical yet challenging task. Existing SAT generation approaches can hardly simultaneously capture the global structural properties and maintain plausible computational hardness. We first present an in-depth analysis for the limitation of previous learning methods in reproducing the computational hardness of original instances, which may stem from the inherent homogeneity in their adopted split-merge procedure. On top of the observations that industrial formulae exhibit clear community structure and oversplit substructures lead to the difficulty in semantic formation of logical structures, we propose HardSATGEN, which introduces a fine-grained control mechanism to the neural split-merge paradigm for SAT formula generation to better recover the structural and computational properties of the industrial benchmarks. Experiments including evaluations on private and practical corporate testbed show the superiority of HardSATGEN being the only method to successfully augment formulae maintaining similar computational hardness and capturing the global structural properties simultaneously. Compared to the best previous methods, the average performance gains achieve 38.5% in structural statistics, 88.4% in computational metrics, and over 140.7% in the effectiveness of guiding solver tuning by our generated instances. Source code is available at http://github.com/Thinklab-SJTU/HardSATGEN


title: Computational philosophy of science

abstract: Philosophy of science attempts to describe all parts of the scientific process in a general way in order to facilitate the description, execution and improvements of this process. So far, all proposed philosophies have only covered existing processes and disciplines partially and imperfectly. In particular logical approaches have always received a lot of attention due to attempts to fundamentally address issues with the definition of science as a discipline with reductionist theories. We propose a new way to approach the problem from the perspective of computational complexity and argue why this approach may be better than previous propositions based on pure logic and mathematics.


title: Losses of thulium atoms from optical dipole traps operating at 532 and 1064 nm

abstract: Recently thulium has been condensed to Bose-Einstein condensate. Machine learning was used to avoid a detailed study of all obstacles making cooling difficult. This paper analyses the atomic loss mechanism for the 532 nm optical trap, used in the Bose-condensation experiment, and compares it with the alternative and more traditional micron-range optical dipole trap. We also measured the scalar and tensor polarizability of thulium at 1064 nm and was found to be $167\pm 25$ a.u. ($275\pm 41\times {{10}^{-41}}\text{F }\cdot \text{ }{{\text{m}}^{\text{2}}}$) and $-4\pm 1$ a.u. ($7\pm 2\times {{10}^{-41}}\text{F }\cdot \text{ }{{\text{m}}^{\text{2}}}$).


title: Localization as a key enabler of 6G wireless systems: A comprehensive survey and an outlook

abstract: When fully implemented, sixth generation (6G) wireless systems will constitute intelligent wireless networks that enable not only ubiquitous communication but also high-accuracy localization services. They will be the driving force behind this transformation by introducing a new set of characteristics and service capabilities in which location will coexist with communication while sharing available resources. To that purpose, this survey investigates the envisioned applications and use cases of localization in future 6G wireless systems, while analyzing the impact of the major technology enablers. Afterwards, system models for millimeter wave, terahertz and visible light positioning that take into account both line-of-sight (LOS) and non-LOS channels are presented, while localization key performance indicators are revisited alongside mathematical definitions. Moreover, a detailed review of the state of the art conventional and learning-based localization techniques is conducted. Furthermore, the localization problem is formulated, the wireless system design is considered and the optimization of both is investigated. Finally, insights that arise from the presented analysis are summarized and used to highlight the most important future directions for localization in 6G wireless systems.


title: Knowledge Distillation in Vision Transformers: A Critical Review

abstract: In Natural Language Processing (NLP), Transformers have already revolutionized the field by utilizing an attention-based encoder-decoder model. Recently, some pioneering works have employed Transformer-like architectures in Computer Vision (CV) and they have reported outstanding performance of these architectures in tasks such as image classification, object detection, and semantic segmentation. Vision Transformers (ViTs) have demonstrated impressive performance improvements over Convolutional Neural Networks (CNNs) due to their competitive modelling capabilities. However, these architectures demand massive computational resources which makes these models difficult to be deployed in the resource-constrained applications. Many solutions have been developed to combat this issue, such as compressive transformers and compression functions such as dilated convolution, min-max pooling, 1D convolution, etc. Model compression has recently attracted considerable research attention as a potential remedy. A number of model compression methods have been proposed in the literature such as weight quantization, weight multiplexing, pruning and Knowledge Distillation (KD). However, techniques like weight quantization, pruning and weight multiplexing typically involve complex pipelines for performing the compression. KD has been found to be a simple and much effective model compression technique that allows a relatively simple model to perform tasks almost as accurately as a complex model. This paper discusses various approaches based upon KD for effective compression of ViT models. The paper elucidates the role played by KD in reducing the computational and memory requirements of these models. The paper also presents the various challenges faced by ViTs that are yet to be resolved.


title: Rich Words in the Block Reversal of a Word

abstract: The block reversal of a word $w$, denoted by $\mathtt{BR}(w)$, is a generalization of the concept of the reversal of a word, obtained by concatenating the blocks of the word in the reverse order. We characterize non-binary and binary words whose block reversal contains only rich words. We prove that for a binary word $w$, richness of all elements of $\mathtt{BR}(w)$ depends on $l(w)$, the length of the run sequence of $w$. We show that if all elements of $\mathtt{BR}(w)$ are rich, then $2\leq l(w)\leq 8$. We also provide the structure of such words.


title: A Scalar-on-Quantile-Function Approach for Estimating Short-term Health Effects of Environmental Exposures

abstract: Environmental epidemiologic studies routinely utilize aggregate health outcomes to estimate effects of short-term (e.g., daily) exposures that are available at increasingly fine spatial resolutions. However, areal averages are typically used to derive population-level exposure, which cannot capture the spatial variation and individual heterogeneity in exposures that may occur within the spatial and temporal unit of interest (e.g., within day or ZIP code). We propose a general modeling approach to incorporate within-unit exposure heterogeneity in health analyses via exposure quantile functions. Furthermore, by viewing the exposure quantile function as a functional covariate, our approach provides additional flexibility in characterizing associations at different quantile levels. We apply the proposed approach to an analysis of air pollution and emergency department (ED) visits in Atlanta over four years. The analysis utilizes daily ZIP code-level distributions of personal exposures to four traffic-related ambient air pollutants simulated from the Stochastic Human Exposure and Dose Simulator. Our analyses find that effects of carbon monoxide on respiratory and cardiovascular disease ED visits are more pronounced with changes in lower quantiles of the population-level exposure. Software for implement is provided in the R package nbRegQF.


title: A method to measure the quenching factor for recoil energy of oxygen in bismuth germanium oxide scintillators

abstract: Bismuth germanium oxide ($\rm Bi_{4} Ge_{3} O_{12}$, BGO) scintillation crystals are widely used as detectors in the fields of particle physics and astrophysics due to their high density, and thus higher efficiency for gamma-ray detection. Owing to their good chemical stability, they can be used in any environment. For rare-event searches, such as dark matter and coherent elastic neutrino-nucleus scattering, BGO crystals are essential to comprehend the response of nuclear recoil. In this study, we have analyzed the events of neutron elastic scattering with oxygen in BGO crystals. Then, we have measured the quenching factor for oxygen recoil energy in the BGO crystal as a function of recoil energy by using a monoenergetic neutron source.


title: Detecting Security Patches via Behavioral Data in Code Repositories

abstract: The absolute majority of software today is developed collaboratively using collaborative version control tools such as Git. It is a common practice that once a vulnerability is detected and fixed, the developers behind the software issue a Common Vulnerabilities and Exposures or CVE record to alert the user community of the security hazard and urge them to integrate the security patch. However, some companies might not disclose their vulnerabilities and just update their repository. As a result, users are unaware of the vulnerability and may remain exposed. In this paper, we present a system to automatically identify security patches using only the developer behavior in the Git repository without analyzing the code itself or the remarks that accompanied the fix (commit message). We showed we can reveal concealed security patches with an accuracy of 88.3% and F1 Score of 89.8%. This is the first time that a language-oblivious solution for this problem is presented.


title: Personalized Graph Signal Processing for Collaborative Filtering

abstract: The collaborative filtering (CF) problem with only user-item interaction information can be solved by graph signal processing (GSP), which uses low-pass filters to smooth the observed interaction signals on the similarity graph to obtain the prediction signals. However, the interaction signal may not be sufficient to accurately characterize user interests and the low-pass filters may ignore the useful information contained in the high-frequency component of the observed signals, resulting in suboptimal accuracy. To this end, we propose a personalized graph signal processing (PGSP) method for collaborative filtering. Firstly, we design the personalized graph signal containing richer user information and construct an augmented similarity graph containing more graph topology information, to more effectively characterize user interests. Secondly, we devise a mixed-frequency graph filter to introduce useful information in the high-frequency components of the observed signals by combining an ideal low-pass filter that smooths signals globally and a linear low-pass filter that smooths signals locally. Finally, we combine the personalized graph signal, the augmented similarity graph and the mixed-frequency graph filter by proposing a pipeline consisting of three key steps: pre-processing, graph convolution and post-processing. Extensive experiments show that PGSP can achieve superior accuracy compared with state-of-the-art CF methods and, as a nonparametric method, PGSP has very high training efficiency.


title: Complex Berry phase and imperfect non-Hermitian phase transitions

abstract: In many classical and quantum systems described by an effective non-Hermitian Hamiltonian, spectral phase transitions, from an entirely real energy spectrum to a complex spectrum, can be observed as a non-Hermitian parameter in the system is increased above a critical value. A paradigmatic example is provided by systems possessing parity-time (PT) symmetry, where the energy spectrum remains entirely real in the unbroken PT phase while a transition to complex energies is observed in the unbroken PT phase. Such spectral phase transitions are universally sharp. However, when the system is slowly and periodically cycled, the phase transition can become smooth, i.e. imperfect, owing to the complex Berry phase associated to the cyclic adiabatic evolution of the system. This remarkable phenomenon is illustrated by considering the spectral phase transition of the Wannier-Stark ladders in a PT-symmetric class of two-band non-Hermitian lattices subjected to an external dc field, unraveling that a non-vanishing imaginary part of the Zak phase -- the Berry phase picked up by a Bloch eigenstate evolving across the entire Brillouin zone -- is responsible for imperfect spectral phase transitions


title: On the convergence of an inertial proximal algorithm with a Tikhonov regularization term

abstract: This paper deals with an inertial proximal algorithm that contains a Tikhonov regularization term, in connection to the minimization problem of a convex lower semicontinuous function $f$. We show that for appropriate Tikhonov regularization parameters the value of the objective function in the sequences generated by our algorithm converges fast (with arbitrary rate) to the global minimum of the objective function and the generated sequences converges weakly to a minimizer of the objective function. We also obtain the fast convergence of the discrete velocities towards zero and some sum estimates. Nevertheless, our main goal is to obtain strong convergence results and also pointwise and sum estimates for the same constellation of the parameters involved. Our analysis reveals that the extrapolation coefficient and the Tikhonov regularization coefficient are strongly correlated and there is a critical setting of the parameters that separates the cases when strong respective weak convergence results can be obtained.


title: Knowledge Graph Completion Method Combined With Adaptive Enhanced Semantic Information

abstract: Translation models tend to ignore the rich semantic information in triads in the process of knowledge graph complementation. To remedy this shortcoming, this paper constructs a knowledge graph complementation method that incorporates adaptively enhanced semantic information. The hidden semantic information inherent in the triad is obtained by fine-tuning the BERT model, and the attention feature embedding method is used to calculate the semantic attention scores between relations and entities in positive and negative triads and incorporate them into the structural information to form a soft constraint rule for semantic information. The rule is added to the original translation model to realize the adaptive enhancement of semantic information. In addition, the method takes into account the effect of high-dimensional vectors on the effect, and uses the BERT-whitening method to reduce the dimensionality and generate a more efficient semantic vector representation. After experimental comparison, the proposed method performs better on both FB15K and WIN18 datasets, with a numerical improvement of about 2.6% compared with the original translation model, which verifies the reasonableness and effectiveness of the method.


title: Learning to Agree on Vision Attention for Visual Commonsense Reasoning

abstract: Visual Commonsense Reasoning (VCR) remains a significant yet challenging research problem in the realm of visual reasoning. A VCR model generally aims at answering a textual question regarding an image, followed by the rationale prediction for the preceding answering process. Though these two processes are sequential and intertwined, existing methods always consider them as two independent matching-based instances. They, therefore, ignore the pivotal relationship between the two processes, leading to sub-optimal model performance. This paper presents a novel visual attention alignment method to efficaciously handle these two processes in a unified framework. To achieve this, we first design a re-attention module for aggregating the vision attention map produced in each process. Thereafter, the resultant two sets of attention maps are carefully aligned to guide the two processes to make decisions based on the same image regions. We apply this method to both conventional attention and the recent Transformer models and carry out extensive experiments on the VCR benchmark dataset. The results demonstrate that with the attention alignment module, our method achieves a considerable improvement over the baseline methods, evidently revealing the feasibility of the coupling of the two processes as well as the effectiveness of the proposed method.


title: SpotLess: Concurrent Rotational Consensus Made Practical through Rapid View Synchronization

abstract: The emergence of blockchain technology has renewed the interest in consensus-based data management systems that are resilient to failures. To maximize the throughput of these systems, we have recently seen several prototype consensus solutions that optimize for throughput at the expense of overall implementation complexity, high costs, and reliability. Due to this, it remains unclear how these prototypes will perform in real-world environments. In this paper, we present SPOTLESS, a novel concurrent rotational consensus protocol made practical. Central to SPOTLESS is the combination of (1) a chained rotational consensus design for replicating requests with a reduced message cost and low-cost failure recovery that eliminates the traditional complex, error-prone view-change protocol; (2) the novel Rapid View Synchronization protocol that enables SPOTLESS to work in more general network assumptions, without a need for a Global Synchronization Time to synchronize view, and recover valid earlier views with the aid of non-faulty replicas without the need to rely on the primary; (3) a high-performance concurrent consensus architecture in which independent instances of the chained consensus operate concurrently to process requests with high throughput, thereby avoiding the bottlenecks seen in other rotational protocols. Due to the concurrent consensus architecture, SPOTLESS greatly outperforms traditional primary-backup consensus protocols such as PBFT (by up to 430%), NARWHAL-HS (by up to 137%), and HOTSTUFF (by up to 3803%). Due to its reduced message cost, SPOTLESS is even able to outperform RCC, a state-of-the-art high-throughput concurrent consensus protocol, by up to 23%. Furthermore, SPOTLESS is able to maintain a stable and low latency and consistently high throughput even during failures.


title: Diversity Induced Environment Design via Self-Play

abstract: Recent work on designing an appropriate distribution of environments has shown promise for training effective generally capable agents. Its success is partly because of a form of adaptive curriculum learning that generates environment instances (or levels) at the frontier of the agent's capabilities. However, such an environment design framework often struggles to find effective levels in challenging design spaces and requires costly interactions with the environment. In this paper, we aim to introduce diversity in the Unsupervised Environment Design (UED) framework. Specifically, we propose a task-agnostic method to identify observed/hidden states that are representative of a given level. The outcome of this method is then utilized to characterize the diversity between two levels, which as we show can be crucial to effective performance. In addition, to improve sampling efficiency, we incorporate the self-play technique that allows the environment generator to automatically generate environments that are of great benefit to the training agent. Quantitatively, our approach, Diversity-induced Environment Design via Self-Play (DivSP), shows compelling performance over existing methods.


title: Oriented and standard shadowing properties on closed surfaces

abstract: We prove that oriented and standard shadowing properties are equivalent for topological flows on closed surfaces with the nonwandering set consisting of the finite number of critical elements (i.e., singularities or closed orbits). Moreover, we prove that each isolated singularity of a topological flow on a closed surface with the oriented shadowing property is either asymptotically stable, backward asymptotically stable, or admits a neighborhood which splits into two or four hyperbolic sectors.


title: Robot Person Following Under Partial Occlusion

abstract: Robot person following (RPF) is a capability that supports many useful human-robot-interaction (HRI) applications. However, existing solutions to person following often assume full observation of the tracked person. As a consequence, they cannot track the person reliably under partial occlusion where the assumption of full observation is not satisfied. In this paper, we focus on the problem of robot person following under partial occlusion caused by a limited field of view of a monocular camera. Based on the key insight that it is possible to locate the target person when one or more of his/her joints are visible, we propose a method in which each visible joint contributes a location estimate of the followed person. Experiments on a public person-following dataset show that, even under partial occlusion, the proposed method can still locate the person more reliably than the existing SOTA methods. As well, the application of our method is demonstrated in real experiments on a mobile robot.


title: A New cross-domain strategy based XAI models for fake news detection

abstract: In this study, we presented a four-level cross-domain strategy for fake news detection on pre-trained models. Cross-domain text classification is a task of a model adopting a target domain by using the knowledge of the source domain. Explainability is crucial in understanding the behaviour of these complex models. A fine-tune BERT model is used to. perform cross-domain classification with several experiments using datasets from different domains. Explanatory models like Anchor, ELI5, LIME and SHAP are used to design a novel explainable approach to cross-domain levels. The experimental analysis has given an ideal pair of XAI models on different levels of cross-domain.


title: Greedy Ordering of Layer Weight Matrices in Transformers Improves Translation

abstract: Prior work has attempted to understand the internal structures and functionalities of Transformer-based encoder-decoder architectures on the level of multi-head attention and feed-forward sublayers. Interpretations have focused on the encoder and decoder, along with the combinatorial possibilities of the self-attention, cross-attention, and feed-forward sublayers. However, without examining the low-level structures, one gains limited understanding of the motivation behind sublayer reordering. Could we dive into the sublayer abstraction and permute layer weight matrices to improve the quality of translation? We propose AEIUOrder to greedily reorder layer weight matrices in the encoder by their well-trainedness, as measured by Heavy-Tailed Self-Regularization (HT-SR) metrics, and order the decoder matrices correspondingly. Our results suggest that greedily reordering layer weight matrices to maximize Total well-trainedness facilitates the model to learn representations and generate translations more effectively.


title: Transform, Contrast and Tell: Coherent Entity-Aware Multi-Image Captioning

abstract: Coherent entity-aware multi-image captioning aims to generate coherent captions for neighboring images in a news document. There are coherence relationships among neighboring images because they often describe same entities or events. These relationships are important for entity-aware multi-image captioning, but are neglected in entity-aware single-image captioning. Most existing work focuses on single-image captioning, while multi-image captioning has not been explored before. Hence, this paper proposes a coherent entity-aware multi-image captioning model by making use of coherence relationships. The model consists of a Transformer-based caption generation model and two types of contrastive learning-based coherence mechanisms. The generation model generates the caption by paying attention to the image and the accompanying text. The caption-caption coherence mechanism aims to render entities in the caption of the image be also in captions of neighboring images. The caption-image-text coherence mechanism aims to render entities in the caption of the image be also in the accompanying text. To evaluate coherence between captions, two coherence evaluation metrics are proposed. The new dataset DM800K is constructed that has more images per document than two existing datasets GoodNews and NYT800K, and is more suitable for multi-image captioning. Experiments on three datasets show the proposed captioning model outperforms 7 baselines according to BLUE, Rouge, METEOR, and entity precision and recall scores. Experiments also show that the generated captions are more coherent than that of baselines according to caption entity scores, caption Rouge scores, the two proposed coherence evaluation metrics, and human evaluations.


title: Weakly-Supervised 3D Medical Image Segmentation using Geometric Prior and Contrastive Similarity

abstract: Medical image segmentation is almost the most important pre-processing procedure in computer-aided diagnosis but is also a very challenging task due to the complex shapes of segments and various artifacts caused by medical imaging, (i.e., low-contrast tissues, and non-homogenous textures). In this paper, we propose a simple yet effective segmentation framework that incorporates the geometric prior and contrastive similarity into the weakly-supervised segmentation framework in a loss-based fashion. The proposed geometric prior built on point cloud provides meticulous geometry to the weakly-supervised segmentation proposal, which serves as better supervision than the inherent property of the bounding-box annotation (i.e., height and width). Furthermore, we propose contrastive similarity to encourage organ pixels to gather around in the contrastive embedding space, which helps better distinguish low-contrast tissues. The proposed contrastive embedding space can make up for the poor representation of the conventionally-used gray space. Extensive experiments are conducted to verify the effectiveness and the robustness of the proposed weakly-supervised segmentation framework. The proposed framework is superior to state-of-the-art weakly-supervised methods on the following publicly accessible datasets: LiTS 2017 Challenge, KiTS 2021 Challenge, and LPBA40. We also dissect our method and evaluate the performance of each component.


title: Concave Pro-rata Games

abstract: In this paper, we introduce a family of games called concave pro-rata games. In such a game, players place their assets into a pool, and the pool pays out some concave function of all assets placed into it. Each player then receives a pro-rata share of the payout; i.e., each player receives an amount proportional to how much they placed in the pool. Such games appear in a number of practical scenarios, including as a simplified version of batched decentralized exchanges, such as those proposed by Penumbra. We show that this game has a number of interesting properties, including a symmetric pure equilibrium that is the unique equilibrium of this game, and we prove that its price of anarchy is $\Omega(n)$ in the number of players. We also show some numerical results in the iterated setting which suggest that players quickly converge to an equilibrium in iterated play.


title: Study of the lineshape of $X(3872)$ using $B$ decays to $D^0\overline{D}{}^{*0}K$

abstract: We present a study of the $X(3872)$ lineshape in the decay $B \to X(3872)K\to D^0\overline{D}{}^{*0}K$ using a data sample of $772\times 10^6$ $B\overline{B}$ pairs collected at the $\Upsilon(4S)$ resonance with the Belle detector at the KEKB asymmetric-energy $e^+e^-$ collider. The peak near the threshold in the $D^0\overline{D}{}^{*0}$ invariant mass spectrum is fitted using a relativistic Breit-Wigner lineshape. We determine the mass and width parameters to be $m = 3873.71 ^{+0.56}_{-0.50} ({\rm stat}) \pm0.13 ({\rm syst}) ~{\rm MeV}/c^2$ and $\Gamma_0 = 5.2 ^{+2.2}_{-1.5} ({\rm stat}) \pm 0.4 ({\rm syst})~{\rm MeV}$, respectively. The branching fraction is found to be ${\cal B} (B^+\to X(3872)K^+) \times {\cal{B}}(X(3872) \to D^0\overline{D}{}^{*0}) = (0.97 ^{+0.21}_{-0.18} ({\rm stat}) \pm 0.10 ({\rm syst})) \times 10^{-4}$. The signal from $B^0$ decays is observed for the first time with $5.2\sigma$ significance, and the ratio of branching fractions between charged and neutral $B$ decays is measured to be ${\cal B}(B^0\to X(3872)K^0)/{\cal B}(B^+ \to X(3872)K^+) = 1.34^{+0.47}_{-0.40} ({\rm stat}) ^{+0.10}_{-0.12} ({\rm syst})$. The peak is also studied using a Flatt\'{e} lineshape. We determine the lower limit on the $D\overline{D}{}^{*}$ coupling constant $g$ to be $0.075$ at 95% credibility in the parameter region where the ratio of $g$ to the mass difference from the $D^0\overline{D}{}^{*0}$ threshold is equal to $-15.11~{\rm GeV}^{-1}$, as measured by LHCb.


title: Interaction Order Prediction for Temporal Graphs

abstract: Link prediction in graphs is a task that has been widely investigated. It has been applied in various domains such as knowledge graph completion, content/item recommendation, social network recommendations and so on. The initial focus of most research was on link prediction in static graphs. However, there has recently been abundant work on modeling temporal graphs, and consequently one of the tasks that has been researched is link prediction in temporal graphs. However, most of the existing work does not focus on the order of link formation, and only predicts the existence of links. In this study, we aim to predict the order of node interactions.


title: Flow past a sphere translating along the axis of a rotating fluid: Revisiting numerically Maxworthy's experiments

abstract: We compute the flow induced by the steady translation of a rigid sphere along the axis of a large cylindrical container filled with a low-viscosity fluid set in rigid-body rotation, the sphere being constrained to spin at the same rate as the undisturbed fluid. The parameter range covered by the simulations is similar to that explored experimentally by Maxworthy [\textit{J. Fluid Mech.}, vol. 40, pp. 453-479 (1970)]. We describe the salient features of the flow, especially the internal characteristics of the Taylor columns that form ahead of and behind the body and the inertial wave pattern, and determine the drag and torque acting on the sphere. Torque variations are found to obey two markedly different laws under rapid- and slow-rotation conditions, respectively. The corresponding scaling laws are predicted by examining the dominant balances governing the axial vorticity distribution in the body vicinity. Results for the drag agree well with the semi-empirical law proposed for inertialess regimes by Tanzosh \& Stone [\textit{J. Fluid Mech.}, vol. 275, pp. 225-256 (1994)]. This law is found to apply even in regimes where inertial effects are large, provided rotation effects are also large enough. Influence of axial confinement is shown to increase dramatically the drag in rapidly rotating configurations, and the container length has to be approximately a thousand times larger than the sphere for this influence to become negligibly small. The reported simulations establish that this confinement effect is at the origin of the long-standing discrepancy existing between Maxworthy's results and theoretical predictions.


title: Inferencing the earth moving equipment-environment interaction in open pit mining

abstract: In mining, grade control generally focuses on blast hole sampling and the estimation of ore control block models with little or no attention given to how the materials are being excavated from the ground. In the process of loading trucks, the underlying variability of the individual bucket load will determine the variability of truck payload. Hence, accurate material movement demands a good knowledge of the excavation process and the buckets interaction with the environment. However, equipment frequently goes into off nominal states due to unexpected delays, disturbances or faults. The large amount of such disturbances causes information loss that reduces the statistical power and biases estimates, leading to increased uncertainty in the production. A reliable method that inferences the missing knowledge about the interaction between the machine and the environment from the available data sources, is vital to accurately model the material movement. In this study, a twostep method was implemented that performed unsupervised clustering and then predicted the missing information. The first method is DBSCAN based spatial clustering which divides the diggers and buckets positional data into connected loading segments. Clear patterns of segmented bucket dig positions were observed. The second model utilized Gaussian process regression which was trained with the clustered data and the model was then used to infer the mean locations of the test clusters. Bucket dig locations were then simulated at the inferred mean locations for different durations and compared against the known bucket dig locations. This method was tested at an open pit mine in the Pilbara of Western Australia. The results demonstrate the advantage of the proposed method in inferencing the missing information of bucket environment interactions and therefore enables miners to continuously track the material movement.


title: Shedding light on the pion production in heavy-ion collisions and application into the neutron star matter properties

abstract: Within the framework of the quantum molecular dynamics transport model, the pion production and constraint of the high-density symmetry energy in heavy-ion collisions near threshold energy have been thoroughly investigated. The energy conservation in the decay of resonances and reabsorption of pions as well as in the inelastic nucleon-nucleon and nucleon-resonance collisions are taken into account. The isospin diffusion in the low-density region (0.2$\rho_{0}$ - 0.8$\rho_{0}$) and high-density region (1.2$\rho_{0}$ - 1.8$\rho_{0}$) is investigated by analyzing the spectra of neutron/proton and $\pi^{-}/\pi^{+}$ ratios in the isotopic reactions of $^{132}$Sn + $^{124}$Sn and $^{108}$Sn + $^{112}$Sn at the incident energy of 270 MeV/nucleon, in which the symmetry energy manifests the opposite effect in the different density domain. The controversial conclusion of the $\pi^{-}/\pi^{+}$ ratio for constraining the high-density symmetry energy by different transport models with the FOPI data has been clarified. A soft symmetry energy with the slope parameter of $L(\rho_{0}) = 42\pm 25$ MeV by using the standard error analysis within the range of $1\sigma$ is obtained by analyzing the experimental data from the S$\pi$RIT collaboration. The neutron stars with the maximal mass of 2 $M_{\odot}$ and radius of 11-13 km are obtained with the constrained symmetry energy.


title: Reducing Nearest Neighbor Training Sets Optimally and Exactly

abstract: In nearest-neighbor classification, a training set $P$ of points in $\mathbb{R}^d$ with given classification is used to classify every point in $\mathbb{R}^d$: Every point gets the same classification as its nearest neighbor in $P$. Recently, Eppstein [SOSA'22] developed an algorithm to detect the relevant training points, those points $p\in P$, such that $P$ and $P\setminus\{p\}$ induce different classifications. We investigate the problem of finding the minimum cardinality reduced training set $P'\subseteq P$ such that $P$ and $P'$ induce the same classification. We show that the set of relevant points is such a minimum cardinality reduced training set if $P$ is in general position. Furthermore, we show that finding a minimum cardinality reduced training set for possibly degenerate $P$ is in P for $d=1$, and NP-complete for $d\geq 2$.


title: Nonsingular black hole chemistry in $4D$ Einstein-Gauss-Bonnet gravity

abstract: The EGB is an outcome of quadratic curvature corrections to the Einstein-Hilbert gravity action in the form of a Gauss-Bonnet (GB) term in $ D > 4$ dimensions, and EGB gravity is topologically invariant in $4D$. Several ways have been proposed for regularizing the $ D \to 4 $ limit of EGB for non-trivial gravitational dynamics in $ 4D $. Motivated by the importance of AdS/CFT, we obtain an exact static spherically symmetric nonsingular black hole in $4D$ EGB gravity coupled to the nonlinear electrodynamics (NED) in an AdS spacetime. We interpret the negative cosmological constant $\Lambda$ as the positive pressure, via $ P=-\Lambda/8\pi$, of the system's thermodynamic properties of the nonsingular black hole with an AdS background. We find that for $P<P_c$, the black holes with $C_P>0$ are stable to thermal fluctuations and unstable otherwise. We also analyzed the Gibbs free energy to find that the small globally unstable black holes undergo a phase transition to the large globally stable black holes. Further, we study the $P-V$ criticality of the system and then calculate the critical exponents to find that our system behaves like Van der Walls fluid.


title: Flow model of intersystem interactions and influence of components of multilayer network systems

abstract: The approach to decomposition of multidimensional network systems on monoflow multilayer network systems (MLNS) is proposed, which significantly simplifies the analysis of intersystem interactions in multipurpose and multifunctional supersystem formations. A flow model of monoflow partially overlapped MLNS is built, which reflects the process of intersystem interactions between network systems that ensure the movement of flows of a certain type. The main local and global flow characteristics of MLNS elements are determined, which allow us more adequately from a functional point of view to establish the importance of nodes and edges of a multilayer system compared to their structural characteristics. The constructed model is proposed to be used for the development of methods of protecting complex network and multilayer network systems from targeted attacks and non-targeted lesions of various types and solving other practically important problems of system analysis.


title: Magnetic activity variability from H$\alpha$ line intensive monitoring for two F-type stars having a hot-Jupiter, $\tau$ Bootis A and $\upsilon$ Andromedae A

abstract: We report the results of intensive monitoring of the variability in the H$\alpha$ line for two F-type stars, $\tau$ Boo and $\upsilon$ And, during the last four years 2019-2022, in order to investigate their stellar magnetic activity. The 4-year H$\alpha$ line intensity data taken with the 1.88-m reflector at Okayama Branch Office, Subaru Telescope, shows the existence of a possible $\sim$ 123-day magnetic activity cycle of $\tau$ Boo. The result of the H$\alpha$ variability as another tracer of the magnetic activity on the chromosphere is consistent with previous studies of the Ca II H&K line and suggests that the magnetic activity cycle is persisted in $\tau$ Boo. For $\upsilon$ And, we suggest a quadratic long-term trend in the H$\alpha$ variability. Meanwhile, the short-term monitoring shows no significant period corresponding to specific variations likely induced by their hot-Jupiter in both cases ($\approx$ 3.31 and 4.62 days, respectively). In this H$\alpha$ observation, we could not find any signature of the Star-Planet Magnetic Interaction. It is speculated that the detected magnetic activity variability of the two F-type stars is related to the stellar intrinsic dynamo.


title: Efficient End-to-End Video Question Answering with Pyramidal Multimodal Transformer

abstract: This paper presents a new method for end-to-end Video Question Answering (VideoQA), aside from the current popularity of using large-scale pre-training with huge feature extractors. We achieve this with a pyramidal multimodal transformer (PMT) model, which simply incorporates a learnable word embedding layer, a few convolutional and transformer layers. We use the anisotropic pyramid to fulfill video-language interactions across different spatio-temporal scales. In addition to the canonical pyramid, which includes both bottom-up and top-down pathways with lateral connections, novel strategies are proposed to decompose the visual feature stream into spatial and temporal sub-streams at different scales and implement their interactions with the linguistic semantics while preserving the integrity of local and global semantics. We demonstrate better or on-par performances with high computational efficiency against state-of-the-art methods on five VideoQA benchmarks. Our ablation study shows the scalability of our model that achieves competitive results for text-to-video retrieval by leveraging feature extractors with reusable pre-trained weights, and also the effectiveness of the pyramid.


title: FedSpectral+: Spectral Clustering using Federated Learning

abstract: Clustering in graphs has been a well-known research problem, particularly because most Internet and social network data is in the form of graphs. Organizations widely use spectral clustering algorithms to find clustering in graph datasets. However, applying spectral clustering to a large dataset is challenging due to computational overhead. While the distributed spectral clustering algorithm exists, they face the problem of data privacy and increased communication costs between the clients. Thus, in this paper, we propose a spectral clustering algorithm using federated learning (FL) to overcome these issues. FL is a privacy-protecting algorithm that accumulates model parameters from each local learner rather than collecting users' raw data, thus providing both scalability and data privacy. We developed two approaches: FedSpectral and FedSpectral+. FedSpectral is a baseline approach that uses local spectral clustering labels to aggregate the global spectral clustering by creating a similarity graph. FedSpectral+, a state-of-the-art approach, uses the power iteration method to learn the global spectral embedding by incorporating the entire graph data without access to the raw information distributed among the clients. We further designed our own similarity metric to check the clustering quality of the distributed approach to that of the original/non-FL clustering. The proposed approach FedSpectral+ obtained a similarity of 98.85% and 99.8%, comparable to that of global clustering on the ego-Facebook and email-Eu-core dataset.


title: A Dombi Counterexample with Positive Lower Density

abstract: Let $r(k,A,n)$ denote the number of representations of $n$ as a sum of $k$ elements of a set $A \subseteq \mathbb{N}$. In 2002, Dombi conjectured that if $A$ is co-infinite, then the sequence $(r(k,A,n))_{n \geq 0}$ cannot be strictly increasing. Using tools from automata theory and logic, we give an explicit counterexample where $\mathbb{N} \setminus A$ has positive lower density.


title: Structural Explanations for Graph Neural Networks using HSIC

abstract: Graph neural networks (GNNs) are a type of neural model that tackle graphical tasks in an end-to-end manner. Recently, GNNs have been receiving increased attention in machine learning and data mining communities because of the higher performance they achieve in various tasks, including graph classification, link prediction, and recommendation. However, the complicated dynamics of GNNs make it difficult to understand which parts of the graph features contribute more strongly to the predictions. To handle the interpretability issues, recently, various GNN explanation methods have been proposed. In this study, a flexible model agnostic explanation method is proposed to detect significant structures in graphs using the Hilbert-Schmidt independence criterion (HSIC), which captures the nonlinear dependency between two variables through kernels. More specifically, we extend the GraphLIME method for node explanation with a group lasso and a fused lasso-based node explanation method. The group and fused regularization with GraphLIME enables the interpretation of GNNs in substructure units. Then, we show that the proposed approach can be used for the explanation of sequential graph classification tasks. Through experiments, it is demonstrated that our method can identify crucial structures in a target graph in various settings.


title: Dynamical Equations With Bottom-up Self-Organizing Properties Learn Accurate Dynamical Hierarchies Without Any Loss Function

abstract: Self-organization is ubiquitous in nature and mind. However, machine learning and theories of cognition still barely touch the subject. The hurdle is that general patterns are difficult to define in terms of dynamical equations and designing a system that could learn by reordering itself is still to be seen. Here, we propose a learning system, where patterns are defined within the realm of nonlinear dynamics with positive and negative feedback loops, allowing attractor-repeller pairs to emerge for each pattern observed. Experiments reveal that such a system can map temporal to spatial correlation, enabling hierarchical structures to be learned from sequential data. The results are accurate enough to surpass state-of-the-art unsupervised learning algorithms in seven out of eight experiments as well as two real-world problems. Interestingly, the dynamic nature of the system makes it inherently adaptive, giving rise to phenomena similar to phase transitions in chemistry/thermodynamics when the input structure changes. Thus, the work here sheds light on how self-organization can allow for pattern recognition and hints at how intelligent behavior might emerge from simple dynamic equations without any objective/loss function.


title: LipFormer: Learning to Lipread Unseen Speakers based on Visual-Landmark Transformers

abstract: Lipreading refers to understanding and further translating the speech of a speaker in the video into natural language. State-of-the-art lipreading methods excel in interpreting overlap speakers, i.e., speakers appear in both training and inference sets. However, generalizing these methods to unseen speakers incurs catastrophic performance degradation due to the limited number of speakers in training bank and the evident visual variations caused by the shape/color of lips for different speakers. Therefore, merely depending on the visible changes of lips tends to cause model overfitting. To address this problem, we propose to use multi-modal features across visual and landmarks, which can describe the lip motion irrespective to the speaker identities. Then, we develop a sentence-level lipreading framework based on visual-landmark transformers, namely LipFormer. Specifically, LipFormer consists of a lip motion stream, a facial landmark stream, and a cross-modal fusion. The embeddings from the two streams are produced by self-attention, which are fed to the cross-attention module to achieve the alignment between visuals and landmarks. Finally, the resulting fused features can be decoded to output texts by a cascade seq2seq model. Experiments demonstrate that our method can effectively enhance the model generalization to unseen speakers.