title: $t$-quantized Cartan matrix and R-matrices for cuspidal modules over quiver Hecke algebras

abstract: As every simple module of a quiver Hecke algebra appears as the image of the R-matrix defined on the convolution product of certain cuspidal modules, knowing the $\mathbb{Z}$-invariants of the R-matrices between cuspidal modules is quite significant. In this paper, we prove that the $(q,t)$-Cartan matrix specialized at $q=1$ of an arbitrary finite type, called the $t$-quantized Cartan matrix, informs us of the invariants of R-matrices. To prove this, we use combinatorial AR-quivers associated with Dynkin quivers and their properties as crucial ingredients.


title: Unraveling the Variations of the Society of England and Wales through Diffusion Maps Analysis on Census 2011

abstract: We propose a new approach to identifying geographical clustering and hotspots of inequality from decadal census data. We use diffusion mapping to study the 181,408 Output Areas in England and Wales, which allows us to decompose the feature structures of countries in the census data space. Additionally, we develop a new localization metric inspired by statistical physics to uncover the importance of minority groups in London. The results of our study can be applied to other census-like data constructions that include spatial localization and differentiation from low degrees of freedom. This new approach can help us better understand the patterns of social deprivation and segregation across the country and aid in the development of policies to address these issues.


title: Variational Reformulation of Generalized Nash Equilibrium Problems with Non-ordered Preferences

abstract: The preferences of players in non-cooperative games represent their choice in the set of available options, which meet the completeness property if players are able to compare any pair of available options. In the existing literature, the variational reformulation of generalized Nash games relies on the numerical representation of players' preferences into objective functions, which is only possible if preferences are transitive and complete. In this work, we first characterize the jointly convex generalized Nash equilibrium problems in terms of a variational inequality without requiring any numerical representation of preferences. Furthermore, we provide the suitable conditions under which any solution of a quasi-variational inequality becomes an equilibrium for the generalized Nash game with non-ordered (incomplete and non-transitive) non-convex inter-dependent preferences. We check the solvability of these games when the strategy maps of players are (possibly) unbounded. As an application, we derive the occurrence of competitive equilibrium for Arrow-Debreu economy under uncertainty.


title: PAC Prediction Sets for Large Language Models of Code

abstract: Prediction sets have recently been shown to be a promising strategy for quantifying the uncertainty of deep neural networks in a way that provides theoretical guarantees. However, existing techniques have largely targeted settings where the space of labels is simple, so prediction sets can be arbitrary subsets of labels. For structured prediction problems where the space of labels is exponential in size, even prediction sets containing a small fraction of all labels can be exponentially large. In the context of code generation, we propose a solution that considers a restricted set of prediction sets that can compactly be represented as partial programs, which are programs with portions replaced with holes. Given a trained code generation model, our algorithm leverages a programming language's abstract syntax tree to generate a set of programs such that the correct program is in the set with high-confidence. Valuable applications of our algorithm include a Codex-style code generator with holes in uncertain parts of the generated code, which provides a partial program with theoretical guarantees. We evaluate our approach on PICARD (a T5 model for SQL semantic parsing) and Codex (a GPT model for over a dozen programming languages, including Python), demonstrating that our approach generates compact PAC prediction sets. This is the first research contribution that generates PAC prediction sets for generative code models.


title: The Unbearable Weight of Massive Privilege: Revisiting Bias-Variance Trade-Offs in the Context of Fair Prediction

abstract: In this paper we revisit the bias-variance decomposition of model error from the perspective of designing a fair classifier: we are motivated by the widely held socio-technical belief that noise variance in large datasets in social domains tracks demographic characteristics such as gender, race, disability, etc. We propose a conditional-iid (ciid) model built from group-specific classifiers that seeks to improve on the trade-offs made by a single model (iid setting). We theoretically analyze the bias-variance decomposition of different models in the Gaussian Mixture Model, and then empirically test our setup on the COMPAS and folktables datasets. We instantiate the ciid model with two procedures that improve "fairness" by conditioning out undesirable effects: first, by conditioning directly on sensitive attributes, and second, by clustering samples into groups and conditioning on cluster membership (blind to protected group membership). Our analysis suggests that there might be principled procedures and concrete real-world use cases under which conditional models are preferred, and our striking empirical results strongly indicate that non-iid settings, such as the ciid setting proposed here, might be more suitable for big data applications in social contexts.


title: OTFS -- Predictability in the Delay-Doppler Domain and its Value to Communication and Radar Sensing

abstract: In our first paper [2] we explained why the Zak-OTFS input-output (I/O) relation is predictable and non-fading when the delay and Doppler periods are greater than the effective channel delay and Doppler spreads, a condition which we refer to as the crystallization condition. We argued that a communication system should operate within the crystalline regime. It is well known that it is possible to identify a linear time varying (LTV) channel if and only if it is under-spread. The crystallization condition is more restrictive than the under-spread condition, so identification is always possible. In the crystalline regime, we show that Zak-OTFS pilot sequences minimize the complexity of identifying the effective DD domain channel filter. We demonstrate that the filter taps can simply be read off from the response to a single Zak-OTFS pilot. In general, we provide an explicit formula for reconstructing the Zak-OTFS I/O relation from a finite number of received pilot symbols in the delay-Doppler (DD) domain. This reconstruction formula makes it possible to study predictability of the Zak-OTFS I/O relation for a sampled system that operates under finite duration and bandwidth constraints. We analyze reconstruction accuracy for different choices of the delay and Doppler periods, and of the pulse shaping filter. Reconstruction accuracy is high when the crystallization condition is satisfied, implying that it is possible to learn directly the I/O relation without needing to estimate the underlying channel. This opens up the possibility of a model-free mode of operation, which is especially useful when a traditional model-dependent mode of operation (reliant on estimation of the underlying physical channel) is out of reach (for example, when the channel comprises of unresolvable paths, or exhibits a continuous delay-Doppler profile such as in presence of acceleration). Our study clarifies the


title: Fine-grained Cross-modal Fusion based Refinement for Text-to-Image Synthesis

abstract: Text-to-image synthesis refers to generating visual-realistic and semantically consistent images from given textual descriptions. Previous approaches generate an initial low-resolution image and then refine it to be high-resolution. Despite the remarkable progress, these methods are limited in fully utilizing the given texts and could generate text-mismatched images, especially when the text description is complex. We propose a novel Fine-grained text-image Fusion based Generative Adversarial Networks, dubbed FF-GAN, which consists of two modules: Fine-grained text-image Fusion Block (FF-Block) and Global Semantic Refinement (GSR). The proposed FF-Block integrates an attention block and several convolution layers to effectively fuse the fine-grained word-context features into the corresponding visual features, in which the text information is fully used to refine the initial image with more details. And the GSR is proposed to improve the global semantic consistency between linguistic and visual features during the refinement process. Extensive experiments on CUB-200 and COCO datasets demonstrate the superiority of FF-GAN over other state-of-the-art approaches in generating images with semantic consistency to the given texts.Code is available at https://github.com/haoranhfut/FF-GAN.


title: Non-reduced components of the Hilbert scheme of curves using triple covers

abstract: In this paper we consider curves on a cone that pass through the vertex and are also triple covers of the base of the cone, which is a general smooth curve of genus $\gamma$ and degree $e$ in $\mathbb{P}^{e-\gamma}$. Using the free resolution of the ideal of such a curve found by Catalisano and Gimigliano, and a technique concerning deformations of curves introduced by Ciliberto, we show that the deformations of such curves remain on cones over a deformation of the base curve. This allows us to prove that for $\gamma \geq 3$ and $e \geq 4\gamma + 5$ there exists a non-reduced component $\mathcal{H}$ of the Hilbert scheme of smooth curves of genus $3e + 3\gamma$ and degree $3e+1$ in $\mathbb{P}^{e-\gamma+1}$. We show that $\dim T_{[X]} \mathcal{H} = \dim \mathcal{H} + 1 = (e - \gamma + 1)^2 + 7e + 5$ for a general point $[X] \in \mathcal{H}$.


title: The Matching Kneser Graph Conjecture For High Chromatic Numbers

abstract: \noindent In this paper, we show that for any positive integers $r$, $k$, $\Theta$, and $\Gamma$ such that $k \geq 2$ and $r \geq k + \Gamma$, there exists a connected graph $G$ for which $$\begin{array}{llcr} \omega (G) = \chi (G) = k, & \chi \left( G , rK_2 \right) = \Theta , & {\rm and} & |E(G)| - {\rm ex}\left( G , rK_2 \right) = \Theta + \Gamma . \end{array}$$


title: Multimodal Propaganda Processing

abstract: Propaganda campaigns have long been used to influence public opinion via disseminating biased and/or misleading information. Despite the increasing prevalence of propaganda content on the Internet, few attempts have been made by AI researchers to analyze such content. We introduce the task of multimodal propaganda processing, where the goal is to automatically analyze propaganda content. We believe that this task presents a long-term challenge to AI researchers and that successful processing of propaganda could bring machine understanding one important step closer to human understanding. We discuss the technical challenges associated with this task and outline the steps that need to be taken to address it.


title: Cross-Domain Label Propagation for Domain Adaptation with Discriminative Graph Self-Learning

abstract: Domain adaptation manages to transfer the knowledge of well-labeled source data to unlabeled target data. Many recent efforts focus on improving the prediction accuracy of target pseudo-labels to reduce conditional distribution shift. In this paper, we propose a novel domain adaptation method, which infers target pseudo-labels through cross-domain label propagation, such that the underlying manifold structure of two domain data can be explored. Unlike existing cross-domain label propagation methods that separate domain-invariant feature learning, affinity matrix constructing and target labels inferring into three independent stages, we propose to integrate them into a unified optimization framework. In such way, these three parts can boost each other from an iterative optimization perspective and thus more effective knowledge transfer can be achieved. Furthermore, to construct a high-quality affinity matrix, we propose a discriminative graph self-learning strategy, which can not only adaptively capture the inherent similarity of the data from two domains but also effectively exploit the discriminative information contained in well-labeled source data and pseudo-labeled target data. An efficient iterative optimization algorithm is designed to solve the objective function of our proposal. Notably, the proposed method can be extended to semi-supervised domain adaptation in a simple but effective way and the corresponding optimization problem can be solved with the identical algorithm. Extensive experiments on six standard datasets verify the significant superiority of our proposal in both unsupervised and semi-supervised domain adaptation settings.


title: Maximum Likelihood Time Synchronization for Zero-padded OFDM

abstract: Existing Orthogonal Frequency-Division Multiplexing (OFDM) variants based on cyclic prefix (CP) allow for efficient time synchronization, but suffer from lower power efficiency compared to zero-padded (ZP)-OFDM. Because of its power efficiency, ZP-OFDM is considered as an appealing solution for the emerging low-power wireless systems. However, in the absence of CP, time synchronization in ZP-OFDM is a very challenging task. In this paper, the non-data-aided (NDA) maximum-likelihood (ML) time synchronization for ZP-OFDM is analytically derived. We show that the optimal NDA-ML synchronization algorithm offers a high lock-in probability and can be efficiently implemented using Monte Carlo sampling (MCS) technique in combination with golden-section search. To obtain the optimal NDA-ML time synchronization algorithm, we first derive a closed-form expression for the joint probability density function (PDF) of the received ZP-OFDM samples in frequency-selective fading channels. The derived expression is valid for doubly-selective fading channels with mobile users as well. The performance of the proposed synchronization algorithm is evaluated under various practical settings through simulation experiments. It is shown that the proposed optimal NDA-ML synchronization algorithm and its MCS implementation substantially outperforms existing algorithms in terms of lock-in probability.


title: Quantile LSTM: A Robust LSTM for Anomaly Detection In Time Series Data

abstract: Anomalies refer to the departure of systems and devices from their normal behaviour in standard operating conditions. An anomaly in an industrial device can indicate an upcoming failure, often in the temporal direction. In this paper, we make two contributions: 1) we estimate conditional quantiles and consider three different ways to define anomalies based on the estimated quantiles. 2) we use a new learnable activation function in the popular Long Short Term Memory networks (LSTM) architecture to model temporal long-range dependency. In particular, we propose Parametric Elliot Function (PEF) as an activation function (AF) inside LSTM, which saturates lately compared to sigmoid and tanh. The proposed algorithms are compared with other well-known anomaly detection algorithms, such as Isolation Forest (iForest), Elliptic Envelope, Autoencoder, and modern Deep Learning models such as Deep Autoencoding Gaussian Mixture Model (DAGMM), Generative Adversarial Networks (GAN). The algorithms are evaluated in terms of various performance metrics, such as Precision and Recall. The algorithms have been tested on multiple industrial time-series datasets such as Yahoo, AWS, GE, and machine sensors. We have found that the LSTM-based quantile algorithms are very effective and outperformed the existing algorithms in identifying anomalies.


title: Characterisation of a self-similar turbulent boundary layer near separation measured using high-spatial-resolution two-component - two-dimensional particle image velocimetry

abstract: This paper report on the design of an experiment to establish an experimental self-similar adverse pressure gradient (APG) turbulent boundary layer (TBL) flow at the verge of separation in order to characterise its statistical structure and the contribution of the Reynolds stresses to the wall shear stress via quadrant analysis decomposition in conjunction with the Renard & Deck (RD) decomposition of the mean skin friction. In this study high-spatial-resolution (HSR) two-component - two-dimensional (2C-2D) particle image velocimetry (PIV) is employed to measure the self-similar APG-TBL flow. The measurements of the self-similar APG-TBL at the verge of separation, which is referred to as 'strong APG-TBL' is compared with similar HSR 2C-2D PIV measurements of a TBL under zero and mild APG to characterise the effect of the APG on the TBL. In the strong APG-TBL, the outer scaled profiles of the first- and second-order statistics, as well as the defect velocity exhibit self-similarity over the measured streamwise domain of 3.3{\delta}. The quadrant decomposition of the velocity fluctuations shows that the formation of the outer peak in the Reynolds shear stress profile under APG is due to the energisation of sweep motions of high-momentum fluid in the outer region of the boundary layer. The RD decomposition of the mean skin friction shows that the skin friction has larger contributions from ejections than sweeps. This is due to the emergence of the outer peaks with a correspondingly diminishing of the inner peaks in the turbulence production profiles. The skewness and flatness profiles show that the zero skewness and minimum flatness locations of the streamwise and wall-normal velocity fluctuations collapse with the location of the maximum Reynolds streamwise stress in the TBLs irrespective of the pressure gradient imposed on the TBL.


title: Binary Embedding-based Retrieval at Tencent

abstract: Large-scale embedding-based retrieval (EBR) is the cornerstone of search-related industrial applications. Given a user query, the system of EBR aims to identify relevant information from a large corpus of documents that may be tens or hundreds of billions in size. The storage and computation turn out to be expensive and inefficient with massive documents and high concurrent queries, making it difficult to further scale up. To tackle the challenge, we propose a binary embedding-based retrieval (BEBR) engine equipped with a recurrent binarization algorithm that enables customized bits per dimension. Specifically, we compress the full-precision query and document embeddings, formulated as float vectors in general, into a composition of multiple binary vectors using a lightweight transformation model with residual multilayer perception (MLP) blocks. We can therefore tailor the number of bits for different applications to trade off accuracy loss and cost savings. Importantly, we enable task-agnostic efficient training of the binarization model using a new embedding-to-embedding strategy. We also exploit the compatible training of binary embeddings so that the BEBR engine can support indexing among multiple embedding versions within a unified system. To further realize efficient search, we propose Symmetric Distance Calculation (SDC) to achieve lower response time than Hamming codes. We successfully employed the introduced BEBR to Tencent products, including Sogou, Tencent Video, QQ World, etc. The binarization algorithm can be seamlessly generalized to various tasks with multiple modalities. Extensive experiments on offline benchmarks and online A/B tests demonstrate the efficiency and effectiveness of our method, significantly saving 30%~50% index costs with almost no loss of accuracy at the system level.


title: EEP-3DQA: Efficient and Effective Projection-based 3D Model Quality Assessment

abstract: Currently, great numbers of efforts have been put into improving the effectiveness of 3D model quality assessment (3DQA) methods. However, little attention has been paid to the computational costs and inference time, which is also important for practical applications. Unlike 2D media, 3D models are represented by more complicated and irregular digital formats, such as point cloud and mesh. Thus it is normally difficult to perform an efficient module to extract quality-aware features of 3D models. In this paper, we address this problem from the aspect of projection-based 3DQA and develop a no-reference (NR) \underline{E}fficient and \underline{E}ffective \underline{P}rojection-based \underline{3D} Model \underline{Q}uality \underline{A}ssessment (\textbf{EEP-3DQA}) method. The input projection images of EEP-3DQA are randomly sampled from the six perpendicular viewpoints of the 3D model and are further spatially downsampled by the grid-mini patch sampling strategy. Further, the lightweight Swin-Transformer tiny is utilized as the backbone to extract the quality-aware features. Finally, the proposed EEP-3DQA and EEP-3DQA-t (tiny version) achieve the best performance than the existing state-of-the-art NR-3DQA methods and even outperforms most full-reference (FR) 3DQA methods on the point cloud and mesh quality assessment databases while consuming less inference time than the compared 3DQA methods.


title: Universal geometry of two-neutron halos and Borromean Efimov states close to dissociation

abstract: The geometry of Borromean three-body halos, such as two-neutron halo nuclei or triatomic molecules close to dissociation, is investigated using a three-body model. This model enables to analytically derive the universal geometric properties found recently within an effective-field theory for halos made of a core and two resonantly-interacting particles [Phys. Rev. Lett., 128, 212501 (2022)]. It is shown that these properties not only apply to the ground three-body state, but also to all the excited (Efimov) states where the core-particle interaction is resonant. Furthermore, a universal geometry persists away from the resonant regime between the two particles, for any state close to the three-body threshold. This "halo universality" is different from the Efimov universality which is only approximate for the ground state. It is explained by the separability of the hyper-radius and hyper-angles close to the three-body dissociation threshold.


title: Enhanced phase sensitivity in a Mach-Zehnder interferometer via photon recycling

abstract: We propose an alternative scheme for phase estimation in a Mach-Zehnder interferometer (MZI) with photon recycling. It is demonstrated that with the same coherent-state input and homodyne detection, our proposal possesses a phase sensitivity beyond the traditional MZI. For instance, it can achieve an enhancement factor of 9.32 in the phase sensitivity compared with the conventional scheme even with a photon loss of 10% on the photon-recycled arm. From another point of view, the quantum Cramer-Rao bound (QCRB) is also investigated. It is found that our scheme is able to achieve a lower QCRB than the traditional one. Intriguingly, the QCRB of our scheme is dependent of the phase shift phi while the traditional scheme has a constant QCRB regardless of the phase shift. Finally, we present the underlying mechanisms behind the enhanced phase sensitivity. We believe that our results provide another angle from which to enhance the phase sensitivity in a MZI via photon recycling.


title: Conforming VEM for general second-order elliptic problems with rough data on polygonal meshes and its application to a Poisson inverse source problem

abstract: This paper focuses on the analysis of conforming virtual element methods for general second-order linear elliptic problems with rough source terms and applies it to a Poisson inverse source problem with rough measurements. For the forward problem, when the source term belongs to $H^{-1}(\Omega)$, the right-hand side for the discrete approximation defined through polynomial projections is not meaningful even for standard conforming virtual element method. The modified discrete scheme in this paper introduces a novel companion operator in the context of conforming virtual element method and allows data in $H^{-1}(\Omega)$. This paper has {\it three} main contributions. The {\it first} contribution is the design of a conforming companion operator $J$ from the {\it conforming virtual element space} to the Sobolev space $V:=H^1_0(\Omega)$, a modified virtual element scheme, and the \textit{a priori} error estimate for the Poisson problem in the best-approximation form without data oscillations. The {\it second} contribution is the extension of the \textit{a priori} analysis to general second-order elliptic problems with source term in $V^*$. The {\it third} contribution is an application of the companion operator in a Poisson inverse source problem when the measurements belong to $V^*$. The Tikhonov's regularization technique regularizes the ill-posed inverse problem, and the conforming virtual element method approximates the regularized problem given a finite measurement data. The inverse problem is also discretised using the conforming virtual element method and error estimates are established. Numerical tests on different polygonal meshes for general second-order problems, and for a Poisson inverse source problem with finite measurement data verify the theoretical results.


title: Morley finite element analysis for fourth-order elliptic equations under a semi-regular mesh condition

abstract: In this study, we present a precise anisotropic interpolation error estimate for the Morley finite element method (FEM) and apply it to fourth-order elliptical equations. We did not impose a shape-regularity mesh condition for the analysis. Therefore, anisotropic meshes can be used. The main contributions of this study include providing new proof of the consistency term. This enabled us to obtain an anisotropic consistency error estimate. The core idea of the proof involves using the relationship between the Raviart--Thomas and Morley finite element spaces. Our results show optimal convergence rates and imply that the modified Morley FEM may be effective for errors.


title: Algorithmic Hallucinations of Near-Surface Winds: Statistical Downscaling with Generative Adversarial Networks to Convection-Permitting Scales

abstract: This paper explores the application of emerging machine learning methods from image super-resolution (SR) to the task of statistical downscaling. We specifically focus on convolutional neural network-based Generative Adversarial Networks (GANs). Our GANs are conditioned on low-resolution (LR) inputs to generate high-resolution (HR) surface winds emulating Weather Research and Forecasting (WRF) model simulations over North America. Unlike traditional SR models, where LR inputs are idealized coarsened versions of the HR images, WRF emulation involves using non-idealized LR and HR pairs resulting in shared-scale mismatches due to internal variability. Our study builds upon current SR-based statistical downscaling by experimenting with a novel frequency-separation (FS) approach from the computer vision field. To assess the skill of SR models, we carefully select evaluation metrics, and focus on performance measures based on spatial power spectra. Our analyses reveal how GAN configurations influence spatial structures in the generated fields, particularly biases in spatial variability spectra. Using power spectra to evaluate the FS experiments reveals that successful applications of FS in computer vision do not translate to climate fields. However, the FS experiments demonstrate the sensitivity of power spectra to a commonly used GAN-based SR objective function, which helps interpret and understand its role in determining spatial structures. This result motivates the development of a novel partial frequency-separation scheme as a promising configuration option. We also quantify the influence on GAN performance of non-idealized LR fields resulting from internal variability. Furthermore, we conduct a spectra-based feature-importance experiment allowing us to explore the dependence of the spatial structure of generated fields on different physically relevant LR covariates.


title: Interpolated inverse discrete wavelet transforms in additive and non-additive spectral background correction

abstract: We demonstrate the applicability of using interpolated inverse discrete wavelet transforms as a general tool for modeling additive or multiplicative background or error signals in spectra. Additionally, we propose an unsupervised way of estimating the optimal wavelet basis along with the model parameters. We apply the method to experimental Raman spectra of phthalocyanine blue, aniline black, naphthol red, pigment yellow 150, and pigment red 264 pigments to remove their additive background and to CARS spectra of adenosine phosphate, fructose, glucose, and sucrose to remove their multiplicative background signals.


title: GPT4MIA: Utilizing Generative Pre-trained Transformer (GPT-3) as A Plug-and-Play Transductive Model for Medical Image Analysis

abstract: In this paper, we propose a novel approach (called GPT4MIA) that utilizes Generative Pre-trained Transformer (GPT) as a plug-and-play transductive inference tool for medical image analysis (MIA). We provide theoretical analysis on why a large pre-trained language model such as GPT-3 can be used as a plug-and-play transductive inference model for MIA. At the methodological level, we develop several technical treatments to improve the efficiency and effectiveness of GPT4MIA, including better prompt structure design, sample selection, and prompt ordering of representative samples/features. We present two concrete use cases (with workflow) of GPT4MIA: (1) detecting prediction errors and (2) improving prediction accuracy, working in conjecture with well-established vision-based models for image classification (e.g., ResNet). Experiments validate that our proposed method is effective for these two tasks. We further discuss the opportunities and challenges in utilizing Transformer-based large language models for broader MIA applications.


title: Convergence analysis of a norm minimization-based convex vector optimization algorithm

abstract: In this work, we propose an outer approximation algorithm for solving bounded convex vector optimization problems (CVOPs). The scalarization model solved iteratively within the algorithm is a modification of the norm-minimizing scalarization proposed in Ararat et al. (2022). For a predetermined tolerance $\epsilon>0$, we prove that the algorithm terminates after finitely many iterations, and it returns a polyhedral outer approximation to the upper image of the CVOP such that the Hausdorff distance between the two is less than $\epsilon$. We show that for an arbitrary norm used in the scalarization models, the approximation error after $k$ iterations decreases by the order of $\mathcal{O}(k^{{1}/{(1-q)}})$, where $q$ is the dimension of the objective space. An improved convergence rate of $\mathcal{O}(k^{{2}/{(1-q)}})$ is proved for the special case of using the Euclidean norm.


title: Piecewise Deterministic Markov Processes for Bayesian Neural Networks

abstract: Inference on modern Bayesian Neural Networks (BNNs) often relies on a variational inference treatment, imposing violated assumptions of independence and the form of the posterior. Traditional MCMC approaches avoid these assumptions at the cost of increased computation due to its incompatibility to subsampling of the likelihood. New Piecewise Deterministic Markov Process (PDMP) samplers permit subsampling, though introduce a model specific inhomogenous Poisson Process (IPPs) which is difficult to sample from. This work introduces a new generic and adaptive thinning scheme for sampling from these IPPs, and demonstrates how this approach can accelerate the application of PDMPs for inference in BNNs. Experimentation illustrates how inference with these methods is computationally feasible, can improve predictive accuracy, MCMC mixing performance, and provide informative uncertainty measurements when compared against other approximate inference schemes.


title: Deformations and cohomologies of embedding tensors on 3-Lie algebras

abstract: In this paper, first we introduce the notion of an embedding tensor on a 3-Lie algebra, which naturally induces a 3-Leibniz algebra. Using the derived bracket, we construct a Lie 3-algebra, whose Maurer-Cartan elements are embedding tensors. Consequently, we obtain the $L_{\infty}$-algebra that governs deformations of embedding tensors. We define the cohomology theory for embedding tensors on 3-Lie algebras. As applications, we show that if two formal deformations of an embedding tensor on a 3-Lie algebra are equivalent, then their infinitesimals are in the same cohomology class in the second cohomology group. Moreover, an order n deformation of an embedding tensor is extendable if and only if the obstruction class, which is in the third cohomology group, is trivial.


title: Quantum symmetry in multigraphs (part I)

abstract: We introduce various notions of quantum symmetry in a directed or undirected multigraph with no isolated vertex and explore relations among them. If the multigraph is single edged (that is, a simple graph where loops are allowed), all our notions of quantum symmetry reduce to already existing notions of quantum symmetry provided by Bichon and Banica. Our constructions also show that any multigraph with at least two pairs of vertices with multiple edges among them possesses genuine quantum symmetry.


title: Building Shortcuts between Distant Nodes with Biaffine Mapping for Graph Convolutional Networks

abstract: Multiple recent studies show a paradox in graph convolutional networks (GCNs), that is, shallow architectures limit the capability of learning information from high-order neighbors, while deep architectures suffer from over-smoothing or over-squashing. To enjoy the simplicity of shallow architectures and overcome their limits of neighborhood extension, in this work, we introduce Biaffine technique to improve the expressiveness of graph convolutional networks with a shallow architecture. The core design of our method is to learn direct dependency on long-distance neighbors for nodes, with which only one-hop message passing is capable of capturing rich information for node representation. Besides, we propose a multi-view contrastive learning method to exploit the representations learned from long-distance dependencies. Extensive experiments on nine graph benchmark datasets suggest that the shallow biaffine graph convolutional networks (BAGCN) significantly outperforms state-of-the-art GCNs (with deep or shallow architectures) on semi-supervised node classification. We further verify the effectiveness of biaffine design in node representation learning and the performance consistency on different sizes of training data.


title: Topologically assisted optimization for rotor design

abstract: We develop and apply a novel shape optimization exemplified for a two-blade rotor with respect to the figure of merit ($FM$). This topologically assisted optimization (TAO) contains two steps. First a global evolutionary optimization is performed for the shape parameters and then a topological analysis reveals the local and global extrema of the objective function directly from the data. This non-dimensional objective function compares the achieved thrust with the required torque. Rotor blades have a decisive contribution to the performance of quadcopters. A two-blade rotor with pre-defined chord length distribution is chosen as the baseline model.The simulation is performed in a moving reference frame with a $k-\omega$ turbulence model for the hovering condition.The rotor shape is parameterized by the twist angle distribution.The optimization of this distribution employs a genetic algorithm. The local maxima are distilled from the data using a novel topological analysis inspired by discrete scalar-field topology. We identify one global maximum to be located in the interior of the data and five further local maxima related to errors from non-converged simulations.The interior location of the global optimum suggests that small improvements can be gained from further optimization.The local maxima have a small persistence, i.e., disappear under a small $\varepsilon$ perturbation of the figure of merit values. In other words, the data may be approximated by a smooth mono-modal surrogate model. Thus, the topological data analysis provides valuable insights for optimization and surrogate modeling.


title: Loss of Distributed Coverage Using Lazy Agents Operating Under Discrete, Local, Event-Triggered Communication

abstract: Continuous surveillance of a spatial region using distributed robots and sensors is a well-studied application in the area of multi-agent systems. This paper investigates a practically-relevant scenario where robotic sensors are introduced asynchronously and inter-robot communication is discrete, event-driven, local and asynchronous. Furthermore, we work with lazy robots; i.e., the robots seek to minimize their area of responsibility by equipartitioning the domain to be covered. We adapt a well-known algorithm which is practicable and known to generally work well for coverage problems. For a specially chosen geometry of the spatial domain, we show that there exists a non-trivial sequence of inter-robot communication events which leads to an instantaneous loss of coverage when the number of robots exceeds a certain threshold. The same sequence of events preserves coverage and, further, leads to an equipartition of the domain when the number of robots is smaller than the threshold. This result demonstrates that coverage guarantees for a given algorithm might be sensitive to the number of robots and, therefore, may not scale in obvious ways. It also suggests that when such algorithms are to be verified and validated prior to field deployment, the number of robots or sensors used in test scenarios should match that deployed on the field.


title: On the Laplacian matching root integral variation

abstract: In this paper, we devote to investigating the circumstances under which the addition of an edge to a graph will cause the Laplacian matching roots to change only by integer quantities. We prove that the Laplacian matching root integral variation in one place is impossible and the Laplacian matching root integral variation in two places is also impossible under some constraints.


title: Optimal management of DB pension fund under both underfunded and overfunded cases

abstract: This paper investigates the optimal management of an aggregated defined benefit pension plan in a stochastic environment. The interest rate follows the Ornstein-Uhlenbeck model, the benefits follow the geometric Brownian motion while the contribution rate is determined by the spread method of fund amortization. The pension manager invests in the financial market with three assets: cash, bond and stock. Regardless of the initial status of the plan, we suppose that the pension fund may become underfunded or overfunded in the planning horizon. The optimization goal of the manager is to maximize the expected utility in the overfunded region minus the weighted solvency risk in the underfunded region. By introducing an auxiliary process and related equivalent optimization problems and using the martingale method, the optimal wealth process, optimal portfolio and efficient frontier are obtained under four cases (high tolerance towards solvency risk, low tolerance towards solvency risk, a specific lower bound, and high lower bound). Moreover, we also obtain the probabilities that the optimal terminal wealth falls in the overfunded and underfunded regions. At last, we present numerical analyses to illustrate the manager's economic behaviors.


title: The Maxwell-Klein-Gordon equation with scattering data

abstract: It has been shown in [Yang-Yu 2019] that general large solutions to the Cauchy problem for the Maxwell-Klein-Gordon system (MKG) in the Minkowski space $\mathbb{R}^{1+3}$ decay like linear solutions. One hence can define the associated radiation field on the future null infinity as the limit of $(r\underline{\alpha}, r\phi)$ along the out going null geodesics. In this paper, we show the existence of a global solution to the MKG system which scatters to any given sufficiently localized radiation field with arbitrarily large size and total charge. The result follows by studying the characteristic initial value problem for the MKG system with general large data by using gauge invariant vector field method. We in particular extend the small data result of He in \cite{MR4299134} to a class of general large data.


title: Data Driven Reward Initialization for Preference based Reinforcement Learning

abstract: Preference-based Reinforcement Learning (PbRL) methods utilize binary feedback from the human in the loop (HiL) over queried trajectory pairs to learn a reward model in an attempt to approximate the human's underlying reward function capturing their preferences. In this work, we investigate the issue of a high degree of variability in the initialized reward models which are sensitive to random seeds of the experiment. This further compounds the issue of degenerate reward functions PbRL methods already suffer from. We propose a data-driven reward initialization method that does not add any additional cost to the human in the loop and negligible cost to the PbRL agent and show that doing so ensures that the predicted rewards of the initialized reward model are uniform in the state space and this reduces the variability in the performance of the method across multiple runs and is shown to improve the overall performance compared to other initialization methods.


title: A State Augmentation based approach to Reinforcement Learning from Human Preferences

abstract: Reinforcement Learning has suffered from poor reward specification, and issues for reward hacking even in simple enough domains. Preference Based Reinforcement Learning attempts to solve the issue by utilizing binary feedbacks on queried trajectory pairs by a human in the loop indicating their preferences about the agent's behavior to learn a reward model. In this work, we present a state augmentation technique that allows the agent's reward model to be robust and follow an invariance consistency that significantly improved performance, i.e. the reward recovery and subsequent return computed using the learned policy over our baseline PEBBLE. We validate our method on three domains, Mountain Car, a locomotion task of Quadruped-Walk, and a robotic manipulation task of Sweep-Into, and find that using the proposed augmentation the agent not only benefits in the overall performance but does so, quite early in the agent's training phase.


title: Probabilistic Qualitative Localization and Mapping

abstract: Simultaneous localization and mapping (SLAM) are essential in numerous robotics applications, such as autonomous navigation. Traditional SLAM approaches infer the metric state of the robot along with a metric map of the environment. While existing algorithms exhibit good results, they are still sensitive to measurement noise, sensor quality, and data association and are still computationally expensive. Alternatively, some navigation and mapping missions can be achieved using only qualitative geometric information, an approach known as qualitative spatial reasoning (QSR). We contribute a novel probabilistic qualitative localization and mapping approach in this work. We infer both the qualitative map and the qualitative state of the camera poses (localization). For the first time, we also incorporate qualitative probabilistic constraints between camera poses (motion model), improving computation time and performance. Furthermore, we take advantage of qualitative inference properties to achieve very fast approximated algorithms with good performance. In addition, we show how to propagate probabilistic information between nodes in the qualitative map, which improves estimation performance and enables inference of unseen map nodes - an important building block for qualitative active planning. We also conduct a study that shows how well we can estimate unseen nodes. Our method particularly appeals to scenarios with few salient landmarks and low-quality sensors. We evaluate our approach in simulation and on a real-world dataset and show its superior performance and low complexity compared to the state-of-the-art. Our analysis also indicates good prospects for using qualitative navigation and planning in real-world scenarios.


title: CRIRES+ detection of CO emissions lines and temperature inversions on the dayside of WASP-18b and WASP-76b

abstract: The dayside atmospheres of ultra-hot Jupiters (UHJs) are predicted to possess temperature inversion layers with extremely high temperatures at high altitudes. We observed the dayside thermal emission spectra of WASP-18b and WASP-76b with the new CRIRES+ high-resolution spectrograph at near-infrared wavelengths. Using the cross-correlation technique, we detected strong CO emission lines in both planets, which confirms the existence of temperature inversions on their dayside hemispheres. The two planets are the first UHJs orbiting F-type stars with CO emission lines detected; previous detections were mostly for UHJs orbiting A-type stars. Evidence of weak H2O emission signals is also found for both planets. We further applied forward-model retrievals on the detected CO lines and retrieved the temperature-pressure profiles along with the CO volume mixing ratios. The retrieved logarithmic CO mixing ratio of WASP-18b (-2.2) is slightly higher than the value predicted by the self-consistent model assuming solar abundance. For WASP-76b, the retrieved CO mixing ratio (-3.6) is broadly consistent with the value of solar abundance. In addition, we included the equatorial rotation velocity (Veq ) in the retrieval when analyzing the line profile broadening. The obtained Veq is 7.0 km/s for WASP-18b and 5.2 km/s for WASP-76b, which are consistent with the tidally locked rotational velocities.


title: Second natural connection on Riemannian $\Pi$-manifolds

abstract: A natural connection, determined by a property of its torsion tensor, is defined and it is called the second natural connection on Riemannian $\Pi$-manifold, i.e. the uniqueness of this connection is proved and a necessary and sufficient condition for coincidence with the first natural connection on the considered manifolds is found. The form of the torsion tensor of the second natural connection is obtained in the classes of the Riemannian $\Pi$-manifolds in which it differs from the first natural connection. An explicit example of dimension 5 is given in support of the proven assertions.


title: Exploiting Unlabeled Data for Feedback Efficient Human Preference based Reinforcement Learning

abstract: Preference Based Reinforcement Learning has shown much promise for utilizing human binary feedback on queried trajectory pairs to recover the underlying reward model of the Human in the Loop (HiL). While works have attempted to better utilize the queries made to the human, in this work we make two observations about the unlabeled trajectories collected by the agent and propose two corresponding loss functions that ensure participation of unlabeled trajectories in the reward learning process, and structure the embedding space of the reward model such that it reflects the structure of state space with respect to action distances. We validate the proposed method on one locomotion domain and one robotic manipulation task and compare with the state-of-the-art baseline PEBBLE. We further present an ablation of the proposed loss components across both the domains and find that not only each of the loss components perform better than the baseline, but the synergic combination of the two has much better reward recovery and human feedback sample efficiency.


title: Significantly increased magnetic anisotropy in Co nano-columnar multilayer structure via a unique sequential oblique-normal deposition approach

abstract: Oblique/normal sequential deposition technique is used to create Co based unique multilayer structure [Co-oblique(4.4nm)/Co-normal (4.2 nm)]x10, where each Co-oblique layer is deposited at an oblique angle of 75deg, to induce large in-plane uniaxial magnetic anisotropy (UMA). Compared to the previous ripple, stress and oblique angle deposition (OAD) related studies on Cobalt in literature, one-order higher UMA with the easy axis of magnetization along the projection of the tilted nano-columns in the multilayer plane is observed. The multilayer retains magnetic anisotropy even after annealing at 450C. The in-plane UMA in this multilayer is found to be the combination of shape, and magneto-crystalline anisotropy (MCA) confirmed by the temperature-dependent grazing incidence small angle X-ray scattering (GISAXS), in situ reflection high energy electron diffraction (RHEED) and grazing incidence X-ray diffraction (GIXRD) measurements. The crystalline texturing of hcp Co in the multilayer minimizes spin-orbit coupling energy along the column direction, which couples with the shape anisotropy energies and results in preferential orientation of the easy magnetic axis along the projection of the columns in the multilayer plane. Reduction in UMA after annealing is attributed to diffusion/merging of columns and annihilating crystallographic texturing. The obtained one-order high UMA demonstrates the potential application of the unique structure engineering technique, which may have far-reaching advantages in magnetic thin films/multilayers and spintronic devices.


title: Query-Centered Temporal Community Search via Time-Constrained Personalized PageRank

abstract: Existing temporal community search suffers from two defects: (i) they ignore the temporal proximity between the query vertex $q$ and other vertices but simply require the result to include $q$. Thus, they find many temporal irrelevant vertices (these vertices are called \emph{query-drifted vertices}) to $q$ for satisfying their cohesiveness, resulting in $q$ being marginalized; (ii) their methods are NP-hard, incurring high costs for exact solutions or compromised qualities for approximate/heuristic algorithms. Inspired by these, we propose a novel problem named \emph{query-centered} temporal community search to circumvent \emph{query-drifted vertices}. Specifically, we first present a novel concept of Time-Constrained Personalized PageRank to characterize the temporal proximity between $q$ and other vertices. Then, we introduce a model called $\beta$-temporal proximity core, which can combine temporal proximity and structural cohesiveness. Subsequently, our problem is formulated as an optimization task that finds a $\beta$-temporal proximity core with the largest $\beta$. To solve our problem, we first devise an exact and near-linear time greedy removing algorithm that iteratively removes unpromising vertices. To improve efficiency, we then design an approximate two-stage local search algorithm with bound-based pruning techniques. Finally, extensive experiments on eight real-life datasets and nine competitors show the superiority of the proposed solutions.


title: New Insights for the Stability-Plasticity Dilemma in Online Continual Learning

abstract: The aim of continual learning is to learn new tasks continuously (i.e., plasticity) without forgetting previously learned knowledge from old tasks (i.e., stability). In the scenario of online continual learning, wherein data comes strictly in a streaming manner, the plasticity of online continual learning is more vulnerable than offline continual learning because the training signal that can be obtained from a single data point is limited. To overcome the stability-plasticity dilemma in online continual learning, we propose an online continual learning framework named multi-scale feature adaptation network (MuFAN) that utilizes a richer context encoding extracted from different levels of a pre-trained network. Additionally, we introduce a novel structure-wise distillation loss and replace the commonly used batch normalization layer with a newly proposed stability-plasticity normalization module to train MuFAN that simultaneously maintains high plasticity and stability. MuFAN outperforms other state-of-the-art continual learning methods on the SVHN, CIFAR100, miniImageNet, and CORe50 datasets. Extensive experiments and ablation studies validate the significance and scalability of each proposed component: 1) multi-scale feature maps from a pre-trained encoder, 2) the structure-wise distillation loss, and 3) the stability-plasticity normalization module in MuFAN. Code is publicly available at https://github.com/whitesnowdrop/MuFAN.


title: Analogue gravity and the island prescription

abstract: Analogue gravity succeeded to simulate Hawking radiation and test it in laboratories. In this setting, the black hole is simulated by an area in a fluid, say water, where no sound wave can escape the event horizon and phonon oscillations are detected as Hawking radiation. This means that the analogue simulations can provide an alternative description, and consequently, a new insight to the high energy physics problems. Now it would be interesting to see what information loss means and how island prescription is interpreted in water experiment. In this paper we show that the analogue of information loss is the loss of momentum per unit mass of the fluid over the horizon and maintaining the momentum loss leads to the island prescription.


title: Multi-View Clustering from the Perspective of Mutual Information

abstract: Exploring the complementary information of multi-view data to improve clustering effects is a crucial issue in multi-view clustering. In this paper, we propose a novel model based on information theory termed Informative Multi-View Clustering (IMVC), which extracts the common and view-specific information hidden in multi-view data and constructs a clustering-oriented comprehensive representation. More specifically, we concatenate multiple features into a unified feature representation, then pass it through a encoder to retrieve the common representation across views. Simultaneously, the features of each view are sent to a encoder to produce a compact view-specific representation, respectively. Thus, we constrain the mutual information between the common representation and view-specific representations to be minimal for obtaining multi-level information. Further, the common representation and view-specific representation are spliced to model the refined representation of each view, which is fed into a decoder to reconstruct the initial data with maximizing their mutual information. In order to form a comprehensive representation, the common representation and all view-specific representations are concatenated. Furthermore, to accommodate the comprehensive representation better for the clustering task, we maximize the mutual information between an instance and its k-nearest neighbors to enhance the intra-cluster aggregation, thus inducing well separation of different clusters at the overall aspect. Finally, we conduct extensive experiments on six benchmark datasets, and the experimental results indicate that the proposed IMVC outperforms other methods.


title: Tensorized Optical Multimodal Fusion Network

abstract: We propose the first tensorized optical multimodal fusion network architecture with a self-attention mechanism and low-rank tensor fusion. Simulation results show $51.3 \times$ less hardware requirement and $3.7\times 10^{13}$ MAC/J energy efficiency.


title: Convolution in dual Ces\`aro sequence spaces

abstract: We investigate convolution operators in the sequence spaces $d_p$, for $1\le p<\infty$. These spaces, for $p>1$, arise as dual spaces of the \ces sequence spaces $ces_p$ thoroughly investigated by G.~Bennett. A detailed study is also made of the algebra of those sequences which convolve $d_p$ into $d_p$. It turns out that such multiplier spaces exhibit features which are very different to the classical multiplier spaces of $\ell^p$.


title: Effect of Ultralight Dark Matter on $g-2$ of the Electron

abstract: If dark matter is ultralight, the number density of dark matter is very high and the techniques of zero-temperature field theory are no longer valid. The dark matter number density modifies the vacuum giving it a non-negligible particle occupation number. For fermionic dark matter, this occupation number can be no larger than one. However, in the case of bosons the occupation number is unbounded. If there is a large occupation number, the Bose enhancement needs to be taken into consideration for any process involving particles which interact with the dark matter. Because the occupation number scales inversely with the dark matter mass, this effect is most prominent for ultralight dark matter. In fact, the Bose enhancement effect from the background is so significant for ultralight dark matter that, if dark matter is a dark photon, the correction to the anomalous magnetic moment is larger than experimental uncertainties for a mixing parameter of order $10^{-16}$ and a dark photon mass of order $10^{-20}$ eV. Furthermore, the constraint on the mixing parameter scales linearly with the dark photon mass and so new significant constraints can be placed on the dark matter mass all the way up to $10^{-14}$ eV. Future experiments measuring $g-2$ will probe even smaller gauge mixing parameters.


title: Seismic Arrival-time Picking on Distributed Acoustic Sensing Data using Semi-supervised Learning

abstract: Distributed Acoustic Sensing (DAS) is an emerging technology for earthquake monitoring and subsurface imaging. The recorded seismic signals by DAS have several distinct characteristics, such as unknown coupling effects, strong anthropogenic noise, and ultra-dense spatial sampling. These aspects differ from conventional seismic data recorded by seismic networks, making it challenging to utilize DAS at present for seismic monitoring. New data analysis algorithms are needed to extract useful information from DAS data. Previous studies on conventional seismic data demonstrated that deep learning models could achieve performance close to human analysts in picking seismic phases. However, phase picking on DAS data is still a difficult problem due to the lack of manual labels. Further, the differences in mathematical structure between these two data formats, i.e., ultra-dense DAS arrays and sparse seismic networks, make model fine-tuning or transfer learning difficult to implement on DAS data. In this work, we design a new approach using semi-supervised learning to solve the phase-picking task on DAS arrays. We use a pre-trained PhaseNet model as a teacher network to generate noisy labels of P and S arrivals on DAS data and apply the Gaussian mixture model phase association (GaMMA) method to refine these noisy labels to build training datasets. We develop a new deep learning model, PhaseNet-DAS, to process the 2D spatial-temporal data of DAS arrays and train the model on DAS data. The new deep learning model achieves high picking accuracy and good earthquake detection performance. We then apply the model to process continuous data and build earthquake catalogs directly from DAS recording. Our approach using semi-supervised learning provides a way to build effective deep learning models for DAS, which have the potential to improve earthquake monitoring using large-scale fiber networks.


title: Utilization of domain knowledge to improve POMDP belief estimation

abstract: The partially observable Markov decision process (POMDP) framework is a common approach for decision making under uncertainty. Recently, multiple studies have shown that by integrating relevant domain knowledge into POMDP belief estimation, we can improve the learned policy's performance. In this study, we propose a novel method for integrating the domain knowledge into probabilistic belief update in POMDP framework using Jeffrey's rule and normalization. We show that the domain knowledge can be utilized to reduce the data requirement and improve performance for POMDP policy learning with RL.


title: Tri-vector deformations on compact isometries

abstract: Classical Yang-Baxter equation governing bi-vector deformations of 10d supergravity is known to have no solutions along non-abelian compact isometries. By providing explicit examples we show that this is in contrast to generalized Yang-Baxter equation governing tri-vector deformations of 11d supergravity. We present deformations of the AdS7xS4 and flat backgrounds with isometries generated by Killing vectors of a sphere. Isometries of the AdS space-time are preserved by such deformations.


title: Fine spectra and compactness of generalized Ces\`{a}ro operators in Banach lattices in ${\mathbb C}^{{\mathbb N}_0}$

abstract: The generalized Ces\`{a}ro operators $\mathcal{C}_t$, for $t\in[0,1)$, introduced in the 1980's by Rhaly, are natural analogues of the classical Ces\`{a}ro averaging operator $\mathcal{C}_1$ and act in various Banach sequence spaces $X\subseteq {\mathbb C}^{{\mathbb N}_0}$. In this paper we concentrate on a certain class of Banach lattices for the coordinate-wise order, which includes all separable, rearrangement invariant sequence spaces, various weighted $c_0$ and $\ell^p$ spaces and many others. In such Banach lattices $X$ the operators $\mathcal{C}_t$, for $t\in[0,1)$, are always compact (unlike $\mathcal{C}_1$) and a full description of their point, continuous and residual spectrum is given. Estimates for the operator norm of $\mathcal{C}_t$ are also presented.


title: MDPose: Real-Time Multi-Person Pose Estimation via Mixture Density Model

abstract: One of the major challenges in multi-person pose estimation is instance-aware keypoint estimation. Previous methods address this problem by leveraging an off-the-shelf detector, heuristic post-grouping process or explicit instance identification process, hindering further improvements in the inference speed which is an important factor for practical applications. From the statistical point of view, those additional processes for identifying instances are necessary to bypass learning the high-dimensional joint distribution of human keypoints, which is a critical factor for another major challenge, the occlusion scenario. In this work, we propose a novel framework of single-stage instance-aware pose estimation by modeling the joint distribution of human keypoints with a mixture density model, termed as MDPose. Our MDPose estimates the distribution of human keypoints' coordinates using a mixture density model with an instance-aware keypoint head consisting simply of 8 convolutional layers. It is trained by minimizing the negative log-likelihood of the ground truth keypoints. Also, we propose a simple yet effective training strategy, Random Keypoint Grouping (RKG), which significantly alleviates the underflow problem leading to successful learning of relations between keypoints. On OCHuman dataset, which consists of images with highly occluded people, our MDPose achieves state-of-the-art performance by successfully learning the high-dimensional joint distribution of human keypoints. Furthermore, our MDPose shows significant improvement in inference speed with a competitive accuracy on MS COCO, a widely-used human keypoint dataset, thanks to the proposed much simpler single-stage pipeline.


title: The Ces\`{a}ro space of Dirichlet series and its multiplier algebra

abstract: We consider the space $\mathcal{H}(ces_p)$ of all Dirichlet series whose coefficients belong to the Ces\`{a}ro sequence space $ces_p$, consisting of all complex sequences whose absolute Ces\`{a}ro means are in $\ell^p$, for $1<p<\infty$. It is a Banach space of analytic functions, for which we study the maximal domain of analyticity and the boundedness of point evaluations. We identify the algebra of analytic multipliers on $\mathcal{H}(ces_p)$ as the Wiener algebra of Dirichlet series shifted to the vertical half-plane $\mathbb{C}_{1/q}:=\{s\in\mathbb{C}:\Re s>1/q\}$, where $1/p+1/q=1$.


title: Seeking Dark Signals in Oscillating Redshifts: Exploring Geometric Scalar Field Dark Matter

abstract: We detail a novel theoretical prediction that a geometric torsion model for scalar field dark matter could lead to oscillations, on readily probeable timescales, in the time evolution of cosmological redshifts of astronomical sources with qualitatively distinct behavior at different redshift scales (larger or smaller than z ~ 0.1). We present an analysis of extant spectroscopy data from the Australian Dark Energy Survey (OzDES) to assess whether such signals are present across a wide array of cosmological sources and baseline redshifts on the six-year timescale of OzDES. While a simple Fourier analysis of redshift variations weakly identifies some candidate frequencies, and so further investigation with future cosmological data sets may be warranted, we have not found compelling empirical evidence for the theory under consideration in this data set, placing tentative constraints on its free parameters.


title: Analytic elastic constants in molecular calculations: Finite strain, non-affine displacements, and many-body interatomic potentials

abstract: Elastic constants are among the most fundamental and important properties of solid materials, which is why they are routinely characterized in both experiments and simulations. While conceptually simple, the treatment of elastic constants is complicated by two factors not yet having been concurrently discussed: finite-strain and non-affine, internal displacements. Here, we revisit the theory behind zero-temperature, finite-strain elastic constants and extend it to explicitly consider non-affine displacements. We further present analytical expressions for second-order derivatives of the potential energy for two-body and generic many-body interatomic potentials, such as cluster and empirical bond-order potentials. Specifically, we revisit the elastic constants of silicon, silicon carbide and silicon dioxide under hydrostatic compression and dilatation. Based on existing and new results, we outline the effect of multiaxial stress states as opposed to volumetric deformation on the limits of stability of their crystalline lattices.


title: Relation between the eventual continuity and the e-property for Markov-Feller semigroups

abstract: We investigate the relation between the e-property and the eventual continuity, or called the asymptotic equicontinuity, which is a generalization of the e-property. We prove that, for any discrete-time or strongly continuous continuous-time eventually continuous Markov-Feller semigroup with an ergodic measure, if the interior of the support of the ergodic measure is nonempty, then the e-property is satisfied on the interior of the support. In particular, it implies that, restricted on the support of each ergodic measure, the e-property and the eventual continuity are equivalent for the discrete-time and the strongly continuous continuous-time Markov-Feller semigroups.


title: Deterministic quantum teleportation between distant superconducting chips

abstract: Quantum teleportation~\cite{Bennett1993} is of both fundamental interest and great practical importance in quantum information science. To date, quantum teleportation has been implemented in various physical systems~\cite{Pirandola2015}, among which superconducting qubits are of particular practical significance as they emerge as a leading system to realize large-scale quantum computation~\cite{Arute2019,Wu2021}. Nevertheless, the number of superconducting qubits on the same chip is severely limited by the available chip size, the cooling power, and the wiring complexity. Realization of quantum teleportation and remote computation over qubits on distant superconducting chips is a key quantum communication technology to scaling up the system through a distributed quantum computational network~\cite{Gottesman1999,Eisert2000,Jiang2007,Kimble2008,Monroe2014}. However, this goal has not been realized yet in experiments due to the technical challenge of making a quantum interconnect between distant superconducting chips and the inefficient transfer of flying microwave photons over the lossy interconnects~\cite{Kurpiers2018,Axline2018,Campagne2018,Magnard2020}. Here we demonstrate deterministic teleportation of quantum states and entangling gates between distant superconducting chips connected by a 64-meter-long cable bus featuring an ultralow loss of 0.32~dB/km at cryogenic temperatures, where high fidelity remote entanglement is generated via flying microwave photons utilizing time-reversal-symmetry~\cite{Cirac1997,Korotkov2011}. Apart from the fundamental interest of teleporting macroscopic superconducting qubits over a long distance, our work lays a foundation to realization of large-scale superconducting quantum computation through a distributed computational network~\cite{Gottesman1999,Eisert2000,Jiang2007,Kimble2008,Monroe2014}.


title: Enhanced Sampling of Configuration and Path Space in a Generalized Ensemble by Shooting Point Exchange

abstract: The computer simulation of many molecular processes is complicated by long time scales caused by rare transitions between long-lived states. Here, we propose a new approach to simulate such rare events, which combines transition path sampling with enhanced exploration of configuration space. The method relies on exchange moves between configuration and trajectory space, carried out based on a generalized ensemble. This scheme substantially enhances the efficiency of the transition path sampling simulations, particularly for systems with multiple transition channels, and yields information on thermodynamics, kinetics and reaction coordinates of molecular processes without distorting their dynamics. The method is illustrated using the isomerization of proline in the KPTP tetrapeptide.


title: Tighter 'Uniform Bounds for Black-Scholes Implied Volatility' and the applications to root-finding

abstract: This note improves the lower and upper bounds of the Black-Scholes implied volatility (IV) in Tehranchi (SIAM J. Financial Math., 7 (2016), p. 893). The proposed tighter bounds are systematically based on the bounds of the option delta. While Tehranchi used the bounds to prove IV asymptotics, we apply the result to the accurate numerical root-finding of IV. We alternatively formulate the Newton-Raphson method on the log price and demonstrate that the iteration always converges rapidly for all price ranges if the new lower bound found in this study is used as an initial guess.


title: Value Engineering for Autonomous Agents

abstract: Machine Ethics (ME) is concerned with the design of Artificial Moral Agents (AMAs), i.e. autonomous agents capable of reasoning and behaving according to moral values. Previous approaches have treated values as labels associated with some actions or states of the world, rather than as integral components of agent reasoning. It is also common to disregard that a value-guided agent operates alongside other value-guided agents in an environment governed by norms, thus omitting the social dimension of AMAs. In this blue sky paper, we propose a new AMA paradigm grounded in moral and social psychology, where values are instilled into agents as context-dependent goals. These goals intricately connect values at individual levels to norms at a collective level by evaluating the outcomes most incentivized by the norms in place. We argue that this type of normative reasoning, where agents are endowed with an understanding of norms' moral implications, leads to value-awareness in autonomous agents. Additionally, this capability paves the way for agents to align the norms enforced in their societies with respect to the human values instilled in them, by complementing the value-based reasoning on norms with agreement mechanisms to help agents collectively agree on the best set of norms that suit their human values. Overall, our agent model goes beyond the treatment of values as inert labels by connecting them to normative reasoning and to the social functionalities needed to integrate value-aware agents into our modern hybrid human-computer societies.


title: 3D Human Pose Lifting with Grid Convolution

abstract: Existing lifting networks for regressing 3D human poses from 2D single-view poses are typically constructed with linear layers based on graph-structured representation learning. In sharp contrast to them, this paper presents Grid Convolution (GridConv), mimicking the wisdom of regular convolution operations in image space. GridConv is based on a novel Semantic Grid Transformation (SGT) which leverages a binary assignment matrix to map the irregular graph-structured human pose onto a regular weave-like grid pose representation joint by joint, enabling layer-wise feature learning with GridConv operations. We provide two ways to implement SGT, including handcrafted and learnable designs. Surprisingly, both designs turn out to achieve promising results and the learnable one is better, demonstrating the great potential of this new lifting representation learning formulation. To improve the ability of GridConv to encode contextual cues, we introduce an attention module over the convolutional kernel, making grid convolution operations input-dependent, spatial-aware and grid-specific. We show that our fully convolutional grid lifting network outperforms state-of-the-art methods with noticeable margins under (1) conventional evaluation on Human3.6M and (2) cross-evaluation on MPI-INF-3DHP. Code is available at https://github.com/OSVAI/GridConv


abstract: Traffic analysis is crucial for urban operations and planning, while the availability of dense urban traffic data beyond loop detectors is still scarce. We present a large-scale floating vehicle dataset of per-street segment traffic information, Metropolitan Segment Traffic Speeds from Massive Floating Car Data in 10 Cities (MeTS-10), available for 10 global cities with a 15-minute resolution for collection periods ranging between 108 and 361 days in 2019-2021 and covering more than 1500 square kilometers per metropolitan area. MeTS-10 features traffic speed information at all street levels from main arterials to local streets for Antwerp, Bangkok, Barcelona, Berlin, Chicago, Istanbul, London, Madrid, Melbourne and Moscow. The dataset leverages the industrial-scale floating vehicle Traffic4cast data with speeds and vehicle counts provided in a privacy-preserving spatio-temporal aggregation. We detail the efficient matching approach mapping the data to the OpenStreetMap road graph. We evaluate the dataset by comparing it with publicly available stationary vehicle detector data (for Berlin, London, and Madrid) and the Uber traffic speed dataset (for Barcelona, Berlin, and London). The comparison highlights the differences across datasets in spatio-temporal coverage and variations in the reported traffic caused by the binning method. MeTS-10 enables novel, city-wide analysis of mobility and traffic patterns for ten major world cities, overcoming current limitations of spatially sparse vehicle detector data. The large spatial and temporal coverage offers an opportunity for joining the MeTS-10 with other datasets, such as traffic surveys in traffic planning studies or vehicle detector data in traffic control settings.


title: Gravitational form factors of a kink in $1+1$ dimensional $\phi^4$ model

abstract: We calculate the one-loop correction to the distribution of energy-momentum tensor around a kink in $1+1$ dimensional $\phi^4$ model. We employ the collective coordinate method to eliminate the zero mode that gives rise to infrared divergence. The ultraviolet divergences are removed by vacuum subtraction and mass renormalization. We obtain an analytic result that is finite and satisfies the momentum conservation. The total energy of the kink obtained from the spatial integral of energy density reproduces the known result. Our result obtained on a finite space has a spatially-uniform term that is inversely proportional to the spatial length.


title: Rigorous Derivation of the Degenerate Parabolic-Elliptic Keller-Segel System from a Moderately Interacting Stochastic Particle System. Part II Propagation of Chaos

abstract: This work is a series of two articles. The main goal is to rigorously derive the degenerate parabolic-elliptic Keller-Segel system in the sub-critical regime from a moderately interacting stochastic particle system. In the first article [7], we establish the classical solution theory of the degenerate parabolic-elliptic Keller-Segel system and its non-local version. In the second article, which is the current one, we derive a propagation of chaos result, where the classical solution theory obtained in the first article is used to derive required estimates for the particle system. Due to the degeneracy of the non-linear diffusion and the singular aggregation effect in the system, we perform an approximation of the stochastic particle system by using a cut-offed interacting potential. An additional linear diffusion on the particle level is used as a parabolic regularization of the system. We present the propagation of chaos result with logarithmic scalings. Consequently, the propagation of chaos follows directly from convergence in the sense of expectation and the vanishing viscosity argument of the Keller-Segel system.


title: Adversarial Contrastive Distillation with Adaptive Denoising

abstract: Adversarial Robustness Distillation (ARD) is a novel method to boost the robustness of small models. Unlike general adversarial training, its robust knowledge transfer can be less easily restricted by the model capacity. However, the teacher model that provides the robustness of knowledge does not always make correct predictions, interfering with the student's robust performances. Besides, in the previous ARD methods, the robustness comes entirely from one-to-one imitation, ignoring the relationship between examples. To this end, we propose a novel structured ARD method called Contrastive Relationship DeNoise Distillation (CRDND). We design an adaptive compensation module to model the instability of the teacher. Moreover, we utilize the contrastive relationship to explore implicit robustness knowledge among multiple examples. Experimental results on multiple attack benchmarks show CRDND can transfer robust knowledge efficiently and achieves state-of-the-art performances.


title: On the Regularising Levenberg-Marquardt Method for Blinn-Phong Photometric Stereo

abstract: Photometric stereo refers to the process to compute the 3D shape of an object using information on illumination and reflectance from several input images from the same point of view. The most often used reflectance model is the Lambertian reflectance, however this does not include specular highlights in input images. In this paper we consider the arising non-linear optimisation problem when employing Blinn-Phong reflectance for modeling specular effects. To this end we focus on the regularising Levenberg-Marquardt scheme. We show how to derive an explicit bound that gives information on the convergence reliability of the method depending on given data, and we show how to gain experimental evidence of numerical correctness of the iteration by making use of the Scherzer condition. The theoretical investigations that are at the heart of this paper are supplemented by some tests with real-world imagery.


title: A Lower Bound and a Near-Optimal Algorithm for Bilevel Empirical Risk Minimization

abstract: Bilevel optimization problems, which are problems where two optimization problems are nested, have more and more applications in machine learning. In many practical cases, the upper and the lower objectives correspond to empirical risk minimization problems and therefore have a sum structure. In this context, we propose a bilevel extension of the celebrated SARAH algorithm. We demonstrate that the algorithm requires $\mathcal{O}((n+m)^{\frac12}\varepsilon^{-1})$ oracle calls to achieve $\varepsilon$-stationarity with $n+m$ the total number of samples, which improves over all previous bilevel algorithms. Moreover, we provide a lower bound on the number of oracle calls required to get an approximate stationary point of the objective function of the bilevel problem. This lower bound is attained by our algorithm, making it optimal in terms of sample complexity.


title: Compositionality of planar perfect matchings

abstract: We exhibit a strong connection between the matchgate formalism introduced by Valiant and the ZW-calculus of Coecke and Kissinger. This connection provides a natural compositional framework for matchgate theory as well as a direct combinatorial interpretation of the diagrams of ZW-calculus through the perfect matchings of their underlying graphs. We identify a precise fragment of ZW-calculus, the planar W-calculus, that we prove to be complete and universal for matchgates, that are linear maps satisfying the matchgate identities. Computing scalars of the planar W-calculus corresponds to counting perfect matchings of planar graphs, and so can be carried in polynomial time using the FKT algorithm, making the planar W-calculus an efficiently simulable fragment of the ZW-calculus, in a similar way that the Clifford fragment is for ZX-calculus. This work opens new directions for the investigation of the combinatorial properties of ZW-calculus as well as the study of perfect matching counting through compositional diagrammatical technics.


title: The classification of reflexive modules of rank one over rational and minimally elliptic singularities

abstract: We classify the reflexive modules of rank one over rational and minimally elliptic singularities. Equivalently, we classify full line bundles on the resolutions of rational and minimally elliptic singularities. As an application, we determine among such reflexive modules of rank one all the special ones (in the sense of Wunram) and all the flat ones. In this way, we also classify the non-flat reflexive modules as well (as a generalization of a construction of Dan and Romano). In particular, we prove (in the rank one case) a conjecture of Behnke, namely that in the case of a cusp singularity any reflexive module admits a flat connection. The results generalize the classical Mckay correspondence, and results of Artin, Verdier, Esnault, Khan and Wunram valid for different particular families of singularities.


title: Collaborative Discrepancy Optimization for Reliable Image Anomaly Localization

abstract: Most unsupervised image anomaly localization methods suffer from overgeneralization because of the high generalization abilities of convolutional neural networks, leading to unreliable predictions. To mitigate the overgeneralization, this study proposes to collaboratively optimize normal and abnormal feature distributions with the assistance of synthetic anomalies, namely collaborative discrepancy optimization (CDO). CDO introduces a margin optimization module and an overlap optimization module to optimize the two key factors determining the localization performance, i.e., the margin and the overlap between the discrepancy distributions (DDs) of normal and abnormal samples. With CDO, a large margin and a small overlap between normal and abnormal DDs are obtained, and the prediction reliability is boosted. Experiments on MVTec2D and MVTec3D show that CDO effectively mitigates the overgeneralization and achieves great anomaly localization performance with real-time computation efficiency. A real-world automotive plastic parts inspection application further demonstrates the capability of the proposed CDO. Code is available on https://github.com/caoyunkang/CDO.


title: A theoretical framework for dynamic anticrack and supershear propagation in snow slab avalanches

abstract: (Shortened abstract) Snow slab avalanches release after the failure and collapse of a weak layer buried below a cohesive snow slab. This results in the propagation of a subsidence, known as a collapse wave or anticrack. The slab may eventually break and detach from the rest of the snowpack, provided that the slope is steep enough to enable gravity to overcome the friction. The only theoretical framework to date (Heierli 2005) proposed an explicit solution for the propagation speed in steady state which could not account for weak layer properties, was not mathematically bounded for certain values of the physical constants involved, and could not explain the newly uncovered supershear transition for steep slopes. Here, a new model for the stationary propagation of anticracks is set up, so as to account for the anticrack speed regime on the one hand, and the supershear regime on the other hand, the existence of which has been recently revealed and ascertained by numerical simulations. The results presented here seem consistent with most of the available data, and highlight the role that the compaction of the weak layer can play in reducing the anticrack speed. On the contrary, by storing energy upon failure and suddenly releasing it at the crack tip, the weak layer elasticity could help justify the higher speeds sometimes observed in both regimes. Finally, a more accurate model is proposed, based on the modelling of both the slab and the weak layer as Timoshenko beams; although its complexity prevents us from solving it analytically, it provides enlightening insights into the mechanical processes at work at the interface between both layers, from a strength-of-materials perspective. This analysis is a first step towards a better understanding of the underlying mechanisms of propagation of cracks in slab avalanches, and towards more accurate avalanche size and occurrence predictions.


title: Explicit and Implicit Knowledge Distillation via Unlabeled Data

abstract: Data-free knowledge distillation is a challenging model lightweight task for scenarios in which the original dataset is not available. Previous methods require a lot of extra computational costs to update one or more generators and their naive imitate-learning lead to lower distillation efficiency. Based on these observations, we first propose an efficient unlabeled sample selection method to replace high computational generators and focus on improving the training efficiency of the selected samples. Then, a class-dropping mechanism is designed to suppress the label noise caused by the data domain shifts. Finally, we propose a distillation method that incorporates explicit features and implicit structured relations to improve the effect of distillation. Experimental results show that our method can quickly converge and obtain higher accuracy than other state-of-the-art methods.


title: Channel Sparsity Variation and Model-Based Analysis on 6, 26, and 132 GHz Measurements

abstract: In this paper, the level of sparsity is examined at 6, 26, and 132 GHz carrier frequencies by conducting channel measurements in an indoor office environment. By using the Gini index (value between 0 and 1) as a metric for characterizing sparsity, we show that increasing carrier frequency leads to increased levels of sparsity. The measured channel impulse responses are used to derive a Third-Generation Partnership Project (3GPP)-style propagation model, used to calculate the Gini index for the comparison of the channel sparsity between the measurement and simulation based on the 3GPP model. Our results show that the mean value of the Gini index in measurement is over twice the value in simulation, implying that the 3GPP channel model does not capture the effects of sparsity in the delay domain as frequency increases. In addition, a new intra-cluster power allocation model based on measurements is proposed to characterize the effects of sparsity in the delay domain of the 3GPP channel model. The accuracy of the proposed model is analyzed using theoretical derivations and simulations. Using the derived intra-cluster power allocation model, the mean value of the Gini index is 0.97, while the spread of variability is restricted to 0.01, demonstrating that the proposed model is suitable for 3GPP-type channels. To our best knowledge, this paper is the first to perform measurements and analysis at three different frequencies for the evaluation of channel sparsity in the same environment.


title: Logarithmically Completely Monotonic Rational Functions

abstract: This paper studies the class of logarithmically completely monotonic (LCM) functions. These functions play an important role in characterising externally positive linear systems which find applications in important control problems such as non-overshooting reference tracking. Conditions are proposed to ensure a rational function is LCM, a result that enables the known space of linear continuous-time externally positive systems to be enlarged and an efficient and optimal pole-placement procedure for the monotonic tracking controller synthesis problem to be developed. The presented conditions are shown to be less conservative than existing approaches whilst being computationally tractable.


title: Vision, Deduction and Alignment: An Empirical Study on Multi-modal Knowledge Graph Alignment

abstract: Entity alignment (EA) for knowledge graphs (KGs) plays a critical role in knowledge engineering. Existing EA methods mostly focus on utilizing the graph structures and entity attributes (including literals), but ignore images that are common in modern multi-modal KGs. In this study we first constructed Multi-OpenEA -- eight large-scale, image-equipped EA benchmarks, and then evaluated some existing embedding-based methods for utilizing images. In view of the complementary nature of visual modal information and logical deduction, we further developed a new multi-modal EA method named LODEME using logical deduction and multi-modal KG embedding, with state-of-the-art performance achieved on Multi-OpenEA and other existing multi-modal EA benchmarks.


title: Triemaps that match

abstract: The trie data structure is a good choice for finite maps whose keys are data structures (trees) rather than atomic values. But what if we want the keys to be patterns, each of which matches many lookup keys? Efficient matching of this kind is well studied in the theorem prover community, but much less so in the context of statically typed functional programming. Doing so yields an interesting new viewpoint -- and a practically useful design pattern, with good runtime performance.


title: A comparison of millisecond pulsar populations between globular clusters and the Galactic field

abstract: We have performed a systematic study of the rotational, orbital and X-ray properties of millisecond pulsars (MSPs) in globular clusters (GCs) and compared their nature with those of the MSPs in the Galactic field (GF). We found that GC MSPs generally rotate slower than their counterparts in the GF. Different from the expectation of a simple recycling scenario, no evidence for the correlation between the orbital period and the rotation period can be found from the MSP binaries in GCs. There is also an indication that the surface magnetic field of GC MSPs are stronger than those in the GF. All these suggest dynamical interactions in GCs can alter the evolution of MSPs/their progenitors which can leave an imprint on their X-ray emission properties. While the MSPs in both GF and GCs have similar distributions of X-ray luminosity and hardness, our sample supports the notion that these two populations follow different relation between the X-ray luminosity and spin-down power. We discuss this in terms of both pulsar emission model and the observational bias.


title: Hate Speech and Offensive Language Detection using an Emotion-aware Shared Encoder

abstract: The rise of emergence of social media platforms has fundamentally altered how people communicate, and among the results of these developments is an increase in online use of abusive content. Therefore, automatically detecting this content is essential for banning inappropriate information, and reducing toxicity and violence on social media platforms. The existing works on hate speech and offensive language detection produce promising results based on pre-trained transformer models, however, they considered only the analysis of abusive content features generated through annotated datasets. This paper addresses a multi-task joint learning approach which combines external emotional features extracted from another corpora in dealing with the imbalanced and scarcity of labeled datasets. Our analysis are using two well-known Transformer-based models, BERT and mBERT, where the later is used to address abusive content detection in multi-lingual scenarios. Our model jointly learns abusive content detection with emotional features by sharing representations through transformers' shared encoder. This approach increases data efficiency, reduce overfitting via shared representations, and ensure fast learning by leveraging auxiliary information. Our findings demonstrate that emotional knowledge helps to more reliably identify hate speech and offensive language across datasets. Our hate speech detection Multi-task model exhibited 3% performance improvement over baseline models, but the performance of multi-task models were not significant for offensive language detection task. More interestingly, in both tasks, multi-task models exhibits less false positive errors compared to single task scenario.


title: Logarithmic vector bundles on the blown-up surface

abstract: We study the logarithmic vector bundles associated to arrangements of smooth irreducible curves with small degree on the blow-up of the projective plane at one point. We then investigate whether they are Torelli arrangements, that is, they can be recovered from the attached logarithmic vector bundles.


title: On the convergence result of the gradient-push algorithm on directed graphs with constant stepsize

abstract: Gradient-push algorithm has been widely used for decentralized optimization problems when the connectivity network is a direct graph. This paper shows that the gradient-push algorithm with stepsize $\alpha>0$ converges exponentially fast to an $O(\alpha)$-neighborhood of the optimizer under the assumption that each cost is smooth and the total cost is strongly convex. Numerical experiments are provided to support the theoretical convergence results.


title: SE(3) symmetry lets graph neural networks learn arterial velocity estimation from small datasets

abstract: Hemodynamic velocity fields in coronary arteries could be the basis of valuable biomarkers for diagnosis, prognosis and treatment planning in cardiovascular disease. Velocity fields are typically obtained from patient-specific 3D artery models via computational fluid dynamics (CFD). However, CFD simulation requires meticulous setup by experts and is time-intensive, which hinders large-scale acceptance in clinical practice. To address this, we propose graph neural networks (GNN) as an efficient black-box surrogate method to estimate 3D velocity fields mapped to the vertices of tetrahedral meshes of the artery lumen. We train these GNNs on synthetic artery models and CFD-based ground truth velocity fields. Once the GNN is trained, velocity estimates in a new and unseen artery can be obtained with 36-fold speed-up compared to CFD. We demonstrate how to construct an SE(3)-equivariant GNN that is independent of the spatial orientation of the input mesh and show how this reduces the necessary amount of training data compared to a baseline neural network.


title: Interpolation Conditions for Linear Operators and Applications to Performance Estimation Problems

abstract: The Performance Estimation Problem methodology makes it possible to determine the exact worst-case performance of an optimization method. In this work, we generalize this framework to first-order methods involving linear operators. This extension requires an explicit formulation of interpolation conditions for those linear operators. We consider the class of linear operators $\mathcal{M}:x \mapsto Mx$ where matrix $M$ has bounded singular values, and the class of linear operators where $M$ is symmetric and has bounded eigenvalues. We describe interpolation conditions for these classes, i.e. necessary and sufficient conditions that, given a list of pairs $\{(x_i,y_i)\}$, characterize the existence of a linear operator mapping $x_i$ to $y_i$ for all $i$. Using these conditions, we first identify the exact worst-case behavior of the gradient method applied to the composed objective $h\circ \mathcal{M}$, and observe that it always corresponds to $\mathcal{M}$ being a scaling operator. We then investigate the Chambolle-Pock method applied to $f+g\circ \mathcal{M}$, and improve the existing analysis to obtain a proof of the exact convergence rate of the primal-dual gap. In addition, we study how this method behaves on Lipschitz convex functions, and obtain a numerical convergence rate for the primal accuracy of the last iterate. We also show numerically that averaging iterates is beneficial in this setting.


title: The Raychaudhuri Equation in inhomogeneous FLRW space-time : A $f(R)$-gravity model

abstract: In general description of the Raychaudhuri equation it is found that this first order non-linear differential equation can be written as a second order linear differential equation in the form of Harmonic Oscillator with varying frequency. Further, the integrability of the Raychaudhuri equation has been studied and also the expansion scalar is obtained in an explicit form. Subsequently, $f(R)$ gravity theory has been studied in the background of inhomogeneous FLRW spacetime with an aim to formulate the Raychaudhuri Equation. A congruence of time-like geodesics has been investigated using the Raychaudhuri Equation to examine whether the geodesics converge or not and some possible conditions are determined to avoid singularity. Finally, a brief quantum description has been presented.


title: SGD with AdaGrad Stepsizes: Full Adaptivity with High Probability to Unknown Parameters, Unbounded Gradients and Affine Variance

abstract: We study Stochastic Gradient Descent with AdaGrad stepsizes: a popular adaptive (self-tuning) method for first-order stochastic optimization. Despite being well studied, existing analyses of this method suffer from various shortcomings: they either assume some knowledge of the problem parameters, impose strong global Lipschitz conditions, or fail to give bounds that hold with high probability. We provide a comprehensive analysis of this basic method without any of these limitations, in both the convex and non-convex (smooth) cases, that additionally supports a general ``affine variance'' noise model and provides sharp rates of convergence in both the low-noise and high-noise~regimes.