title: The toral contractions and $\Gamma$-distinguished $\Gamma$-contractions

abstract: We consider distinguished varieties in the bidisc $\mathbb D^2$ and the symmetrized bidisc $\mathbb{G}_2$. A commuting pair of Hilbert space operators $(S,P)$ for which $\Gamma=\overline{\mathbb{G}}_2$ is a spectral set is called a \textit{$\Gamma$-contraction}. A commuting pair of contractions $(T_1,T_2)$ is said to be \textit{toral} if there is a toral polynomial $p\in \mathbb C[z_1,z_2]$ such that $p(T_1,T_2)=0$. Similarly, a $\Gamma$-contraction $(S,P)$ is called $\Gamma$-\textit{distinguished} if $(S,P)$ is annihilated by a $\Gamma$-distinguished polynomial in $\mathbb C[z_1,z_2]$. The main results af this article are the following: we find a necessary and sufficient condition such that a toral pair of contractions dilates to a toral pair of isometries. Also, we characterize all $\Gamma$-distinguished $\Gamma$-contractions that admit $\Gamma$-distinguished $\Gamma$-isometric dilations. We determine the distinguished boundary of a distinguished variety in $\mathbb D^2$ and $\mathbb G_2$. Then we prove that a pair of commuting contractions $(T_1,T_2)$ (or a $\Gamma$-contraction $(S,P)$) dilates to a toral pair of isometries (or a $\Gamma$-distinguished $\Gamma$-isometry) if and only if there is a toral polynomial (or $\Gamma$-distinguished polynomial) $p\in \mathbb C[z_1,z_2]$ such that $Z(p) \cap \overline{\mathbb D}^2$ (or $Z(p) \cap \overline{\mathbb G}_2$) is a complete spectral set for $(T_1,T_2)$ (or $(S,P)$). We provide several examples at places to show the contrasts between the theory of toral contractions and $\Gamma$-distinguished $\Gamma$-contractions.


title: Multiple-environment Self-adaptive Network for Aerial-view Geo-localization

abstract: Aerial-view geo-localization tends to determine an unknown position through matching the drone-view image with the geo-tagged satellite-view image. This task is mostly regarded as an image retrieval problem. The key underpinning this task is to design a series of deep neural networks to learn discriminative image descriptors. However, existing methods meet large performance drops under realistic weather, such as rain and fog, since they do not take the domain shift between the training data and multiple test environments into consideration. To minor this domain gap, we propose a Multiple-environment Self-adaptive Network (MuSe-Net) to dynamically adjust the domain shift caused by environmental changing. In particular, MuSe-Net employs a two-branch neural network containing one multiple-environment style extraction network and one self-adaptive feature extraction network. As the name implies, the multiple-environment style extraction network is to extract the environment-related style information, while the self-adaptive feature extraction network utilizes an adaptive modulation module to dynamically minimize the environment-related style gap. Extensive experiments on two widely-used benchmarks, i.e., University-1652 and CVUSA, demonstrate that the proposed MuSe-Net achieves a competitive result for geo-localization in multiple environments. Furthermore, we observe that the proposed method also shows great potential to the unseen extreme weather, such as mixing the fog, rain and snow.


title: Subspace Nonnegative Matrix Factorization for Feature Representation

abstract: Traditional nonnegative matrix factorization (NMF) learns a new feature representation on the whole data space, which means treating all features equally. However, a subspace is often sufficient for accurate representation in practical applications, and redundant features can be invalid or even harmful. For example, if a camera has some sensors destroyed, then the corresponding pixels in the photos from this camera are not helpful to identify the content, which means only the subspace consisting of remaining pixels is worthy of attention. This paper proposes a new NMF method by introducing adaptive weights to identify key features in the original space so that only a subspace involves generating the new representation. Two strategies are proposed to achieve this: the fuzzier weighted technique and entropy regularized weighted technique, both of which result in an iterative solution with a simple form. Experimental results on several real-world datasets demonstrated that the proposed methods can generate a more accurate feature representation than existing methods. The code developed in this study is available at https://github.com/WNMF1/FWNMF-ERWNMF.


title: 'I think I discovered a military base in the middle of the ocean' -- Null Island, the most real of fictional places

abstract: This paper explores Null Island, a fictional place located at 0$^\circ$ latitude and 0$^\circ$ longitude in the WGS84 geographic coordinate system. Null Island is erroneously associated with large amounts of geographic data in a wide variety of location-based services, place databases, social media and web-based maps. While it was originally considered a joke within the geospatial community, this article will demonstrate implications of its existence, both technological and social in nature, promoting Null Island as a fundamental issue of geographic information that requires more widespread awareness. The article summarizes error sources that lead to data being associated with Null Island. We identify four evolutionary phases which help explain how this fictional place evolved and established itself as an entity reaching beyond the geospatial profession to the point of being discovered by the visual arts and the general population. After providing an accurate account of data that can be found at (0, 0), geospatial, technological and social implications of Null Island are discussed. Guidelines to avoid misplacing data to Null Island are provided. Since data will likely continue to appear at this location, our contribution is aimed at both GIScientists and the general population to promote awareness of this error source.


title: Projective geometry of 3-Sasaki structures

abstract: We show that $3$-Sasaki structures admit a natural description in terms of projective differential geometry. This description provides a concrete link between $3$-Sasaki structures and several other geometries and constructions via a single unifying picture. First we establish that a $3$-Sasaki structure may be understood as a projective structure equipped with a certain holonomy reduction to the (possibly indefinite) unitary quaternionic group $\textrm{Sp}(p,q)$, namely a parallel hyperk\"ahler structure on the projective tractor bundle satisfying a particular genericity condition. For the converse, where one begins with a general parallel hyperk\"ahler structure on the projective tractor bundle, the genericity condition is not automatic. Indeed we prove that generically such a reduction decomposes the underlying manifold into a disjoint union of strata including open manifolds with (indefinite) $3$-Sasaki structures and a closed separating hypersurface at infinity with respect to the $3$-Sasaki metrics. Moreover, it is shown that the latter hypersurface inherits a Biquard-Fefferman conformal structure, which thus (locally) fibres over a quaternionic contact structure, and which in turn compactifies the natural quaternionic K\"ahler quotients of the $3$-Sasaki structures on the open manifolds. As an application we describe the projective compactification of (suitably) complete, non-compact (indefinite) $3$-Sasaki manifolds and recover Biquard's notion of asymptotically hyperbolic quaternionic K\"ahler metrics.


title: Awake Complexity of Distributed Minimum Spanning Tree

abstract: We study the distributed minimum spanning tree (MST) problem, a fundamental problem in distributed computing. It is well-known that distributed MST can be solved in $\tilde{O}(D+\sqrt{n})$ rounds in the standard CONGEST model (where $n$ is the network size and $D$ is the network diameter) and this is essentially the best possible round complexity (up to logarithmic factors). However, in resource-constrained networks such as ad hoc wireless and sensor networks, nodes spending so much time can lead to significant spending of resources such as energy. Motivated by the above consideration, we study distributed algorithms for MST under the \emph{sleeping model} [Chatterjee et al., PODC 2020], a model for design and analysis of resource-efficient distributed algorithms. In the sleeping model, a node can be in one of two modes in any round -- \emph{sleeping} or \emph{awake} (unlike the traditional model where nodes are always awake). Only the rounds in which a node is \emph{awake} are counted, while \emph{sleeping} rounds are ignored. A node spends resources only in the awake rounds and hence the main goal is to minimize the \emph{awake complexity} of a distributed algorithm, the worst-case number of rounds any node is awake. We present deterministic and randomized distributed MST algorithms that have an \emph{optimal} awake complexity of $O(\log n)$ time with a matching lower bound. We also show that our randomized awake-optimal algorithm has essentially the best possible round complexity by presenting a lower bound of $\tilde{\Omega}(n)$ on the product of the awake and round complexity of any distributed algorithm (including randomized) that outputs an MST. To complement our trade-off lower bound, we present a parameterized family of distributed algorithms that gives an essentially optimal trade-off between the awake complexity and the round complexity.


title: Optimal Subsampling for High-dimensional Ridge Regression

abstract: We investigate the feature compression of high-dimensional ridge regression using the optimal subsampling technique. Specifically, based on the basic framework of random sampling algorithm on feature for ridge regression and the A-optimal design criterion, we first obtain a set of optimal subsampling probabilities. Considering that the obtained probabilities are uneconomical, we then propose the nearly optimal ones. With these probabilities, a two step iterative algorithm is established which has lower computational cost and higher accuracy. We provide theoretical analysis and numerical experiments to support the proposed methods. Numerical results demonstrate the decent performance of our methods.


title: LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

abstract: Self-supervised pre-training techniques have achieved remarkable progress in Document AI. Most multimodal pre-trained models use a masked language modeling objective to learn bidirectional representations on the text modality, but they differ in pre-training objectives for the image modality. This discrepancy adds difficulty to multimodal representation learning. In this paper, we propose \textbf{LayoutLMv3} to pre-train multimodal Transformers for Document AI with unified text and image masking. Additionally, LayoutLMv3 is pre-trained with a word-patch alignment objective to learn cross-modal alignment by predicting whether the corresponding image patch of a text word is masked. The simple unified architecture and training objectives make LayoutLMv3 a general-purpose pre-trained model for both text-centric and image-centric Document AI tasks. Experimental results show that LayoutLMv3 achieves state-of-the-art performance not only in text-centric tasks, including form understanding, receipt understanding, and document visual question answering, but also in image-centric tasks such as document image classification and document layout analysis. The code and models are publicly available at \url{https://aka.ms/layoutlmv3}.


title: A remark on the component group of the Sato-Tate group

abstract: In this paper, we give a complete characterization of the component group of the Sato-Tate group of an abelian variety $A$ of arbitrary dimension, defined over a number field $K,$ in terms of the connectedness of the Lefschetz group associated to $A.$


title: Boson Sampling for Generalized Bosons

abstract: We introduce the notion of "generalized bosons" whose exchange statistics resemble those of bosons, but the local bosonic commutator $[a_i,a_i^\dagger]=1$ is replaced by an arbitrary single-mode operator that is diagonal in the generalized Fock basis. Examples of generalized bosons include boson pairs and spins. We consider the analogue of the boson sampling task for these particles and observe that its output probabilities are still given by permanents, so that the results regarding hardness of sampling directly carry over. Finally, we propose implementations of generalized boson sampling in circuit-QED and ion-trap platforms.


title: $W$ boson mass shift and muon magnetic moment in the Zee model

abstract: The CDF collaboration at Fermilab has recently reported a new precision measurement of the $W$~boson mass showing a substantial $7\sigma$ deviation from the Standard Model prediction. Moreover, Fermilab has recently confirmed the longstanding tension in the $(g-2)_\mu$ measurement. We propose a unified solution to these deviations within the simplest radiative neutrino mass model: the Zee model. Our analysis establishes non-trivial links between the origin of neutrino mass, the $(g-2)_\mu$ anomaly, and the $W$~boson mass shift while being consistent with lepton flavor violation and all other experimental constraints. We find that the mass spectrum of the physical scalars must be hierarchical to be consistent with the $W$~boson mass shift; remarkably, this is also the key to resolving the $(g-2)_\mu$ tension. Furthermore, this mass splitting offers a unique same-sign dimuon signal through which our model can be tested at the LHC.


title: Colors of Irregular Satellites of Saturn with DECam

abstract: We report g-r and r-i new colors for 21 Saturn Irregular Satellites, among them, 4 previously unreported. This is the highest number of Saturn Irregular satellites reported in a single survey. These satellites were measured by "stacking" their observations to increase their signal without trailing. This work describes a novel processing algorithm that enables the detection of faint sources under significant background noise and in front of a severely crowded field. Our survey shows these new color measurements of Saturn Irregular Satellites are consistent with other Irregular Satellites populations as found in previous works and reinforcing the observation that the lack of ultra red objects among the irregular satellites is a real feature that separates them from the trans-Neptunian objects (their posited source population).


title: Quasihomomorphisms from the integers into Hamming metrics

abstract: A function $f: \mathbb{Z} \to \mathbb{Q}^n$ is a $c$-quasihomomorphism if the Hamming distance between $f(x+y)$ and $f(x)+f(y)$ is at most $c$ for all $x,y \in \mathbb{Z}$. We show that any $c$-quasihomomorphism has distance at most some constant $C(c)$ to an actual group homomorphism; here $C(c)$ depends only on $c$ and not on $n$ or $f$. This gives a positive answer to a special case of a question posed by Kazhdan and Ziegler.


title: Proton Stability: From the Standard Model to Beyond Grand Unification

abstract: A proton is known for its longevity, but what is its lifetime? While many Grand Unified Theories predict the proton decay with a finite lifetime, we show that the Standard Model (SM) and some versions of Ultra Unification (which replace sterile neutrinos with new exotic gapped/gapless sectors, e.g., topological or conformal field theory under global anomaly cancellation constraints) with a discrete baryon plus lepton symmetry permit a stable proton. For the 4d SM with $N_f$ families of 15 or 16 Weyl fermions, in addition to the continuous baryon minus lepton U(1)$_{\bf B - L}$ symmetry, there is also a compatible discrete baryon plus lepton $\mathbb{Z}_{2N_f, \bf B + L}$ symmetry. The $\mathbb{Z}_{2N_f, \bf B + L}$ is discrete due to the ABJ anomaly under the BPST SU(2) instanton. Although both U(1)$_{\bf B - L}$ and $\mathbb{Z}_{2N_f, \bf B + L}$ symmetries are anomaly-free under the dynamical SM gauge field, it is important to check whether they have mixed anomalies with the gravitational background field and higher symmetries (whose charged objects are Wilson electric or 't Hooft magnetic line operators) of SM. We can also replace the U(1)$_{\bf B - L}$ with a discrete variant $\mathbb{Z}_{4,X}$ for $X \equiv 5({\bf B - L})-\frac{2}{3} {\tilde Y}$ of electroweak hypercharge ${\tilde Y}$. We explore a systematic classification of candidate perturbative local and nonperturbative global anomalies of the 4d SM, including all these gauge and gravitational backgrounds, via a cobordism theory, which controls the SM's deformation class. We discuss the proton stability of the SM and Ultra Unification in the presence of discrete ${\bf B + L}$ symmetry protection, in particular (U(1)$_{\bf B - L} \times \mathbb{Z}_{2N_f,\bf B + L})/{\mathbb{Z}_2^{\rm F}}$ or $(\mathbb{Z}_{4,X} \times \mathbb{Z}_{2N_f, \bf B + L})/{\mathbb{Z}_2^{\rm F}}$ symmetry with the fermion parity $\mathbb{Z}_2^{\rm F}$.


title: CenterNet++ for Object Detection

abstract: There are two mainstreams for object detection: top-down and bottom-up. The state-of-the-art approaches mostly belong to the first category. In this paper, we demonstrate that the bottom-up approaches are as competitive as the top-down and enjoy higher recall. Our approach, named CenterNet, detects each object as a triplet keypoints (top-left and bottom-right corners and the center keypoint). We firstly group the corners by some designed cues and further confirm the objects by the center keypoints. The corner keypoints equip the approach with the ability to detect objects of various scales and shapes and the center keypoint avoids the confusion brought by a large number of false-positive proposals. Our approach is a kind of anchor-free detector because it does not need to define explicit anchor boxes. We adapt our approach to the backbones with different structures, i.e., the 'hourglass' like networks and the the 'pyramid' like networks, which detect objects on a single-resolution feature map and multi-resolution feature maps, respectively. On the MS-COCO dataset, CenterNet with Res2Net-101 and Swin-Transformer achieves APs of 53.7% and 57.1%, respectively, outperforming all existing bottom-up detectors and achieving state-of-the-art. We also design a real-time CenterNet, which achieves a good trade-off between accuracy and speed with an AP of 43.6% at 30.5 FPS. https://github.com/Duankaiwen/PyCenterNet.


title: Etudes for the inverse spectral problem

abstract: In this note we study inverse spectral problems for canonical Hamiltonian systems, which encompass a broad class of second order differential equations on a half-line. Our goal is to extend the classical resultss developed in the work of Marchenko, Gelfand-Levitan, and Krein to broader classes of canonical systems and to illustrate the solution algorithms and formulas with a variety of examples. One of the main ingredients of our approach is the use of truncated Toeplitz operators, which complement the standard toolbox of the Krein-de Branges theory of canonical systems.


title: StableMoE: Stable Routing Strategy for Mixture of Experts

abstract: The Mixture-of-Experts (MoE) technique can scale up the model size of Transformers with an affordable computational overhead. We point out that existing learning-to-route MoE methods suffer from the routing fluctuation issue, i.e., the target expert of the same input may change along with training, but only one expert will be activated for the input during inference. The routing fluctuation tends to harm sample efficiency because the same input updates different experts but only one is finally used. In this paper, we propose StableMoE with two training stages to address the routing fluctuation problem. In the first training stage, we learn a balanced and cohesive routing strategy and distill it into a lightweight router decoupled from the backbone model. In the second training stage, we utilize the distilled router to determine the token-to-expert assignment and freeze it for a stable routing strategy. We validate our method on language modeling and multilingual machine translation. The results show that StableMoE outperforms existing MoE methods in terms of both convergence speed and performance.


title: Fast and Memory-Efficient Network Towards Efficient Image Super-Resolution

abstract: Runtime and memory consumption are two important aspects for efficient image super-resolution (EISR) models to be deployed on resource-constrained devices. Recent advances in EISR exploit distillation and aggregation strategies with plenty of channel split and concatenation operations to make full use of limited hierarchical features. In contrast, sequential network operations avoid frequently accessing preceding states and extra nodes, and thus are beneficial to reducing the memory consumption and runtime overhead. Following this idea, we design our lightweight network backbone by mainly stacking multiple highly optimized convolution and activation layers and decreasing the usage of feature fusion. We propose a novel sequential attention branch, where every pixel is assigned an important factor according to local and global contexts, to enhance high-frequency details. In addition, we tailor the residual block for EISR and propose an enhanced residual block (ERB) to further accelerate the network inference. Finally, combining all the above techniques, we construct a fast and memory-efficient network (FMEN) and its small version FMEN-S, which runs 33% faster and reduces 74% memory consumption compared with the state-of-the-art EISR model: E-RFDN, the champion in AIM 2020 efficient super-resolution challenge. Besides, FMEN-S achieves the lowest memory consumption and the second shortest runtime in NTIRE 2022 challenge on efficient super-resolution. Code is available at https://github.com/NJU-Jet/FMEN.


title: L3Cube-HingCorpus and HingBERT: A Code Mixed Hindi-English Dataset and BERT Language Models

abstract: Code-switching occurs when more than one language is mixed in a given sentence or a conversation. This phenomenon is more prominent on social media platforms and its adoption is increasing over time. Therefore code-mixed NLP has been extensively studied in the literature. As pre-trained transformer-based architectures are gaining popularity, we observe that real code-mixing data are scarce to pre-train large language models. We present L3Cube-HingCorpus, the first large-scale real Hindi-English code mixed data in a Roman script. It consists of 52.93M sentences and 1.04B tokens, scraped from Twitter. We further present HingBERT, HingMBERT, HingRoBERTa, and HingGPT. The BERT models have been pre-trained on codemixed HingCorpus using masked language modelling objectives. We show the effectiveness of these BERT models on the subsequent downstream tasks like code-mixed sentiment analysis, POS tagging, NER, and LID from the GLUECoS benchmark. The HingGPT is a GPT2 based generative transformer model capable of generating full tweets. We also release L3Cube-HingLID Corpus, the largest code-mixed Hindi-English language identification(LID) dataset and HingBERT-LID, a production-quality LID model to facilitate capturing of more code-mixed data using the process outlined in this work. The dataset and models are available at https://github.com/l3cube-pune/code-mixed-nlp .


title: Unsupervised Contrastive Domain Adaptation for Semantic Segmentation

abstract: Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrastive pairs and cross-domain contrastive pairs to learn discriminative features that align across domains. Based on the resulting well-aligned feature representations we introduce a label expansion approach that is able to discover samples from hard classes during the adaptation process to further boost performance. The proposed approach consistently outperforms state-of-the-art methods for domain adaptation. It achieves 60.2% mIoU on the Cityscapes dataset when training on the synthetic GTA5 dataset together with unlabeled Cityscapes images.


title: Dynamic Network Adaptation at Inference

abstract: Machine learning (ML) inference is a real-time workload that must comply with strict Service Level Objectives (SLOs), including latency and accuracy targets. Unfortunately, ensuring that SLOs are not violated in inference-serving systems is challenging due to inherent model accuracy-latency tradeoffs, SLO diversity across and within application domains, evolution of SLOs over time, unpredictable query patterns, and co-location interference. In this paper, we observe that neural networks exhibit high degrees of per-input activation sparsity during inference. . Thus, we propose SLO-Aware Neural Networks which dynamically drop out nodes per-inference query, thereby tuning the amount of computation performed, according to specified SLO optimization targets and machine utilization. SLO-Aware Neural Networks achieve average speedups of $1.3-56.7\times$ with little to no accuracy loss (less than 0.3%). When accuracy constrained, SLO-Aware Neural Networks are able to serve a range of accuracy targets at low latency with the same trained model. When latency constrained, SLO-Aware Neural Networks can proactively alleviate latency degradation from co-location interference while maintaining high accuracy to meet latency constraints.


title: TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation Representation

abstract: Knowledge graph embedding (KGE) aims to learn continuous vectors of relations and entities in knowledge graph. Recently, transition-based KGE methods have achieved promising performance, where the single relation vector learns to translate head entity to tail entity. However, this scoring pattern is not suitable for complex scenarios where the same entity pair has different relations. Previous models usually focus on the improvement of entity representation for 1-to-N, N-to-1 and N-to-N relations, but ignore the single relation vector. In this paper, we propose a novel transition-based method, TranS, for knowledge graph embedding. The single relation vector in traditional scoring patterns is replaced with synthetic relation representation, which can solve these issues effectively and efficiently. Experiments on a large knowledge graph dataset, ogbl-wikikg2, show that our model achieves state-of-the-art results.


title: Rank Based Tests for High Dimensional White Noise

abstract: The development of high-dimensional white noise test is important in both statistical theories and applications, where the dimension of the time series can be comparable to or exceed the length of the time series. This paper proposes several distribution-free tests using the rank based statistics for testing the high-dimensional white noise, which are robust to the heavy tails and do not quire the finite-order moment assumptions for the sample distributions. Three families of rank based tests are analyzed in this paper, including the simple linear rank statistics, non-degenerate U-statistics and degenerate U-statistics. The asymptotic null distributions and rate optimality are established for each family of these tests. Among these tests, the test based on degenerate U-statistics can also detect the non-linear and non-monotone relationships in the autocorrelations. Moreover, this is the first result on the asymptotic distributions of rank correlation statistics which allowing for the cross-sectional dependence in high dimensional data.


title: An Iterative Decoupled Algorithm with Unconditional Stability for Biot Model

abstract: This paper is concerned with numerical algorithms for Biot model. By introducing an intermediate variable, the classical 2-field Biot model is written into a 3-field formulation. Based on such a 3-field formulation, we propose a coupled algorithm, some time-extrapolation based decoupled algorithms, and an iterative decoupled algorithm. Our focus is the analysis of the iterative decoupled algorithm. It is shown that the convergence of the iterative decoupled algorithm requires no extra assumptions on physical parameters or stabilization parameters. Numerical experiments are provided to demonstrate the accuracy and efficiency of the proposed method.


title: Low Degree Testing over the Reals

abstract: We study the problem of testing whether a function $f: \mathbb{R}^n \to \mathbb{R}$ is a polynomial of degree at most $d$ in the \emph{distribution-free} testing model. Here, the distance between functions is measured with respect to an unknown distribution $\mathcal{D}$ over $\mathbb{R}^n$ from which we can draw samples. In contrast to previous work, we do not assume that $\mathcal{D}$ has finite support. We design a tester that given query access to $f$, and sample access to $\mathcal{D}$, makes $(d/\varepsilon)^{O(1)}$ many queries to $f$, accepts with probability $1$ if $f$ is a polynomial of degree $d$, and rejects with probability at least $2/3$ if every degree-$d$ polynomial $P$ disagrees with $f$ on a set of mass at least $\varepsilon$ with respect to $\mathcal{D}$. Our result also holds under mild assumptions when we receive only a polynomial number of bits of precision for each query to $f$, or when $f$ can only be queried on rational points representable using a logarithmic number of bits. Along the way, we prove a new stability theorem for multivariate polynomials that may be of independent interest.


title: Zero-shot Entity and Tweet Characterization with Designed Conditional Prompts and Contexts

abstract: Online news and social media have been the de facto mediums to disseminate information globally from the beginning of the last decade. However, bias in content and purpose of intentions are not regulated, and managing bias is the responsibility of content consumers. In this regard, understanding the stances and biases of news sources towards specific entities becomes important. To address this problem, we use pretrained language models, which have been shown to bring about good results with no task-specific training or few-shot training. In this work, we approach the problem of characterizing Named Entities and Tweets as an open-ended text classification and open-ended fact probing problem.We evaluate the zero-shot language model capabilities of Generative Pretrained Transformer 2 (GPT-2) to characterize Entities and Tweets subjectively with human psychology-inspired and logical conditional prefixes and contexts. First, we fine-tune the GPT-2 model on a sufficiently large news corpus and evaluate subjective characterization of popular entities in the corpus by priming with prefixes. Second, we fine-tune GPT-2 with a Tweets corpus from a few popular hashtags and evaluate characterizing tweets by priming the language model with prefixes, questions, and contextual synopsis prompts. Entity characterization results were positive across measures and human evaluation.


title: The 2HD+a model for a combined explanation of the possible excesses in the CDF $\mathbf{M_W}$ measurement and $\mathbf{(g-2)_\mu}$ with Dark Matter

abstract: The new measurement of the $W$ boson mass performed by the CDF experiment at the Tevatron shows a significant deviation not only with the expectation in the Standard Model but also with other precision measurements performed at LEP, the Tevatron and the LHC. We nevertheless take this new measurement at face value and interpret it as an effect of new physics. We particularly try to link it with other possible anomalies such as the recent muon $g-2$ and consider a scenario that addresses some shortcomings of the Standard Model. We show that a model with two doublets and a light pseudoscalar Higgs fields, supplemented by a stable isosinglet fermion, can simultaneously explain the possible $M_W$ and $(g-2)_\mu$ anomalies and accounts for the weakly interacting massive particle that could be responsible of the dark matter in the universe.


title: Non-Markovian random walks characterize network robustness to nonlocal cascades

abstract: Localized perturbations in a real-world network have the potential to trigger cascade failures at the whole system level, hindering its operations and functions. Standard approaches analytically tackling this problem are mostly based either on static descriptions, such as percolation, or on models where the failure evolves through first-neighbor connections, crucially failing to capture the nonlocal behavior typical of real cascades. We introduce a dynamical model that maps the failure propagation across the network to a self-avoiding random walk that, at each step, has a probability to perform nonlocal jumps toward operational systems' units. Despite the inherent non-Markovian nature of the process, we are able to characterize the critical behavior of the system out of equilibrium, as well as the stopping time distribution of the cascades. Our numerical experiments on synthetic and empirical biological and transportation networks are in excellent agreement with theoretical expectation, demonstrating the ability of our framework to quantify the vulnerability to nonlocal cascade failures of complex systems with interconnected structure.


title: On Ozaki's theorem realizing prescribed $p$-groups as $p$-class tower groups

abstract: We give a streamlined and effective proof of Ozaki's theorem that any finite $p$-group $\Gamma$ is the Galois group of the $p$-Hilbert class field tower of some number field $\rm F$. Our work is inspired by Ozaki's and applies in broader circumstances. While his theorem is in the totally complex setting, we obtain the result in any mixed signature setting for which there exists a number field ${\rm k}_0$ with class number prime to $p$. We construct ${\rm F}/{\rm k}_0$ by a sequence of ${\mathbb Z}/p$-extensions ramified only at finite tame primes and also give explicit bounds on $[{\rm F}:{\rm k}_0]$ and the number of ramified primes of ${\rm F}/{\rm k}_0$ in terms of $\# \Gamma$.


title: Caption Feature Space Regularization for Audio Captioning

abstract: Audio captioning aims at describing the content of audio clips with human language. Due to the ambiguity of audio, different people may perceive the same audio differently, resulting in caption disparities (i.e., one audio may correlate to several captions with diverse semantics). For that, general audio captioning models achieve the one-to-many training by randomly selecting a correlated caption as the ground truth for each audio. However, it leads to a significant variation in the optimization directions and weakens the model stability. To eliminate this negative effect, in this paper, we propose a two-stage framework for audio captioning: (i) in the first stage, via the contrastive learning, we construct a proxy feature space to reduce the distances between captions correlated to the same audio, and (ii) in the second stage, the proxy feature space is utilized as additional supervision to encourage the model to be optimized in the direction that benefits all the correlated captions. We conducted extensive experiments on two datasets using four commonly used encoder and decoder architectures. Experimental results demonstrate the effectiveness of the proposed method. The code is available at https://github.com/PRIS-CV/Caption-Feature-Space-Regularization.


title: Two dimensional perfect evolution algebras over domains

abstract: We will study evolution algebras $A$ which are free modules of dimension $2$ over domains. Furthermore, we will assume that these algebras are perfect, that is $A^2=A$. We start by making some general considerations about algebras over domains: they are sandwiched between a certain essential $D$-submodule and its scalar extension over the field of fractions of the domain. We introduce the notion of quasiperfect algebras and modify slightly the procedure to associate a graph to an evolution algebra over a field given in \cite{ElduqueGraphs}. Essentially, we introduce color in the connecting arrows, depending on a suitable criterion related to the squares of the natural basis elements. Then we classify the algebras under scope parametrizing the isomorphic classes by convenient moduli.


title: Robust, Nonparametric, Efficient Decomposition of Spectral Peaks under Distortion and Interference

abstract: We propose a decomposition method for the spectral peaks in an observed frequency spectrum, which is efficiently acquired by utilizing the Fast Fourier Transform. In contrast to the traditional methods of waveform fitting on the spectrum, we optimize the problem from a more robust perspective. We model the peaks in spectrum as pseudo-symmetric functions, where the only constraint is a nonincreasing behavior around a central frequency when the distance increases. Our approach is more robust against arbitrary distortion, interference and noise on the spectrum that may be caused by an observation system. The time complexity of our method is linear, i.e., $O(N)$ per extracted spectral peak. Moreover, the decomposed spectral peaks show a pseudo-orthogonal behavior, where they conform to a power preserving equality.


title: Temporally Efficient Vision Transformer for Video Instance Segmentation

abstract: Recently vision transformer has achieved tremendous success on image-level visual recognition tasks. To effectively and efficiently model the crucial temporal information within a video clip, we propose a Temporally Efficient Vision Transformer (TeViT) for video instance segmentation (VIS). Different from previous transformer-based VIS methods, TeViT is nearly convolution-free, which contains a transformer backbone and a query-based video instance segmentation head. In the backbone stage, we propose a nearly parameter-free messenger shift mechanism for early temporal context fusion. In the head stages, we propose a parameter-shared spatiotemporal query interaction mechanism to build the one-to-one correspondence between video instances and queries. Thus, TeViT fully utilizes both framelevel and instance-level temporal context information and obtains strong temporal modeling capacity with negligible extra computational cost. On three widely adopted VIS benchmarks, i.e., YouTube-VIS-2019, YouTube-VIS-2021, and OVIS, TeViT obtains state-of-the-art results and maintains high inference speed, e.g., 46.6 AP with 68.9 FPS on YouTube-VIS-2019. Code is available at https://github.com/hustvl/TeViT.


title: Special theory of regularity

abstract: The theory of regularity is a philosophical perspective in which laws of nature are just descriptions, that is to say, laws of nature do not govern the world. Moreover, according to the theory of regularity, the number of laws of nature might be infinite, thus any attempt towards the theory of everything is doomed. Here I propose a special or restricted theory of regularity. The main difference as to the well-known version of that theory is both the range of validity and the scale of the laws of nature. Laws of nature ought to be considered just inside the observable universe and within certain energy and length scales. Even so I apply the theory of regularity to the multiverse scenario. As a consequence, the special theory of regularity supports only two types of multiverses by comparison with our world: those ones with a different sequence of unique events and different laws of nature and those ones with the same sequence of unique events and the same laws of nature instanced by the unique events. The latter case is some sort of eternal recurrence or a parallel eternal recurrence.


title: STONet: A Neural-Operator-Driven Spatio-temporal Network

abstract: Graph-based spatio-temporal neural networks are effective to model the spatial dependency among discrete points sampled irregularly from unstructured grids, thanks to the great expressiveness of graph neural networks. However, these models are usually spatially-transductive -- only fitting the signals for discrete spatial nodes fed in models but unable to generalize to `unseen' spatial points with zero-shot. In comparison, for forecasting tasks on continuous space such as temperature prediction on the earth's surface, the \textit{spatially-inductive} property allows the model to generalize to any point in the spatial domain, demonstrating models' ability to learn the underlying mechanisms or physics laws of the systems, rather than simply fit the signals. Besides, in temporal domains, \textit{irregularly-sampled} time series, e.g. data with missing values, urge models to be temporally-continuous. Motivated by the two issues, we propose a spatio-temporal framework based on neural operators for PDEs, which learn the underlying mechanisms governing the dynamics of spatially-continuous physical quantities. Experiments show our model's improved performance on forecasting spatially-continuous physic quantities, and its superior generalization to unseen spatial points and ability to handle temporally-irregular data.


title: Exploring Dimensionality Reduction Techniques in Multilingual Transformers

abstract: Both in scientific literature and in industry,, Semantic and context-aware Natural Language Processing-based solutions have been gaining importance in recent years. The possibilities and performance shown by these models when dealing with complex Language Understanding tasks is unquestionable, from conversational agents to the fight against disinformation in social networks. In addition, considerable attention is also being paid to developing multilingual models to tackle the language bottleneck. The growing need to provide more complex models implementing all these features has been accompanied by an increase in their size, without being conservative in the number of dimensions required. This paper aims to give a comprehensive account of the impact of a wide variety of dimensional reduction techniques on the performance of different state-of-the-art multilingual Siamese Transformers, including unsupervised dimensional reduction techniques such as linear and nonlinear feature extraction, feature selection, and manifold techniques. In order to evaluate the effects of these techniques, we considered the multilingual extended version of Semantic Textual Similarity Benchmark (mSTSb) and two different baseline approaches, one using the pre-trained version of several models and another using their fine-tuned STS version. The results evidence that it is possible to achieve an average reduction in the number of dimensions of $91.58\% \pm 2.59\%$ and $54.65\% \pm 32.20\%$, respectively. This work has also considered the consequences of dimensionality reduction for visualization purposes. The results of this study will significantly contribute to the understanding of how different tuning approaches affect performance on semantic-aware tasks and how dimensional reduction techniques deal with the high-dimensional embeddings computed for the STS task and their potential for highly demanding NLP tasks


title: Clustering Coefficient of the Tensor Product of Graphs

abstract: Clustering coefficient is one of the most useful indices in complex networks. However, graph theoretic properties of this metric have not been discussed much in the literature, especially in graphs resulting from some binary operations. In this paper we present some expressions for the clustering coefficient of the tensor product of arbitrary graphs, regular graphs, and strongly regular graphs. A Vizing-type upperbound and a sharp lower bound for the clustering coefficient of the tensor product of graphs are also given.


title: Linear codes using simplicial complexes

abstract: Certain simplicial complexes are used to construct a subset $D$ of $\mathbb{F}_{2^n}^m$ and $D$, in turn, defines the linear code $C_{D}$ over $\mathbb{F}_{2^n}$ that consists of $(v\cdot d)_{d\in D}$ for $v\in \mathbb{F}_{2^n}^m$. Here we deal with the case $n=3$, that is, when $C_{D}$ is an octanary code. We establish a relation between $C_{D}$ and its binary subfield code $C_{D}^{(2)}$ with the help of a generator matrix. For a given length and dimension, a code is called distance optimal if it has the highest possible distance. With respect to the Griesmer bound, five infinite families of distance optimal codes are obtained, and sufficient conditions for certain linear codes to be minimal are established.


title: Enveloped Sinusoid Parseval Frames

abstract: This paper presents a method of constructing Parseval frames from any collection of complex envelopes. The resulting Enveloped Sinusoid Parseval (ESP) frames can represent a wide variety of signal types as specified by their physical morphology. Since the ESP frame retains its Parseval property even when generated from a variety of envelopes, it is compatible with large scale and iterative optimization algorithms. ESP frames are constructed by applying time-shifted enveloping functions to the discrete Fourier Transform basis, and in this way are similar to the short-time Fourier Transform. This work provides examples of ESP frame generation for both synthetic and experimentally measured signals. Furthermore, the frame's compatibility with distributed sparse optimization frameworks is demonstrated, and efficient implementation details are provided. Numerical experiments on acoustics data reveal that the flexibility of this method allows it to be simultaneously competitive with the STFT in time-frequency processing and also with Prony's Method for time-constant parameter estimation, surpassing the shortcomings of each individual technique.


title: Probabilistic Modelled Optimal Frame for Erasures under Spectral and Operator Norm

abstract: Error occurs in data transmission process when some data are missing at the time of reconstruction. Finding the best dual frame or a dual pair that minimizes the reconstruction error when erasure occurs,is a deep-rooted problem in frame theory. The main motivation behind this paper is to characterize the optimal dual under the spectral and operator norms. Here we give several equivalent conditions for which the canonical dual is an optimal dual frame for a given frame. We also go on to characterize the set of dual pairs which attains the optimal value.


title: Solvable models in the KPZ class: approach through periodic and free boundary Schur measures

abstract: We explore probabilistic consequences of correspondences between $q$-Whittaker measures and periodic and free boundary Schur measures established by the authors in the recent paper [arXiv:2106.11922]. The result is a comprehensive theory of solvability of stochastic models in the KPZ class where exact formulas descend from mapping to explicit determinantal and pfaffian point processes. We discover new variants of known results as determinantal formulas for the current distribution of the ASEP on the line and new results such as Fredholm pfaffian formulas for the distribution of the point-to-point partition function of the Log Gamma polymer model in half space. In the latter case, scaling limits and asymptotic analysis allow to establish Baik-Rains phase transition for height function of the KPZ equation on the half line at the origin.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Bounds on skewness and kurtosis of steady state currents

abstract: Current fluctuations are a powerful tool to unravel the underlying physics of the observed transport process. This work discusses some general properties of the third and the fourth current cumulant (skewness and kurtosis) related to dynamics and thermodynamics of a transport setup. Specifically, several distinct bounds on these quantities are either analytically derived or numerically conjectured, which are applicable to: 1) noninteracting fermionic systems, 2) noninteracting bosonic systems, 3) thermally driven classical Markovian systems, 4) unicyclic Markovian networks. Finally, it is demonstrated that violation of the obtained inequalities can provide a broad spectrum of information about the physics of the analyzed system, e.g., enable one to infer the presence of interactions or unitary dynamics, unravel the topology of the Markovian network, or characterize the nature of thermodynamic forces driving the system. In particular, relevant information about the microscopic dynamics can be gained even at equilibrium when the current variance -- a standard measure of current fluctuations -- is determined mostly by the thermal noise.


title: On isomorphism conditions for algebra functors with applications to Leavitt path algebras

abstract: We introduce certain functors from the category of commutative rings (and related categories) to that of $\mathbb{Z}$-algebras (not necessarily associative or commutative). One of the motivating examples is the Leavitt path algebra functor $R\mapsto L_R(E)$ for a given graph $E$. Our goal is to find "descending" isomorphism results of the type: if $\mathfrak{F},\mathcal{G}$ are algebra functors and $K\subset K'$ a field extension, under what conditions an isomorphism $\mathfrak{F}(K')\cong \mathcal{G}(K')$ of $K'$-algebras implies the existence of an isomorphism $\mathfrak{F}(K)\cong\mathcal{G}(K)$ of $K$-algebras? We find some positive answers to that problem for the so-called "extension invariant functors" which include the functors associated to Leavitt path algebras, Steinberg algebras, path algebras, group algebras, evolution algebras and others. For our purposes, we employ an extension of the Hilbert's Nullstellensatz Theorem for polynomials in possibly infinitely many variables, as one of our main tools. We also remark that for extension invariant functors $\mathfrak{F},\mathcal{G}$, an isomorphism $\mathfrak{F}(H)\cong\mathcal{G}(H)$, for some Hopf $K$-algebra $H$, implies the existence of an isomorphism $\mathfrak{F}(S)\cong\mathcal{G}(S)$ for any commutative and unital $K$-algebra $S$.


title: Power savings for counting solutions to polynomial-factorial equations

abstract: Let $P$ be a polynomial with integer coefficients and degree at least two. We prove an upper bound on the number of integer solutions $n\leq N$ to $n! = P(x)$ which yields a power saving over the trivial bound. In particular, this applies to a century-old problem of Brocard and Ramanujan. The previous best result was that the number of solutions is $o(N)$. The proof uses techniques of Diophantine and Pad\'e approximation.


title: Timelike behavior of the pion electromagnetic form factor in the functional formalism

abstract: The electromagnetic form factor of the pion is calculated within the use of functional formalism. We develop integral representation for the minimal set of Standard Model Green's functions and derive the dispersion relation for the form factor in the two flavor QCD isospin limit $m_u=m_d$. We use the dressed quark propagator as obtained form the gap equation in Minkowski space and within the Dyson-Schwinger equations formalism to derive the approximate dispersion relation for the form factor for the first time. We evaluate the form factor for the spacelike as well as for the timelike momentum in the presented formalism. A new Nakanishi-like form of integral representation is proved on the basis of the vector Bethe-Salpeter equation for the quark-photon vector with a ladder-rainbow kernel. The Gauge Technique turns out to be a part of the entire structure of the vertex. In the analytic approach presented here, it is shown that the a large amount of the $\rho$-meson peak in the cross section $e^+e^-\rightarrow \pi^+\pi^-$ is governed by the gauge invariance of QED/QCD, i.e. by Gauge Technique constructed quark-photon vertex. This approximation naturally explains the broad shape of the $\rho$-meson peak.


title: Tomography of stellar halos: what does anisotropy in a stellar halo tell us?

abstract: The stellar halo of the Milky Way is known to have a highly lumpy structure due to the presence of tidal debris and streams accreted from the satellite galaxies. The abundance and distribution of these substructures can provide a wealth of information on the assembly history of the Milky Way. We use some information-theoretic measures to study the anisotropy in a set of Milky Way-sized stellar halos from the Bullock & Johnston suite of simulations that uses a hybrid approach coupling semi-analytic and N-body techniques. Our analysis shows that the whole-sky anisotropy in each stellar halo increases with the distance from its centre and eventually plateaus out beyond a certain radius. All the stellar halos have a very smooth structure within a radius of $\sim 50$ kpc and a highly anisotropic structure in the outskirts. At a given radius, the anisotropies at a fixed polar or azimuthal angle have two distinct components: (i) an approximately isotropic component and (ii) a component with large density fluctuations on small spatial scales. We remove the contributions of the substructures and any non-spherical shape of the halo by randomizing the polar and azimuthal coordinates of the stellar particles while keeping their radial distances fixed. We observe that the fluctuating part of the anisotropy is completely eliminated, and the approximately uniform component of the anisotropy is significantly reduced after the sphericalization. A comparison between the original halos and their sphericalized versions reveals that the approximately uniform part of the anisotropy originates from the discreteness noise and the non-spherical shape of the halo whereas the substructures contribute to the fluctuating part. We show that such distinction between the anisotropies has the potential to constrain the shape of the stellar halo and its substructures.


title: CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learning

abstract: Conventionally, generation of natural language for dialogue agents may be viewed as a statistical learning problem: determine the patterns in human-provided data and generate appropriate responses with similar statistical properties. However, dialogue can also be regarded as a goal directed process, where speakers attempt to accomplish a specific task. Reinforcement learning (RL) algorithms are designed specifically for solving such goal-directed problems, but the most direct way to apply RL -- through trial-and-error learning in human conversations, -- is costly. In this paper, we study how offline reinforcement learning can instead be used to train dialogue agents entirely using static datasets collected from human speakers. Our experiments show that recently developed offline RL methods can be combined with language models to yield realistic dialogue agents that better accomplish task goals.


title: On energetics and progenitors of Odd Radio Circles: A causal connection with tidal disruption of stars?

abstract: Odd Radio Circles or ORCs are recently discovered edge-brightened, low surface brightness circular radio sources. The progenitors and astrophysical processes responsible for their origins are presently debated. Some ORCs are host-less and some appear to be hosted in distant quiescent galaxies. Two plausible explanations consider ORCs as nearby supernova remnants with sizes a few hundred parsec in the intragroup medium of the local group of galaxies or alternatively shocked halos of a few hundred kpc extent around distant galaxies. The input shock energy required to create ORCs of a few hundred kpc size is estimated in a range of $10^{55} - 10^{59}$ erg. It is shown here that the cumulative energy in unbound debris ejected from multiple ($10^{5} - 10^{9}$) tidal disruption events over $\sim100$ Myr period around a central massive black hole can meet the required energies to generate ORCs around some galaxies, which have recently undergone a merger. The potential hosts for ORCs are identified here as abundant post-starburst galaxies at intermediate redshifts having massive black holes. A causal connection between ORC around quiescent galaxies and tidal disruption may find support in the observed dominance of tidal disruption events in post-starburst galaxies.


title: Thickness and a gap lemma in $\mathbb{R}^d$

abstract: We give a definition of thickness in $\mathbb{R}^d$ that is useful even for totally disconnected sets, and prove a Gap Lemma type result. We also guarantee an interval of distances in any direction in thick compact sets, relate thick sets (for this definition of thickness) with winning sets, give a lower bound for the Hausdorff dimension of the intersection of countably many of them, a result guaranteeing the presence of large patterns, and lower bounds for the Hausdorff dimension of a set in relationship with its thickness.


title: The Markov model of a dynamic system based on experimental data for control problems of bionic prostheses

abstract: This article is devoted to a prediction of gait kinematics based on the Markov chains in the delay space. We use hypercubic grid in the delay space of angles in the sagittal plane in the knee and hip joints to construct Markov states. Our experimental signal (obtained from the telemetry of the prosthesis) provides transition probabilities. The resulting Markov model seems to be helpful for estimation of attractor dimension, characteristic frequencies of the system, and so on.


title: In-Circuit Impedance Measurement Setups of Inductive Coupling Approach: A Review

abstract: In-circuit impedance measurement provides useful information for many EMC applications. The inductive coupling approach is a promising in-circuit impedance measurement method due to its non-contact characteristics and simple on-site implementation. Many measurement setups of this approach were reported. However, a comprehensive survey and comparison of these setups have not been found in the literature. This paper reviews these setups in terms of their characteristics, limitations, and applications. In addition, recommendations for future research are also presented.


title: Energy calibration of nonlinear microcalorimeters with uncertainty estimates from Gaussian process regression

abstract: The nonlinear energy response of cryogenic microcalorimeters is usually corrected through an empirical calibration. X-ray or gamma-ray emission lines of known shape and energy anchor a smooth function that generalizes the calibration data and converts detector measurements to energies. We argue that this function should be an approximating spline. The theory of Gaussian process regression makes a case for this functional form. It also provides an important benefit previously absent from our calibration method: a quantitative uncertainty estimate for the calibrated energies, with lower uncertainty near the best-constrained calibration points.


title: Smartphone-based measurements of the optical properties of snow

abstract: Snow is a highly complex medium composed of ice crystals of various shapes and sizes. Knowledge of its intrinsic optical properties such as the scattering and absorption coefficient is tantamount to radiative transfer models in climate research. The absorption coefficient, in particular, allows us to access information about light-absorbing particles contained in the snow. In contrast to snow's apparent properties like the albedo, measuring the intrinsic properties is challenging. Here, we present a simple apparatus that can measure bulk optical properties of snow using readily available components and a smartphone camera, and a robust diffuse-optical framework for data analysis. We demonstrate the instrument both on scattering phantoms with known scattering and absorption coefficient as well as in the field. Its low cost, simplicity and portability uniquely qualify this setup for large-scale field work, undergraduate education and citizen science.


title: Sensitive multi-species photoacoustic gas detection based on mid-infrared supercontinuum source and miniature multipass cell

abstract: We report multipass broadband photoacoustic spectroscopy of trace gases in the mid-infrared. The measurement principle of the sensor relies on supercontinuum-based Fourier transform photoacoustic spectroscopy (FT-PAS), in which a scanning interferometer modulates the intensity of a mid-infrared supercontinuum light source and a cantilever microphone is employed for sensitive photoacoustic detection. With a custom-built external Herriott cell, the supercontinuum beam propagates ten times through a miniature and acoustically non-resonant gas cell. The performance of the FT-PAS system is demonstrated by measuring the fundamental C-H stretch bands of various hydrocarbons. A noise equivalent detection limit of 11 ppb is obtained for methane (40 s averaging time, 15 $\mu$W/cm$^{-1}$ incident power spectral density, 4 cm$^{-1}$ resolution), which is an improvement by a factor of 12 compared to the best previous FT-PAS systems. High linearity and good stability of the sensor provide reliable identification of individual species from a gas mixture with strong spectral overlap, laying the foundation for sensitive and selective multi-species detection in small sample volumes.


title: Better automation of beamline control at HEPS

abstract: At the High Energy Photon Source (HEPS) where up to 90 beamlines can be provided in the future, minimisation of workload for individual beamlines and maximisation of knowledge about one beamline that can be applied to other beamlines is essential to minimise the total complexity in beamline control. Presented in this paper are our efforts to achieve these goals by composing relatively simple utilities and mechanisms to automate tasks, and always remembering to keep our automation solutions simple and clear. After an introduction to our choice of basic software in EPICS-based beamline control, the issues encountered in introducing package management to EPICS modules, as well as our solutions to them, are presented; then the design and implementation of our packaging system is concisely discussed. After a presentation of our efforts to reduce the need for self-built multi-device EPICS IOC applications by providing reusable modular IOC executables, our implementation of easily maintainable multi-IOC setups through the separation and minimisation of each user's IOC configurations is given. Finally, the ongoing project of comprehensive beamline services at HEPS to further simplify configuration management on multiple scales, ranging from individual beamline devices to all beamlines at HEPS, is introduced.


title: On the existence of twin prime in an interval

abstract: Let $S_{(x,y]} = \left\{\frac{p_n}{p_{n+1}-2} :~ n\in I \right\}$, where $I = \left\{n :~ x<p_n \le y \right\}$, $p_n$ is the $n$-th prime and $x, y \in \mathbb{R}_{>0}$. If $M_\alpha(x,y)$ denotes the $\alpha$-power mean of the elements of $S_{(x,y]}$, it is shown that the existence of a twin prime pair in $(x,y]$ is implied if $\displaystyle \lim_{\alpha \rightarrow \infty}M_{\alpha}(x,y) > 1 - 2/y + O(y^{-2})$ for a sufficiently large $y$. For a special choice of $y$, we also find a lower bound for the mean: $\displaystyle \lim_{\alpha \rightarrow \infty}M_{\alpha}(x,x^\beta)>1-c/x^\beta+O(x^{-\beta}\log^{-1} x)$, where the constant $c>0$ and $\beta = 1+c/\log^2 x$ or equivalently, $x^\beta=x+cx/\log x+O(x/\log^2 x)$. With $c<2$, the lower bound for $\displaystyle \lim_{\alpha \rightarrow \infty}M_{\alpha}(x,x^\beta)$ satisfies the inequality on the existence of a twin prime in the interval $(x,x^\beta]$.


title: A new approach to generalize metric functions

abstract: S-metric and b-metric spaces are metrizable, but it is still quite impossible to get an explicit form of the concerned metric function. To overcome this, the notion of $\phi$-metric is developed by making a suitable modification in triangle inequality and its properties are pretty similar to metric function. It is shown that one can easily construct a $\phi$-metric from existing generalized distance functions like S-metric, b-metric, etc. and those are $\phi$-metrizable. The convergence of sequence on those metric spaces is identical to the respective induced $\phi$-metric spaces. So, unlike metrics, concerned $\phi$-metric can be easily constructed and $\phi$-metric functions may play the role of metric functions substantially. Also, the structure of $\phi$-metric spaces is studied and some fixed point theorems are established.


title: Strolling in Room-Scale VR: Hex-Core-MK1 Omnidirectional Treadmill

abstract: The natural locomotion interface is critical to the development of many VR applications. For household VR applications, there are two basic requirements: natural immersive experience and minimized space occupation. The existing locomotion strategies generally do not simultaneously satisfy these two requirements well. This paper presents a novel omnidirectional treadmill (ODT) system, named Hex-Core-MK1 (HCMK1). By implementing two kinds of mirror symmetrical spiral rollers to generate the omnidirectional velocity field, this proposed system is capable of providing real walking experiences with a full-degree of freedom in an area as small as 1.76 m^2, while delivering great advantages over several existing ODT systems in terms of weight, volume, latency and dynamic performance. Compared with the sizes of Infinadeck and HCP, the two best motor-driven ODTs so far, the 8 cm height of HCMK1 is only 20% of Infinadeck and 50% of HCP. In addition, HCMK1 is a lightweight device weighing only 110 kg, which provides possibilities of further expanding VR scenarios, such as terrain simulation. The latency of HCMK1 is only 23ms. The experiments show that HCMK1 can deliver on a starting acceleration of 16.00 m/s^2 and a braking acceleration of 30.00 m/s^2.


title: On Dynamics of Asymptotically Minimal Polynomials

abstract: We study dynamical properties of asymptotically extremal polynomials associated with a non-polar planar compact set E. In particular, we prove that if the zeros of such polynomials are uniformly bounded then their Brolin measures converge weakly to the equilibrium measure of E. In addition, if E is regular and the zeros of such polynomials are sufficiently close to E then we prove that the filled Julia sets converge to polynomial convex hull of E in the Klimek topology.


title: Beyond i.i.d. in the Resource Theory of Asymmetry: An Information-Spectrum Approach for Quantum Fisher Information

abstract: Energetic coherence is indispensable for various operations, including precise measurement of time and acceleration of quantum manipulations. Since energetic coherence is fragile, it is essential to understand the limits in distillation and dilution to restore damage. The resource theory of asymmetry (RTA) provides a rigorous framework to investigate energetic coherence as a resource to break time-translation symmetry. Recently, in the i.i.d. regime where identical copies of a state are converted into identical copies of another state, it has been shown that the convertibility of energetic coherence is governed by a standard measure of energetic coherence, called the quantum Fisher information (QFI). This fact means that QFI in the theory of energetic coherence takes the place of entropy in thermodynamics and entanglement entropy in entanglement theory. However, distillation and dilution in realistic situations take place in regimes beyond i.i.d., where quantum states often have complex correlations. Unlike entanglement theory, the conversion theory of energetic coherence in pure states in the non-i.i.d. regime has been an open problem. In this Letter, we solve this problem by introducing a new technique: an information-spectrum method for QFI. Two fundamental quantities, coherence cost and distillable coherence, are shown to be equal to the spectral QFI rates for arbitrary sequences of pure states. As a consequence, we find that both entanglement theory and RTA in the non-i.i.d. regime are understood in the information-spectrum method, while they are based on different quantities, i.e., entropy and QFI, respectively.


title: Beta-decay implications for the W-boson mass anomaly

abstract: We point out the necessity to consider $\beta$-decay observables in resolutions of the $W$-boson anomaly in the Standard Model Effective Field Theory that go beyond pure oblique corrections. We demonstrate that present global analyses that explain the $W$-boson mass anomaly predict a large, percent-level, violation of first-row CKM unitarity. We investigate what solutions to the $W$-boson mass anomaly survive after including $\beta$-decay constraints.


title: Gaussian dispersion analysis in the time domain: efficient conversion with Pad\'e approximants

abstract: We present an approach for adapting the Gaussian dispersion analysis (GDA) of optical materials to time-domain simulations. Within a GDA model, the imaginary part of a measured dielectric function is presented as a sum of Gaussian absorption terms. Such a simple model is valid for materials where inhomogeneous broadening is substantially larger than the homogeneous linewidth. The GDA model is the essential broadband approximation for the dielectric function of many glasses, polymers, and other natural and artificial materials with disorder. However, efficient implementation of this model in time-domain full-wave electromagnetic solvers has never been fully achieved. We start with a causal form of an isolated oscillator with Gaussian-type absorption - Causal Dawson-Gauss oscillator. Then, we derive explicit analytical formulas to implement the Gaussian oscillator in a finite-difference time-domain (FDTD) solver with minimal use of memory and floating point operations. The derivation and FDTD implementation employ our generalized dispersive material (GDM) model - a universal, modular approach to describing optical dispersion with Pad\'e approximants. We share the FDTD prototype codes that include automated generation of the approximants and a universal FDTD dispersion implementation that employs various second-order accurate numerical schemes. The codes can be used with non-commercial solvers and commercial software for time-domain simulations of light propagation in dispersive media, which are experimentally characterized with GDA models.


title: Deep Equilibrium Optical Flow Estimation

abstract: Many recent state-of-the-art (SOTA) optical flow models use finite-step recurrent update operations to emulate traditional algorithms by encouraging iterative refinements toward a stable flow estimation. However, these RNNs impose large computation and memory overheads, and are not directly trained to model such stable estimation. They can converge poorly and thereby suffer from performance degradation. To combat these drawbacks, we propose deep equilibrium (DEQ) flow estimators, an approach that directly solves for the flow as the infinite-level fixed point of an implicit layer (using any black-box solver), and differentiates through this fixed point analytically (thus requiring $O(1)$ training memory). This implicit-depth approach is not predicated on any specific model, and thus can be applied to a wide range of SOTA flow estimation model designs. The use of these DEQ flow estimators allows us to compute the flow faster using, e.g., fixed-point reuse and inexact gradients, consumes $4\sim6\times$ times less training memory than the recurrent counterpart, and achieves better results with the same computation budget. In addition, we propose a novel, sparse fixed-point correction scheme to stabilize our DEQ flow estimators, which addresses a longstanding challenge for DEQ models in general. We test our approach in various realistic settings and show that it improves SOTA methods on Sintel and KITTI datasets with substantially better computational and memory efficiency.


title: Photothermal responsivity of van der Waals material-based nanomechanical resonators

abstract: Nanomechanical resonators made from van der Waals materials (vdW NMRs) provide a new tool for sensing absorbed laser power. The photothermal response of vdW NMRs, quantified from the resonant frequency shifts induced by optical absorption, is enhanced when incorporated in a Fabry-Perot (FP) interferometer. Along with the enhancement comes the dependence of the photothermal response on NMR displacement, which lacks investigation. Here, we address the knowledge gap by studying electromotively driven niobium diselenide drumheads fabricated on highly reflective substrates. We use a FP-mediated absorptive heating model to explain the measured variations of the photothermal response. The model predicts a higher magnitude and tuning range of photothermal responses on few-layer and monolayer NbSe$_{2}$ drumheads, which outperform other clamped vdW drum-type NMRs at a laser wavelength of $532\,$nm. Further analysis of the model shows that both the magnitude and tuning range of NbSe$_{2}$ drumheads scale with thickness, establishing a displacement-based framework for building bolometers using FP-mediated vdW NMRs.


title: Network Onion Divergence: Network representation and comparison using nested configuration models with fixed connectivity, correlation and centrality patterns

abstract: Random networks, constrained to reproduce specific features of networks, are often used to represent and analyze network data as well as their mathematical descriptions. Chief among them, the configuration model constrains random networks by their degree distribution and is foundational to many areas of network science. However, these representations are often selected based on intuition or mathematical and computational simplicity rather than on statistical evidence. To evaluate the quality of a network representation we need to consider both the amount of information required by a random network model as well as the probability of recovering the original data when using the model as a generative process. To this end, we calculate the approximate size of network ensembles generated by the popular configuration model and its generalizations that include degree-correlations and centrality layers based on the onion decomposition. We then apply minimum description length as a model selection criterion and also introduce the Network Onion Divergence: model selection and network comparison over a nested family of configuration models with differing level of structural details. Using over 100 empirical sets of network data, we find that a simple Layered Configuration Model offers the most compact representation of the majority of real networks. We hope that our results will continue to motivate the development of intricate random network models that help capture network structure beyond the simple degree distribution.


title: Constraining runaway dilaton models using joint gravitational-wave and electromagnetic observations

abstract: With the advent of gravitational-wave astronomy it has now been possible to constrain modified theories of gravity that were invoked to explain the dark energy. In a class of dilaton models, distances to cosmic sources inferred from electromagnetic and gravitational wave observations would differ due to the presence of a friction term. In such theories, the ratio of the Newton's constant to the fine structure constant varies with time. In this paper we explore the degree to which it will be possible to test such models. If collocated sources (e.g. supernovae and binary neutron star mergers), but not necessarily multimessengers, can be identified by electromagnetic telescopes and gravitational-wave detectors one can probe if light and gravitational radiation are subject to the same laws of propagation over cosmological distances. This helps in constraining the variation of Newton's constant relative to fine-structure constant. The next generation of gravitational wave detectors, such as the Cosmic Explorer and Einstein Telescope, in tandem with the Vera Rubin Observatory and gamma ray observatories such as the Fermi Space Observatory will be able to detect or constrain such variations at the level of a few parts in 100. We apply this method to GW170817 with distances inferred by the LIGO and Virgo detectors and the observed Kilonova.


title: VSA: Learning Varied-Size Window Attention in Vision Transformers

abstract: Attention within windows has been widely explored in vision transformers to balance the performance, computation complexity, and memory footprint. However, current models adopt a hand-crafted fixed-size window design, which restricts their capacity of modeling long-term dependencies and adapting to objects of different sizes. To address this drawback, we propose \textbf{V}aried-\textbf{S}ize Window \textbf{A}ttention (VSA) to learn adaptive window configurations from data. Specifically, based on the tokens within each default window, VSA employs a window regression module to predict the size and location of the target window, i.e., the attention area where the key and value tokens are sampled. By adopting VSA independently for each attention head, it can model long-term dependencies, capture rich context from diverse windows, and promote information exchange among overlapped windows. VSA is an easy-to-implement module that can replace the window attention in state-of-the-art representative models with minor modifications and negligible extra computational cost while improving their performance by a large margin, e.g., 1.1\% for Swin-T on ImageNet classification. In addition, the performance gain increases when using larger images for training and test. Experimental results on more downstream tasks, including object detection, instance segmentation, and semantic segmentation, further demonstrate the superiority of VSA over the vanilla window attention in dealing with objects of different sizes. The code will be released https://github.com/ViTAE-Transformer/ViTAE-VSA.


title: Reparametrization Symmetry of Local Entropy Production on a Dynamical Horizon

abstract: Recently, it has been shown that for a dynamical black hole in any higher derivative theory of gravity, one could construct a spatial entropy current, characterizing the in/outflow of entropy at every point on the horizon, as long as the dynamics of the amplitude is small enough. However, the construction is very much dependent on how we choose the spatial slicing of the horizon along its null generators. In this note, we have shown that though both the entropy density and the spatial entropy current change non-trivially under a reparametrization of the null generator, the net entropy production, which is given by the `time' derivative of entropy density plus the divergence of the spatial current is invariant. We have explicitly verified this claim for the particular case of dynamical black holes Einstein-Gauss-Bonnet theory.


title: A new hydrodynamic spherical accretion exact solution and its quasi-spherical perturbations

abstract: We present an exact $\gamma=5/3$ spherical accretion solution which modifies the Bondi boundary condition of $\rho \to const.$ as $r\to \infty$ to $\rho \to 0$ as $r \to \infty$. This change allows for simple power law solutions on the density and infall velocity fields, ranging from a cold empty free-fall condition where pressure tends to zero, to a hot hydrostatic equilibrium limit with no infall velocity. As in the case of the Bondi solution, a maximum accretion rate appears. As in the $\gamma=5/3$ case of the Bondi solution, no sonic radius appears, this time however, because the flow is always characterised by a constant Mach number. This number equals 1 for the case of the maximum accretion rate, diverges towards the cold empty state, and becomes subsonic towards the hydrostatic equilibrium limit. It can be shown that in the limit as { $r \to 0$}, the Bondi solution tends to the new solution presented, { extending the validity of the Bondi accretion value to} cases where the accretion density profile does not remain at a fixed constant value out to infinity. We then explore small deviations from sphericity and the presence of angular momentum through an analytic perturbative analysis. Such perturbed solutions yield a rich phenomenology through density and velocity fields in terms of Legendre polynomials, which we begin to explore for simple angular velocity boundary conditions having zeros on the plane and pole. The new solution presented provides complementary physical insight into accretion problems in general.

categories: astro-ph.HE astro-ph.GA physics.class-ph physics.flu-dyn


title: Pulsar skips: Understanding variations in the regular periods of rotating neutron stars

abstract: Pulsars are spinning neutron stars with very regular periods. These pulsars have, however, had instances where they exhibit a change in their periods. Older theories have shown that older pulsars have a tendency to skip and speed up. Newer theories have been created, due to the discovery that younger X-ray pulsars exhibit the same skips. The older theories explain that the core of the pulsar is a superfluid with a differential rotation and the core will occasionally exhibit solid properties to catch the crust of the pulsar and speed it up. The newer quantum mechanical theory states that quantum particle packets, called the strange nuggets, slam into the side of the pulsar to add angular momentum to the pulsar and then release it later.


title: Comment on "Scaling properties of background- and chiral-magnetically-driven charge separation in heavy ion collisions at $\sqrt{s}_{\rm NN}=200$ GeV (arXiv:2203.10029)"

abstract: In a recent preprint arXiv:2203.10029, the authors argue for a multiplicity scaling of the squared inverse width of the $R_{\Psi_{2}}$ distribution to claim a positive signal for the chiral magnetic effect from STAR's isobar data, in stark contradiction to the conclusion reached by the STAR Collaboration. This Comment points out the fallacy of their arguments and reinforces the STAR conclusion.


title: Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion

abstract: We present a framework for modeling interactional communication in dyadic conversations: given multimodal inputs of a speaker, we autoregressively output multiple possibilities of corresponding listener motion. We combine the motion and speech audio of the speaker using a motion-audio cross attention transformer. Furthermore, we enable non-deterministic prediction by learning a discrete latent representation of realistic listener motion with a novel motion-encoding VQ-VAE. Our method organically captures the multimodal and non-deterministic nature of nonverbal dyadic interactions. Moreover, it produces realistic 3D listener facial motion synchronous with the speaker (see video). We demonstrate that our method outperforms baselines qualitatively and quantitatively via a rich suite of experiments. To facilitate this line of research, we introduce a novel and large in-the-wild dataset of dyadic conversations. Code, data, and videos available at https://evonneng.github.io/learning2listen/.


title: Deconstructing {\" U}nsal-Yaffe Reconfinement

abstract: In the UY reconfined phase on a lattice the thermal trace is over states transforming in all $SU(N)/Z(N)$ irreducible representations as opposed to only over $SU(N)$ singlets in the standard formulation. As $N\to\infty$, on a finite lattice, the usual Hilbert space becomes orthogonal to the deformed one. Concerns about the extended UY proposal for large $N$ Eguchi-Kawai reduction are raised.


title: Neural Space-filling Curves

abstract: We present Neural Space-filling Curves (SFCs), a data-driven approach to infer a context-based scan order for a set of images. Linear ordering of pixels forms the basis for many applications such as video scrambling, compression, and auto-regressive models that are used in generative modeling for images. Existing algorithms resort to a fixed scanning algorithm such as Raster scan or Hilbert scan. Instead, our work learns a spatially coherent linear ordering of pixels from the dataset of images using a graph-based neural network. The resulting Neural SFC is optimized for an objective suitable for the downstream task when the image is traversed along with the scan line order. We show the advantage of using Neural SFCs in downstream applications such as image compression. Code and additional results will be made available at https://hywang66.github.io/publication/neuralsfc.


title: Revisiting Consistency Regularization for Semi-supervised Change Detection in Remote Sensing Images

abstract: Remote-sensing (RS) Change Detection (CD) aims to detect "changes of interest" from co-registered bi-temporal images. The performance of existing deep supervised CD methods is attributed to the large amounts of annotated data used to train the networks. However, annotating large amounts of remote sensing images is labor-intensive and expensive, particularly with bi-temporal images, as it requires pixel-wise comparisons by a human expert. On the other hand, we often have access to unlimited unlabeled multi-temporal RS imagery thanks to ever-increasing earth observation programs. In this paper, we propose a simple yet effective way to leverage the information from unlabeled bi-temporal images to improve the performance of CD approaches. More specifically, we propose a semi-supervised CD model in which we formulate an unsupervised CD loss in addition to the supervised Cross-Entropy (CE) loss by constraining the output change probability map of a given unlabeled bi-temporal image pair to be consistent under the small random perturbations applied on the deep feature difference map that is obtained by subtracting their latent feature representations. Experiments conducted on two publicly available CD datasets show that the proposed semi-supervised CD method can reach closer to the performance of supervised CD even with access to as little as 10% of the annotated training data. Code available at https://github.com/wgcban/SemiCD


title: On perfect powers that are sum of two balancing numbers

abstract: Let $B_k$ denote the $k^{th}$ term of balancing sequence. In this paper we find all positive integer solutions of the Diophantine equation $B_n+B_m = x^q$ in variables $(m, n,x,q)$ under the assumption $n\equiv m \pmod 2$. Furthermore, we study the Diophantine equation \[B_n^{3}\pm B_m^{3} = x^q\] with positive integer $q\geq 3$ and $\gcd(B_n, B_m) =1$.


title: Fluctuations for some non-stationary interacting particle systems via Boltzmann-Gibbs Principle

abstract: Conjecture II.3.6 of Spohn in [Spohn '91] and Lecture 7 of Jensen-Yau in [Jensen-Yau '99] ask for a general derivation of universal fluctuations of hydrodynamic limits in large-scale stochastic interacting particle systems. However, the past few decades have witnessed only minimal progress according to [Goncalves-Landim-Milanes '17]. In this paper, we develop a general method for deriving the so-called Boltzmann-Gibbs principle for a general family of non-integrable and non-stationary interacting particle systems, thereby responding to Spohn and Jensen-Yau. Most importantly, our method depends mostly on local and dynamical, and thus more general/universal, features of the model. This contrasts with previous works, which rely on global and non-universal assumptions on invariant measures or initial measures of the model. As a concrete application of the method, we derive the KPZ equation as a large-scale limit of the height functions for a family of non-stationary and non-integrable exclusion processes with an environment-dependent asymmetry. This establishes a first result to Big Picture Question 1.6 in [AimPLKPZ] for non-stationary and non-integrable "speed-change" models that have also been of interest beyond KPZ [De Masi-Presutti-Spohn-Wick '86, Funaki '18, Funaki-Handa-Uchiyama '91, Komoriya '98].


title: Reverse engineering of one-qubit filter functions with dynamical invariants

abstract: We derive an integral expression for the filter-transfer function of an arbitrary one-qubit gate through the use of dynamical invariant theory and Hamiltonian reverse engineering. We use this result to define a cost function which can be efficiently optimized to produce one-qubit control pulses that are robust against specified frequency bands of the noise power spectral density. We demonstrate the utility of our result by generating optimal control pulses that are designed to suppress broadband detuning and pulse amplitude noise. We report an order of magnitude improvement in gate fidelity in comparison with known composite pulse sequences. More broadly, we also use the same theoretical framework to prove the robustness of nonadiabatic geometric quantum gates under specific error models and control constraints.


title: SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix Data Augmentation

abstract: A novel approach of data augmentation based on irregular superpixel decomposition is proposed. This approach called SuperpixelGridMasks permits to extend original image datasets that are required by training stages of machine learning-related analysis architectures towards increasing their performances. Three variants named SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix are presented. These grid-based methods produce a new style of image transformations using the dropping and fusing of information. Extensive experiments using various image classification models and datasets show that baseline performances can be significantly outperformed using our methods. The comparative study also shows that our methods can overpass the performances of other data augmentations. Experimental results obtained over image recognition datasets of varied natures show the efficiency of these new methods. SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix codes are publicly available at https://github.com/hammoudiproject/SuperpixelGridMasks


title: Comparative analysis of machine learning and numerical modeling for combined heat transfer in Polymethylmethacrylate

abstract: This study compares different methods to predict the simultaneous effects of conductive and radiative heat transfer in a Polymethylmethacrylate (PMMA) sample. PMMA is a kind of polymer utilized in various sensors and actuator devices. One-dimensional combined heat transfer is considered in numerical analysis. Computer implementation was obtained for the numerical solution of governing equation with the implicit finite difference method in the case of discretization. Kirchhoff transformation was used to get data from a non-linear equation of conductive heat transfer by considering monochromatic radiation intensity and temperature conditions applied to the PMMA sample boundaries. For Deep Neural Network (DNN) method, the novel Long Short Term Memory (LSTM) method was introduced to find accurate results in the least processing time than the numerical method. A recent study derived the combined heat transfers and their temperature profiles for the PMMA sample. Furthermore, the transient temperature profile is validated by another study. A comparison proves a perfect agreement. It shows the temperature gradient in the primary positions that makes a spectral amount of conductive heat transfer from a PMMA sample. It is more straightforward when they are compared with the novel DNN method. Results demonstrate that this artificial intelligence method is accurate and fast in predicting problems. By analyzing the results from the numerical solution it can be understood that the conductive and radiative heat flux is similar in the case of gradient behavior, but it is also twice in its amount approximately. Hence, total heat flux has a constant value in an approximated steady state condition. In addition to analyzing their composition, ROC curve and confusion matrix were implemented to evaluate the algorithm performance.


title: 3D Convolutional Networks for Action Recognition: Application to Sport Gesture Recognition

abstract: 3D convolutional networks is a good means to perform tasks such as video segmentation into coherent spatio-temporal chunks and classification of them with regard to a target taxonomy. In the chapter we are interested in the classification of continuous video takes with repeatable actions, such as strokes of table tennis. Filmed in a free marker less ecological environment, these videos represent a challenge from both segmentation and classification point of view. The 3D convnets are an efficient tool for solving these problems with window-based approaches.


title: Investigating Temporal Convolutional Neural Networks for Satellite Image Time Series Classification: A survey

abstract: Satellite Image Time Series (SITS) of the Earth's surface provide detailed land cover maps, with their quality in the spatial and temporal dimensions consistently improving. These image time series are integral for developing systems that aim to produce accurate, up-to-date land cover maps of the Earth's surface. Applications are wide-ranging, with notable examples including ecosystem mapping, vegetation process monitoring and anthropogenic land-use change tracking. Recently proposed methods for SITS classification have demonstrated respectable merit, but these methods tend to lack native mechanisms that exploit the temporal dimension of the data; commonly resulting in extensive data pre-processing contributing to prohibitively long training times. To overcome these shortcomings, Temporal CNNs have recently been employed for SITS classification tasks with encouraging results. This paper seeks to survey this method against a plethora of other contemporary methods for SITS classification to validate the existing findings in recent literature. Comprehensive experiments are carried out on two benchmark SITS datasets with the results demonstrating that Temporal CNNs display a superior performance to the comparative benchmark algorithms across both studied datasets, achieving accuracies of 95.0\% and 87.3\% respectively. Investigations into the Temporal CNN architecture also highlighted the non-trivial task of optimising the model for a new dataset.


title: CapillaryX: A Software Design Pattern for Analyzing Medical Images in Real-time using Deep Learning

abstract: Recent advances in digital imaging, e.g., increased number of pixels captured, have meant that the volume of data to be processed and analyzed from these images has also increased. Deep learning algorithms are state-of-the-art for analyzing such images, given their high accuracy when trained with a large data volume of data. Nevertheless, such analysis requires considerable computational power, making such algorithms time- and resource-demanding. Such high demands can be met by using third-party cloud service providers. However, analyzing medical images using such services raises several legal and privacy challenges and does not necessarily provide real-time results. This paper provides a computing architecture that locally and in parallel can analyze medical images in real-time using deep learning thus avoiding the legal and privacy challenges stemming from uploading data to a third-party cloud provider. To make local image processing efficient on modern multi-core processors, we utilize parallel execution to offset the resource-intensive demands of deep neural networks. We focus on a specific medical-industrial case study, namely the quantifying of blood vessels in microcirculation images for which we have developed a working system. It is currently used in an industrial, clinical research setting as part of an e-health application. Our results show that our system is approximately 78% faster than its serial system counterpart and 12% faster than a master-slave parallel system architecture.


title: Machine Learning-Based Automated Thermal Comfort Prediction: Integration of Low-Cost Thermal and Visual Cameras for Higher Accuracy

abstract: Recent research is trying to leverage occupants' demand in the building's control loop to consider individuals' well-being and the buildings' energy savings. To that end, a real-time feedback system is needed to provide data about occupants' comfort conditions that can be used to control the building's heating, cooling, and air conditioning (HVAC) system. The emergence of thermal imaging techniques provides an excellent opportunity for contactless data gathering with no interruption in occupant conditions and activities. There is increasing attention to infrared thermal camera usage in public buildings because of their non-invasive quality in reading the human skin temperature. However, the state-of-the-art methods need additional modifications to become more reliable. To capitalize potentials and address some existing limitations, new solutions are required to bring a more holistic view toward non-intrusive thermal scanning by leveraging the benefit of machine learning and image processing. This research implements an automated approach to collect and register simultaneous thermal and visual images and read the facial temperature in different regions. This paper also presents two additional investigations. First, through utilizing IButton wearable thermal sensors on the forehead area, we investigate the reliability of an in-expensive thermal camera (FLIR Lepton) in reading the skin temperature. Second, by studying the false-color version of thermal images, we look into the possibility of non-radiometric thermal images for predicting personalized thermal comfort. The results shows the strong performance of Random Forest and K-Nearest Neighbor prediction algorithms in predicting personalized thermal comfort. In addition, we have found that non-radiometric images can also indicate thermal comfort when the algorithm is trained with larger amounts of data.