title: Local boundary behaviour and the area integral of generalized harmonic functions associated with root systems

abstract: The rational Dunkl operators are commuting differential-reflection operators on the Euclidean space $\RR^d$ associated with a root system. The aim of the paper is to study local boundary behaviour of generalized harmonic functions associated with the Dunkl operators. We introduce a Lusin-type area integral operator $S$ by means of Dunkl's generalized translation and the Dunkl operators. The main results are on characterizations of local existence of non-tangential boundary limits of a generalized harmonic function $u$ in the upper half-space $\RR^{d+1}_+$ associated with the Dunkl operators, and for a subset $E$ of $\RR^d$ invariant under the reflection group generated by the root system, the equivalence of the following three assertions are proved: (i) $u$ has a finite non-tangential limit at $(x,0)$ for a.e. $x\in E$; (ii) $u$ is non-tangentially bounded for a.e. $x\in E$; (iii) $(Su)(x)$ is finite for a.e. $x\in E$.


title: Proof of the Gaussian maximizers conjecture for the communication capacity of noisy heterodyne measurements

abstract: Basing on recently developed convex programming framework in the paper [arXiv:2204.10626], we provide a proof for a long-standing conjecture on optimality of Gaussian encondings for the ultimate communication rate of generalized heterodyne receivers under the oscillator energy constraint. Our results generalize previous ones (obtained under the assumption of validity of the energy threshold condition) and show a drastic difference in the structure of the optimal encoding within and beyond this condition. The core of the proof in the case beyond the threshold is a new log-Sobolev type inequality, which relates the generalized Wehrl entropy with the wavefunction gradient.


title: Toward Sustainable Transportation: Accelerating Vehicle Electrification with Dynamic Charging Deployment

abstract: Electric vehicles (EVs) are being actively adopted as a solution to sustainable transportation. However, a bottleneck remains with charging, where two of the main problems are the long charging time and the range anxiety of EV drivers. In this research, we investigate the deployment of dynamic charging systems, i.e., electrified roads that wirelessly charge EVs on the go, with a view to accelerating EVs adoption rate. We propose a traffic-based deployment strategy, statistically quantify its impact, and apply the strategy to two case studies of real traffic in New York City (USA) and Xi'an (China). We find that our analytical estimates not only closely match the real data, but they also suggest that dynamic charging considerably extends the driving range of popular EV models in urban mobility. For example, when only 5% of the existing roads in New York City are equipped with this technology, an EV model such as the Nissan Leaf will approximately maintain its battery level without stopping to recharge. If the percentage of charging roads is increased to 10%, then the Leaf will gain nearly 10% of its battery after every 40 kilometers of driving. Our framework provides a solution to public and private organizations that support and facilitate vehicle electrification through charging infrastructure.


title: A new poling protocol for enhanced piezoelectricity in Bi0.5Na0.5TiO3

abstract: In this work, a way to improve the piezoelectric properties of Bi0.5Na0.5TiO3 (BNT) is demonstrated by introducing a new poling protocol. A customized corona poling unit with a low temperature (77 K) sample stage is suggested. Using this protocol, the BNT sample is quenched from its paraelectric phase (T = 350{\deg}C) directly to its ferroelectric phase under corona discharge. Sample poled under this protocol showed an immense improvement (~38% increase) in the piezoelectric coefficient (d33) and 20% increase in the maximum unipolar piezoelectric strain (Smax).


title: LDRNet: Enabling Real-time Document Localization on Mobile Devices

abstract: While Identity Document Verification (IDV) technology on mobile devices becomes ubiquitous in modern business operations, the risk of identity theft and fraud is increasing. The identity document holder is normally required to participate in an online video interview to circumvent impostors. However, the current IDV process depends on an additional human workforce to support online step-by-step guidance which is inefficient and expensive. The performance of existing AI-based approaches cannot meet the real-time and lightweight demands of mobile devices. In this paper, we address those challenges by designing an edge intelligence-assisted approach for real-time IDV. Aiming at improving the responsiveness of the IDV process, we propose a new document localization model for mobile devices, LDRNet, to Localize the identity Document in Real-time. On the basis of a lightweight backbone network, we build three prediction branches for LDRNet, the corner points prediction, the line borders prediction and the document classification. We design novel supplementary targets, the equal-division points, and use a new loss function named Line Loss, to improve the speed and accuracy of our approach. In addition to the IDV process, LDRNet is an efficient and reliable document localization alternative for all kinds of mobile applications. As a matter of proof, we compare the performance of LDRNet with other popular approaches on localizing general document datasets. The experimental results show that LDRNet runs at a speed up to 790 FPS which is 47x faster, while still achieving comparable Jaccard Index(JI) in single-model and single-scale tests.


title: Approximating the first passage time density from data using generalized Laguerre polynomials

abstract: This paper analyzes a method to approximate the first passage time probability density function which turns to be particularly useful if only sample data are available. The method relies on a Laguerre-Gamma polynomial approximation and iteratively looks for the best degree of the polynomial such that the fitting function is a probability density function. The proposed iterative algorithm relies on simple and new recursion formulae involving first passage time moments. These moments can be computed recursively from cumulants, if they are known. In such a case, the approximated density can be used also for the maximum likelihood estimates of the parameters of the underlying stochastic process. If cumulants are not known, suitable unbiased estimators relying on k-statistics are employed. To check the feasibility of the method both in fitting the density and in estimating the parameters, the first passage time problem of a geometric Brownian motion is considered.


title: Fractional kinetic equations

abstract: We develop the idea of non-Markovian CTRW (continuous time random walk) approximation to the evolution of interacting particle systems, which leads to a general class of fractional kinetic measure-valued evolutions with variable order. We prove the well-posedness of the resulting new equations and present a probabilistic formula for their solutions. Though our method are quite general, for simplicity we treat in detail only the fractional versions of the interacting diffusions. The paper can be considered as a development of the ideas from the works of Belavkin and Maslov devoted to Markovian (quantum and classical) systems of interacting particles.


title: Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks

abstract: The convergence of GD and SGD when training mildly parameterized neural networks starting from random initialization is studied. For a broad range of models and loss functions, including the most commonly used square loss and cross entropy loss, we prove an ``early stage convergence'' result. We show that the loss is decreased by a significant amount in the early stage of the training, and this decrease is fast. Furthurmore, for exponential type loss functions, and under some assumptions on the training data, we show global convergence of GD. Instead of relying on extreme over-parameterization, our study is based on a microscopic analysis of the activation patterns for the neurons, which helps us derive more powerful lower bounds for the gradient. The results on activation patterns, which we call ``neuron partition'', help build intuitions for understanding the behavior of neural networks' training dynamics, and may be of independent interest.


title: Constraint on the mass of graviton with gravitational waves

abstract: We consider the effects of the mass of graviton on both the waveform of gravitational waves and the antenna response to gravitational waves. We find the effect on the response function is negligible for small mass. By using the Fisher matrix method, we make parameter estimations with space-based gravitational wave detectors for massive black hole binaries in massive gravity theory. The wavelength of massive graviton is constrained to be $\lambda_g\gtrsim 10^{17}$ m and the mass is constrained to be $m_g\lesssim 10^{-60}$ kg by one year's observation of massive black hole binaries with space-based gravitational wave detectors.


title: On low-dimensional partial isometries

abstract: Two statements concerning $n$-by-$n$ partial isometries are being considered: (i) these matrices are generic, if unitarily irreducible, and (ii) if nilpotent, their numerical ranges are circular disks. Both statements hold for $n\leq 4$ but fail starting with $n=5$.


title: Collaborative search and autonomous task allocation in organizations of learning agents

abstract: This paper introduces a model of multi-unit organizations with either static structures, i.e., they are designed top-down following classical approaches to organizational design, or dynamic structures, i.e., the structures emerge over time from micro-level decisions. In the latter case, the units are capable of learning about the technical interdependencies of the task they face, and they use their knowledge by adapting the task allocation from time to time. In both static and dynamic organizations, searching for actions to increase the performance can either be carried out individually or collaboratively. The results indicate that (i) collaborative search processes can help overcome the adverse effects of inefficient task allocations as long as there is an internal fit with other organizational design elements, and (ii) for dynamic organizations, the emergent task allocation does not necessarily mirror the technical interdependencies of the task the organizations face, even though the same (or even higher) performances are achieved.


title: Non-static fluid spheres admitting a conformal Killing vector: Exact solutions

abstract: We carry on a general study on non--static spherically symmetric fluids admitting a conformal Killing vector (CKV). Several families of exact analytical solutions are found for different choices of the CKV, in both, the dissipative and the adiabatic regime. To specify the solutions, besides the fulfillment of the junction conditions on the boundary of the fluid distribution, different conditions are imposed, such as vanishing complexity factor and quasi--homologous evolution. A detailed analysis of the obtained solutions, its prospective applications to astrophysical scenarios, as well as alternative approaches to obtain new solutions, are discussed.


title: Product safety idioms: a method for building causal Bayesian networks for product safety and risk assessment

abstract: Idioms are small, reusable Bayesian network (BN) fragments that represent generic types of uncertain reasoning. This paper shows how idioms can be used to build causal BNs for product safety and risk assessment that use a combination of data and knowledge. We show that the specific product safety idioms that we introduce are sufficient to build full BN models to evaluate safety and risk for a wide range of products. The resulting models can be used by safety regulators and product manufacturers even when there are limited (or no) product testing data.


title: Mandelic acid single-crystal growth: Experiments vs numerical simulations

abstract: Mandelic acid is an enantiomer of interest in many areas, in particular for the pharmaceutical industry. One of the approaches to produce enantiopure mandelic acid is through crystallization from an aqueous solution. We propose in this study a numerical tool based on lattice Boltzmann simulations to model crystallization dynamics of (S)-mandelic acid. The solver is first validated against experimental data. It is then used to perform parametric studies concerning the effects of important parameters such as supersaturation and seed size on the growth rate. It is finally extended to investigate the impact of forced convection on the crystal habits. Based on there parametric studies, a modification of the reactor geometry is proposed that should reduce the observed deviations from symmetrical growth with a five-fold habit.


title: Recurrent Video Restoration Transformer with Guided Deformable Attention

abstract: Video restoration aims at restoring multiple high-quality frames from multiple low-quality frames. Existing video restoration methods generally fall into two extreme cases, i.e., they either restore all frames in parallel or restore the video frame by frame in a recurrent way, which would result in different merits and drawbacks. Typically, the former has the advantage of temporal information fusion. However, it suffers from large model size and intensive memory consumption; the latter has a relatively small model size as it shares parameters across frames; however, it lacks long-range dependency modeling ability and parallelizability. In this paper, we attempt to integrate the advantages of the two cases by proposing a recurrent video restoration transformer, namely RVRT. RVRT processes local neighboring frames in parallel within a globally recurrent framework which can achieve a good trade-off between model size, effectiveness, and efficiency. Specifically, RVRT divides the video into multiple clips and uses the previously inferred clip feature to estimate the subsequent clip feature. Within each clip, different frame features are jointly updated with implicit feature aggregation. Across different clips, the guided deformable attention is designed for clip-to-clip alignment, which predicts multiple relevant locations from the whole inferred clip and aggregates their features by the attention mechanism. Extensive experiments on video super-resolution, deblurring, and denoising show that the proposed RVRT achieves state-of-the-art performance on benchmark datasets with balanced model size, testing memory and runtime.


title: Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech

abstract: Polyphone disambiguation aims to capture accurate pronunciation knowledge from natural text sequences for reliable Text-to-speech (TTS) systems. However, previous approaches require substantial annotated training data and additional efforts from language experts, making it difficult to extend high-quality neural TTS systems to out-of-domain daily conversations and countless languages worldwide. This paper tackles the polyphone disambiguation problem from a concise and novel perspective: we propose Dict-TTS, a semantic-aware generative text-to-speech model with an online website dictionary (the existing prior information in the natural language). Specifically, we design a semantics-to-pronunciation attention (S2PA) module to match the semantic patterns between the input text sequence and the prior semantics in the dictionary and obtain the corresponding pronunciations; The S2PA module can be easily trained with the end-to-end TTS model without any annotated phoneme labels. Experimental results in three languages show that our model outperforms several strong baseline models in terms of pronunciation accuracy and improves the prosody modeling of TTS systems. Further extensive analyses demonstrate that each design in Dict-TTS is effective. The code is available at \url{https://github.com/Zain-Jiang/Dict-TTS}.


title: The Lindeberg-Feller and Lyapunov Conditions in Infinite Dimensions

abstract: This paper makes 3 contributions. First, it generalizes the Lindeberg\textendash Feller and Lyapunov Central Limit Theorems to Hilbert Spaces by way of $L^2$. Second, it generalizes these results to spaces in which sample failure and missingness can occur. Finally, it shows that satisfaction of the Lindeberg\textendash Feller Condition in such spaces guarantees the consistency of all inferences from the partial functional data with respect to the completely observed data. These latter two results are especially important given the increasing attention to statistical inference with partially observed functional data. This paper goes beyond previous research by providing simple boundedness conditions which guarantee that \textit{all} inferences, as opposed to some proper subset of them, will be consistently estimated. This is shown primarily by aggregating conditional expectations with respect to the space of missingness patterns. This paper appears to be the first to apply this technique.


title: On the control over the distribution of ticks based on the extensions of the KISS model

abstract: Ticks and tick-borne diseases present a well known threat to the health of people in many parts of the globe. The scientific literature devoted both to field observations and to modeling the propagation of ticks continues to grow. So far the majority of the mathematical studies were devoted to models based on ordinary differential equations, where spatial variability was taken into account by a discrete parameter. Only few papers use spatially nontrivial diffusion models, and they are devoted mostly to spatially homogeneous equilibria. Here we develop diffusion models for the propagation of ticks stressing spatial heterogeneity. This allows us to assess the sizes of control zones that can be created (using various available techniques) to produce a patchy territory, on which ticks will be eventually eradicated. Using averaged parameters taken from various field observations we apply our theoretical results to the concrete cases of the lone star ticks of North America and of the taiga ticks of Russia.


title: BenchFaaS: Benchmarking Serverless Functions in an Edge Computing Network Testbed

abstract: The serverless computing model has evolved as one of the key solutions in the cloud for fast autoscaling and capacity planning. In edge computing environments, however, the serverless model is challenged by the system heterogeneity and performance variability. In this paper, we introduce BenchFaaS, an open-source edge computing network testbed which automates the deployment and benchmarking of serverless functions. Our edge computing network considers a cluster of virtual machines and Raspberry Pis, and is designed to benchmark serverless functions under different hardware and network conditions. We measure and evaluate: (i) overhead incurred by testbed, (ii) performance of compute intensive tasks, (iii) impact of application payload size, (iv) scalability, and (v) performance of chained serverless functions. We share the lessons learnt in engineering and implementing the testbed. We present the measurement results and analyze the impact of networked infrastructure on serverless performance. The measurements indicate that a properly dimensioned edge computing network can effectively serve as a serverless infrastructure.


title: A statistical analysis of an image classification problem

abstract: The availability of massive image databases resulted in the development of scalable machine learning methods such as convolutional neural network (CNNs) filtering and processing these data. While the very recent theoretical work on CNNs focuses on standard nonparametric denoising problems, the variability in image classification datasets does, however, not originate from additive noise but from variation of the shape and other characteristics of the same object across different images. To address this problem, we consider a simple supervised classification problem for object detection on grayscale images. While from the function estimation point of view, every pixel is a variable and large images lead to high-dimensional function recovery tasks suffering from the curse of dimensionality, increasing the number of pixels in our image deformation model enhances the image resolution and makes the object classification problem easier. We propose and theoretically analyze two different procedures. The first method estimates the image deformation by support alignment. Under a minimal separation condition, it is shown that perfect classification is possible. The second method fits a CNN to the data. We derive a rate for the misclassification error depending on the sample size and the number of pixels. Both classifiers are empirically compared on images generated from the MNIST handwritten digit database. The obtained results corroborate the theoretical findings.


title: Which models are innately best at uncertainty estimation?

abstract: Due to the comprehensive nature of this paper, it has been updated and split into two separate papers: "A Framework For Benchmarking Class-out-of-distribution Detection And Its Application To ImageNet" and "What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers". We recommend reading them instead. Deep neural networks must be equipped with an uncertainty estimation mechanism when deployed for risk-sensitive tasks. This paper studies the relationship between deep architectures and their training regimes with their corresponding selective prediction and uncertainty estimation performance. We consider both in-distribution uncertainties and class-out-of-distribution ones. Moreover, we consider some of the most popular estimation performance metrics previously proposed including AUROC, ECE, AURC, and coverage for selective accuracy constraint. We present a novel and comprehensive study of selective prediction and the uncertainty estimation performance of 484 existing pretrained deep ImageNet classifiers that are available at popular repositories. We identify numerous and previously unknown factors that affect uncertainty estimation and examine the relationships between the different metrics. We find that distillation-based training regimes consistently yield better uncertainty estimations than other training schemes such as vanilla training, pretraining on a larger dataset and adversarial training. We also provide strong empirical evidence showing that ViT is by far the most superior architecture in terms of uncertainty estimation performance, judging by any aspect, in both in-distribution and class-out-of-distribution scenarios.


title: HPGNN: Using Hierarchical Graph Neural Networks for Outdoor Point Cloud Processing

abstract: Inspired by recent improvements in point cloud processing for autonomous navigation, we focus on using hierarchical graph neural networks for processing and feature learning over large-scale outdoor LiDAR point clouds. We observe that existing GNN based methods fail to overcome challenges of scale and irregularity of points in outdoor datasets. Addressing the need to preserve structural details while learning over a larger volume efficiently, we propose Hierarchical Point Graph Neural Network (HPGNN). It learns node features at various levels of graph coarseness to extract information. This enables to learn over a large point cloud while retaining fine details that existing point-level graph networks struggle to achieve. Connections between multiple levels enable a point to learn features in multiple scales, in a few iterations. We design HPGNN as a purely GNN-based approach, so that it offers modular expandability as seen with other point-based and Graph network baselines. To illustrate the improved processing capability, we compare previous point based and GNN models for semantic segmentation with our HPGNN, achieving a significant improvement for GNNs (+36.7 mIoU) on the SemanticKITTI dataset.


title: The 1st Level General Fractional Derivatives and some of their Properties

abstract: In this paper, we first provide a short summary of the main properties of the so-called general fractional derivatives with the Sonin kernels introduced so far. These are integro-differential operators defined as compositions of the first order derivative and an integral operator of convolution type. Depending on succession of these operators, the general fractional derivatives of the Riemann-Liouville and of the Caputo types were defined and studied. The main objective of this paper is a construction of the 1st level general fractional derivatives that comprise both the general fractional derivative of the Riemann-Liouville type and the general fractional derivative of the Caputo type. We also provide some of their properties including the 1st and the 2nd fundamental theorems of Fractional Calculus for these derivatives and the suitably defined general fractional integrals.


title: A Riemann-Hilbert approach to existence of global solutions to the Fokas-Lenells equation on the line

abstract: We obtain the the existence of global solutions to the Cauchy problem of the Fokas-Lenells (FL) equation on the line \begin{align} &u_{xt}+\alpha\beta^2u-2i\alpha\beta u_x-\alpha u_{xx}-i\alpha\beta^2|u|^2u_x=0,\nonumber \\ &u(x,t=0)=u_0(x), \nonumber \end{align} where without the small-norm assumption on initial data $u_0(x)\in H^3(\mathbb{R})\cap H^{2,1}(\mathbb{R})$. Our main technical tool is the inverse scattering transform method based on the representation of a Riemann-Hilbert (RH) problem associated with the above Cauchy problem. The existence and the uniqueness of the RH problem is shown via a general vanishing lemma. The spectral problem associated with the FL equation is changed into an equivalent Zakharov-Shabat-type spectral problem to establish the RH problems on the real axis. By representing the solutions of the RH problem via the Cauchy integral protection and the reflection coefficients, the reconstruction formula is used to obtain a unique local solution of the FL equation. Further, the eigenfunctions and the reflection coefficients are shown Lipschitz continuous with respect to initial data, which provides a priori estimate of the solution to the FL equation. Based on the local solution and the uniformly priori estimate, we construct a unique global solution in $H^3(\mathbb{R})\cap H^{2,1}(\mathbb{R})$ to the FL equation.


title: Perspectives of Non-Expert Users on Cyber Security and Privacy: An Analysis of Online Discussions on Twitter

abstract: Current research on users` perspectives of cyber security and privacy related to traditional and smart devices at home is very active, but the focus is often more on specific modern devices such as mobile and smart IoT devices in a home context. In addition, most were based on smaller-scale empirical studies such as online surveys and interviews. We endeavour to fill these research gaps by conducting a larger-scale study based on a real-world dataset of 413,985 tweets posted by non-expert users on Twitter in six months of three consecutive years (January and February in 2019, 2020 and 2021). Two machine learning-based classifiers were developed to identify the 413,985 tweets. We analysed this dataset to understand non-expert users` cyber security and privacy perspectives, including the yearly trend and the impact of the COVID-19 pandemic. We applied topic modelling, sentiment analysis and qualitative analysis of selected tweets in the dataset, leading to various interesting findings. For instance, we observed a 54% increase in non-expert users` tweets on cyber security and/or privacy related topics in 2021, compared to before the start of global COVID-19 lockdowns (January 2019 to February 2020). We also observed an increased level of help-seeking tweets during the COVID-19 pandemic. Our analysis revealed a diverse range of topics discussed by non-expert users across the three years, including VPNs, Wi-Fi, smartphones, laptops, smart home devices, financial security, and security and privacy issues involving different stakeholders. Overall negative sentiment was observed across almost all topics non-expert users discussed on Twitter in all the three years. Our results confirm the multi-faceted nature of non-expert users` perspectives on cyber security and privacy and call for more holistic, comprehensive and nuanced research on different facets of such perspectives.


title: Never mind the metrics -- what about the uncertainty? Visualising confusion matrix metric distributions

abstract: There are strong incentives to build models that demonstrate outstanding predictive performance on various datasets and benchmarks. We believe these incentives risk a narrow focus on models and on the performance metrics used to evaluate and compare them -- resulting in a growing body of literature to evaluate and compare metrics. This paper strives for a more balanced perspective on classifier performance metrics by highlighting their distributions under different models of uncertainty and showing how this uncertainty can easily eclipse differences in the empirical performance of classifiers. We begin by emphasising the fundamentally discrete nature of empirical confusion matrices and show how binary matrices can be meaningfully represented in a three dimensional compositional lattice, whose cross-sections form the basis of the space of receiver operating characteristic (ROC) curves. We develop equations, animations and interactive visualisations of the contours of performance metrics within (and beyond) this ROC space, showing how some are affected by class imbalance. We provide interactive visualisations that show the discrete posterior predictive probability mass functions of true and false positive rates in ROC space, and how these relate to uncertainty in performance metrics such as Balanced Accuracy (BA) and the Matthews Correlation Coefficient (MCC). Our hope is that these insights and visualisations will raise greater awareness of the substantial uncertainty in performance metric estimates that can arise when classifiers are evaluated on empirical datasets and benchmarks, and that classification model performance claims should be tempered by this understanding.


title: Vanilla Feature Distillation for Improving the Accuracy-Robustness Trade-Off in Adversarial Training

abstract: Adversarial training has been widely explored for mitigating attacks against deep models. However, most existing works are still trapped in the dilemma between higher accuracy and stronger robustness since they tend to fit a model towards robust features (not easily tampered with by adversaries) while ignoring those non-robust but highly predictive features. To achieve a better robustness-accuracy trade-off, we propose the Vanilla Feature Distillation Adversarial Training (VFD-Adv), which conducts knowledge distillation from a pre-trained model (optimized towards high accuracy) to guide adversarial training towards higher accuracy, i.e., preserving those non-robust but predictive features. More specifically, both adversarial examples and their clean counterparts are forced to be aligned in the feature space by distilling predictive representations from the pre-trained/clean model, while previous works barely utilize predictive features from clean models. Therefore, the adversarial training model is updated towards maximally preserving the accuracy as gaining robustness. A key advantage of our method is that it can be universally adapted to and boost existing works. Exhaustive experiments on various datasets, classification models, and adversarial training algorithms demonstrate the effectiveness of our proposed method.


title: X-ray intraday variability of the TeV blazar Mrk 421 with {\it XMM-Newton}

abstract: Highly variable Markarian 421 is a bright high synchrotron energy peaked blazar showing wide featureless non-thermal spectrum making it a good candidate for our study of intraday flux and spectral variations over time. We analyse its X-ray observations of over 17 years taken with the EPIC-PN instrument to probe into the intraday variability properties. The photon energy band of 0.3 - 10.0 keV, and its sub-bands, soft 0.3-2.0 keV and hard 2.0-10.0 keV. To examine flux variability, fractional variability amplitude and the minimum variability timescale have been calculated. We also probed into the spectral variability by studying hardness ratio for each observation and the correlation between the two energy bands using discrete correlation function and inspecting the normalized light curves. The parameters obtained from these methods have been studied for any correlation or non-random trends. From this work, we speculate on the constraints for possible particle acceleration and emission processes in the jet, for better understanding of the processes involving a turbulent behaviour except of shocks. A positive discrete correlation function between the two sub-bands indicates the role of the same electron population in the emission of photons in the two bands. The correlation between the parameters of flux variability and parameters of spectral variation and lags in sub-energy bands provide the constraints to be considered for any modelling of emission processes.


title: Sentiment Analysis of Online Travel Reviews Based on Capsule Network and Sentiment Lexicon

abstract: With the development of online travel services, it has great application prospects to timely mine users' evaluation emotions for travel services and use them as indicators to guide the improvement of online travel service quality. In this paper, we study the text sentiment classification of online travel reviews based on social media online comments and propose the SCCL model based on capsule network and sentiment lexicon. SCCL model aims at the lack of consideration of local features and emotional semantic features of the text in the language model that can efficiently extract text context features like BERT and GRU. Then make the following improvements to their shortcomings. On the one hand, based on BERT-BiGRU, the capsule network is introduced to extract local features while retaining good context features. On the other hand, the sentiment lexicon is introduced to extract the emotional sequence of the text to provide richer emotional semantic features for the model. To enhance the universality of the sentiment lexicon, the improved SO-PMI algorithm based on TF-IDF is used to expand the lexicon, so that the lexicon can also perform well in the field of online travel reviews.


title: Testing dynamical torsion effects on the charged black hole's shadow, deflection angle and greybody with M87* and Sgr. A* from EHT

abstract: Poincar\'e Gauge's theory of gravity is the most noteworthy alternative extension of general relativity that has a correspondence between spin and spacetime geometry. In this paper, we use Reissner-Nordstrom-de Sitter and anti-de Sitter solutions, where torsion $\tau$ is added as an independent field, to analyze the weak deflection angles $\hat{\alpha}$ of massive and null particles in finite distance regime. We then apply $\hat{\alpha}$ to determine the Einstein ring formation in M87* and Sgr. A* and determine that relative to Earth's location from these black holes, massive torsion effects can provide considerable deviation, while the cosmological constant's effect remains negligible. Furthermore, we also explore how the torsion parameter affects the shadow radius perceived by both static and co-moving (with cosmic expansion) observers in a Universe dominated by dark energy, matter, and radiation. Our findings indicate that torsion and cosmological constant parameters affect the shadow radius differently between observers in static and co-moving states. We also show how the torsion parameter affects the luminosity of the photonsphere by studying the shadow with infalling accretion. The calculation of the quasinormal modes, greybody bounds, and high-energy absorption cross-section are also affected by the torsion parameter considerably.


title: Topological string amplitudes and Seiberg-Witten prepotentials from the counting of dimers in transverse flux

abstract: Important illustration to the principle ``partition functions in string theory are $\tau$-functions of integrable equations'' is the fact that the (dual) partition functions of $4d$ $\mathcal{N}=2$ gauge theories solve Painlev\'e equations. In this paper we show a road to self-consistent proof of the recently suggested generalization of this correspondence: partition functions of topological string on local Calabi-Yau manifolds solve $q$-difference equations of non-autonomous dynamics of the ``cluster-algebraic'' integrable systems. We explain in details the ``solutions'' side of the proposal. In the simplest non-trivial example we show how $3d$ box-counting of topological string partition function appears from the counting of dimers on bipartite graph with the discrete gauge field of ``flux'' $q$. This is a new form of topological string/spectral theory type correspondence, since the partition function of dimers can be computed as determinant of the linear $q$-difference Kasteleyn operator. Using WKB method in the ``melting'' $q\to 1$ limit we get a closed integral formula for Seiberg-Witten prepotential of the corresponding $5d$ gauge theory. The ``equations'' side of the correspondence remains the intriguing topic for the further studies.

categories: hep-th math-ph math.CO math.MP math.PR math.QA


title: MotionCNN: A Strong Baseline for Motion Prediction in Autonomous Driving

abstract: To plan a safe and efficient route, an autonomous vehicle should anticipate future motions of other agents around it. Motion prediction is an extremely challenging task that recently gained significant attention within the research community. In this work, we present a simple and yet very strong baseline for multimodal motion prediction based purely on Convolutional Neural Networks. While being easy-to-implement, the proposed approach achieves competitive performance compared to the state-of-the-art methods and ranks 3rd on the 2021 Waymo Open Dataset Motion Prediction Challenge. Our source code is publicly available at GitHub


title: Estimating and Mitigating the Congestion Effect of Curbside Pick-ups and Drop-offs: A Causal Inference Approach

abstract: Curb space is one of the busiest areas in urban road networks. Especially in recent years, the rapid increase of ride-hailing trips and commercial deliveries has induced massive pick-ups/drop-offs (PUDOs), which occupy the limited curb space that was designed and built decades ago. These PUDOs could jam curbside utilization and disturb the mainline traffic flow, evidently leading to significant negative societal externalities. However, there is a lack of an analytical framework that rigorously quantifies and mitigates the congestion effect of PUDOs in the system view, particularly with little data support and involvement of confounding effects. To bridge this research gap, this paper develops a rigorous causal inference approach to estimate the congestion effect of PUDOs on general regional networks. A causal graph is set to represent the spatio-temporal relationship between PUDOs and traffic speed, and a double and separated machine learning (DSML) method is proposed to quantify how PUDOs affect traffic congestion. Additionally, a re-routing formulation is developed and solved to encourage passenger walking and traffic flow re-routing to achieve system optimization. Numerical experiments are conducted using real-world data in the Manhattan area. On average, 100 additional units of PUDOs in a region could reduce the traffic speed by 3.70 and 4.54 mph on weekdays and weekends, respectively. Re-routing trips with PUDOs on curb space could respectively reduce the system-wide total travel time by 2.44% and 2.12% in Midtown and Central Park on weekdays. Sensitivity analysis is also conducted to demonstrate the effectiveness and robustness of the proposed framework.


title: A Survey on Deep Learning based Channel Estimation in Doubly Dispersive Environments

abstract: Wireless communications systems are impacted by multi-path fading and Doppler shift in dynamic environments, where the channel becomes doubly-dispersive and its estimation becomes an arduous task. Only a few pilots are used for channel estimation in conventional approaches to preserve high data rate transmission. Consequently, such estimators experience a significant performance degradation in high mobility scenarios. Recently, deep learning has been employed for doubly-dispersive channel estimation due to its low-complexity, robustness, and good generalization ability. Against this backdrop, the current paper presents a comprehensive survey on channel estimation techniques based on deep learning by deeply investigating different methods. The study also provides extensive experimental simulations followed by a computational complexity analysis. After considering different parameters such as modulation order, mobility, frame length, and deep learning architecture, the performance of the studied estimators is evaluated in several mobility scenarios. In addition, the source codes are made available online in order to make the results reproducible.


title: Error Analysis of Time-Discrete Random Batch Method for Interacting Particle Systems and Associated Mean-Field Limits

abstract: The random batch method provides an efficient algorithm for computing statistical properties of a canonical ensemble of interacting particles. In this work, we study the error estimates of the fully discrete random batch method, especially in terms of approximating the invariant distribution. Using a triangle inequality framework, we show that the long-time error of the method is $O(\sqrt{\tau} + e^{-\lambda t})$, where $\tau$ is the time step and $\lambda$ is the convergence rate which does not depend on the time step $\tau$ or the number of particles $N$. Our results also apply to the McKean-Vlasov process, which is the mean-field limit of the interacting particle system as the number of particles $N\rightarrow\infty$.


title: Asymptotic formula for the $M_2$-ranks of overpartitions

abstract: Let $\overline{N}_2(a,c,n)$ be the number of overpartitions of $n$ whose the $M_2$-rank is congruent to $a$ modulo $c$. In this paper, we obtain the asymptotic formula of $\overline{N}_2(a,c,n)$ utilizing the Ingham Tauberian Theorem. As applications, we derive inequalities concerning with $\overline{N}_2(a,c,n)$ including its strict concavity and log-concavity.


title: All-BN Distributed Bragg Reflectors Fabricated in a Single MOCVD Process

abstract: Distributed Bragg Reflectors (DBR) are well-established photonic structures that are used in many photonic applications. However, most of the DBRs are based on different materials or require post-process etching which can hinder integration with other components in the final photonic structure. Here, we demonstrate the fabrication of DBR structures consisting only of undoped boron nitride (BN) layers with high refractive index contrast by using Metal-Organic Chemical Vapor Deposition (MOCVD). This has been achieved in a single process, without the need for any post-process etching. The difference in the refractive index of the component BN layers stems from different degrees of porosity of the individual BN layers, which is a direct result of a different growth temperature. The fabricated DBR structures consist of 15.5 pairs of BN layers and exhibit a reflectance of 87+/-1% at the maximum. The wavelength of maximum reflectance can be tuned from 500 nm up to the Infrared Region (IR), by simply adjusting the growth periods of subsequent BN layers. We also demonstrate that the fabricated structures can be used to create an optical microcavity. The fabricated DBRs are very promising candidates for future applications, for example in combination with single-photon emitters in h-BN, which could allow the building of a cavity-based all-BN single-photon source.


title: Formally Verified Solution Methods for Infinite-Horizon Markov Decision Processes

abstract: We formally verify executable algorithms for solving Markov decision processes (MDPs) in the interactive theorem prover Isabelle/HOL. We build on existing formalizations of probability theory to analyze the expected total reward criterion on infinite-horizon problems. Our developments formalize the Bellman equation and give conditions under which optimal policies exist. Based on this analysis, we verify dynamic programming algorithms to solve tabular MDPs. We evaluate the formally verified implementations experimentally on standard problems and show they are practical. Furthermore, we show that, combined with efficient unverified implementations, our system can compete with and even outperform state-of-the-art systems.


title: Additional Fibonacci-Bernoulli relations

abstract: We continue our study on relationships between Fibonacci (Lucas) numbers and Bernoulli numbers and polynomials. The derivations of our results are based on functional equations for the respective generating functions, which in our case are combinations of hyperbolic functions. Special cases and some corollaries will highlight interesting aspects of our findings.


title: Near-Term Advances in Quantum Natural Language Processing

abstract: This paper describes experiments showing that some tasks in natural language processing (NLP) can already be performed using quantum computers, though so far only with small datasets. We demonstrate various approaches to topic classification. The first uses an explicit word-based approach, in which word-topic scoring weights are implemented as fractional rotations of individual qubit, and a new phrase is classified based on the accumulation of these weights in a scoring qubit using entangling controlled-NOT gates. This is compared with more scalable quantum encodings of word embedding vectors, which are used in the computation of kernel values in a quantum support vector machine: this approach achieved an average of 62% accuracy on classification tasks involving over 10000 words, which is the largest such quantum computing experiment to date. We describe a quantum probability approach to bigram modeling that can be applied to sequences of words and formal concepts, investigating a generative approximation to these distributions using a quantum circuit Born machine, and an approach to ambiguity resolution in verb-noun composition using single-qubit rotations for simple nouns and 2-qubit controlled-NOT gates for simple verbs. The smaller systems described have been run successfully on physical quantum computers, and the larger ones have been simulated. We show that statistically meaningful results can be obtained using real datasets, but this is much more difficult to predict than with easier artificial language examples used previously in developing quantum NLP systems. Other approaches to quantum NLP are compared, partly with respect to contemporary issues including informal language, fluency, and truthfulness.


title: Submanifolds of some Hartogs domain and the complex Euclidean space

abstract: Two Kahler manifolds are called relatives if they admit a common Kahler submanifold with the same induced metrics. In this paper, we show that a Hartogs domain over an irreducible bounded symmetric domain equipped with the Bergman metric is not a relative to the complex Euclidean space. This generalizes the results in [5, 4] and the novelty here is that the Bergman kernel of the Hartogs domain is not necessarily Nash algebraic.


title: Efficient Frozen Gaussian Sampling Algorithms for Nonadiabatic Quantum Dynamics at Metal Surfaces

abstract: In this article, we propose a Frozen Gaussian Sampling (FGS) algorithm for simulating nonadiabatic quantum dynamics at metal surfaces with a continuous spectrum. This method consists of a Monte-Carlo algorithm for sampling the initial wave packets on the phase space and a surface-hopping type stochastic time propagation scheme for the wave packets. We prove that to reach a certain accuracy threshold, the sample size required is independent of both the semiclassical parameter $\varepsilon$ and the number of metal orbitals $N$, which makes it one of the most promising methods to study the nonadiabatic dynamics. The algorithm and its convergence properties are also validated numerically. Furthermore, we carry out numerical experiments including exploring the nuclei dynamics, electron transfer and finite-temperature effects, and demonstrate that our method captures the physics which can not be captured by classical surface hopping trajectories.


title: Existence and Stability of the Lamb Dipoles for the Quasi-Geostrophic Shallow-Water Equations

abstract: In this paper, we prove the nonlinear orbital stability of vortex dipoles for the quasi-geostrophic shallow-water (QGSW) equations. The vortex dipoles are explicit travelling wave solutions to the QGSW equations, which are analogues of the classical circular vortex of Lamb and Chaplygin for the steady planar Euler equations. We establish a variational characterization of these vortex poles, which provides a basis for the stability result.


title: Cauchy-de Branges spaces, geometry of their reproducing kernels and multiplication operators

abstract: Cauchy-de Branges spaces are Hilbert spaces of entire functions defined in terms of Cauchy transforms of discrete measures on the plane and generalizing the classical de Branges theory. We consider extensions of two important properties of de Branges spaces to this, more general, setting. First, we discuss geometric properties (completeness, Riesz bases) of systems of reproducing kernels corresponding to the zeros of certain entire functions associated to the space. In the case of de Branges spaces they correspond to orthogonal bases of reproducing kernels. The second theme of the paper is a characterization of the density of the domain of multiplication by $z$ in Cauchy-de Branges spaces.


title: Development of research network on Quantum Annealing Computation and Information using Google Scholar data

abstract: We build and analyze the network of hundred top cited nodes (research papers and books from Google Scholar; strength or citation of the nodes range from about 44000 up to 100) starting early 1980 to till last year. These searched publications (papers, books) are based on Quantum Annealing Computation and Information categorized in four different sets: A) Quantum/Transverse Field Spin Glass Model, B) Quantum Annealing, C) Quantum Adiabatic Computation and D) Quantum Computation Information in the title or abstract of the searched publications. We fitted the growth in the annual number of publication ($n_p$) in each of these four categories A to D to the form $n_p \sim\exp{(t/\tau)}$ where $t$ denotes the time in year. We found the scaling time $\tau$ to be of order about 10 years for category A and C whereas $\tau$ is order of about 5 years for category B and D.


title: On the Orbital Period and Models of V Sge

abstract: The orbital period of V Sge is decreasing at a rate which increased from dP/dt=-(4.11\pm 0.33)\times 10^{-10} in 1962 to -(5.44\pm 0.61)\times 10^{-10} in 2022. This implies that the mass trahsfer from the secondary component is accelerating. From the evidence based on the orbital period variations, combined with estimates of the mass loss from the system based on radio observations, it follows that (1) the mass transfer rate from the secondary component is larger than dM2/dt=-5\times 10^{-6}M{\odot }/yr, possibly as large as dM2/dt=-2.5\times 10^{-5}M{\odot }/yr, and (2) the mass loss rate from the primary component is dM1/dt=-4\times 10^{-7}M{\odot }/yr or larger. Close similarity of V Sge to binary Wolf-Rayet stars supports the model with primary component being a hot, evolved star loosing its mass. Several arguments are presented which exclude the alternative model with primary component being a white dwarf with an accretion disk.


title: Factored Conditional Filtering: Tracking States and Estimating Parameters in High-Dimensional Spaces

abstract: This paper introduces the factored conditional filter, a new filtering algorithm for simultaneously tracking states and estimating parameters in high-dimensional state spaces. The conditional nature of the algorithm is used to estimate parameters and the factored nature is used to decompose the state space into low-dimensional subspaces in such a way that filtering on these subspaces gives distributions whose product is a good approximation to the distribution on the entire state space. The conditions for successful application of the algorithm are that observations be available at the subspace level and that the transition model can be factored into local transition models that are approximately confined to the subspaces; these conditions are widely satisfied in computer science, engineering, and geophysical filtering applications. We give experimental results on tracking epidemics and estimating parameters in large contact networks that show the effectiveness of our approach.


title: A Simple Meta-learning Paradigm for Zero-shot Intent Classification with Mixture Attention Mechanism

abstract: Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial points lie in two aspects: extracting better utterance features and strengthening the model generalization ability. In this paper, we propose a simple yet effective meta-learning paradigm for zero-shot intent classification. To learn better semantic representations for utterances, we introduce a new mixture attention mechanism, which encodes the pertinent word occurrence patterns by leveraging the distributional signature attention and multi-layer perceptron attention simultaneously. To strengthen the transfer ability of the model from seen classes to unseen classes, we reformulate zero-shot intent classification with a meta-learning strategy, which trains the model by simulating multiple zero-shot classification tasks on seen categories, and promotes the model generalization ability with a meta-adapting procedure on mimic unseen categories. Extensive experiments on two real-world dialogue datasets in different languages show that our model outperforms other strong baselines on both standard and generalized zero-shot intent classification tasks.


title: Semi-Supervised Learning for Mars Imagery Classification and Segmentation

abstract: With the progress of Mars exploration, numerous Mars image data are collected and need to be analyzed. However, due to the imbalance and distortion of Martian data, the performance of existing computer vision models is unsatisfactory. In this paper, we introduce a semi-supervised framework for machine vision on Mars and try to resolve two specific tasks: classification and segmentation. Contrastive learning is a powerful representation learning technique. However, there is too much information overlap between Martian data samples, leading to a contradiction between contrastive learning and Martian data. Our key idea is to reconcile this contradiction with the help of annotations and further take advantage of unlabeled data to improve performance. For classification, we propose to ignore inner-class pairs on labeled data as well as neglect negative pairs on unlabeled data, forming supervised inter-class contrastive learning and unsupervised similarity learning. For segmentation, we extend supervised inter-class contrastive learning into an element-wise mode and use online pseudo labels for supervision on unlabeled areas. Experimental results show that our learning strategies can improve the classification and segmentation models by a large margin and outperform state-of-the-art approaches.


title: Optimizing Sensing Matrices for Spherical Near-Field Antenna Measurements

abstract: In this article, we address the problem of reducing the number of required samples for Spherical Near-Field Antenna Measurements (SNF) by using Compressed Sensing (CS). A condition to ensure the numerical performance of sparse recovery algorithms is the design of a sensing matrix with low mutual coherence. Without fixing any part of the sampling pattern, we propose sampling points that minimize the mutual coherence of the respective sensing matrix by using augmented Lagrangian method. Numerical experiments show that the proposed sampling scheme yields a higher recovery success in terms of phase transition diagram when compared to other known sampling patterns, such as the spiral and Hammersley sampling schemes. Furthermore, we also demonstrate that the application of CS with an optimized sensing matrix requires fewer samples than classical approaches to reconstruct the Spherical Mode Coefficients (SMCs) and far-field pattern.


title: Simplicial effective resistance and enumeration of spanning trees

abstract: A graph can be regarded as an electrical network in which each edge is a resistor. This point of view relates combinatorial quantities, such as the number of spanning trees, to electrical ones such as effective resistance. The second and third authors have extended the combinatorics/electricity analogy to higher dimension and expressed the simplicial analogue of effective resistance as a ratio of weighted tree enumerators. In this paper, we first use that ratio to prove a new enumeration formula for color-shifted complexes, confirming a conjecture by Aalipour and the first author, and generalizing a result of Ehrenborg and van Willigenburg on Ferrers graphs. We then use the same technique to recover an enumeration formula for shifted complexes, first proved by Klivans and the first and fourth authors. In each case, we add facets one at a time, and give explicit expressions for simplicial effective resistances of added facets by constructing high-dimensional analogues of currents and voltages (respectively homological cycles and cohomological cocycles).


title: Functional Ensemble Distillation

abstract: Bayesian models have many desirable properties, most notable is their ability to generalize from limited data and to properly estimate the uncertainty in their predictions. However, these benefits come at a steep computational cost as Bayesian inference, in most cases, is computationally intractable. One popular approach to alleviate this problem is using a Monte-Carlo estimation with an ensemble of models sampled from the posterior. However, this approach still comes at a significant computational cost, as one needs to store and run multiple models at test time. In this work, we investigate how to best distill an ensemble's predictions using an efficient model. First, we argue that current approaches that simply return distribution over predictions cannot compute important properties, such as the covariance between predictions, which can be valuable for further processing. Second, in many limited data settings, all ensemble members achieve nearly zero training loss, namely, they produce near-identical predictions on the training set which results in sub-optimal distilled models. To address both problems, we propose a novel and general distillation approach, named Functional Ensemble Distillation (FED), and we investigate how to best distill an ensemble in this setting. We find that learning the distilled model via a simple augmentation scheme in the form of mixup augmentation significantly boosts the performance. We evaluated our method on several tasks and showed that it achieves superior results in both accuracy and uncertainty estimation compared to current approaches.


title: Triple Regge exchange and transverse single-spin asymmetries of the very forward neutral pion production in polarized $p+p$ collisions

abstract: Recently, the RHICf Collaboration measured the transverse single-spin asymmetries of the very forward neutral pion in polarized $p+p$ collisions at $\sqrt{s}=510$ GeV, produced at large pseudorapidity ($\eta\gtrsim 6$). The data show large asymmetries both in longitudinal momentum fraction $x_F$ and transverse momentum $p_T$ at $p_T<1\,\mathrm{GeV}/c$. Employing baryonic triple Regge exchanges, we describe the complete RHICf data for the first time and show that the neutral pion production at low $p_T$ can be interpreted as a diffractive one.


title: Packing, Hitting, and Colouring Squares

abstract: Given a finite family of squares in the plane, the packing problem asks for the maximum number $\nu$ of pairwise disjoint squares among them, while the hitting problem for the minimum number $\tau$ of points hitting all of them. Clearly, $\tau \ge \nu$. Both problems are known to be NP-hard, even for families of axis-parallel unit squares. The main results of this work provide the first non-trivial bounds for the $\tau / \nu$ ratio for not necessarily axis-parallel squares. We establish an upper bound of $6$ for unit squares and $10$ for squares of varying sizes. The worst ratios we can provide with examples are $3$ and $4$, respectively. For comparison, in the axis-parallel case, the supremum of the considered ratio is in the interval $[\frac{3}{2},2]$ for unit squares and $[\frac{3}{2},4]$ for squares of varying sizes. The methods we introduced for the $\tau/\nu$ ratio can also be used to relate the chromatic number $\chi$ and clique number $\omega$ of squares by bounding the $\chi/\omega$ ratio by $6$ for unit squares and $9$ for squares of varying sizes. The $\tau / \nu$ and $\chi/\omega$ ratios have already been bounded before by a constant for "fat" objects, the fattest and simplest of which are disks and squares. However, while disks have received significant attention, specific bounds for squares have remained essentially unexplored. This work intends to fill this gap.


title: Jordan Constant of $\mathrm{PGL}_3(K)$

abstract: We determine the Jordan constants of groups $\mathrm{GL}_2(K)$, $\mathrm{SL}_2(K)$, $\mathrm{PGL}_2(K)$ and $\mathrm{PGL}_3(K)$ for any given field $K$ of characteristic 0.


title: M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversation

abstract: Emotion Recognition in Conversations (ERC) is crucial in developing sympathetic human-machine interaction. In conversational videos, emotion can be present in multiple modalities, i.e., audio, video, and transcript. However, due to the inherent characteristics of these modalities, multi-modal ERC has always been considered a challenging undertaking. Existing ERC research focuses mainly on using text information in a discussion, ignoring the other two modalities. We anticipate that emotion recognition accuracy can be improved by employing a multi-modal approach. Thus, in this study, we propose a Multi-modal Fusion Network (M2FNet) that extracts emotion-relevant features from visual, audio, and text modality. It employs a multi-head attention-based fusion mechanism to combine emotion-rich latent representations of the input data. We introduce a new feature extractor to extract latent features from the audio and visual modality. The proposed feature extractor is trained with a novel adaptive margin-based triplet loss function to learn emotion-relevant features from the audio and visual data. In the domain of ERC, the existing methods perform well on one benchmark dataset but not on others. Our results show that the proposed M2FNet architecture outperforms all other methods in terms of weighted average F1 score on well-known MELD and IEMOCAP datasets and sets a new state-of-the-art performance in ERC.


title: High thermoelectric performances in PbP monolayers considering full electron-phonon coupling and four-phonon scattering processes

abstract: The band convergence strategy, which improves Seebeck coefficient by inducing multi-valley in bandstructures, has been widely used in thermoelectric performance (TE) enhancing. However, the phonon-assisted intervalley scattering effect is neglected and the mode-selection rules remain unclear. In this work, TE properties for $\alpha$-, $\beta$- and $\gamma$-PbP are intestigated under the consideration of full mode-, energy- and momentum-resolved electron-phonon interactions (EPI). The group theory is used to analyze the selection rules for EPI matrix elements. Our calculations reveal that, the intervalley scattering contributes non-trivially to the total carrier relaxation time, and the intervalley scattering can be modulated through crystal symmetry. In addition, the investigation on the thermal properties reveals that four-phonon scattering effect dominates the phonon relaxation processes, since the three-phonon scattering is suppressed due to the significantly large acoustic-optical phonon bandgap in $\alpha$-, $\beta$- and $\gamma$-PbP. By considering full EPI effect and high-order phonon scattering processes, the calculated ZT values reach 0.90, 0.24 and 1.25 for $\alpha$-, $\beta$- and $\gamma$-PbP, repectively, indicating their promising applications in thermoelectric devices.


title: On weak associated reflexivity of weighted Sobolev spaces of the first order on real line

abstract: We study associate and double associate spaces of two-weighted Sobolev spaces of the first order on real half-line and we show that unlike the notion of duality the associativity is divided into two cases which we call "strong" and "weak" ones with the division of the second associativity into four cases. On the way we prove that the Sobolev space of compactly supported functions possess weak associated reflexivity and the double weak-strong associate space is vacuous. The case of power weights was recently characterized by reduction to Ces\`{a}ro or Copson type spaces [18].


title: Bounds for the Bergman kernel and the sup-norm of holomorphic Siegel cusp forms

abstract: We prove `polynomial in $k$' bounds on the size of the Bergman kernel for the space of holomorphic Siegel cusp forms of degree $n$ and weight $k$. When $n=1,2$ our bounds agree with the conjectural bounds on the aforementioned size, while the lower bounds match for all $n \ge 1$. For an $L^2$-normalised Siegel cusp form $F$ of degree $2$, our bound for its sup-norm is $O_\epsilon (k^{9/4+\epsilon})$. Further, we show that in any compact set $\Omega$ (which does not depend on $k$) contained in the Siegel fundamental domain of $\mathrm{Sp}(2, \mathbb Z)$ on the Siegel upper half space, the sup-norm of $F$ is $O_\Omega(k^{3/2 - \eta})$ for some $\eta>0$, going beyond the `generic' bound in this setting.


title: Evidence of Magnon-Mediated Orbital Magnetism in a Quasi-2D Topological Magnon Insulator

abstract: We explore spin dynamics in Cu(1,3-bdc), a quasi-2D topological magnon insulator. The results show that the thermal evolution of Land\'e $g$-factor ($g$) is anisotropic: $g_\textrm{in-plane}$ reduces while $g_\textrm{out-plane}$ increases with increasing temperature $T$. Moreover, the anisotropy of the $g$-factor ($\Delta g$) and the anisotropy of saturation magnetization ($\Delta M_\textrm{s}$) are correlated below 4 K, but they diverge above 4 K. We show that the electronic orbital moment contributes to the $g$ anisotropy at lower $T$, while the topological orbital moment induced by thermally excited spin chirality dictates the $g$ anisotropy at higher $T$. Our work suggests an interplay among topology, spin chirality, and orbital magnetism in Cu(1,3-bdc).


title: Jacobi forms, Saito-Kurokawa lifts, their Pullbacks and sup-norms on average

abstract: We formulate a precise conjecture about the size of the $L^\infty$-mass of the space of Jacobi forms on $\mathbb H_n \times \mathbb C^{g \times n}$ of matrix index $S$ of size $g$. This $L^\infty$-mass is measured by the size of the Bergman kernel of the space. We prove the conjectured lower bound for all such $n,g,S$ and prove the upper bound in the $k$ aspect when $n=1$, $g \ge 1$. When $n=1$ and $g=1$, we make a more refined study of the sizes of the index-(old and) new spaces, the latter via the Waldspurger's formula. Towards this and with independent interest, we prove a power saving asymptotic formula for the averages of the twisted central $L$-values $L(1/2, f \otimes \chi_D)$ with $f$ varying over newforms of level a prime $p$ and even weight $k$ as $k,p \to \infty$ and $D$ being (explicitly) polynomially bounded by $k,p$. Here $\chi_D$ is a real quadratic Dirichlet character. We also prove that the size of the space of Saito-Kurokawa lifts (of even weight $k$) is $k^{5/2}$ by three different methods (with or without the use of central $L$-values), and show that the size of their pullbacks to the diagonally embedded $\mathbb H \times \mathbb H$ is $k^2$. In an appendix, the same question is answered for the pullbacks of the whole space $S^2_k$, the size here being $k^3$.


title: Peeling for tensorial wave equations on Schwarzschild spacetime

abstract: In this paper, we establish the asymptotic behaviour along outgoing and incoming radial geodesics, i.e., the peeling property for the tensorial Fackrell-Ipser and spin $\pm 1$ Teukolsky equations on Schwarzschild spacetime. Our method combines a conformal compactification with vector field techniques to prove the two-side estimates of the energies of tensorial fields through the future and past null infinity $\mathscr{I}^\pm$ and the initial Cauchy hypersurface $\Sigma_0 = \left\{ t=0 \right\}$ in a neighbourhood of spacelike infinity $i_0$ far away from the horizon and future timelike infinity. Our results obtain the optimal initial data which guarantees the peeling at all orders.


title: FOF: Learning Fourier Occupancy Field for Monocular Real-time Human Reconstruction

abstract: The advent of deep learning has led to significant progress in monocular human reconstruction. However, existing representations, such as parametric models, voxel grids, meshes and implicit neural representations, have difficulties achieving high-quality results and real-time speed at the same time. In this paper, we propose Fourier Occupancy Field (FOF), a novel powerful, efficient and flexible 3D representation, for monocular real-time and accurate human reconstruction. The FOF represents a 3D object with a 2D field orthogonal to the view direction where at each 2D position the occupancy field of the object along the view direction is compactly represented with the first few terms of Fourier series, which retains the topology and neighborhood relation in the 2D domain. A FOF can be stored as a multi-channel image, which is compatible with 2D convolutional neural networks and can bridge the gap between 3D geometries and 2D images. The FOF is very flexible and extensible, e.g., parametric models can be easily integrated into a FOF as a prior to generate more robust results. Based on FOF, we design the first 30+FPS high-fidelity real-time monocular human reconstruction framework. We demonstrate the potential of FOF on both public dataset and real captured data. The code will be released for research purposes.


title: High-repetition-rate seeded free-electron laser enhanced by self-modulation

abstract: Recently, the self-modulation scheme of a weakly pre-bunched electron beam has been proposed [Yan et al., Physical Review Letters 126, 084801 (2021)], which is of great promise for high-repetition-rate seeded free-electron lasers (FELs), such as high-gain harmonic generation (HGHG). In this paper, the self-modulation scheme is systematically analyzed and optimized, and further experiments in which the self-modulator is resonant at the second harmonic of the seed laser are conducted. The three-dimensional numerical simulations show that the required seed laser intensity in the self-modulation scheme is around three orders of magnitude lower than that of the standard HGHG through the optimization of the beam size or the peak current. More importantly, by reasonably setting the initial energy modulation and the resonance of the self-modulator, a more prominent bunching factor and lase at the 30th harmonic of the seed laser can be achieved in a single-stage HGHG. Moreover, the experiment results confirm that varying the resonance conditions of the self-modulator can still amplify the laser-induced energy modulation, where coherent radiation generated even at the 12th harmonic can be observed. These results indicate that the self-modulation scheme can remarkably reduce the requirements of the seed laser system while improving the harmonic up-conversion efficiency, which paves the way for realizing high-repetition-rate and fully coherent soft x-ray FELs.


title: Machine learning applications for electricity market agent-based models: A systematic literature review

abstract: The electricity market has a vital role to play in the decarbonisation of the energy system. However, the electricity market is made up of many different variables and data inputs. These variables and data inputs behave in sometimes unpredictable ways which can not be predicted a-priori. It has therefore been suggested that agent-based simulations are used to better understand the dynamics of the electricity market. Agent-based models provide the opportunity to integrate machine learning and artificial intelligence to add intelligence, make better forecasts and control the power market in better and more efficient ways. In this systematic literature review, we review 55 papers published between 2016 and 2021 which focus on machine learning applied to agent-based electricity market models. We find that research clusters around popular topics, such as bidding strategies. However, there exists a long-tail of different research applications that could benefit from the high intensity research from the more investigated applications.


title: Polynomial ergodic averages of measure-preserving systems acted by $\mathbb{Z}^{d}$

abstract: In this paper, we reduce pointwise convergence of polynomial ergodic averages of general measure-preserving system acted by $\mathbb{Z}^{d}$ to the case of measure-preserving system acted by $\mathbb{Z}^{d}$ with zero entropy. As an application, we can build pointwise convergence of polynomial ergodic averages for $K$-system acted by $\mathbb{Z}^{d}$.


title: A Quasi-Uniform Approach to Characterizing the Boundary of the Almost Entropic Region

abstract: The convex closure of entropy vectors for quasi-uniform random vectors is the same as the closure of the entropy region. Thus, quasi-uniform random vectors constitute an important class of random vectors for characterizing the entropy region. Moreover, the one-to-one correspondence between quasi-uniform codes and quasi-uniform random vectors makes quasi-uniform random vectors of central importance for designing effective codes for communication systems. In this paper, we present a novel approach that utilizes quasi-uniform random vectors for characterizing the boundary of the almost entropic region. In particular, we use the notion of quasi-uniform random vectors to establish looseness of known inner bounds for the entropy vectors at the boundary of the almost entropic region for three random variables. For communication models such as network coding, our approach can be applied to design network codes from quasi-uniform entropy vectors.


title: DarkSLAM: GAN-assisted Visual SLAM for Reliable Operation in Low-light Conditions

abstract: Existing visual SLAM approaches are sensitive to illumination, with their precision drastically falling in dark conditions due to feature extractor limitations. The algorithms currently used to overcome this issue are not able to provide reliable results due to poor performance and noisiness, and the localization quality in dark conditions is still insufficient for practical use. In this paper, we present a novel SLAM method capable of working in low light using Generative Adversarial Network (GAN) preprocessing module to enhance the light conditions on input images, thus improving the localization robustness. The proposed algorithm was evaluated on a custom indoor dataset consisting of 14 sequences with varying illumination levels and ground truth data collected using a motion capture system. According to the experimental results, the reliability of the proposed approach remains high even in extremely low light conditions, providing 25.1% tracking time on darkest sequences, whereas existing approaches achieve tracking only 0.6% of the sequence time.


title: GridShift: A Faster Mode-seeking Algorithm for Image Segmentation and Object Tracking

abstract: In machine learning and computer vision, mean shift (MS) qualifies as one of the most popular mode-seeking algorithms used for clustering and image segmentation. It iteratively moves each data point to the weighted mean of its neighborhood data points. The computational cost required to find the neighbors of each data point is quadratic to the number of data points. Consequently, the vanilla MS appears to be very slow for large-scale datasets. To address this issue, we propose a mode-seeking algorithm called GridShift, with significant speedup and principally based on MS. To accelerate, GridShift employs a grid-based approach for neighbor search, which is linear in the number of data points. In addition, GridShift moves the active grid cells (grid cells associated with at least one data point) in place of data points towards the higher density, a step that provides more speedup. The runtime of GridShift is linear in the number of active grid cells and exponential in the number of features. Therefore, it is ideal for large-scale low-dimensional applications such as object tracking and image segmentation. Through extensive experiments, we showcase the superior performance of GridShift compared to other MS-based as well as state-of-the-art algorithms in terms of accuracy and runtime on benchmark datasets for image segmentation. Finally, we provide a new object-tracking algorithm based on GridShift and show promising results for object tracking compared to CamShift and meanshift++.


title: Polynomial identities that involve binomial coefficients, double and rising factorials and their probabilistic interpretations and proofs

abstract: We formulate several polynomial identities. One side of these identities has a nice simple form. Whereas the other has a form of a polynomial whose coefficients contain binomial coefficients double factorials or (and) rising factorials. The origins and the proofs of these identities are probabilistic. However, their form suggests universal applications in simplifying expressions. Many useful simplifying formulae are presented in the sequel.


title: Relativistic Mean Field Study of Neutron Stars and Hyperon Stars

abstract: This thesis focuses on a variety of active research topics, such as nuclear matter, neutron stars, and phase transition within the framework of the RMF model. We use the previously successful effective field theory-driven Relativistic Mean Field (RMF) and density-dependent RMF (DD-RMF)formalisms for analyzing hadron matter to examine the infinite nuclear matter and neutron stars. The presence of exotic phases such as quarks has been investigated using the MIT Bag model and its variants, such as the vBag model, at various bag constants. The other exotic phases, such as hyperons, have also been studied under the influence of a strong magnetic field.


title: 3D Convolutional with Attention for Action Recognition

abstract: Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels and optical flow separately, models using a two-stream fusion technique, and models consisting of both convolutional neural network (CNN) and long-short term memory (LSTM) network are few examples of such complex models. Moreover, fine-tuning such complex models is computationally expensive as well. This paper proposes a deep neural network architecture for learning such dependencies consisting of a 3D convolutional layer, fully connected (FC) layers, and attention layer, which is simpler to implement and gives a competitive performance on the UCF-101 dataset. The proposed method first learns spatial and temporal features of actions through 3D-CNN, and then the attention mechanism helps the model to locate attention to essential features for recognition.


title: A weighted average distributed estimator for high dimensional parameter

abstract: Distributed sparse learning for high dimensional parameters has attached vast attentions due to its wide application in prediction and classification in diverse fields of machine learning. Existing distributed sparse regression usually takes an average way to ensemble the local results produced by distributed machines, which enjoys low communication cost but is statistical inefficient. To address this problem, we proposed a new Weighted AVerage Estimate (WAVE) for high-dimensional regressions. The WAVE is a solution to a weighted least-square loss with an adaptive $L_1$ penalty, in which the $L_1$ penalty controls the sparsity and the weight promotes the statistical efficiency. It can not only achieve a balance between the statistical and communication efficiency, but also reach a faster rate than the average estimate with a very low communication cost, requiring the local machines delivering two vectors to the master merely. The consistency of parameter estimation and model selection is also provided, which guarantees the safety of using WAVE in the distributed system. The consistency also provides a way to make hypothisis testing on the parameter. Moreover, WAVE is robust to the heterogeneous distributed samples with varied mean and covariance across machines, which has been verified by the asymptotic normality under such conditions. Other competitors, however, do not own this property. The effectiveness of WAVE is further illustrated by extensive numerical studies and real data analyses.


title: The fractional volatility model and rough volatility

abstract: The question of the volatility roughness is interpreted in the framework of a data-reconstructed fractional volatility model, where volatility is driven by fractional noise. Some examples are worked out and also, using Malliavin calculus for fractional processes, an option pricing equation and its solution are obtained.


title: Performance Comparison of Simple Transformer and Res-CNN-BiLSTM for Cyberbullying Classification

abstract: The task of text classification using Bidirectional based LSTM architectures is computationally expensive and time consuming to train. For this, transformers were discovered which effectively give good performance as compared to the traditional deep learning architectures. In this paper we present a performance based comparison between simple transformer based network and Res-CNN-BiLSTM based network for cyberbullying text classification problem. The results obtained show that transformer we trained with 0.65 million parameters has significantly being able to beat the performance of Res-CNN-BiLSTM with 48.82 million parameters for faster training speeds and more generalized metrics. The paper also compares the 1-dimensional character level embedding network and 100-dimensional glove embedding network with transformer.


title: OBAMA, an Ontology-Based Software Tool for Agile Method Adoption

abstract: Tools like Prot\'eg\'e support the creation and edition of one or more ontologies in a single workspace. They nevertheless require a user to be familiar with this kind of abstractions and their supporting techniques such as a reasoner and SPARQL queries. This paper presents a step-by-step implementation of a prototype-tool that allows retrieving and displaying easily the information about agile practices contained in an ontology using Python programming language. Future development includes the flexible insertion, modification, and removal of knowledge by the user.


title: Stylistic Fingerprints, POS-tags and Inflected Languages: A Case Study in Polish

abstract: In stylometric investigations, frequencies of the most frequent words (MFWs) and character n-grams outperform other style-markers, even if their performance varies significantly across languages. In inflected languages, word endings play a prominent role, and hence different word forms cannot be recognized using generic text tokenization. Countless inflected word forms make frequencies sparse, making most statistical procedures complicated. Presumably, applying one of the NLP techniques, such as lemmatization and/or parsing, might increase the performance of classification. The aim of this paper is to examine the usefulness of grammatical features (as assessed via POS-tag n-grams) and lemmatized forms in recognizing authorial profiles, in order to address the underlying issue of the degree of freedom of choice within lexis and grammar. Using a corpus of Polish novels, we performed a series of supervised authorship attribution benchmarks, in order to compare the classification accuracy for different types of lexical and syntactic style-markers. Even if the performance of POS-tags as well as lemmatized forms was notoriously worse than that of lexical markers, the difference was not substantial and never exceeded ca. 15%.


title: Role of Orientational Disorder in ZSM-22 in the Adsorption of SO$_2$

abstract: Computational studies addressing the adsorption of fluids in nano-porous materials mostly use ideal single crystal models of the adsorbent. While a few recent studies have tried to address the effects of inter-crystalline spacing on the adsorption of fluids in polycrystalline models of nano-porous materials, the effects of the orientational disorder in the polycrystalline adsorbent remain unexplored. Here we report the adsorption of SO$_2$, an industrially and environmentally important gas, in ZSM-22, a zeolite characterized by straight channel like pores. The simple pore geometry of ZSM-22 helps us make polycrystalline models of the adsorbent with different degrees of orientational disorder. Using grand canonical Monte Carlo (GCMC) simulations, we obtain the adsorption isotherms of SO$_2$ in ZSM-22 with different inter-crystalline spacings and degree of orientational disorder. Introducing inter-crystalline space is found to enhance the adsorption capacity, with a larger inter-crystalline space leading to higher adsorption. Increasing the orientational disorder of the adsorbent is found to enhance the adsorption capacity too. However, the effects of orientational disorder become weaker when the inter-crystalline space is widened. This weakening of the effect of orientational disorder is a result of an interplay between the width of the inter-crystalline space and the strength of guest-guest interactions.


abstract: General rogue wave solutions to the Sasa-Satsuma equation are constructed by the Kadomtsev-Petviashvili (KP) hierarchy reduction method. These solutions are presented in three different forms. The first form is expressed in terms of recursively defined differential operators while the second form shares a similar solution structure except that the differential operators are no longer recursively defined. Instead of using differential operators, the third form is expressed by Schur polynomials.


title: Variable-rate hierarchical CPC leads to acoustic unit discovery in speech

abstract: The success of deep learning comes from its ability to capture the hierarchical structure of data by learning high-level representations defined in terms of low-level ones. In this paper we explore self-supervised learning of hierarchical representations of speech by applying multiple levels of Contrastive Predictive Coding (CPC). We observe that simply stacking two CPC models does not yield significant improvements over single-level architectures. Inspired by the fact that speech is often described as a sequence of discrete units unevenly distributed in time, we propose a model in which the output of a low-level CPC module is non-uniformly downsampled to directly minimize the loss of a high-level CPC module. The latter is designed to also enforce a prior of separability and discreteness in its representations by enforcing dissimilarity of successive high-level representations through focused negative sampling, and by quantization of the prediction targets. Accounting for the structure of the speech signal improves upon single-level CPC features and enhances the disentanglement of the learned representations, as measured by downstream speech recognition tasks, while resulting in a meaningful segmentation of the signal that closely resembles phone boundaries.


title: Optimal discrimination between real and complex quantum theories

abstract: We find the minimal number of settings to test quantum theory based on real numbers, assuming separability of the sources, modifying the recent proposal [M.-O. Renou et al., Nature 600, 625 (2021)]. The test needs only three settings for observers $A$ and $C$, but the ratio of complex to real maximum is smaller than in the existing proposal. We also found that two settings and two outcomes for both observes are insufficient.


title: Online FDR Control for RNAseq Data

abstract: Motivation: While the analysis of a single RNA sequencing (RNAseq) dataset has been well described in the literature, modern research workflows often have additional complexity in that related RNAseq experiments are performed sequentially over time. The simplest and most widely used analysis strategy ignores the temporal aspects and analyses each dataset separately. However, this can lead to substantial inflation of the overall false discovery rate (FDR). We propose applying recently developed methodology for online hypothesis testing to analyse sequential RNAseq experiments in a principled way, guaranteeing FDR control at all times while never changing past decisions. Results: We show that standard offline approaches have variable control of FDR of related RNAseq experiments over time and a naively composed approach may improperly change historic decisions. We demonstrate that the online FDR algorithms are a principled way to guarantee control of FDR. Furthermore, in certain simulation scenarios, we observe empirically that online approaches have comparable power to offline approaches. Availability and Implementation: The onlineFDR package is freely available at http: //www.bioconductor.org/packages/onlineFDR. Additional code used for the simulation studies can be found at https://github.com/latlio/onlinefdr_rnaseq_simulation


title: Spontaneous synchronisation and exceptional points in breather complex

abstract: We experimentally demonstrate the spontaneous synchronization and the exceptional point (EP) induced pulse generation mechanism in the breather complex. The breathing frequency and phase are found to be synchronized during the formation of a 9-breather assembled complex in a mode-locked fiber laser. The breathers are formed at exactly the time point of the complex's breathing frequency leaving or entering the subharmonic entrainment. Such new pulse generation mechanism should be related to the non-Hermitian EPs or the time translation symmetry breaking. The investigations of destroying and rebuilding the mode-locking reveal the connection between the synchronization and laser stabilization. These findings may inspire a wide range of researches including ultrafast optics, micro-cavity combs, ocean breather behaviors, non-Hermitian optics, etc.


title: Comparison of measuring the cloud top height by a radiosonde with an optical sensor and an airplane

abstract: Currently, the cloud top height (CTH) is measured by remote satellite and radar methods. Radar methods detect only clouds with precipitation, so their information about the optical cloud top height has little reliability. In addition, any remote method must be monitored. The CTH is most accurately measured by aircraft methods. However, its use for measuring the height of cumulonimbus clouds is almost impossible. The paper presents the results of comparing the measurement of the CTH using a radiosonde with an optical sensor and an aircraft with a special laser locator. The measured heights differed from each other by 30 meters, which corresponds to the accuracy of the equipment used. The purpose of the work is to monitor the quality of satellite and radar methods for measuring the CTH.


title: Sequential Counterfactual Decision-Making Under Confounded Reward

abstract: We investigate the limitations of random trials when the cause of interest is confounded with the effect by formalizing a counterfactual policy-space where the agent's natural predilection is input to a soft-intervention.


title: Learning Mesh Motion Techniques with Application to Fluid-Structure Interaction

abstract: Mesh degeneration is a bottleneck for fluid-structure interaction (FSI) simulations and for shape optimization via the method of mappings. In both cases, an appropriate mesh motion technique is required. The choice is typically based on heuristics, e.g., the solution operators of partial differential equations (PDE), such as the Laplace or biharmonic equation. Especially the latter, which shows good numerical performance for large displacements, is expensive. Moreover, from a continuous perspective, choosing the mesh motion technique is to a certain extent arbitrary and has no influence on the physically relevant quantities. Therefore, we consider approaches inspired by machine learning. We present a hybrid PDE-NN approach, where the neural network (NN) serves as parameterization of a coefficient in a second order nonlinear PDE. We ensure existence of solutions for the nonlinear PDE by the choice of the neural network architecture. Moreover, we present an approach where a neural network corrects the harmonic extension such that the boundary displacement is not changed. In order to avoid technical difficulties in coupling finite element and machine learning software, we work with a splitting of the monolithic FSI system into three smaller subsystems. This allows to solve the mesh motion equation in a separate step. We assess the quality of the learned mesh motion technique by applying it to a FSI benchmark problem. In addition, we discuss generalizability and computational cost of the learned mesh motion operators.


title: Statistical Deep Learning for Spatial and Spatio-Temporal Data

abstract: Deep neural network models have become ubiquitous in recent years, and have been applied to nearly all areas of science, engineering, and industry. These models are particularly useful for data that have strong dependencies in space (e.g., images) and time (e.g., sequences). Indeed, deep models have also been extensively used by the statistical community to model spatial and spatio-temporal data through, for example, the use of multi-level Bayesian hierarchical models and deep Gaussian processes. In this review, we first present an overview of traditional statistical and machine learning perspectives for modeling spatial and spatio-temporal data, and then focus on a variety of hybrid models that have recently been developed for latent process, data, and parameter specifications. These hybrid models integrate statistical modeling ideas with deep neural network models in order to take advantage of the strengths of each modeling paradigm. We conclude by giving an overview of computational technologies that have proven useful for these hybrid models, and with a brief discussion on future research directions.


title: Strain tuning the magnetic and transport properties of Mn$_3$Ge

abstract: The kagome lattice antiferromagnet Mn$_3$Ge has a local hexagonal symmetry with a 120$^\circ$ ordered ground state. This non-colinear ground state engenders a strong anomalous Hall response. The main goal of this work is to understand the effect of strain on this response. We derive an effective model for the Hall vector which functions as our order parameter. Using this model we show how both intra and inter planar strains can be used to switch the sign of the Hall response at a constant magnetic field. Further, we also investigate the effect of this strain on the spin wave band gaps and show that strain can be used to effectively manipulate them, which can be used to tune the magnon responses in this system.


title: U(1) Symmetry-breaking Observed in Generic CNN Bottleneck Layers

abstract: We report on a novel model linking deep convolutional neural networks (CNN) to biological vision and fundamental particle physics. Information propagation in a CNN is modeled via an analogy to an optical system, where information is concentrated near a bottleneck where the 2D spatial resolution collapses about a focal point $1\times 1=1$. A 3D space $(x,y,t)$ is defined by $(x,y)$ coordinates in the image plane and CNN layer $t$, where a principal ray $(0,0,t)$ runs in the direction of information propagation through both the optical axis and the image center pixel located at $(x,y)=(0,0)$, about which the sharpest possible spatial focus is limited to a circle of confusion in the image plane. Our novel insight is to model the principal optical ray $(0,0,t)$ as geometrically equivalent to the medial vector in the positive orthant $I(x,y) \in R^{N+}$ of a $N$-channel activation space, e.g. along the greyscale (or luminance) vector $(t,t,t)$ in $RGB$ colour space. Information is thus concentrated into an energy potential $E(x,y,t)=\|I(x,y,t)\|^2$, which, particularly for bottleneck layers $t$ of generic CNNs, is highly concentrated and symmetric about the spatial origin $(0,0,t)$ and exhibits the well-known "Sombrero" potential of the boson particle. This symmetry is broken in classification, where bottleneck layers of generic pre-trained CNN models exhibit a consistent class-specific bias towards an angle $\theta \in U(1)$ defined simultaneously in the image plane and in activation feature space. Initial observations validate our hypothesis from generic pre-trained CNN activation maps and a bare-bones memory-based classification scheme, with no training or tuning. Training from scratch using combined one-hot $+ U(1)$ loss improves classification for all tasks tested including ImageNet.