title: XookSuut a code for modeling circular and non-circular flows on 2D velocity maps

abstract: We present $\texttt{XookSuut}$, a Python implementation of the $\texttt{DiskFit}$ algorithm, optimized to perform robust Bayesian inference on parameters describing models of circular and noncircular rotation in galaxies. $\texttt{XookSuut}$~surges as a Bayesian alternative for kinematic modeling of 2D velocity maps; it implements efficient sampling methods, specifically Markov Chain Monte Carlo (MCMC) and Nested Sampling (NS), to obtain the posteriors and marginalized distributions of kinematic models including circular motions, axisymmetric radial flows, bisymmetric flows, and harmonic decomposition of the LoS~velocity. In this way, kinematic models are obtained by pure sampling methods, rather than standard minimization techniques based on the $\chi^2$. All together, $\texttt{XookSuut}$~represents a sophisticated tool for deriving rotational curves and to explore the error distribution and covariance between parameters.


title: Density-Based Clustering with Kernel Diffusion

abstract: Finding a suitable density function is essential for density-based clustering algorithms such as DBSCAN and DPC. A naive density corresponding to the indicator function of a unit $d$-dimensional Euclidean ball is commonly used in these algorithms. Such density suffers from capturing local features in complex datasets. To tackle this issue, we propose a new kernel diffusion density function, which is adaptive to data of varying local distributional characteristics and smoothness. Furthermore, we develop a surrogate that can be efficiently computed in linear time and space and prove that it is asymptotically equivalent to the kernel diffusion density function. Extensive empirical experiments on benchmark and large-scale face image datasets show that the proposed approach not only achieves a significant improvement over classic density-based clustering algorithms but also outperforms the state-of-the-art face clustering methods by a large margin.


title: Hydrodynamic interactions can induce jamming in flow-driven systems

abstract: Hydrodynamic interactions between fluid-dispersed particles are ubiquitous in soft matter and biological systems and they give rise to intriguing collective phenomena. While it was reported that these interactions can facilitate force-driven particle motion over energetic barriers, here we show the opposite effect in a flow-driven system, i.e. that hydrodynamic interactions hinder transport across barriers. We demonstrate this result by combining experiments and theory. In the experiments, we drive colloidal particles using rotating optical traps, thus creating a vortex flow in the corotating reference frame. We observe a jamming-like decrease of particle currents with density for large barriers between traps. The theoretical model shows that this jamming arises from hydrodynamic interactions between the particles. The impact of hydrodynamic interactions is reversed compared to force-driven motion, suggesting that our findings are a generic feature of flow-driven transport.


title: SurroundNet: Towards Effective Low-Light Image Enhancement

abstract: Although Convolution Neural Networks (CNNs) has made substantial progress in the low-light image enhancement task, one critical problem of CNNs is the paradox of model complexity and performance. This paper presents a novel SurroundNet which only involves less than 150$K$ parameters (about 80-98 percent size reduction compared to SOTAs) and achieves very competitive performance. The proposed network comprises several Adaptive Retinex Blocks (ARBlock), which can be viewed as a novel extension of Single Scale Retinex in feature space. The core of our ARBlock is an efficient illumination estimation function called Adaptive Surround Function (ASF). It can be regarded as a general form of surround functions and be implemented by convolution layers. In addition, we also introduce a Low-Exposure Denoiser (LED) to smooth the low-light image before the enhancement. We evaluate the proposed method on the real-world low-light dataset. Experimental results demonstrate that the superiority of our submitted SurroundNet in both performance and network parameters against State-of-the-Art low-light image enhancement methods. Code is available at https: github.com/ouc-ocean-group/SurroundNet.


title: Boson Sampling in Low-depth Optical Systems

abstract: Optical losses are the main obstacle to demonstrating a quantum advantage via boson sampling without leaving open the possibility of classical spoofing. We propose a method for generating low-depth optical circuits suitable for boson sampling with very high efficiencies. Our circuits require only a constant number of optical components (namely three) to implement an optical transformation suitable for demonstrating a quantum advantage. Consequently, our proposal has a constant optical loss regardless of the number of optical modes. We argue that sampling from our family of circuits is computationally hard by providing numerical evidence that our family of circuits converges to that of the original boson sampling proposal in the limit of large optical systems. Our work opens a new route to demonstrate an optical quantum advantage.


title: Harnack inequality and one-endedness of UST on reversible random graphs

abstract: We prove that for recurrent, reversible graphs, the following conditions are equivalent: (a) existence and uniqueness of the potential kernel, (b) existence and uniqueness of harmonic measure from infinity, (c) a new anchored Harnack inequality, and (d) one-endedness of the wired Uniform Spanning Tree. In particular this gives a proof of the anchored (and in fact also elliptic) Harnack inequality on the UIPT. This also complements and strengthens some results of Benjamini, Lyons, Peres and Schramm. Furthermore, we make progress towards a conjecture of Aldous and Lyons by proving that these conditions are fulfilled for strictly subdiffusive recurrent unimodular graphs. Finally, we discuss the behaviour of the random walk conditioned to never return to the origin, which is well defined as a consequence of our results


title: Polymer drag reduction in surfactant-contaminated turbulent bubbly channel flows

abstract: Polymer additives are commonly utilized to manipulate bubbly flows in various applications. Here, we investigate the effects of clean and contaminated bubbles driven upwards (upflow) in Newtonian and viscoelastic turbulent channel flows. Interface-resolved direct numerical simulations are performed to examine sole and combined effects of soluble surfactant and viscoelasticity using an efficient 3D finite-difference/front-tracking method. The incompressible flow equations are solved fully coupled with the FENE-P viscoelastic model and the equations governing interfacial and bulk surfactant concentrations. The latter coupling is accomplished by a non-linear equation of state that relates the surface tension to the surfactant concentration. For Newtonian turbulent bubbly flows, the effects of Triton X-100 and 1-Pentanol surfactant are examined. It is observed that the sorption kinetics highly affect the dynamics of bubbly flow. A minute amount of Triton X-100 is found to be sufficient to prevent the formation of bubble clusters restoring the single-phase behavior while even two orders of magnitude more 1-Pentanol surfactant is not adequate to prevent the formation of layers. For viscoelastic turbulent flows, it is found that the viscoelasticity promotes formation of the bubble-wall layers and thus the polymer drag reduction is completely lost for the surfactant-free bubbly flows, while the addition of small amount of surfactant (Triton X-100) in this system restores the polymer drag reduction resulting in $25\%$ drag reduction for the $Wi=4$ case.


title: Multiple Object Trackers in OpenCV: A Benchmark

abstract: Object tracking is one of the most important and fundamental disciplines of Computer Vision. Many Computer Vision applications require specific object tracking capabilities, including autonomous and smart vehicles, video surveillance, medical treatments, and many others. The OpenCV as one of the most popular libraries for Computer Vision includes several hundred Computer Vision algorithms. Object tracking tasks in the library can be roughly clustered in single and multiple object trackers. The library is widely used for real-time applications, but there are a lot of unanswered questions such as when to use a specific tracker, how to evaluate its performance, and for what kind of objects will the tracker yield the best results? In this paper, we evaluate 7 trackers implemented in OpenCV against the MOT20 dataset. The results are shown based on Multiple Object Tracking Accuracy (MOTA) and Multiple Object Tracking Precision (MOTP) metrics.


title: Achieving safe minimum circle circumnavigation around multiple targets: a dynamic compensation approach

abstract: Minimum circle circumnavigation is proposed in this paper, which is of special value in target monitoring, capturing and/or attacking. In this paper, a safe minimum circle circumnavigation of multiple targets based on bearing measurements is studied. In contrast with the traditional circumnavigation problem, with the new pattern, one agent is able to enclose multiple targets along a minimum circle with the desired enclosing distance and tangential speed. To achieve the minimum circle circumnavigation, an algorithm including dynamic compensators and a control protocol is proposed, by which collision is avoided between the agent and the multiple targets during the whole moving process. Moreover, the control protocol developed for a single agent is further extended to the scenarios of multiple agents by adding a coordination mechanism into the tangential velocity term, which drives the agents to distribute evenly on each expected circular orbit with the same radius or different radius. Simulations results illustrate the effectiveness of the proposed methods.


title: W+c-jet production at the LHC with NNLO QCD accuracy

abstract: In these proceedings, we highlight some aspects of the recent computation of NNLO QCD corrections for W production in association with a charm jet at the LHC. The results are presented in the form of cross sections and differential distributions and are compared to ATLAS data.


title: A singular Schr\"odinger-Maxwell system

abstract: In this paper we are concerned with existence of positive solutions for a Schr\"odinger-Maxwell system with singular or strongly-singular terms. We overcome the difficulty given by the singular terms through an approximation scheme and controlling the approximated sequences of solutions with suitable barriers from above and from below. Besides this, in some particular case, we show that the unique energy solution of the singular system is a saddle point of a suitable functional.


title: Investigation of Wavelength-induced Uncertainties in Full-Wave Radar Tomography of High Contrast Domain: An Application to Small Solar System Bodies

abstract: This paper aims to reconstruct the internal structure of a two-dimensional test object via numerically simulated full-wave time domain radar tomography with the presence of wavelength-induced (WI) uncertainties, following from a complex domain structure, and domain diameters 21 or 64 times the wavelength of the signal propagating inside the target. In particular, we consider an application in planetary scientific studies of reconstructing the interior structure of an arbitrary high contrast small Solar System Body (SSSB), i.e., an asteroid, with a probing signal wavelength limited by the instrument and mission payload requirements. Our uncertainty reduction model finds the reconstruction via averaging multiple inverse solutions assuming that the WI deviations in the solutions correspond to random deviations, which we assume to be independent and identically distributed (IID). It incorporates error marginalisation via a randomised signal configuration, spatial-averaging of candidate solutions, frequency-based error marginalisation, and the truncated singular value decomposition (TSVD) filtering technique, based on our assumptions of the phase discrepancy of the signal, domain parameters, and the full-wave forward model. The numerical experiments are performed for 20 and 60 MHz centre frequencies proposed for CubeSat-based radars, the latter being the centre frequency of the Juventas Radar which will be aboard Hera mission to investigate the interior structure of asteroid Dimorphos. A benchmark reconstruction of the target was obtained with the spatial averaging, sparse point density and frequency randomised configuration for both 20 and 60 MHz frequency systems.


title: Two-stage least squares with a randomly right censored outcome

abstract: This note develops a simple two-stage least squares (2SLS) procedure to estimate the causal effect of some endogenous regressors on a randomly right censored outcome in the linear model. The proposal replaces the usual ordinary least squares regressions of the standard 2SLS by weighted least squares regressions. The weights correspond to the inverse probability of censoring. We show consistency and asymptotic normality of the estimator. The estimator exhibits good finite sample performances in simulations.


title: Continuity of isomorphisms applied to rigidity problems of entropy spectra

abstract: For a fixed topological Markov shift, we consider measure-preserving dynamical systems of Gibbs measures for 2-locally constant functions on the shift. We also consider isomorphisms between two such systems. We study the set of all 2-locally constant functions $f$ on the shift such that all those isomorphisms defined on the system associated with $f$ are induced from automorphisms of the shift. We prove that this set contains a full-measure open set of the space of all 2-locally constant functions on the shift. We apply this result to rigidity problems of entropy spectra and show that the strong non-rigidity occurs if and only if so does the weak non-rigidity.


title: Nodal solutions for singular semilinear elliptic systems

abstract: n this paper, we prove existence of nodal solutions for singular semilinear elliptic systems without variational structure where its both components are of sign changing. Our approach is based on sub-supersolutions method combined with perturbation arguments involving singular terms.


title: Asset Prices with Investor Protection and Survival Analysis of Shareholders in the Cross-Sectional Economy

abstract: In this paper, we consider a dynamic asset pricing model in a cross-sectional economy with two firms where a controlling shareholder cannot divert output in one firm with perfect investor protection for minority shareholders and where he can divert a fraction of output in the other firm with imperfect protection. After obtaining the parameters of asset prices by solving the shareholders' consumption-portfolio problems in equilibrium, our model features the effect of investor protection and cross-section in the economy. Furthermore, some survival analysis of the shareholders is presented and sufficient conditions on extinction of the shareholders are given in either firm. Our numerical results are in line with some empirical evidence: (i) poorer investor protection in the cross-sectional economy enables the controlling shareholder to hold less shares of the firm with perfect protection and more shares of the firm with imperfect protection, decreases stock gross returns of both firms, increases stock volatilities of both firms, and decreases interest rates of the economy; (ii) compared with the economy with the single relative firm, for the firm with perfect protection, cross-section enables the controlling shareholder to hold less shares, decreases stock returns, increases stock volatilities slightly and decreases interest rates, while for the firm with imperfect protection, cross-section enables the controlling shareholder to hold more shares, increases stock returns and volatilities and increases interest rates.


title: Dynamic Forecasting of Conversation Derailment

abstract: Online conversations can sometimes take a turn for the worse, either due to systematic cultural differences, accidental misunderstandings, or mere malice. Automatically forecasting derailment in public online conversations provides an opportunity to take early action to moderate it. Previous work in this space is limited, and we extend it in several ways. We apply a pretrained language encoder to the task, which outperforms earlier approaches. We further experiment with shifting the training paradigm for the task from a static to a dynamic one to increase the forecast horizon. This approach shows mixed results: in a high-quality data setting, a longer average forecast horizon can be achieved at the cost of a small drop in F1; in a low-quality data setting, however, dynamic training propagates the noise and is highly detrimental to performance.


title: The response of a bistable energy harvester to different excitations: the harvesting efficiency and links with stochastic and vibrational resonances

abstract: Energy harvesting of ambient vibrations using a combination of a mechanical structure (oscillator) and an electrical transducer has become a valuable technique for powering small wireless sensors. Bistable mechanical oscillators have recently attracted the attention of researchers as they can be used to harvest energy within a wider band of frequencies. In this manuscript, the response of a bistable harvester to different forms of ambient vibration is analysed. In particular, harmonic noise, which has a narrow spectrum, similarly to harmonic signals, yet is stochastic, like broad-spectrum white noise, is considered. Links between bistable harvester responses and stochastic and vibrational resonance are explored.


title: Learning High-Speed Flight in the Wild

abstract: Quadrotors are agile. Unlike most other machines, they can traverse extremely complex environments at high speeds. To date, only expert human pilots have been able to fully exploit their capabilities. Autonomous operation with on-board sensing and computation has been limited to low speeds. State-of-the-art methods generally separate the navigation problem into subtasks: sensing, mapping, and planning. While this approach has proven successful at low speeds, the separation it builds upon can be problematic for high-speed navigation in cluttered environments. Indeed, the subtasks are executed sequentially, leading to increased processing latency and a compounding of errors through the pipeline. Here we propose an end-to-end approach that can autonomously fly quadrotors through complex natural and man-made environments at high speeds, with purely onboard sensing and computation. The key principle is to directly map noisy sensory observations to collision-free trajectories in a receding-horizon fashion. This direct mapping drastically reduces processing latency and increases robustness to noisy and incomplete perception. The sensorimotor mapping is performed by a convolutional network that is trained exclusively in simulation via privileged learning: imitating an expert with access to privileged information. By simulating realistic sensor noise, our approach achieves zero-shot transfer from simulation to challenging real-world environments that were never experienced during training: dense forests, snow-covered terrain, derailed trains, and collapsed buildings. Our work demonstrates that end-to-end policies trained in simulation enable high-speed autonomous flight through challenging environments, outperforming traditional obstacle avoidance pipelines.


title: Higher topological complexity of hyperbolic groups

abstract: We prove for non-elementary torsion-free hyperbolic groups $\Gamma$ and all $r\ge 2$ that the higher topological complexity ${\sf{TC}}_r(\Gamma)$ is equal to $r\cdot \mathrm{cd}(\Gamma)$. In particular, hyperbolic groups satisfy the rationality conjecture on the $\sf{TC}$-generating function, giving an affirmative answer to a question of Farber and Oprea. More generally, we consider certain toral relatively hyperbolic groups.


title: A Comprehensive Comparison of Word Embeddings in Event & Entity Coreference Resolution

abstract: Coreference Resolution is an important NLP task and most state-of-the-art methods rely on word embeddings for word representation. However, one issue that has been largely overlooked in literature is that of comparing the performance of different embeddings across and within families in this task. Therefore, we frame our study in the context of Event and Entity Coreference Resolution (EvCR & EnCR), and address two questions : 1) Is there a trade-off between performance (predictive & run-time) and embedding size? 2) How do the embeddings' performance compare within and across families? Our experiments reveal several interesting findings. First, we observe diminishing returns in performance with respect to embedding size. E.g. a model using solely a character embedding achieves 86% of the performance of the largest model (Elmo, GloVe, Character) while being 1.2% of its size. Second, the larger model using multiple embeddings learns faster overall despite being slower per epoch. However, it is still slower at test time. Finally, Elmo performs best on both EvCR and EnCR, while GloVe and FastText perform best in EvCR and EnCR respectively.


title: Towards Explainable Real Estate Valuation via Evolutionary Algorithms

abstract: Human lives are increasingly influenced by algorithms, which therefore need to meet higher standards not only in accuracy but also with respect to explainability. This is especially true for high-stakes areas such as real estate valuation. Unfortunately, the methods applied there often exhibit a trade-off between accuracy and explainability. One explainable approach is case-based reasoning (CBR), where each decision is supported by specific previous cases. However, such methods can be wanting in accuracy. The unexplainable machine learning approaches are often observed to provide higher accuracy but are not scrutable in their decision-making. In this paper, we apply evolutionary algorithms (EAs) to CBR predictors in order to improve their performance. In particular, we deploy EAs to the similarity functions (used in CBR to find comparable cases), which are fitted to the data set at hand. As a consequence, we achieve higher accuracy than state-of-the-art deep neural networks (DNNs), while keeping interpretability and explainability. These results stem from our empirical evaluation on a large data set of real estate offers where we compare known similarity functions, their EA-improved counterparts, and DNNs. Surprisingly, DNNs are only on par with standard CBR techniques. However, using EA-learned similarity functions does yield an improved performance.


title: Adaptation to Inexactness for some Gradient-type Methods

abstract: We introduce a notion of inexact model of a convex objective function, which allows for errors both in the function and in its gradient. For this situation, a gradient method with an adaptive adjustment of some parameters of the model is proposed and an estimate for the convergence rate is found. This estimate is optimal on a class of sufficiently smooth problems in the presence of errors. We consider a special class of convex nonsmooth optimization problems. In order to apply the proposed technique to this class, an artificial error should be introduced. We show that the method can be modified for such problems to guarantee a convergence in the function with a nearly optimal rate on the class of convex nonsmooth optimization problems. An adaptive gradient method is proposed for objective functions with some relaxation of the Lipschitz condition for the gradient that satisfy the Polyak--Lojasievicz gradient dominance condition. Here, the objective function and its gradient can be given inexactly. The adaptive choice of the parameters is performed during the operation of the method with respect to both the Lipschitz constant of the gradient and a value corresponding to the error of the gradient and the objective function. The linear convergence of the method is justified up to a value associated with the errors.


title: Confidential Token-Based License Management

abstract: In a global economy with many competitive participants, licensing and tracking of 3D printed parts is desirable if not mandatory for many use-cases. We investigate a blockchain-based approach, as blockchains provide many attractive features, like decentralized architecture and high security assurances. An often neglected aspect of the product life-cycle management is the confidentiality of transactions to hide valuable business information from competitors. To solve the combined problem of trust and confidentiality, we present a confidential licensing and tracking system which works on any publicly verifiable, token-based blockchain that supports tokens of different types representing licenses or attributes of parts. Together with the secure integration of a unique eID in each part, our system provides an efficient, immutable and authenticated transaction log scalable to thousands of transactions per second. With our confidential Token-Based License Management system (cTLM), large industries such as automotive or aviation can license and trace all parts confidentially.


title: An automated threshold Edge Drawing algorithm

abstract: Parameter choosing in classical edge detection algorithms can be a costly and complex task. Choosing the correct parameters can improve considerably the resulting edge-map. In this paper we present a version of Edge Drawing algorithm in which we include an automated threshold choosing step. To better highlight the effect of this additional step we use different first order operators in the algorithm. Visual and statistical results are presented to sustain the benefits of the proposed automated threshold scheme.


title: Approaching Thouless Energy and Griffiths Regime in Random Spin Systems By Singular Value Decomposition

abstract: We employ singular value decomposition (SVD) to study the eigenvalue spectra of random spin systems. By SVD, eigenvalue spectrum is decomposed into orthonormal modes $W_k$ with weight $\lambda_k$. We show that the scree plot ($\lambda_k$ with respect to $k$) in the ergodic phase contains two branches that both follow power-law $\lambda_k\sim k^{-\alpha}$ but with different exponents $\alpha$. By evaluating $W_k$, it's verified the part of $\lambda_k $ with $k>k_{\text{Th}}$ is universal that follows random matrix theory, where $k_{\text{Th}}$ is related to the Thouless energy. We further demonstrate that $\alpha$ corresponds only to the exponential part of the level spacing distribution while being insensitive to the level repulsion, or equivalently the system's symmetry. Consequently, $\alpha$ gives an underestimation for the many-body localization transition point, which suggests a non-ergodic behavior that may be attributed to the Griffiths regime.


title: Non-linear density-velocity dynamics in $f(R)$ gravity from spherical collapse

abstract: We investigate the joint density-velocity evolution in $f(R)$ gravity using smooth, compensated spherical top-hats as a proxy for the non-linear regime. Using the Hu-Sawicki model as a working example, we solve the coupled continuity, Euler and Einstein equations using an iterative hybrid Lagrangian-Eulerian scheme. The novel aspect of this scheme is that the metric potentials are solved for analytically in the Eulerian frame. The evolution is assumed to follow GR at very early epochs and switches to $f(R)$ at a pre-determined epoch. Choosing the `switching epoch' too early is computationally expensive because of high frequency oscillations; choosing it too late potentially destroys consistency with $\Lambda$CDM. To make an informed choice, we perform an eigenvalue analysis of the background model which gives a ballpark estimate of the magnitude of oscillations. There are two length scales in the problem: the comoving Compton wavelength of the associated scalar field and the width of the top-hat. The evolution is determined by their ratio. When the ratio is large, the evolution is scale-independent and the density-velocity divergence relation (DVDR) is unique. When the ratio is small, the evolution is very close to GR, except for the formation of a spike near the top-hat edge, a feature which has been noted in earlier literature. We are able to qualitatively explain this feature in terms of the analytic solution for the metric potentials, in the absence of the chameleon mechanism. In the intermediate regime, the evolution is profile-dependent and no unique DVDR exists.


title: Pano-AVQA: Grounded Audio-Visual Question Answering on 360$^\circ$ Videos

abstract: 360$^\circ$ videos convey holistic views for the surroundings of a scene. It provides audio-visual cues beyond pre-determined normal field of views and displays distinctive spatial relations on a sphere. However, previous benchmark tasks for panoramic videos are still limited to evaluate the semantic understanding of audio-visual relationships or spherical spatial property in surroundings. We propose a novel benchmark named Pano-AVQA as a large-scale grounded audio-visual question answering dataset on panoramic videos. Using 5.4K 360$^\circ$ video clips harvested online, we collect two types of novel question-answer pairs with bounding-box grounding: spherical spatial relation QAs and audio-visual relation QAs. We train several transformer-based models from Pano-AVQA, where the results suggest that our proposed spherical spatial embeddings and multimodal training objectives fairly contribute to a better semantic understanding of the panoramic surroundings on the dataset.


title: Conditioned local limit theorems for random walks on the real line

abstract: Consider a random walk $S_n=\sum_{i=1}^n X_i$ with independent and identically distributed real-valued increments $X_i$ of zero mean and finite variance. Assume that $X_i$ is non-lattice and has a moment of order $2+\delta$. For any $x\geq 0$, let $\tau_x = \inf \left\{ k\geq 1: x+S_{k} < 0 \right\}$ be the first time when the random walk $x+S_n$ leaves the half-line $[0,\infty)$. We study the asymptotic behavior of the probability $\bb P (\tau_x >n)$ and that of the expectation $\mathbb{E} \left( f(x + S_n ), \tau_x > n \right)$ for a large class of target function $f$ and various values of $x$, $y$ possibly depending on $n$. This general setting implies limit theorems for the joint distribution $\mathbb{P} \left( x + S_n \in y+ [0, \Delta], \tau_x > n \right)$ where $\Delta>0$ may also depend on $n$. In particular, the case of moderate deviations $y=\sigma \sqrt{q n\log n}$ is considered. We also deduce some new asymptotics for random walks with drift and give explicit constants in the asymptotic of the probability $\bb P (\tau_x =n)$. For the proofs we establish new conditioned integral limit theorems with precise error terms.


title: Phase transition of Frustrated Ising model via D-wave Quantum Annealing Machine

abstract: We study the frustrated Ising model on the two-dimensional $L \times L$ square lattice with ferromagnetic (FM) nearest-neighbor and antiferromagnetic diagonal-neighbor interactions using the D-wave quantum annealing machine (D-QAM) with 5000+ qubits composed on structure of the Pegasus graph. As the former Monte Carlo and mean field results, we find the FM to stripe order phase transition, through observations of the magnetization $M$, energy, magnetic susceptibility and structure factor. We also analyze probability which occurs any $M$ at a given interaction for many quantum annealing shots to estimate the shape of objective function $f$. The only one value of $M$ with specific phase is observed in the regions far from phase transition for many quantum annealing shots, while several values of $M$ with different possibilities are appeared in the regimes of phase transition. We guess that $f$ in the regimes of phase transition retains the multi-modal structure with several local minimums, due to the strong degeneracies caused by frustrations. Finally, we discuss fail of the quantum annealing simulations, through analysis of the number of the chains, defined as the same variable with $N$-qubits, as a function of $L$.


title: Non-Parametric Neuro-Adaptive Coordination of Multi-Agent Systems

abstract: We develop a learning-based algorithm for the distributed formation control of networked multi-agent systems governed by unknown, nonlinear dynamics. Most existing algorithms either assume certain parametric forms for the unknown dynamic terms or resort to unnecessarily large control inputs in order to provide theoretical guarantees. The proposed algorithm avoids these drawbacks by integrating neural network-based learning with adaptive control in a two-step procedure. In the first step of the algorithm, each agent learns a controller, represented as a neural network, using training data that correspond to a collection of formation tasks and agent parameters. These parameters and tasks are derived by varying the nominal agent parameters and the formation specifications of the task in hand, respectively. In the second step of the algorithm, each agent incorporates the trained neural network into an online and adaptive control policy in such a way that the behavior of the multi-agent closed-loop system satisfies a user-defined formation task. Both the learning phase and the adaptive control policy are distributed, in the sense that each agent computes its own actions using only local information from its neighboring agents. The proposed algorithm does not use any a priori information on the agents' unknown dynamic terms or any approximation schemes. We provide formal theoretical guarantees on the achievement of the formation task.


title: Discrimination of coherent and incoherent cathodoluminescence using temporal photon correlations

abstract: We present a method to separate coherent and incoherent contributions of cathodoluminescence (CL) by using a time-resolved coincidence detection scheme. For a proof-of-concept experiment, we generate CL by irradiating an optical multimode fiber with relativistic electrons in a transmission electron microscope. A temporal analysis of the CL reveals a large peak in coincidence counts for small time delays, also known as photon bunching. Additional measurements allow us to attribute the bunching peak to the temporal correlations of coherent CL (Cherenkov radiation) created by individual electrons. Thereby, we show that coincidence measurements can be employed to discriminate coherent from incoherent CL and to quantify their contribution to the detected CL signal. This method provides additional information for the correct interpretation of CL, which is essential for material characterization. Furthermore, it might facilitate the study of coherent electron-matter interaction.


title: The Elastic Spiral Phase Pipe

abstract: We design a device for the passive mode conversion of guided, axisymmetric, ultrasonic waves in hollow elastic pipes into arbitrary non-axisymmetric flexural waves that have a constant angular profile along the pipe axis. To achieve this we create an elastic analogue to optical spiral phase plates - the elastic spiral phase pipe. Three possible configurations of the elastic spiral phase pipe are presented which allow the efficient generation of non-axisymmetric flexural waves from an axisymmetric, longitudinal forcing. The theory leverages the dispersive nature of the guided elastic waves that are supported in pipes through a defined relative refractive index. As such we include a spectral collocation method used to aid the design of the elastic spiral phase pipe that is corroborated with numerical simulations and then experimentally verified.


title: REIN-2: Giving Birth to Prepared Reinforcement Learning Agents Using Reinforcement Learning Agents

abstract: Deep Reinforcement Learning (Deep RL) has been in the spotlight for the past few years, due to its remarkable abilities to solve problems which were considered to be practically unsolvable using traditional Machine Learning methods. However, even state-of-the-art Deep RL algorithms have various weaknesses that prevent them from being used extensively within industry applications, with one such major weakness being their sample-inefficiency. In an effort to patch these issues, we integrated a meta-learning technique in order to shift the objective of learning to solve a task into the objective of learning how to learn to solve a task (or a set of tasks), which we empirically show that improves overall stability and performance of Deep RL algorithms. Our model, named REIN-2, is a meta-learning scheme formulated within the RL framework, the goal of which is to develop a meta-RL agent (meta-learner) that learns how to produce other RL agents (inner-learners) that are capable of solving given environments. For this task, we convert the typical interaction of an RL agent with the environment into a new, single environment for the meta-learner to interact with. Compared to traditional state-of-the-art Deep RL algorithms, experimental results show remarkable performance of our model in popular OpenAI Gym environments in terms of scoring and sample efficiency, including the Mountain Car hard-exploration environment.


title: Adaptive F-FFT Demodulation for ICI Mitigation in Differential Underwater Acoustic OFDM Systems

abstract: This paper addresses the problem of frequency-domain inter-carrier interference (ICI) mitigation for differential orthogonal frequency-division multiplexing (OFDM) systems. The classical fractional fast Fourier transform (F-FFT), adopting the fixed sampling interval, would suffer from the limited accuracy of ICI mitigation and low adaptability in dynamic Doppler spread. To target the above challenges, we propose an adaptive fractional Fourier transform (A-FFT) demodulation method, in which an estimation algorithm based on the coordinate descent approach is designed to compute the fiducial frequency offset without increasing pilots. By means of compensating ICI at fractions of the fiducial frequency offset adapted to the time-varying Doppler shift, the A-FFT has the capability of tracking Doppler fluctuations over the underwater acoustic channels, thus extending the application range of frequency-domain ICI mitigation. Simulation results show that the A-FFT is significantly superior to the existing classical methods, the partial fast Fourier transform (P-FFT) and the F-FFT, for both medium and high Doppler factors and large carrier numbers in terms of the mean squared error (MSE). Numerically, the MSE of the A-FFT is reduced by $\bf{39.88\%-72.14\%}$ compared to that of the F-FFT with the input signal-to-noise ratio ranging from 10 dB to 30 dB at a Doppler factor of $\bf{2.5\times 10^{-4}}$ and a carrier number of 1024, while the P-FFT even cannot work well.


title: New construction of nine-qubit error-correcting code

abstract: We report new construction of nine-qubit error-correcting code, which introduces two new nine-qubit codes and one new three-qubit code. Because both the new two nine-qubit codes have the normal logical operators, as opposed to the nine-qubit Shor code, it results in different performance when the three codes are applied in concatenated quantum error-correction. On the other hand, one of the two nine-qubit codes has the same stabilizer generators as the nine-qubit Shor code, they are more suitable for the high-wight bit-flip noise, and the other code has the different stabilizer generators, which is more suitable for the high-wight phase-flip noise. This work is enlightening to the construction of quantum error-correcting codes, and adds more options for optimizing the performance of quantum error-correction.


title: Bismut-Stroock Hessian formulas and local Hessian estimates for heat semigroups and harmonic functions on Riemannian manifolds

abstract: In this article, we develop a martingale approach to localized Bismut-type Hessian formulas for heat semigroups on Riemannian manifolds. Our approach extends the Hessian formulas established by Stroock (1996) and removes in particular the compact manifold restriction. To demonstrate the potential of these formulas, we give as application explicit quantitative local estimates for the Hessian of the heat semigroup, as well as for harmonic functions on regular domains in Riemannian manifolds.


title: The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose Estimation

abstract: We introduce CenterGroup, an attention-based framework to estimate human poses from a set of identity-agnostic keypoints and person center predictions in an image. Our approach uses a transformer to obtain context-aware embeddings for all detected keypoints and centers and then applies multi-head attention to directly group joints into their corresponding person centers. While most bottom-up methods rely on non-learnable clustering at inference, CenterGroup uses a fully differentiable attention mechanism that we train end-to-end together with our keypoint detector. As a result, our method obtains state-of-the-art performance with up to 2.5x faster inference time than competing bottom-up methods. Our code is available at https://github.com/dvl-tum/center-group .


title: Offensive Language Detection with BERT-based models, By Customizing Attention Probabilities

abstract: This paper describes a novel study on using `Attention Mask' input in transformers and using this approach for detecting offensive content in both English and Persian languages. The paper's principal focus is to suggest a methodology to enhance the performance of the BERT-based models on the `Offensive Language Detection' task. Therefore, we customize attention probabilities by changing the `Attention Mask' input to create more efficacious word embeddings. To do this, we firstly tokenize the training set of the exploited datasets (by BERT tokenizer). Then, we apply Multinomial Naive Bayes to map these tokens to two probabilities. These probabilities indicate the likelihood of making a text non-offensive or offensive, provided that it contains that token. Afterwards, we use these probabilities to define a new term, namely Offensive Score. Next, we create two separate (because of the differences in the types of the employed datasets) equations based on Offensive Scores for each language to re-distribute the `Attention Mask' input for paying more attention to more offensive phrases. Eventually, we put the F1-macro score as our evaluation metric and fine-tune several combinations of BERT with ANNs, CNNs and RNNs to examine the effect of using this methodology on various combinations. The results indicate that all models will enhance with this methodology. The most improvement was 2% and 10% for English and Persian languages, respectively.


title: Probing the Gluon Plasma with Charm Balance Functions

abstract: Recent theoretical explanations for how hydrodynamic-like flow can build up quickly in small collision systems (hydrodynamization) has led to a microscopic picture of flow building up in a gluon-dominated phase before chemical equilibrium between quarks and gluons has been attained. The goal of this contribution to Offshell-2021 is to explore consequence of assuming a long-lived gluon-dominated phase, which we shall denote a gluon plasma (GP). As these consequences are naturally enhanced in a large systems, we assume and explore the extreme scenario in which a GP would be created in AA collisions and exist for significant time before the formation of a chemically-equilibrated quark-gluon plasma (QGP). The GP and its formation would be impossible to probe with light-quark hadrons, which are first produced later in this scenario. As charm quarks are produced early in the collision, they can circumvent the limitations of light quarks and we propose charm balance functions as an effective tool to test this idea and constrain the dynamics of the GP.


title: Dark gravitomagnetism with LISA and gravitational waves space detectors

abstract: We present here the proposal to use the LISA interferometer for detecting the gravito-magnetic field due to the rotation of the Milky Way, including the contribution given by the dark matter halo. The galactic signal would be superposed to the gravitomagnetic field of the Sun. The technique to be used is based on the asymmetric propagation of light along the closed contour of the space interferometer (Sagnac-like approach). Both principle and practical aspects of the proposed experiment are discussed. The strategy for disentangling the sought for signal from the kinematic terms due to proper rotation and orbital motion is based on the time modulation of the time of flight asymmetry. Such modulation will be originated by the annual oscillation of the plane of the interferometer with respect to the galactic plane. Also the effect of the gravitomagnetic field on the polarization of the electromagnetic signals is presented as an in principle detectable phenomenon.


title: Spin pumping at terahertz nutation resonances

abstract: We investigate spin pumping current injected by the nutation resonances of a ferromagnet or an antiferromagnet into an adjacent metal. Comparing the dc spin pumping current between the normal precession and nutation resonances, we find that the ratio of spin pumping current at the nutation resonance to the precession resonance is more pronounced in antiferromagnets. We further show that the spin pumping current injected by the nutation resonance is opposite in sign as compared to the normal precession mode. This could offer a useful experimental signature for identifying such nutation resonances. Analyzing the nature of the nutational eigenmodes, we show that the sign change in spin current is rooted in a reversal of the precession sense for the nutation mode(s). Furthermore, the nutational modes in antiferromagnets are found to be dominated by precession of one of the two sublattices only.


title: Sobolev-to-Lipschitz Property on QCD-spaces and Applications

abstract: We prove the Sobolev-to-Lipschitz property for metric measure spaces satisfying the quasi curvature dimension condition recently introduced in E. Milman, The Quasi Curvature-Dimension Condition with applications to sub-Riemannian manifolds, Comm. Pure Appl. Math. (to appear, arXiv:1908.01513v5). We provide several applications to properties of the corresponding heat semigroup. In particular, under the additional assumption of infinitesimal Hilbertianity, we show the Varadhan short-time asymptotics for the heat semigroup with respect to the distance, and prove the irreducibility of the heat semigroup. These result apply in particular to large classes of (ideal) sub-Riemannian manifolds.


title: A theorem of Retakh for exact $\infty$-categories and higher extension functors

abstract: We define extension $\infty$-categories for exact $\infty$-categories in terms of bifibrations. Extension $\infty$-categories are invariant when passing to the stable hull, and consequently we show that they form an $\Omega$-spectrum, generalizing a theorem of Retakh. Finally, we show that the homotopy groups of extension $\infty$-categories are naturally isomorphic to the higher extension groups of the extriangulated category given by the homotopy category.


title: Role of assortativity in predicting burst synchronization using echo state network

abstract: In this study, we use a reservoir computing based echo state network (ESN) to predict the collective burst synchronization of neurons. Specifically, we investigate the ability of ESN in predicting the burst synchronization of an ensemble of Rulkov neurons placed on a scale-free network. We have shown that a limited number of nodal dynamics used as input in the machine can capture the real trend of burst synchronization in this network. Further, we investigate on the proper selection of nodal inputs of degree-degree (positive and negative) correlated networks. We show that for a disassortative network, selection of different input nodes based on degree has no significant role in machine's prediction. However, in the case of assortative network, training the machine with the information (i.e time series) of low-degree nodes gives better results in predicting the burst synchronization. Finally, we explain the underlying mechanism responsible for observing this differences in prediction in a degree correlated network.


title: Characterisation of analogue front end and time walk in CMOS active pixel sensor

abstract: In this work we investigated a method to determine time walk in an active silicon pixel sensor prototype using Edge-TCT with infrared laser charge injection. Samples were investigated before and after neutron irradiation to 5e14 neq/cm2. Threshold, noise and calibration of the analogue front end were determined with external charge injection. A spatially sensitive measurement of collected charge and time walk was carried out with Edge-TCT, showing a uniform charge collection and output delay in pixel centre. On pixel edges charge sharing was observed due to finite beam width resulting in smaller signals and larger output delay. Time walk below 25 ns was observed for charge above 2000 electrons at a threshold above the noise level. Time walk measurement with external charge injection yielded identical results.


title: Manin triples and non-degenerate anti-symmetric bilinear forms on Lie superalgebras in characteristic $2$

abstract: In this paper, we introduce and develop the notion of a Manin triple for a Lie superalgebra $\mathfrak g$ defined over a field of characteristic $p=2$. We find cohomological necessary conditions for the pair $(\mathfrak g, \mathfrak g^*)$ to form a Manin triple. We introduce the concept of Lie bi-superalgebras for $p=2$ and establish a link between Manin triples and Lie bi-superalgebras. In particular, we study Manin triples defined by a classical $r$-matrix with an extra condition (called an admissible classical $r$-matrix). A particular case is examined where $\mathfrak g$ has an even invariant non-degenerate bilinear form. In this case, admissible $r$-matrices can be obtained inductively through the process of double extensions. In addition, we introduce the notion of double extensions of Manin triples, and show how to get a new Manin triple from an existing one.


title: Piecewise Interpretable Hilbert Spaces

abstract: We study Hilbert spaces $H$ interpreted, in an appropriate sense, in a first-order theory. Under a new finiteness hypothesis that we call {\em scatteredness} we prove that $H$ is a direct sum of {\em asymptotically free} components, where short-range interactions are controlled by algebraic closure and long-range interactions vanish. Examples include $L^2$-spaces relative to Macpherson-Steinhorn definable measures; $L^2$ spaces relative to the Haar measure of the absolute Galois groups; irreducible unitary representations of $p$-adic Lie groups; and unitary representations of the automorphism group of an $\omega$-categorical theory. In the last case, our main result specialises to a theorem of Tsankov. New methods are required, making essential use of local stability theory in continuous logic.


title: $4\pi$-periodic supercurrent tuned by an axial magnetic flux in topological insulator nanowires

abstract: Topological insulator (TI) nanowires in proximity with conventional superconductors have been proposed as a tunable platform to realize topological superconductivity and Majorana zero modes (MZM). The tuning is done using an axial magnetic flux $\Phi$ which allows transforming the system from trivial at $\Phi=0$ to topologically nontrivial when half a magnetic flux quantum $\Phi_0/2$ threads the wire's cross-section. Here we explore the expected topological transition in TI-wire-based Josephson junctions as a function of magnetic flux by probing the $4\pi$-periodic fraction of the supercurrent, which is considered as an indicator of topological superconductivity. Our data suggest that this $4\pi$-periodic supercurrent is at lower magnetic field largely of trivial origin, but that at magnetic fields above $\sim\Phi_{0}/4$ topological $4\pi$-periodic supercurrents take over.


title: AWEU-Net: An Attention-Aware Weight Excitation U-Net for Lung Nodule Segmentation

abstract: Lung cancer is deadly cancer that causes millions of deaths every year around the world. Accurate lung nodule detection and segmentation in computed tomography (CT) images is the most important part of diagnosing lung cancer in the early stage. Most of the existing systems are semi-automated and need to manually select the lung and nodules regions to perform the segmentation task. To address these challenges, we proposed a fully automated end-to-end lung nodule detection and segmentation system based on a deep learning approach. In this paper, we used Optimized Faster R-CNN; a state-of-the-art detection model to detect the lung nodule regions in the CT scans. Furthermore, we proposed an attention-aware weight excitation U-Net, called AWEU-Net, for lung nodule segmentation and boundaries detection. To achieve more accurate nodule segmentation, in AWEU-Net, we proposed position attention-aware weight excitation (PAWE), and channel attention-aware weight excitation (CAWE) blocks to highlight the best aligned spatial and channel features in the input feature maps. The experimental results demonstrate that our proposed model yields a Dice score of 89.79% and 90.35%, and an intersection over union (IoU) of 82.34% and 83.21% on the publicly LUNA16 and LIDC-IDRI datasets, respectively.


title: Sim2Air - Synthetic aerial dataset for UAV monitoring

abstract: In this paper we propose a novel approach to generate a synthetic aerial dataset for application in UAV monitoring. We propose to accentuate shape-based object representation by applying texture randomization. A diverse dataset with photorealism in all parameters such as shape, pose, lighting, scale, viewpoint, etc. except for atypical textures is created in a 3D modelling software Blender. Our approach specifically targets two conditions in aerial images where texture of objects is difficult to detect, namely challenging illumination and objects occupying only a small portion of the image. Experimental evaluation of YOLO and Faster R-CNN detectors trained on synthetic data with randomized textures confirmed our approach by increasing the mAP value (17 and 3.7 percentage points for YOLO; 20 and 1.1 percentage points for Faster R-CNN) on two test datasets of real images, both containing UAV-to-UAV images with motion blur. Testing on different domains, we conclude that the more the generalisation ability is put to the test, the more apparent are the advantages of the shape-based representation.


title: ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentation

abstract: Video-text retrieval has many real-world applications such as media analytics, surveillance, and robotics. This paper presents the 1st place solution to the video retrieval track of the ICCV VALUE Challenge 2021. We present a simple yet effective approach to jointly tackle two video-text retrieval tasks (video retrieval and video corpus moment retrieval) by leveraging the model trained only on the video retrieval task. In addition, we create an ensemble model that achieves the new state-of-the-art performance on all four datasets (TVr, How2r, YouCook2r, and VATEXr) presented in the VALUE Challenge.


title: Tracy-Widom limit for free sum of random matrices

abstract: We consider fluctuations of the largest eigenvalues of the random matrix model $A+UBU^{*}$ where $A$ and $B$ are $N \times N$ deterministic Hermitian (or symmetric) matrices and $U$ is a Haar-distributed unitary (or orthogonal) matrix. We prove that the largest eigenvalue weakly converges to the Tracy-Widom distribution, under mild assumptions on $A$ and $B$ to guarantee that the density of states of the model decays as square root around the upper edge. Our proof is based on the comparison of the Green function along the Dyson Brownian motion starting from the matrix $A + UBU^{*}$ and ending at time $N^{-1/3+\chi}$. As a byproduct of our proof, we also prove an optimal local law for the Dyson Brownian motion up to the constant time scale.


title: Service Scheduling for Random Requests with Fixed Waiting Costs

abstract: We study service scheduling problems in a slotted system in which agents arrive with service requests according to a Bernoulli process and have to leave within two slots after arrival, service costs are quadratic in service rates, and there are also waiting costs. We consider fixed waiting costs. We frame the problems as average cost Markov decision processes. While the studied system is a linear system with quadratic costs, it has state dependent control. Moreover, it also possesses a non-standard cost function structure in the case of fixed waiting costs, rendering the optimization problem complex. Here, we characterize optimal policy. We also consider a system in which the agents make scheduling decisions for their respective service requests keeping their own cost in view. We again consider fixed waiting costs and frame this scheduling problem as a stochastic game. Here, we provide Nash equilibrium.


title: Phonon-induced magnetoresistivity of Weyl semimetal nanowires

abstract: We study longitudinal magnetotransport in disorder-free cylindrical Weyl semimetal nanowires. Our theory includes a magnetic flux $\Phi$ piercing the nanowire and captures the finite curvature of the Fermi arc in the surface Brillouin zone through a boundary angle $\alpha$. Electron backscattering by acoustic phonons via the deformation potential causes a finite resistivity which we evaluate by means of the semiclassical Boltzmann approach. We find that low-energy transport is dominated by surface states, where transport observables are highly sensitive to the angle $\alpha$ and to Aharonov-Bohm phases due to $\Phi$. A generic subband dispersion relation allows for either one or two pairs of Fermi points. In the latter case, intra-node backscattering is possible and implies a parametrically larger resistivity than for a single Fermi point pair. As a consequence, large and abrupt resistivity changes take place across the transition points separating parameter regions with a different number of Fermi point pairs in a given subband.


title: Human Values in Mobile App Development: An Empirical Study on Bangladeshi Agriculture Mobile Apps

abstract: Given the ubiquity of mobile applications (apps) in daily lives, understanding and reflecting end-users' human values (e.g., transparency, privacy, social recognition etc.) in apps has become increasingly important. Violations of end users' values by software applications have been reported in the media and have resulted in a wide range of difficulties for end users. Value violations may bring more and lasting problems for marginalized and vulnerable groups of end-users. This research aims to understand the extent to which the values of Bangladeshi female farmers, marginalized and vulnerable end-users, who are less studied by the software engineering community, are reflected in agriculture apps in Bangladesh. Further to this, we aim to identify possible strategies to embed their values in those apps. To this end, we conducted a mixed-methods empirical study consisting of 13 interviews with app practitioners and four focus groups with 20 Bangladeshi female farmers. The accumulated results from the interviews and focus groups identified 22 values of Bangladeshi female farmers, which the participants expect to be reflected in the agriculture apps. Among these 22 values, 15 values (e.g., accuracy, independence) are already reflected and 7 values (e.g., accessibility, pleasure) are ignored/violated in the existing agriculture apps. We also identified 14 strategies (e.g., "applying human-centered approaches to elicit values", "establishing a dedicated team/person for values concerns") to address Bangladeshi female farmers' values in agriculture apps.


title: WeTS: A Benchmark for Translation Suggestion

abstract: Translation Suggestion (TS), which provides alternatives for specific words or phrases given the entire documents translated by machine translation (MT) \cite{lee2021intellicat}, has been proven to play a significant role in post editing (PE). However, there is still no publicly available data set to support in-depth research for this problem, and no reproducible experimental results can be followed by researchers in this community. To break this limitation, we create a benchmark data set for TS, called \emph{WeTS}, which contains golden corpus annotated by expert translators on four translation directions. Apart from the human-annotated golden corpus, we also propose several novel methods to generate synthetic corpus which can substantially improve the performance of TS. With the corpus we construct, we introduce the Transformer-based model for TS, and experimental results show that our model achieves State-Of-The-Art (SOTA) results on all four translation directions, including English-to-German, German-to-English, Chinese-to-English and English-to-Chinese. Codes and corpus can be found at https://github.com/ZhenYangIACAS/WeTS.git.


title: Underwater Focussing of Sound by Umklapp Diffraction

abstract: Scholte modes that are localized between a submerged axisymmetric-structured elastic plate and surrounding fluid can undergo mode conversion via Umklapp diffraction into radiative modes; this radiative response is verified by experiments that show focussing of underwater sound across a broad range of frequencies. The diffracted beams, that form a cone, are engineered to exist at a desired spatial position, associated with an abrupt change in the patterning of the plate. These structures take the form of grooves present only on one side of the plate, yet the focussing phenomena is achieved on both sides, even as viewed from the flat surface.


title: Decentralized sliding-mode control laws for the bearing-based formation tracking problem

abstract: This paper studies the time-varying bearing-based tracking of leader-follower formations. The desired constraints between agents are specified by bearing vectors, and several leaders are moving with a bounded reference velocity. Each followers can measure the relative positions of its neighbors, its own velocities, and receive information from their neighbors. Under the assumptions that the desired formation is infinitesimally bearing rigid and the local reference frames of followers are aligned with each other, two control laws are presented in this paper based on sliding mode control approach. Stability analyses are given based on Lyapunov stability theory and supported by numerical simulations.


title: Privacy preserving local analysis of digital trace data: A proof-of-concept

abstract: We present PORT, a software platform for local data extraction and analysis of digital trace data. While digital trace data collected by private and public parties hold a huge potential for social-scientific discovery, their most useful parts have been unattainable for academic researchers due to privacy concerns and prohibitive API access. However, the EU General Data Protection Regulation (GDPR) grants all citizens the right to an electronic copy of their personal data. All major data controllers, such as social media platforms, banks, online shops, loyalty card systems and public transportation cards comply with this right by providing their clients with a `Data Download Package' (DDP). Previously, a conceptual workflow was introduced allowing citizens to donate their data to scientific- researchers. In this workflow, citizens' DDPs are processed locally on their machines before they are asked to provide informed consent to share a subset of the processed data with the researchers. In this paper, we present the newly developed software PORT that implements the local processing part of this workflow, protecting privacy by shielding sensitive data from any contact with outside observers -- including the researchers themselves. Thus, PORT enables a host of potential applications of social data science to hitherto unobtainable data.


title: Observation of a structure in the M$_{p\eta}$ invariant mass distribution near 1700 MeV/$c^2$ in the $\mathbf{\gamma p \rightarrow p \pi^0 \eta} $ reaction

abstract: The reaction $\gamma p \rightarrow p \pi^0 \eta$ has been studied with the CBELSA/TAPS detector at the electron stretcher accelerator ELSA in Bonn for incident photon energies from threshold up to 3.1 GeV. This paper has been motivated by the recently claimed observation of a narrow structure in the M$_{N\eta}$ invariant mass distribution at a mass of 1678 MeV/$c^2$. The existence of this structure cannot be confirmed in the present work. Instead, for E$_{\gamma}$ = 1400 - 1500 MeV and the cut M$_{p\pi^0} \le 1190 $ MeV/$c^2$ a statistically significant structure in the M$_{p\eta}$ invariant mass distribution near 1700 MeV/$c^2$ is observed with a width of $\Gamma\approx 35$ MeV/$c^2$ while the mass resolution is $\sigma_{res}$ = 5 MeV/$c^2$. Increasing the incident photon energy from 1420 to 1540 MeV this structure shifts in mass from $\approx$ 1700MeV/c$^2$ to $\approx$ 1725 MeV/$c^2$; the width increases to about 50 MeV/$c^2$ and decreases thereafter. The cross section associated with this structure reaches a maximum of $\approx$ 100 nb around E$_{\gamma} \approx$ 1490 MeV (W $\approx $ 1920 MeV), which coincides with the $p a_0$ threshold. Three scenarios are discussed which might be the origin of this structure in the M$_{p\eta}$ invariant mass distribution. The most likely interpretation is that it is due to a triangular singularity in the $\gamma p \rightarrow p a_0 \rightarrow p \pi^0 \eta$ reaction


title: Beyond Desktop Computation: Challenges in Scaling a GPU Infrastructure

abstract: Enterprises and labs performing computationally expensive data science applications sooner or later face the problem of scale but unconnected infrastructure. For this up-scaling process, an IT service provider can be hired or in-house personnel can attempt to implement a software stack. The first option can be quite expensive if it is just about connecting several machines. For the latter option often experience is missing with the data science staff in order to navigate through the software jungle. In this technical report, we illustrate the decision process towards an on-premises infrastructure, our implemented system architecture, and the transformation of the software stack towards a scaleable GPU cluster system.


title: Measurements of inclusive photons at forward rapidities in p-Pb collisions at $\sqrt{s\rm_{NN}}$ = 5.02 TeV with ALICE

abstract: We present multiplicity and pseudorapidity distributions of inclusive photons at forward rapidity in proton-lead (p-Pb) collisions at $\sqrt{s\rm_{NN}}$ = 5.02 TeV using the data obtained from Photon Multiplicity Detector (PMD) of ALICE. The centrality dependence of pseudorapidity distributions of inclusive photons is also studied. Results are compared with the previous ALICE measurements of charged-particle production and with theoretical predictions from Monte Carlo models, DPMJET and HIJING.


title: Can the brain use waves to solve planning problems?

abstract: A variety of behaviors like spatial navigation or bodily motion can be formulated as graph traversal problems through cognitive maps. We present a neural network model which can solve such tasks and is compatible with a broad range of empirical findings about the mammalian neocortex and hippocampus. The neurons and synaptic connections in the model represent structures that can result from self-organization into a cognitive map via Hebbian learning, i.e. into a graph in which each neuron represents a point of some abstract task-relevant manifold and the recurrent connections encode a distance metric on the manifold. Graph traversal problems are solved by wave-like activation patterns which travel through the recurrent network and guide a localized peak of activity onto a path from some starting position to a target state.


title: Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking

abstract: On the way towards general Visual Question Answering (VQA) systems that are able to answer arbitrary questions, the need arises for evaluation beyond single-metric leaderboards for specific datasets. To this end, we propose a browser-based benchmarking tool for researchers and challenge organizers, with an API for easy integration of new models and datasets to keep up with the fast-changing landscape of VQA. Our tool helps test generalization capabilities of models across multiple datasets, evaluating not just accuracy, but also performance in more realistic real-world scenarios such as robustness to input noise. Additionally, we include metrics that measure biases and uncertainty, to further explain model behavior. Interactive filtering facilitates discovery of problematic behavior, down to the data sample level. As proof of concept, we perform a case study on four models. We find that state-of-the-art VQA models are optimized for specific tasks or datasets, but fail to generalize even to other in-domain test sets, for example they cannot recognize text in images. Our metrics allow us to quantify which image and question embeddings provide most robustness to a model. All code is publicly available.


title: Spoki: Unveiling a New Wave of Scanners through a Reactive Network Telescope

abstract: Large-scale Internet scans are a common method to identify victims of a specific attack. Stateless scanning like in ZMap has been established as an efficient approach to probing at Internet scale. Stateless scans, however, need a second phase to perform the attack, which remains invisible to network telescopes that only capture the first incoming packet and is not observed as a related event by honeypots. In this work, we examine Internet-wide scan traffic through Spoki, a reactive network telescope operating in real-time that we design and implement. Spoki responds to asynchronous TCP SYN packets and engages in TCP handshakes initiated in the second phase of two-phase scans. Because it is extremely lightweight it scales to large prefixes where it has the unique opportunity to record the first data sequence submitted within the TCP handshake ACK. We analyze two-phase scanners during a three months period using globally deployed Spoki reactive telescopes as well as flow data sets from IXPs and ISPs. We find that a predominant fraction of TCP SYNs on the Internet has irregular characteristics. Our findings also provide a clear signature of today's scans as: (i) highly targeted, (ii) scanning activities notably vary between regional vantage points, and (iii) a significant share originates from malicious sources.


title: Second Hankel determinant of logarithmic coefficients of certain analytic functions

abstract: We consider a family of all analytic and univalent functions (i.e., one-to-one) in the unit disk $\mathbb{D}:=\{z\in \mathbb{C}:|z|<1\}$ of the form $f(z)=z+a_2z^2+a_3z^3+\cdots$. In this paper, we obtain the sharp bounds of the second Hankel determinant of Logarithmic coefficients for some subclasses of analytic functions.


title: Deploying Containerized QuantEx Quantum Simulation Software on HPC Systems

abstract: The simulation of quantum circuits using the tensor network method is very computationally demanding and requires significant High Performance Computing (HPC) resources to find an efficient contraction order and to perform the contraction of the large tensor networks. In addition, the researchers want a workflow that is easy to customize, reproduce and migrate to different HPC systems. In this paper, we discuss the issues associated with the deployment of the QuantEX quantum computing simulation software within containers on different HPC systems. Also, we compare the performance of the containerized software with the software running on bare metal.


title: Sustainable Packaging of Quantum Chemistry Software with the Nix Package Manager

abstract: The installation of quantum chemistry software packages is commonly done manually and can be a time-consuming and complicated process. An update of the underlying Linux system requires a reinstallation in many cases and can quietly break software installed on the system. In this paper, we present an approach that allows for an easy installation of quantum chemistry software packages, which is also independent of operating system updates. The use of the Nix package manager allows building software in a reproducible manner, which allows for a reconstruction of the software for later reproduction of scientific results. The build recipes that are provided can be readily used by anyone to avoid complex installation procedures.


title: Ethical Assurance: A practical approach to the responsible design, development, and deployment of data-driven technologies

abstract: This article offers several contributions to the interdisciplinary project of responsible research and innovation in data science and AI. First, it provides a critical analysis of current efforts to establish practical mechanisms for algorithmic assessment, which are used to operationalise normative principles, such as sustainability, accountability, transparency, fairness, and explainability, in order to identify limitations and gaps with the current approaches. Second, it provides an accessible introduction to the methodology of argument-based assurance, and explores how it is currently being applied in the development of safety cases for autonomous and intelligent systems. Third, it generalises this method to incorporate wider ethical, social, and legal considerations, in turn establishing a novel version of argument-based assurance that we call 'ethical assurance'. Ethical assurance is presented as a structured means for unifying the myriad practical mechanisms that have been proposed, as it is built upon a process-based form of project governance that supports inclusive and participatory ethical deliberation while also remaining grounded in social and technical realities. Finally, it sets an agenda for ethical assurance, by detailing current challenges, open questions, and next steps, which serve as a springboard to build an active (and interdisciplinary) research programme as well as contribute to ongoing discussions in policy and governance.


abstract: Sum-Product Networks (SPNs) are expressive probabilistic models that provide exact, tractable inference. They achieve this efficiency by making use of local independence. On the other hand, mixtures of exchangeable variable models (MEVMs) are a class of tractable probabilistic models that make use of exchangeability of discrete random variables to render inference tractable. Exchangeability, which arises naturally in relational domains, has not been considered for efficient representation and inference in SPNs yet. The contribution of this paper is a novel probabilistic model which we call Exchangeability-Aware Sum-Product Networks (XSPNs). It contains both SPNs and MEVMs as special cases, and combines the ability of SPNs to efficiently learn deep probabilistic models with the ability of MEVMs to efficiently handle exchangeable random variables. We introduce a structure learning algorithm for XSPNs and empirically show that they can be more accurate than conventional SPNs when the data contains repeated, interchangeable parts.


title: Global and local thermodynamics of the (2+1)-dimensional rotating Gauss-Bonnet black hole

abstract: The aim of this paper is to study the local and the global thermodynamic properties of the 3-dimensional rotating Gauss-Bonnet black hole. To this end we consider the conditions for local and global thermodynamic stability of the solution in a given ensemble of state quantities. Concerning the local analysis we found the regions of stability for every physical specific heat together with the existing Davies curves. Another central result is the generalization of the notion of global thermodynamic stability, known from the standard thermodynamics, to describe the global equilibrium of black holes. The new approach consists of applying specific Legendre transformation of the energy or the entropy to find the natural thermodynamic potential for the given ensemble of macro parameters. The global stability analysis, restricted to the week positivity conjecture is based on the properties of the new thermodynamic potential. The advantage of this method is that it allows one to chose different potentials, corresponding to different constraints to which the system may be subjected. Finally, we find it natural to impose global thermodynamic stability only where local one exists for the given black hole solution.


title: Robust and Scalable SDE Learning: A Functional Perspective

abstract: Stochastic differential equations provide a rich class of flexible generative models, capable of describing a wide range of spatio-temporal processes. A host of recent work looks to learn data-representing SDEs, using neural networks and other flexible function approximators. Despite these advances, learning remains computationally expensive due to the sequential nature of SDE integrators. In this work, we propose an importance-sampling estimator for probabilities of observations of SDEs for the purposes of learning. Crucially, the approach we suggest does not rely on such integrators. The proposed method produces lower-variance gradient estimates compared to algorithms based on SDE integrators and has the added advantage of being embarrassingly parallelizable. This facilitates the effective use of large-scale parallel hardware for massive decreases in computation time.


title: On Solving the Minimum Common String Partition Problem by Decision Diagrams

abstract: In the Minimum Common String Partition Problem (MCSP), we are given two strings on input, and we want to partition both into the same collection of substrings, minimizing the number of the substrings in the partition. This combinatorial optimization problem has applications in computational biology and is NP-hard. Many different heuristic and exact methods exist for this problem, such as a Greedy approach, Ant Colony Optimization, or Integer Linear Programming. In this paper, we formulate the MCSP as a Dynamic Program and develop an exact solution algorithm based on Decision Diagrams for it. We also introduce a restricted Decision Diagram that allows to compute heuristic solutions to the MCSP and compare the quality of solution and runtime on instances from literature with existing approaches. Our approach scales well and is suitable for heuristic solution of large-scale instances.


title: Learning a subspace of policies for online adaptation in Reinforcement Learning

abstract: Deep Reinforcement Learning (RL) is mainly studied in a setting where the training and the testing environments are similar. But in many practical applications, these environments may differ. For instance, in control systems, the robot(s) on which a policy is learned might differ from the robot(s) on which a policy will run. It can be caused by different internal factors (e.g., calibration issues, system attrition, defective modules) or also by external changes (e.g., weather conditions). There is a need to develop RL methods that generalize well to variations of the training conditions. In this article, we consider the simplest yet hard to tackle generalization setting where the test environment is unknown at train time, forcing the agent to adapt to the system's new dynamics. This online adaptation process can be computationally expensive (e.g., fine-tuning) and cannot rely on meta-RL techniques since there is just a single train environment. To do so, we propose an approach where we learn a subspace of policies within the parameter space. This subspace contains an infinite number of policies that are trained to solve the training environment while having different parameter values. As a consequence, two policies in that subspace process information differently and exhibit different behaviors when facing variations of the train environment. Our experiments carried out over a large variety of benchmarks compare our approach with baselines, including diversity-based methods. In comparison, our approach is simple to tune, does not need any extra component (e.g., discriminator) and learns policies able to gather a high reward on unseen environments.


title: Domain Adaptive Semantic Segmentation via Regional Contrastive Consistency Regularization

abstract: Unsupervised domain adaptation (UDA) for semantic segmentation has been well-studied in recent years. However, most existing works largely neglect the local regional consistency across different domains and are less robust to changes in outdoor environments. In this paper, we propose a novel and fully end-to-end trainable approach, called regional contrastive consistency regularization (RCCR) for domain adaptive semantic segmentation. Our core idea is to pull the similar regional features extracted from the same location of different images, i.e., the original image and augmented image, to be closer, and meanwhile push the features from the different locations of the two images to be separated. We innovatively propose a region-wise contrastive loss with two sampling strategies to realize effective regional consistency. Besides, we present momentum projection heads, where the teacher projection head is the exponential moving average of the student. Finally, a memory bank mechanism is designed to learn more robust and stable region-wise features under varying environments. Extensive experiments on two common UDA benchmarks, i.e., GTAV to Cityscapes and SYNTHIA to Cityscapes, demonstrate that our approach outperforms the state-of-the-art methods.


title: PMC$_\infty$: Infinite-Order Scale-Setting method using the Principle of Maximum Conformality and preserving the Intrinsic Conformality

abstract: We show results for Thrust and C-parameter in $e^+ e^-$ annihilation to 3 jets obtained using the recently developed new method for eliminating the scale ambiguity and the scheme dependence in pQCD namely the Infinite-Order Scale-Setting method using the Principle of Maximum Conformality (PMC$_\infty$). This method preserves an important underlying property of gauge theories: intrinsic Conformality (iCF). It leads to a remarkably efficient method to eliminate the conventional renormalization scale ambiguity at any order in pQCD. A comparison with Conventional Scale Setting method (CSS) is also shown.


title: K-Wav2vec 2.0: Automatic Speech Recognition based on Joint Decoding of Graphemes and Syllables

abstract: Wav2vec 2.0 is an end-to-end framework of self-supervised learning for speech representation that is successful in automatic speech recognition (ASR), but most of the work on the topic has been developed with a single language: English. Therefore, it is unclear whether the self-supervised framework is effective in recognizing other languages with different writing systems, such as Korean which uses the Hangul having a unique writing system. In this paper, we present K-Wav2Vec 2.0, which is a modified version of Wav2vec 2.0 designed for Korean automatic speech recognition by exploring and optimizing various factors of the original Wav2vec 2.0. In fine-tuning, we propose a multi-task hierarchical architecture to reflect the Korean writing structure. Moreover, a joint decoder is applied to alleviate the problem of words existing outside of the vocabulary. In pre-training, we attempted the cross-lingual transfer of the pre-trained model by further pre-training the English Wav2vec 2.0 on a Korean dataset, considering limited resources. Our experimental results demonstrate that the proposed method yields the best performance on both Korean ASR datasets: Ksponspeech (a large-scale Korean speech corpus) and Clovacall (a call-based dialog corpus). Further pre-training is also effective in language adaptation, leading to large improvements without additional data.


title: A Characterization of Totally Compatible Automata

abstract: Every function on a finite set defines an equivalence relation and, therefore, a partition called the kernel of the function. Automata such that every possible partition is the kernel of a word are called totally compatible. A characterization of such automata is given together with an algorithm to recognize them in polynomial running time with respect to the number of states.


title: Next-to-leading power SCET in Higgs amplitudes induced by light quarks

abstract: In this article, we report how to use the "plus-type" subtraction scheme to deal with endpoint divergences in $h\rightarrow\gamma\gamma$ or $gg\rightarrow h$ amplitudes induced by light quark loop, which can be formulated by next-to-leading power (NLP) SCET. This subtraction is ensured by two re-factorization conditions, which have been proven to all orders in $\alpha_s$. Based on these conditions, cutoffs emerge naturally after some re-arrangements to handle endpoint divergences and renormalization is compatible with that. Our formalism can analytically reproduce three-loop amplitudes up to $\ln^3(-M_h^2/m_b^2-i0)$ and resum to next-to-leading logarithm and beyond.


title: QFT without infinities and hierarchy problem

abstract: The standard way to do computations in Quantum Field Theory (QFT) often results in the requirement of dramatic cancellations between contributions induced by a "heavy" sector into the physical observables of the "light" (or low energy) sector - the phenomenon known as "hierarchy problem". This procedure uses divergent multi-loop Feynman diagrams, their regularisation to handle the UV divergences, and then renormalisation to remove them. At the same time, the ultimate outcome of the renormalisation is the mapping of several finite parameters defining the renormalisable field theory into different observables (e.g. all kinds of particle cross-sections). In this paper, we first demonstrate how to relate the parameters of the theory to observables without running into intermediate UV divergences. Then we go one step further: we show how in theories with different mass scales, all physics of the "light" sector can be computed in a way which does not require dramatic cancellations induced by physics of the "heavy" sector. The existence of such a technique suggests that the "hierarchy problem" in renormalisable theories is not really physical, but rather an artefact of the conventional procedure to compute correlation functions. If the QFT is defined by the "divergencies-free" method all fine-tunings in theories with well separated energy scales may be avoided.


title: The Sugawara-Sommerfield construction including canonical spin current

abstract: We set up the Sugawara-Sommerfield (SS) construction and generalize it by the inclusion of canonical spin current. Using the techniques of current algebra, we infer that the canonical spin current are linear in the vector-axial vector currents. From a geometric perspective, the underlying manifold has a vanishing Lorentz curvature and a non-vanishing torsion. This leads to teleparallelism and the canonical spin current (connection) assume a pure gauge form. Moreover, this model provides a possibility to unify gravity with strong-interactions by expressing the gravitational gauge connections in terms of the Yang-Mills gauge connections.


title: Learning Division with Neural Arithmetic Logic Modules

abstract: To achieve systematic generalisation, it first makes sense to master simple tasks such as arithmetic. Of the four fundamental arithmetic operations (+,-,$\times$,$\div$), division is considered the most difficult for both humans and computers. In this paper we show that robustly learning division in a systematic manner remains a challenge even at the simplest level of dividing two numbers. We propose two novel approaches for division which we call the Neural Reciprocal Unit (NRU) and the Neural Multiplicative Reciprocal Unit (NMRU), and present improvements for an existing division module, the Real Neural Power Unit (Real NPU). Experiments in learning division with input redundancy on 225 different training sets, find that our proposed modifications to the Real NPU obtains an average success of 85.3$\%$ improving over the original by 15.1$\%$. In light of the suggestion above, our NMRU approach can further improve the success to 91.6$\%$.


title: Gradual Federated Learning with Simulated Annealing

abstract: Federated averaging (FedAvg) is a popular federated learning (FL) technique that updates the global model by averaging local models and then transmits the updated global model to devices for their local model update. One main limitation of FedAvg is that the average-based global model is not necessarily better than local models in the early stage of the training process so that FedAvg might diverge in realistic scenarios, especially when the data is non-identically distributed across devices and the number of data samples varies significantly from device to device. In this paper, we propose a new FL technique based on simulated annealing. The key idea of the proposed technique, henceforth referred to as \textit{simulated annealing-based FL} (SAFL), is to allow a device to choose its local model when the global model is immature. Specifically, by exploiting the simulated annealing strategy, we make each device choose its local model with high probability in early iterations when the global model is immature. From extensive numerical experiments using various benchmark datasets, we demonstrate that SAFL outperforms the conventional FedAvg technique in terms of the convergence speed and the classification accuracy.


title: A tractable class of multivariate phase-type distributions for loss modeling

abstract: Phase-type (PH) distributions are a popular tool for the analysis of univariate risks in numerous actuarial applications. Their multivariate counterparts (MPH$^\ast$), however, have not seen such a proliferation, due to lack of explicit formulas and complicated estimation procedures. A simple construction of multivariate phase-type distributions -- mPH -- is proposed for the parametric description of multivariate risks, leading to models of considerable probabilistic flexibility and statistical tractability. The main idea is to start different Markov processes at the same state, and allow them to evolve independently thereafter, leading to dependent absorption times. By dimension augmentation arguments, this construction can be cast into the umbrella of MPH$^\ast$ class, but enjoys explicit formulas which the general specification lacks, including common measures of dependence. Moreover, it is shown that the class is still rich enough to be dense on the set of multivariate risks supported on the positive orthant, and it is the smallest known sub-class to have this property. In particular, the latter result provides a new short proof of the denseness of the MPH$^\ast$ class. In practice this means that the mPH class allows for modeling of bivariate risks with any given correlation or copula. We derive an EM algorithm for its statistical estimation, and illustrate it on bivariate insurance data. Extensions to more general settings are outlined.


title: Chaotic deterministic quantization in a 5D general relativity

abstract: How to quantize gravity is a major outstanding open question in quantum physics. While many approaches assume Einstein's theory is an effective low-energy theory, another possibility is that standard methods of quantization are the problem. In this paper, I analyze a quantization mechanism based on chaotic dynamics of 5D general relativity (with imaginary time) with BKL dynamics in the mixmaster universe as an example. I propose that the randomness of quantum mechanics as well as its other properties such as nonlocality derive from chaotic flow of 4D spacetime through a 5th dimension, with the metric tensor under Wick rotation to Euclidean space acting as a heat bath for other quantum fields. This is done by showing that the theory meets mixing conditions such that it is chaotically self-quantizing and quantizes other fields to which it is coupled, such that in the limit taking chaotic dynamics scale to zero the quantization is equivalent to a stochastic quantization. A classical stability analysis shows this dimension is likely spacelike.


title: Modification of the Optical Properties of Molecular Chains upon Coupling to Adatoms

abstract: Adsorbed atoms (adatoms) coupled to the matrix of solid state host materials as impurities can significantly modify their properties. Especially in low-dimensional materials, such as one-dimensional organic polymer chains or quasi-one-dimensional graphene nanoribbons, intriguing manipulation of the optical properties, such as the absorption cross section, is possible. The most widely used approach to couple quantum emitters to optical antennas is based on the Purcell effect. This formalism, however, does not comprise charge transfer from the emitter to the antenna, but only spontaneous emission of the quantum emitter into the tailored photonic environment, that is evoked by the antenna. To capture such effects, we present a tight-binding formalism to couple an adatom to a finite Su-Schrieffer-Heeger chain, where the former is treated as a two-level system and the latter acts as an optical antenna. We systematically analyze how the coupling strength and the position of the adatom influence the optical properties of the molecular chains in the model. We take into account charge transfer from the adatom to the antenna and vice versa via an inter-system hopping parameter, and also include Coulomb interaction within the antenna as well as between the adatom and the antenna. We show that coupling the adatom to one of the bulk atoms of the linear chain results in a substantial change in optical properties already for comparatively small coupling strengths. We also find that the position of the adatom crucially determines if and how the optical properties of the chains are altered. Therefore, we identify this adatom-chain hybrid system as a tunable platform for light-matter interaction at the nanoscale.


title: TSGB: Target-Selective Gradient Backprop for Probing CNN Visual Saliency

abstract: The explanation for deep neural networks has drawn extensive attention in the deep learning community over the past few years. In this work, we study the visual saliency, a.k.a. visual explanation, to interpret convolutional neural networks. Compared to iteration based saliency methods, single backward pass based saliency methods benefit from faster speed, and they are widely used in downstream visual tasks. Thus, we focus on single backward pass based methods. However, existing methods in this category struggle to uccessfully produce fine-grained saliency maps concentrating on specific target classes. That said, producing faithful saliency maps satisfying both target-selectiveness and fine-grainedness using a single backward pass is a challenging problem in the field. To mitigate this problem, we revisit the gradient flow inside the network, and find that the entangled semantics and original weights may disturb the propagation of target-relevant saliency. Inspired by those observations, we propose a novel visual saliency method, termed Target-Selective Gradient Backprop (TSGB), which leverages rectification operations to effectively emphasize target classes and further efficiently propagate the saliency to the image space, thereby generating target-selective and fine-grained saliency maps. The proposed TSGB consists of two components, namely, TSGB-Conv and TSGB-FC, which rectify the gradients for convolutional layers and fully-connected layers, respectively. Extensive qualitative and quantitative experiments on the ImageNet and Pascal VOC datasets show that the proposed method achieves more accurate and reliable results than the other competitive methods. Code is available at https://github.com/123fxdx/CNNvisualizationTSGB.


title: Dual Attention-Based Federated Learning for Wireless Traffic Prediction

abstract: Wireless traffic prediction is essential for cellular networks to realize intelligent network operations, such as load-aware resource management and predictive control. Existing prediction approaches usually adopt centralized training architectures and require the transferring of huge amounts of traffic data, which may raise delay and privacy concerns for certain scenarios. In this work, we propose a novel wireless traffic prediction framework named \textit{Dual Attention-Based Federated Learning} (FedDA), by which a high-quality prediction model is trained collaboratively by multiple edge clients. To simultaneously capture the various wireless traffic patterns and keep raw data locally, FedDA first groups the clients into different clusters by using a small augmentation dataset. Then, a quasi-global model is trained and shared among clients as prior knowledge, aiming to solve the statistical heterogeneity challenge confronted with federated learning. To construct the global model, a dual attention scheme is further proposed by aggregating the intra- and inter-cluster models, instead of simply averaging the weights of local models. We conduct extensive experiments on two real-world wireless traffic datasets and results show that FedDA outperforms state-of-the-art methods. The average mean squared error performance gains on the two datasets are up to 10\% and 30\%, respectively.