title: Efficient Document-level Event Extraction via Pseudo-Trigger-aware Pruned Complete Graph

abstract: Most previous studies of document-level event extraction mainly focus on building argument chains in an autoregressive way, which achieves a certain success but is inefficient in both training and inference. In contrast to the previous studies, we propose a fast and lightweight model named as PTPCG. In our model, we design a novel strategy for event argument combination together with a non-autoregressive decoding algorithm via pruned complete graphs, which are constructed under the guidance of the automatically selected pseudo triggers. Compared to the previous systems, our system achieves competitive results with 19.8\% of parameters and much lower resource consumption, taking only 3.8\% GPU hours for training and up to 8.5 times faster for inference. Besides, our model shows superior compatibility for the datasets with (or without) triggers and the pseudo triggers can be the supplements for annotated triggers to make further improvements. Codes are available at https://github.com/Spico197/DocEE .


title: Existence of solutions of degenerate semilinear elliptic boundary value problems

abstract: We show an existence of a weak solution of a degenerate and/or singular semilinear elliptic boundary value (nonhomogeneous) problem lying between a given weak subsolution and a given weak supersolution. It has been applied for an existence result of large solution to a similar problem.


title: Generalized cohomological field theories in the higher order formalism

abstract: In the classical Batalin--Vilkovisky formalism, the BV operator $\Delta$ is a differential operator of order two with respect to the commutative product. In the differential graded setting, it is known that if the BV operator is homotopically trivial, then there is a tree level cohomological field theory induced on the homology; this is a manifestation of the fact that the homotopy quotient of the operad of BV algebras by $\Delta$ is represented by the operad of hypercommutative algebras. In this paper, we study generalized Batalin--Vilkovisky algebras where the operator $\Delta$ is of the given finite order. In that case, we unravel a new interesting algebraic structure on the homology whenever $\Delta$ is homotopically trivial. We also suggest that the sequence of algebraic structures arising in the higher order formalism is a part of a "trinity" of remarkable mathematical objects, fitting the philosophy proposed by Arnold in the 1990s.


title: Accurate approximations of density functional theory for large systems with applications to defects in crystalline solids

abstract: This chapter presents controlled approximations of Kohn-Sham density functional theory (DFT) that enable very large scale simulations. The work is motivated by the study of defects in crystalline solids, though the ideas can be used in other applications. The key idea is to formulate DFT as a minimization problem over the density operator, and to cast spatial and spectral discretization as systematically convergent approximations. This enables efficient and adaptive algorithms that solve the equations of DFT with no additional modeling, and up to desired accuracy, for very large systems, with linear and sublinear scaling. Various approaches based on such approximations are presented, and their numerical performance demonstrated through selected examples. These examples also provide important insight about the mechanics and physics of defects in crystalline solids.

categories: cond-mat.mtrl-sci math-ph math.FA math.MP


title: Identifying RR Lyrae in the ZTF DR3 dataset

abstract: We present a RR Lyrae (RRL) catalogue based on the combination of the third data release of the Zwicky Transient Facility (ZTF DR3) and \textit{Gaia} EDR3. We use a multi-step classification pipeline relying on the Fourier decomposition fitting to the multi-band ZTF light curves and random forest classification. The resulting catalogue contains 71,755 RRLs with period and light curve parameter measurements and has completeness of 0.92 and purity of 0.92 with respect to the SOS \textit{Gaia} DR2 RRLs. The catalogue covers the Northern sky with declination $\geq -28^\circ$, its completeness is $\gtrsim 0.8$ for heliocentric distance $\leq 80$~kpc, and the most distant RRL at 132~kpc. Compared with several other RRL catalogues covering the Northern sky, our catalogue has more RRLs around the Galactic halo and is more complete at low Galactic latitude areas. Analysing the spatial distribution of RRL in the catalogue reveals the previously known major over-densities of the Galactic halo, such as the Virgo over-density and the Hercules-Aquila Cloud, with some evidence of an association between the two. We also analyse the Oosterhoff fraction differences throughout the halo, comparing it with the density distribution, finding increasing Oosterhoff I fraction at the elliptical radii between 16 and 32 kpc and some evidence of different Oosterhoff fractions across various halo substructures.


title: Control-Tutored Reinforcement Learning: Towards the Integration of Data-Driven and Model-Based Control

abstract: We present an architecture where a feedback controller derived on an approximate model of the environment assists the learning process to enhance its data efficiency. This architecture, which we term as Control-Tutored Q-learning (CTQL), is presented in two alternative flavours. The former is based on defining the reward function so that a Boolean condition can be used to determine when the control tutor policy is adopted, while the latter, termed as probabilistic CTQL (pCTQL), is instead based on executing calls to the tutor with a certain probability during learning. Both approaches are validated, and thoroughly benchmarked against Q-Learning, by considering the stabilization of an inverted pendulum as defined in OpenAI Gym as a representative problem.


title: Inequalities for $\mathrm{BV}^{\mathbb{A}} $-Functions

abstract: In this paper, we prove trace-type Poincar\'e and Sobolev inequalities for the space of functions of bounded $\mathbb{A}$-Variation


title: Learn from Human Teams: a Probabilistic Solution to Real-Time Collaborative Robot Handling with Dynamic Gesture Commands

abstract: We study real-time collaborative robot (cobot) handling, where the cobot maneuvers a workpiece under human commands. This is useful when it is risky for humans to directly handle the workpiece. However, it is hard to make the cobot both easy to command and flexible in possible operations. In this work, we propose a Real-Time Collaborative Robot Handling (RTCoHand) framework that allows the control of cobot via user-customized dynamic gestures. This is hard due to variations among users, human motion uncertainties, and noisy human input. We model the task as a probabilistic generative process, referred to as Conditional Collaborative Handling Process (CCHP), and learn from human-human collaboration. We thoroughly evaluate the adaptability and robustness of CCHP and apply our approach to a real-time cobot handling task with Kinova Gen3 robot arm. We achieve seamless human-robot collaboration with both experienced and new users. Compared to classical controllers, RTCoHand allows significantly more complex maneuvers and lower user cognitive burden. It also eliminates the need for trial-and-error, rendering it advantageous in safety-critical tasks.


title: Solution of single parameter Bring quintic equation

abstract: In this paper, we propose a new method to obtain a solution to a single-parameter Bring quintic equation of the form, $x^{5}+x=a$, where $a$ is real. The method transforms the given quintic equation to an infinite but convergent series expression in $(x/a)$, which is further transformed to a quartic equation in a novel fashion. The coefficients of the quartic equation so obtained are some kind of infinite series expressions in $a^{-4}$, which are termed as \textit{ultraradicals}. The quartic equation is then solved and its one real solution is picked; further using this, the real solution of quintic equation, $x^{5}+x=a,$ is extracted. The ultraradicals used in this method converge for $|a| > 1$; hence the method can be used when $|a| > 1$.


title: On $\mathcal I$ and $\mathcal I^*$-equal convergence in linear $2$-normed spaces

abstract: In this paper we study the notion of $\mathcal{I}$ and $\mathcal{I^*}$-equal convergence in linear 2-normed spaces and some of their properties. We also establish the relationship between them.


title: A General Auxiliary Controller for Multi-agent Flocking

abstract: We aim to improve the performance of multi-agent flocking behavior by quantifying the structural significance of each agent. We designed a confidence score(ConfScore) to measure the spatial significance of each agent. The score will be used by an auxiliary controller to refine the velocity of agents. The agents will be enforced to follow the motion of the leader agents whose ConfScores are high. We demonstrate the efficacy of the auxiliary controller by applying it to several existing algorithms including learning-based and non-learning-based methods. Furthermore, we examined how the auxiliary controller can help improve the performance under different settings of communication radius, number of agents and maximum initial velocity.


title: Towards automated optimisation of residual convolutional neural networks for electrocardiogram classification

abstract: The interpretation of the electrocardiogram (ECG) gives clinical information and helps in assessing heart function. There are distinct ECG patterns associated with a specific class of arrythmia. The convolutional neural network is currently one of the most commonly employed deep learning algorithms for ECG processing. However, deep learning models require many hyperparameters to tune. Selecting an optimal or best hyperparameter for the convolutional neural network algorithm is a highly challenging task. Often, we end up tuning the model manually with different possible ranges of values until a best fit model is obtained. Automatic hyperparameters tuning using Bayesian optimisation (BO) and evolutionary algorithms can provide an effective solution to current labour-intensive manual configuration approaches. In this paper, we propose to optimise the Residual one Dimensional Convolutional Neural Network model (R-1D-CNN) at two levels. At the first level, a residual convolutional layer and one-dimensional convolutional neural layers are trained to learn patient-specific ECG features over which multilayer perceptron layers can learn to produce the final class vectors of each input. This level is manual and aims to lower the search space. The second level is automatic and based on our proposed BO-based algorithm. Our proposed optimised R-1D-CNN architecture is evaluated on two publicly available ECG Datasets. Comparative experimental results demonstrate that our BO-based algorithm achieves an optimal rate of 99.95%, while the baseline model achieves 99.70% for the MIT-BIH database. Moreover, experiments demonstrate that the proposed architecture fine-tuned with BO achieves a higher accuracy than the other proposed architectures. Our optimised architecture achieves excellent results compared to previous works on benchmark datasets.


title: Quantum Interior Point Methods for Semidefinite Optimization

abstract: We present two quantum interior point methods for semidefinite optimization problems, building on recent advances in quantum linear system algorithms. The first scheme, more similar to a classical solution algorithm, computes an inexact search direction and is not guaranteed to explore only feasible points; the second scheme uses a nullspace representation of the Newton linear system to ensure feasibility even with inexact search directions. The second is a novel scheme that might seem impractical in the classical world, but it is well-suited for a hybrid quantum-classical setting. We show that both schemes converge to an optimal solution of the semidefinite optimization problem under standard assumptions. By comparing the theoretical performance of classical and quantum interior point methods with respect to various input parameters, we show that our second scheme obtains a speedup over classical algorithms in terms of the dimension of the problem $n$, but has worse dependence on other numerical parameters.


title: Quantum Gaussian filter for exploring ground-state properties

abstract: Filter methods realize a projection from a superposed quantum state onto a target state, which can be efficient if two states have sufficient overlap. Here we propose a quantum Gaussian filter (QGF) with the filter operator being a Gaussian function of the system Hamiltonian. A hybrid quantum-classical algorithm feasible on near-term quantum computers is developed, which implements the quantum Gaussian filter as a linear combination of Hamiltonian evolution at various times. Remarkably, the linear combination coefficients are determined classically and can be optimized in the postprocessing procedure. Compared to the existing filter algorithms whose coefficients are given in advance, our method is more flexible in practice under given quantum resources with the help of postprocessing on classical computers. We demonstrate the quantum Gaussian filter algorithm for the quantum Ising model with numeral simulations under noises. We also propose an alternative full quantum approach that implements a QGF with an ancillary continuous-variable mode.


title: Constructions For Several Few-weight Linear Codes And Their Applications

abstract: In this paper, for any odd prime $p$ and an integer $m\ge 3$, several classes of linear codes with $t$-weight $(t=3,5,7)$ are obtained based on some defining sets, and then their complete weight enumerators are determined explicitly by employing Gauss sums and quadratic character sums. Especially for $m = 3$, a class of MDS codes with parameters $[p,3,p-2]$ are obtained. Furthermore, some of these codes can be suitable for applications in secret sharing schemes and $s$-sum sets for any odd $s>1$.


title: Retrosynthetic Planning with Experience-Guided Monte Carlo Tree Search

abstract: In retrosynthetic planning, the huge number of possible routes to synthesize a complex molecule using simple building blocks leads to a combinatorial explosion of possibilities. Even experienced chemists often have difficulty to select the most promising transformations. The current approaches rely on human-defined or machine-trained score functions which have limited chemical knowledge or use expensive estimation methods for guiding. Here we an propose experience-guided Monte Carlo tree search (EG-MCTS) to deal with this problem. Instead of rollout, we build an experience guidance network to learn knowledge from synthetic experiences during the search. Experiments on benchmark USPTO datasets show that, EG-MCTS gains significant improvement over state-of-the-art approaches both in efficiency and effectiveness. In a comparative experiment with the literature, our computer-generated routes mostly matched the reported routes. Routes designed for real drug compounds exhibit the effectiveness of EG-MCTS on assisting chemists performing retrosynthetic analysis.


title: On Automatic Data Augmentation for 3D Point Cloud Classification

abstract: Data augmentation is an important technique to reduce overfitting and improve learning performance, but existing works on data augmentation for 3D point cloud data are based on heuristics. In this work, we instead propose to automatically learn a data augmentation strategy using bilevel optimization. An augmentor is designed in a similar fashion to a conditional generator and is optimized by minimizing a base model's loss on a validation set when the augmented input is used for training the model. This formulation provides a more principled way to learn data augmentation on 3D point clouds. We evaluate our approach on standard point cloud classification tasks and a more challenging setting with pose misalignment between training and validation/test sets. The proposed strategy achieves competitive performance on both tasks and we provide further insight into the augmentor's ability to learn the validation set distribution.


title: Transformations, symmetries and Noether theorems for differential-difference equations

abstract: The first part of this paper develops a geometric setting for differential-difference equations that resolves an open question about the extent to which continuous symmetries can depend on discrete independent variables. For general mappings, differentiation and differencing fail to commute. We prove that there is no such failure for structure-preserving mappings, and identify a class of equations that allow greater freedom than is typical. For variational symmetries, the above results lead to a simple proof of the differential-difference version of Noether's Theorem. We state and prove the differential-difference version of Noether's Second Theorem, together with a Noether-type theorem that spans the gap between the analogues of Noether's two theorems. These results are applied to various equations from physics.


title: Unsupervised Image to Image Translation for Multiple Retinal Pathology Synthesis in Optical Coherence Tomography Scans

abstract: Image to Image Translation (I2I) is a challenging computer vision problem used in numerous domains for multiple tasks. Recently, ophthalmology became one of the major fields where the application of I2I is increasing rapidly. One such application is the generation of synthetic retinal optical coherence tomographic (OCT) scans. Existing I2I methods require training of multiple models to translate images from normal scans to a specific pathology: limiting the use of these models due to their complexity. To address this issue, we propose an unsupervised multi-domain I2I network with pre-trained style encoder that translates retinal OCT images in one domain to multiple domains. We assume that the image splits into domain-invariant content and domain-specific style codes, and pre-train these style codes. The performed experiments show that the proposed model outperforms state-of-the-art models like MUNIT and CycleGAN synthesizing diverse pathological scans.


title: Robust Implementation with Costly Information

abstract: We study whether a planner can robustly implement a state-contingent social choice function when (i) agents must incur a cost to learn the state and (ii) the planner faces uncertainty regarding agents' preferences over outcomes, information costs, and beliefs and higher-order beliefs about one another's payoffs. We propose mechanisms that can approximately implement any desired social choice function when the perturbations concerning agents' payoffs have small ex ante probability. The mechanism is also robust to trembles in agents' strategies and when agents receive noisy information about the state.


title: Spatial Graph Convolutional Neural Network via Structured Subdomain Adaptation and Domain Adversarial Learning for Bearing Fault Diagnosis

abstract: Unsupervised domain adaptation (UDA) has shown remarkable results in bearing fault diagnosis under changing working conditions in recent years. However, most UDA methods do not consider the geometric structure of the data. Furthermore, the global domain adaptation technique is commonly applied, which ignores the relation between subdomains. This paper addresses mentioned challenges by presenting the novel deep subdomain adaptation graph convolution neural network (DSAGCN), which has two key characteristics: First, graph convolution neural network (GCNN) is employed to model the structure of data. Second, adversarial domain adaptation and local maximum mean discrepancy (LMMD) methods are applied concurrently to align the subdomain's distribution and reduce structure discrepancy between relevant subdomains and global domains. CWRU and Paderborn bearing datasets are used to validate the DSAGCN method's efficiency and superiority between comparison models. The experimental results demonstrate the significance of aligning structured subdomains along with domain adaptation methods to obtain an accurate data-driven model in unsupervised fault diagnosis.


title: Information entropy re-defined in a category theory context using preradicals

abstract: Algebraically, entropy can be defined for abelian groups and their endomorphisms, and was latter extended to consider objects in a Flow category derived from abelian categories, such as $R\textit{-}Mod$ with $R$ a ring. Preradicals are endofunctors which can be realized as compatible choice assignments in the category where they are defined. Here we present a formal definition of entropy for preradicals on $R$-Mod and show that the concept of entropy for preradicals respects their order as a big lattice. Also, due to the connection between modules and complete bounded modular lattices, we provide a definition of entropy for lattice preradicals, and show that this notion is equivalent, from a functorial perspective, to the one defined for module preradicals.


title: On diagonalizable quantum weighted Hankel matrices

abstract: A semi-infinite weighted Hankel matrix with entries defined in terms of basic hypergeometric series is explicitly diagonalized as an operator on $\ell^{2}(\mathbb{N}_{0})$. The approach uses the fact that the operator commutes with a diagonalizable Jacobi operator corresponding to Al-Salam-Chihara orthogonal polynomials. Yet another weighted Hankel matrix, which commutes with a Jacobi operator associated with the continuous $q$-Laguerre polynomials, is diagonalized. As an application, several new integral formulas for selected quantum orthogonal polynomials are deduced. In addition, an open research problem concerning a quantum Hilbert matrix is also mentioned.


title: The XYZ$^2$ hexagonal stabilizer code

abstract: We consider a topological stabilizer code on a honeycomb grid, the "XYZ$^2$" code. The code is inspired by the Kitaev honeycomb model and is a simple realization of a "matching code" discussed by Wootton [J. Phys. A: Math. Theor. 48, 215302 (2015)], with a specific implementation of the boundary. It utilizes weight-six ($XYZXYZ$) plaquette stabilizers and weight-two ($XX$) link stabilizers on a planar hexagonal grid composed of $2d^2$ qubits for code distance $d$, with weight-three stabilizers at the boundary, stabilizing one logical qubit. We study the properties of the code using maximum-likelihood decoding, assuming perfect stabilizer measurements. For pure $X$, $Y$, or $Z$ noise, we can solve for the logical failure rate analytically, giving a threshold of 50%. In contrast to the rotated surface code and the XZZX code, which have code distance $d^2$ only for pure $Y$ noise, here the code distance is $2d^2$ for both pure $Z$ and pure $Y$ noise. Thresholds for noise with finite $Z$ bias are similar to the XZZX code, but with markedly lower sub-threshold logical failure rates. The code possesses distinctive syndrome properties with unidirectional pairs of plaquette defects along the three directions of the triangular lattice for isolated errors, which may be useful for efficient matching-based or other approximate decoding.


title: Frames With Several Generators Associated with Weyl-Heisenberg Group and Extended Affine Group

abstract: We study the construction of Gabor frames and wavelet frames for Weyl-Heisenberg group and extended affine group by using contraction between the affine group and the Weyl-Heisenberg group due to Subag, Baruch, Birman and Mann. Firstly, we give construction of Gabor frames with several generators from a unitary irreducible representation associated to the Weyl-Heisenberg group. Wavelet frames with several generators associated with an extended affine group have been obtained. A relation between frames for Weyl-Heisenberg group and extended affine group is also discussed. Finally, we show that frames of Gabor and wavelet structure are stable under small perturbations.


title: Ancient and recent collisions revealed by phosphate minerals in the Chelyabinsk meteorite

abstract: The collision history of asteroids is an important archive of inner Solar System evolution. Evidence for these collisions is brought to Earth by meteorites, which can preserve impact-reset radioisotope mineral ages. However, as meteorites often preserve numerous mineral ages, their interpretation is controversial. Here, we combine analysis of phosphate U-Pb ages and mineral microtextures to construct a collision history for the highly shocked Chelyabinsk meteorite. We show that phosphate U-Pb ages in the meteorite are independent of thermal history at macro-to-microscales, correlating instead with phosphate microtexture. Isotopic data from pristine phosphate domains is largely concordant, whereas fracture-damaged domains universally display discordance. Combining both populations best constrains upper (4,473 +/- 11 Ma) and lower intercept (-9 +/- 55 Ma, i.e., within error of the present day) U-Pb ages for Chelyabinsk phosphates. We conclude that all phosphate U-Pb ages were completely reset during an ancient high energy collision. Fracture-damaged phosphate domains experienced further Pb-loss during mild collisional heating in the geologically recent past, and must be targeted to properly constrain a lower intercept age. Targeting textural sub-populations of phosphate grains can significantly improve the calculation and interpretation of U-Pb ages, permitting more robust reconstruction of both ancient and recent asteroidal collision histories.


title: CertiStr: A Certified String Solver (technical report)

abstract: Theories over strings are among the most heavily researched logical theories in the SMT community in the past decade, owing to the error-prone nature of string manipulations, which often leads to security vulnerabilities (e.g. cross-site scripting and code injection). The majority of the existing decision procedures and solvers for these theories are themselves intricate; they are complicated algorithmically, and also have to deal with a very rich vocabulary of operations. This has led to a plethora of bugs in implementation, which have for instance been discovered through fuzzing. In this paper, we present CertiStr, a certified implementation of a string constraint solver for the theory of strings with concatenation and regular constraints. CertiStr aims to solve string constraints using a forward-propagation algorithm based on symbolic representations of regular constraints as symbolic automata, which returns three results: sat, unsat, and unknown, and is guaranteed to terminate for the string constraints whose concatenation dependencies are acyclic. The implementation has been developed and proven correct in Isabelle/HOL, through which an effective solver in OCaml was generated. We demonstrate the effectiveness and efficiency of CertiStr against the standard Kaluza benchmark, in which 80.4% tests are in the string constraint fragment of CertiStr. Of these 80.4% tests, CertiStr can solve 83.5% (i.e. CertiStr returns sat or unsat) within 60s.


title: The ferroelectric nematic phase: An optimum liquid crystal candidate for nonlinear optics

abstract: Materials that exhibit high nonlinear optical (NLO) susceptibilities are considered as promising candidates for a wide range of photonic and electronic applications. Here we argue that the ferroelectric nematic (NF) materials have sufficient potentialities to become materials for the next-generation of NLO devices. We have carried out a study of the efficiency of optical second-harmonic generation in a prototype NF material, finding a nonlinear susceptibility of 5.6 pmV-1 in the transparent regime, one of the highest ever reported in ferroelectric liquid crystals. Given the fact that the studied molecule was not specifically designed for NLO applications we conclude there is still margin to obtain NF materials with enhanced properties that should allow their practical use.


title: Acoustoelectric current in graphene due to electron deformation potential and piezoelectric phonon couplings

abstract: Recent studies strongly indicate that graphene can be used as a channel material for converting surface acoustic waves to acoustoelectric current, which is a resource for various exciting technological applications. On the theoretical side, studies on phonon amplification/attenuation and acoustoelectric current at low temperatures in graphene have reported approximate analytical results under exceedingly simplifying conditions using the Boltzmann transport equation. Overcoming the earlier simplifying assumptions, we investigate both numerically and analytically the governing kinetic equations for amplification/attenuation and acoustoelectric current, taking into account the piezoelectric and deformation potential electron phonon coupling mechanism in the semi classical Boltzmann transport formalism approach, and obtain analytical results that are in reasonable agreement with the reported experimental results.


title: On the fundamental solution for degenerate Kolmogorov equations with rough coefficients

abstract: The aim of this work is to prove the existence of a fundamental solution associated to the Kolmogorov equation L u = f with measurable coefficients in the dilation invariant case. Moreover, we prove Gaussian upper and lower bounds for it, and other related properties.


title: Impact of Blocking Correlation on the Performance of mmWave Cellular Networks

abstract: In mmWave networks, a large or nearby object can obstruct multiple communication links, which results in spatial correlation in the blocking probability between a user and two or more base stations (BSs). This paper characterizes this blocking correlation and derives its impact on the signal-to-interference-plus-noise ratio (SINR) of a mmWave cellular network. We first present an exact analysis of a 1D network and highlight the impact of blocking correlation in the derived expressions. Gaining insights from the 1D analysis, we develop an analytical framework for a 2D network where we characterize the sum interference at the user by considering the correlation between the blocking of serving and interfering links. Using this, we derive the SINR coverage probability. Via simulations, we demonstrate that including blockage correlation in the analysis is required for accurate characterization of the system performance, in particular when the blocking objects tend to be large.


title: Achieving Low Complexity Neural Decoders via Iterative Pruning

abstract: The advancement of deep learning has led to the development of neural decoders for low latency communications. However, neural decoders can be very complex which can lead to increased computation and latency. We consider iterative pruning approaches (such as the lottery ticket hypothesis algorithm) to prune weights in neural decoders. Decoders with fewer number of weights can have lower latency and lower complexity while retaining the accuracy of the original model. This will make neural decoders more suitable for mobile and other edge devices with limited computational power. We also propose semi-soft decision decoding for neural decoders which can be used to improve the bit error rate performance of the pruned network.


title: Nekhoroshev estimates for the orbital stability of Earth's satellites

abstract: We provide stability estimates, obtained by implementing the Nekhoroshev theorem, in reference to the orbital motion of a small body (satellite or space debris) around the Earth. We consider a Hamiltonian model, averaged over fast angles, including the $J_2$ geopotential term as well as third-body perturbations due to Sun and Moon. We discuss how to bring the Hamiltonian into a form suitable for the implementation of the Nekhoroshev theorem in the version given by P\"oschel(1993) for the `non-resonant' regime. The manipulation of the Hamiltonian includes i) averaging over fast angles, ii) a suitable expansion around reference values for the orbit's eccentricity and inclination, and iii) a preliminary normalization allowing to eliminate particular terms whose existence is due to the non-zero inclination of the invariant plane of secular motions known as the `Laplace plane'. After bringing the Hamiltonian to a suitable form, we examine the domain of applicability of the theorem in the action space, translating the result in the space of physical elements. We find that the necessary conditions for the theorem to hold are fulfilled in some non-zero measure domains in the eccentricity and inclination plane (e, i) for a body's orbital altitude (semi-major axis) up to about 20000 km. For altitudes around 11000 km we obtain stability times of the order of several thousands of years in domains covering nearly all eccentricities and inclinations of interest in applications of the satellite problem, except for narrow zones around some so-called `inclination-dependent' resonances. On the other hand, the domains of Nekhoroshev stability recovered by the present method shrink in size as the semi-major axis a increases (and the corresponding Nekhoroshev times reduce to hundreds of years), while the stability domains practically all vanish for a > 20000 km.


title: Daily monitoring of scattered light noise due to microseismic variability at the Virgo interferometer

abstract: Data acquired by the Virgo interferometer during the second part of the O3 scientific run, referred to as O3b, were analysed with the aim of characterising the onset and time evolution of scattered light noise in connection with the variability of microseismic noise in the environment surrounding the detector. The adaptive algorithm used, called pytvfemd, is suitable for the analysis of time series which are both nonlinear and nonstationary. It allowed to obtain the first oscillatory mode of the differential arm motion degree of freedom of the detector during days affected by scattered light noise. The mode's envelope i.e., its instantaneous amplitude, is then correlated with the motion of the West end bench, a known source of scattered light during O3. The relative velocity between the West end test mass and the West end optical bench is used as a predictor of scattered light noise. Higher values of correlation are obtained in periods of higher seismic noise in the microseismic frequency band. This is also confirmed by the signal-to-noise ratio (SNR) of scattered light glitches from GravitySpy for the January-March 2020 period. Obtained results suggest that the adopted methodology is suited for scattered light noise characterisation and monitoring in gravitational wave interferometers.


title: Formation of the Earth and Moon: Influence of Small Bodies

abstract: The paper discusses a model of the bombardment of the Earth and the Moon by small bodies when these planets were formed. It is shown that the total ice mass delivered with the bodies to the Earth from the feeding zone of the giant planets and the outer asteroid belt could have been comparable to the total mass of the Earth's oceans. Objects that initially crossed Jupiter's orbit could become Earth-crossers mainly within the first one million years. Most collisions of bodies originally located at a distance of 4 to 5 AU (astronomical units) from the Sun with the Earth occurred during the first ten million years. Some bodies from the Uranus and Neptune zones could fall onto the Earth in more than 20 million years. From their initial distances from the Sun of about 3 to 3.5 AU, some bodies could fall onto the Earth and Moon in a few billion years for the model that takes into account only the gravitational influence of the planets. The ratio of the number of bodies that collided with the Earth to the number of bodies that collided with the Moon varied mainly from 20 to 40 for planetesimals from the feeding zone of the terrestrial planets. For bodies originally located at a distance of more than 3 AU from the Sun, this ratio was mainly in the range between 16.4 and 17.4. The characteristic velocities of collisions of planetesimals from the feeding zones of the terrestrial planets with the Moon varied from 8 to 16 km/s, depending on the initial values of the semi-major axes and eccentricities of orbits of the planetesimals. The collision velocities of bodies that came from the feeding zones of Jupiter and Saturn with the Moon were mainly from 20 to 23 km/s.


title: Behavior measures are predicted by how information is encoded in an individual's brain

abstract: Similar to how differences in the proficiency of the cardiovascular and musculoskeletal system predict an individual's athletic ability, differences in how the same brain region encodes information across individuals may explain their behavior. However, when studying how the brain encodes information, researchers choose different neuroimaging tasks (e.g., language or motor tasks), which can rely on processing different types of information and can modulate different brain regions. We hypothesize that individual differences in how information is encoded in the brain are task-specific and predict different behavior measures. We propose a framework using encoding-models to identify individual differences in brain encoding and test if these differences can predict behavior. We evaluate our framework using task functional magnetic resonance imaging data. Our results indicate that individual differences revealed by encoding-models are a powerful tool for predicting behavior, and that researchers should optimize their choice of task and encoding-model for their behavior of interest.


title: Auto-Tag: Tagging-Data-By-Example in Data Lakes

abstract: As data lakes become increasingly popular in large enterprises today, there is a growing need to tag or classify data assets (e.g., files and databases) in data lakes with additional metadata (e.g., semantic column-types), as the inferred metadata can enable a range of downstream applications like data governance (e.g., GDPR compliance), and dataset search. Given the sheer size of today's enterprise data lakes with petabytes of data and millions of data assets, it is imperative that data assets can be ``auto-tagged'', using lightweight inference algorithms and minimal user input. In this work, we develop Auto-Tag, a corpus-driven approach that automates data-tagging of \textit{custom} data types in enterprise data lakes. Using Auto-Tag, users only need to provide \textit{one} example column to demonstrate the desired data-type to tag. Leveraging an index structure built offline using a lightweight scan of the data lake, which is analogous to pre-training in machine learning, Auto-Tag can infer suitable data patterns to best ``describe'' the underlying ``domain'' of the given column at an interactive speed, which can then be used to tag additional data of the same ``type'' in data lakes. The Auto-Tag approach can adapt to custom data-types, and is shown to be both accurate and efficient. Part of Auto-Tag ships as a ``custom-classification'' feature in a cloud-based data governance and catalog solution \textit{Azure Purview}.


title: Real-Time Detection of Crowded Buses via Mobile Phones

abstract: Automated passenger counting (APC) technology is central to many aspects of the public transit experience. APC information informs public transit planners about utilization in a public transit system and operations about dynamic fluctuations in demand. Perhaps most importantly, APC information provides one metric to the rider experience - standing during a long ride because of a crowded vehicle is an unpleasant experience. Several technologies have been successfully used for APC including light beam sensing and video image analysis. However, these technologies are expensive and must be installed in buses. In this paper, we analyze a new source of data using statistical models: rider smartphone accelerometers. Smartphones are ubiquitous in society and accelerometers have been shown to accurately model user states such as walking and sitting. We extend these models to use accelerometers to detect if the rider is standing or sitting on a bus. Standing riders are a signal that the bus is crowded. This paper provides evidence that user smartphones are a valid source of participatory sensing and thus a new source of automated passenger counting data.


title: Topologically trivial proper 2-knots

abstract: We study smooth, proper embeddings of noncompact surfaces in 4-manifolds, focusing on exotic planes and annuli, i.e., embeddings pairwise homeomorphic to the standard embeddings of R^2 and R^2-int D^2 in R^4. We encounter two uncountable classes of exotic planes, with radically different properties. One class is simple enough that we exhibit explicit level diagrams of them without 2-handles. Diagrams from the other class seem intractable to draw, and require infinitely many 2-handles. We show that every compact surface embedded rel nonempty boundary in the 4-ball has interior pairwise homeomorphic to infinitely many smooth, proper embeddings in R^4. We also see that the almost-smooth, compact, embedded surfaces produced in 4-manifolds by Freedman theory must have singularities requiring infinitely many local minima in their radial functions. We construct exotic planes with uncountable group actions injecting into the pairwise mapping class group. This work raises many questions, some of which we list.


title: U-shaped Transformer with Frequency-Band Aware Attention for Speech Enhancement

abstract: The state-of-the-art speech enhancement has limited performance in speech estimation accuracy. Recently, in deep learning, the Transformer shows the potential to exploit the long-range dependency in speech by self-attention. Therefore, it is introduced in speech enhancement to improve the speech estimation accuracy from a noise mixture. However, to address the computational cost issue in Transformer with self-attention, the axial attention is the option i.e., to split a 2D attention into two 1D attentions. Inspired by the axial attention, in the proposed method we calculate the attention map along both time- and frequency-axis to generate time and frequency sub-attention maps. Moreover, different from the axial attention, the proposed method provides two parallel multi-head attentions for time- and frequency-axis. Furthermore, it is proven in the literature that the lower frequency-band in speech, generally, contains more desired information than the higher frequency-band, in a noise mixture. Therefore, the frequency-band aware attention is proposed i.e., high frequency-band attention (HFA), and low frequency-band attention (LFA). The U-shaped Transformer is also first time introduced in the proposed method to further improve the speech estimation accuracy. The extensive evaluations over four public datasets, confirm the efficacy of the proposed method.


title: FedSoft: Soft Clustered Federated Learning with Proximal Local Updating

abstract: Traditionally, clustered federated learning groups clients with the same data distribution into a cluster, so that every client is uniquely associated with one data distribution and helps train a model for this distribution. We relax this hard association assumption to soft clustered federated learning, which allows every local dataset to follow a mixture of multiple source distributions. We propose FedSoft, which trains both locally personalized models and high-quality cluster models in this setting. FedSoft limits client workload by using proximal updates to require the completion of only one optimization task from a subset of clients in every communication round. We show, analytically and empirically, that FedSoft effectively exploits similarities between the source distributions to learn personalized and cluster models that perform well.


title: Deterministic and Discriminative Imitation (D2-Imitation): Revisiting Adversarial Imitation for Sample Efficiency

abstract: Sample efficiency is crucial for imitation learning methods to be applicable in real-world applications. Many studies improve sample efficiency by extending adversarial imitation to be off-policy regardless of the fact that these off-policy extensions could either change the original objective or involve complicated optimization. We revisit the foundation of adversarial imitation and propose an off-policy sample efficient approach that requires no adversarial training or min-max optimization. Our formulation capitalizes on two key insights: (1) the similarity between the Bellman equation and the stationary state-action distribution equation allows us to derive a novel temporal difference (TD) learning approach; and (2) the use of a deterministic policy simplifies the TD learning. Combined, these insights yield a practical algorithm, Deterministic and Discriminative Imitation (D2-Imitation), which operates by first partitioning samples into two replay buffers and then learning a deterministic policy via off-policy reinforcement learning. Our empirical results show that D2-Imitation is effective in achieving good sample efficiency, outperforming several off-policy extension approaches of adversarial imitation on many control tasks.


title: Towards Autonomous Satellite Communications: An AI-based Framework to Address System-level Challenges

abstract: The next generation of satellite constellations is designed to better address the future needs of our connected society: highly-variable data demand, mobile connectivity, and reaching more under-served regions. Artificial Intelligence (AI) and learning-based methods are expected to become key players in the industry, given the poor scalability and slow reaction time of current resource allocation mechanisms. While AI frameworks have been validated for isolated communication tasks or subproblems, there is still not a clear path to achieve fully-autonomous satellite systems. Part of this issue results from the focus on subproblems when designing models, instead of the necessary system-level perspective. In this paper we try to bridge this gap by characterizing the system-level needs that must be met to increase satellite autonomy, and introduce three AI-based components (Demand Estimator, Offline Planner, and Real Time Engine) that jointly address them. We first do a broad literature review on the different subproblems and identify the missing links to the system-level goals. In response to these gaps, we outline the three necessary components and highlight their interactions. We also discuss how current models can be incorporated into the framework and possible directions of future work.


title: Energy Extraction, or Lack Thereof

abstract: The problem of stability of rotating black holes is the subject of a long standing research program since the 1960s and remains an unresolved problem in general relativity. A major obstacle in the black hole stability problem is that the energy of waves propagating through rotating black holes spacetimes is not necessarily positive-definite, due to the so called ergo-region. This is a serious complication that limits the efficacy of most mathematical techniques. In this Letter, we report that, despite the ergo-region, there exists a positive-definite \emph{total energy} for axisymmetric Maxwell, gravitational and electrovacuum perturbations of Kerr and Kerr-Newman black hole spacetimes.


title: Moving binary Bose-Einstein condensates in a weak random potential

abstract: We study the behavior of moving Bose-Bose mixtures in a weak disordered potential in the realm of the Bogoliubov-Huang-Meng theory. Corrections due to the quantum fluctuations, disorder effects and the relative motion of two fluids to the glassy fraction, the condensed depletion, the anomalous density, and the equation of state of each species are obtained analytically for small velocity. We show that the intriguing interplay of the relative motion and the disorder potential could not only change the stability condition, but destroy also the localization process in the two condensates preventing the formation of a Bose glass state. Unexpectedly, we find that the quantum fluctuations reduce with the velocity of the two fluids. The obtained theoretical predictions are checked by our numerical results.


title: Macroscopic Magnetic Monopoles in a 3D-Printed Mechano-Magnet

abstract: The notion of magnetic monopoles has puzzled physicists since the introduction of Maxwell's Equations and famously Dirac had hypothesized them in the context of quantum mechanics. While they have proved experimentally elusive as elementary particles, the concept has come to describe excitations or topological defects in various material systems, from liquid crystals, to Hall systems, skyrmion lattices, and Bose-Einstein condensate. Perhaps the most versatile manifestation of magnetic monopoles as quasiparticles in matter has been in so-called spin ice materials. There, they represent violations of the ice rule, carry a magnetic charge, and can move freely unbound. Spin ice emergent magnetic monopoles appear at the atomic scale in rare earth pyrochlores or at the nano-scale in artificial spin ices systems. Here we demonstrate for the first time that the notion of magnetic monopoles can be transported at the macroscopic scale. We have built a mechano-magnet realized via 3D-printing, that consists of mechanical rotors on which macroscopic magnets can pivot. By controlling the relative height of the rotors we can achieve different regimes for magnetic monopoles, including the free monopole state. We then explore their driven dynamics under field. In the future, integration of our proof of principle in an elastic matrix can lead to novel macroscopic mechano-magnetic materials, to explore unusual piezomagnetism and magnetostriction, with applications to actuators and soft-robotics.


title: Continuous variable graph states: entanglement and graph properties

abstract: We propose the definition of the geometric measure of entanglement for continuous variable states. On the basis of this definition we examine entanglement of the graph states obtained as a result of action of a unitary operator on the ground state of a system of $N$ noninteracting harmonic oscillators. We find that the entanglement of a harmonic oscillator with other ones is defined by the value of its vertex degree.


title: GenMotion: Data-driven Motion Generators for Real-time Animation Synthesis

abstract: With the recent success of deep learning algorithms, many researchers have focused on generative models for human motion animation. However, the research community lacks a platform for training and benchmarking various algorithms, and the animation industry needs a toolkit for implementing advanced motion synthesizing techniques. To facilitate the study of deep motion synthesis methods for skeleton-based human animation and their potential applications in practical animation making, we introduce \genmotion: a library that provides unified pipelines for data loading, model training, and animation sampling with various deep learning algorithms. Besides, by combining Python coding in the animation software \genmotion\ can assist animators in creating real-time 3D character animation. Source code is available at https://github.com/realvcla/GenMotion/.


title: OstrichRL: A Musculoskeletal Ostrich Simulation to Study Bio-mechanical Locomotion

abstract: Muscle-actuated control is a research topic that spans multiple domains, including biomechanics, neuroscience, reinforcement learning, robotics, and graphics. This type of control is particularly challenging as bodies are often overactuated and dynamics are delayed and non-linear. It is however a very well tested and tuned actuation mechanism that has undergone millions of years of evolution with interesting properties exploiting passive forces and efficient energy storage of muscle-tendon units. To facilitate research on muscle-actuated simulation, we release a 3D musculoskeletal simulation of an ostrich based on the MuJoCo physics engine. The ostrich is one of the fastest bipeds on earth and therefore makes an excellent model for studying muscle-actuated bipedal locomotion. The model is based on CT scans and dissections used to collect actual muscle data, such as insertion sites, lengths, and pennation angles. Along with this model, we also provide a set of reinforcement learning tasks, including reference motion tracking, running, and neck control, used to infer muscle actuation patterns. The reference motion data is based on motion capture clips of various behaviors that we preprocessed and adapted to our model. This paper describes how the model was built and iteratively improved using the tasks. We also evaluate the accuracy of the muscle actuation patterns by comparing them to experimentally collected electromyographic data from locomoting birds. The results demonstrate the need for rich reward signals or regularization techniques to constrain muscle excitations and produce realistic movements. Overall, we believe that this work can provide a useful bridge between fields of research interested in muscle actuation.


title: A Critique of Kumar's "Necessary and Sufficient Condition for Satisfiability of a Boolean Formula in CNF and Its Implications on P versus NP problem."

abstract: In this paper, we analyze the argument made by Kumar in the technical report "Necessary and Sufficient Condition for Satisfiability of a Boolean Formula in CNF and Its Implications on P versus NP problem." The paper claims to present a polynomial-time algorithm that decides CNF-SAT. We show that the paper's analysis is flawed and that the fundamental underpinning of its algorithm requires an exponential number of steps on infinitely many inputs.


title: MedAttacker: Exploring Black-Box Adversarial Attacks on Risk Prediction Models in Healthcare

abstract: Deep neural networks (DNNs) have been broadly adopted in health risk prediction to provide healthcare diagnoses and treatments. To evaluate their robustness, existing research conducts adversarial attacks in the white/gray-box setting where model parameters are accessible. However, a more realistic black-box adversarial attack is ignored even though most real-world models are trained with private data and released as black-box services on the cloud. To fill this gap, we propose the first black-box adversarial attack method against health risk prediction models named MedAttacker to investigate their vulnerability. MedAttacker addresses the challenges brought by EHR data via two steps: hierarchical position selection which selects the attacked positions in a reinforcement learning (RL) framework and substitute selection which identifies substitute with a score-based principle. Particularly, by considering the temporal context inside EHRs, it initializes its RL position selection policy by using the contribution score of each visit and the saliency score of each code, which can be well integrated with the deterministic substitute selection process decided by the score changes. In experiments, MedAttacker consistently achieves the highest average success rate and even outperforms a recent white-box EHR adversarial attack technique in certain cases when attacking three advanced health risk prediction models in the black-box setting across multiple real-world datasets. In addition, based on the experiment results we include a discussion on defending EHR adversarial attacks.


title: In-silico modeling of the micromechanics of fibrous scaffolds and stiffness sensing by cells

abstract: Mechanical properties of the tissue engineering scaffolds are known to play a crucial role in tissue regeneration. Here, we have utilized discrete network and finite element models to study fibrous scaffold mechanics and its dependence on structure. We have considered two loading conditions, first, uniaxial elongation (macroscopic), and second, localized cellular forces (microscopic). Using these two scenarios, we have tried to establish a link between scaffold micromechanics and its macroscopic mechanical properties. We have demonstrated that the macroscopic elastic modulus of fibrous scaffold is dependent on the sample shape, size and the degree of fiber fusion. Under microscopic loading conditions the deformation of the fibrous scaffolds is anisotropic with an orientation dependent decay with distance. Further, we explored the stiffness sensing under the conditions of fixed stress or fixed strain application by the cells. With fixed strain, we found that the stiffness sensed by a cell is proportional to scaffold's macroscopic Young's modulus. However, for fixed stress application, it also depends on cell's elasticity with stiffness experienced by stiff and soft cells differing by an order of magnitude. The analyses demonstrate that there exists a gap between mechanical properties of the fibrous scaffolds as measured from the macroscopic testings and those sensed by the cells. This warrants a need for extreme care during the designing and reporting of experiments involving cell-scaffold interactions. The insights from this work will help in the designing of tissue engineering scaffolds for applications where mechanical stimuli are a critical factor


title: Symmetric bases for finite element exterior calculus spaces

abstract: In 2006, Arnold, Falk, and Winther developed finite element exterior calculus, using the language of differential forms to generalize the Lagrange, Raviart--Thomas, Brezzi--Douglas--Marini, and N\'ed\'elec finite element spaces for simplicial triangulations. In a recent paper, Licht asks whether, on a single simplex, one can construct bases for these spaces that are invariant with respect to permuting the vertices of the simplex. For scalar fields, standard bases all have this symmetry property, but for vector fields, this question is more complicated: such invariant bases may or may not exist, depending on the polynomial degree of the element. In dimensions two and three, Licht constructs such invariant bases for certain values of the polynomial degree $r$, and he conjectures that his list is complete, that is, that no such basis exists for other values of $r$. In this paper, we show that Licht's conjecture is true in dimension two. However, in dimension three, we show that Licht's ideas can be extended to give invariant bases for many more values of $r$; we then show that this new larger list is complete. Along the way, we develop a more general framework for the geometric decomposition ideas of Arnold, Falk, and Winther.


title: Influence of collective nuclear vibrations on initial state eccentricities in Pb+Pb collisions

abstract: We study within the Monte Carlo Glauber model the influence of collective quantum effects in the Pb nucleus on the azimuthal anisotropy coefficients $\epsilon_{2,3}$ in Pb+Pb collisions at the LHC energies. To account for the quantum effects, we modify the sampling of the nucleon positions by applying suitable filters that guarantee that the colliding nuclei have the mean squared quadrupole and octupole moments consistent with the ones extracted from the experimental quadrupole and octupole strength functions for the Pb nucleus with the help of the energy weighted sum rule. Our Monte Carlo Glauber model with the modified sampling of the nucleon positions leads to $\epsilon_2\{2\}/\epsilon_3\{2\}\approx 0.8$ at centrality $\lesssim 1$\%, which allows to resolve the $v_2$-to-$v_3$ puzzle.


title: The Optimization of Flux Trajectories for the Adiabatic Controlled-Z Gate on Split-Tunable Transmons

abstract: In a system of two tunable-frequency qubits, it is well-known that adiabatic tuning into strong coupling-interaction regions between the qubit subspace and the rest of the Hilbert space can be used to generate an effective controlled Z rotation. We address the problem of determining a preferable adiabatic trajectory along which to tune the qubit frequency, and apply this to the flux-tunable transmon model. The especially minimally anharmonic nature of these quantum processors makes them good candidates for qubit control using non-computational states, as long as higher-level leakage is properly addressed. While the statement of this method has occurred multiple times in literature, there has been little discussion of which trajectories may be used. We present a generalized method for optimizing parameterized families of possible flux trajectories and provide examples of use on five test families of one and two parameters.


title: Perceptual Loss with Recognition Model for Single-Channel Enhancement and Robust ASR

abstract: Single-channel speech enhancement approaches do not always improve automatic recognition rates in the presence of noise, because they can introduce distortions unhelpful for recognition. Following a trend towards end-to-end training of sequential neural network models, several research groups have addressed this problem with joint training of front-end enhancement module with back-end recognition module. While this approach ensures enhancement outputs are helpful for recognition, the enhancement model can overfit to the training data, weakening the recognition model in the presence of unseen noise. To address this, we used a pre-trained acoustic model to generate a perceptual loss that makes speech enhancement more aware of the phonetic properties of the signal. This approach keeps some benefits of joint training, while alleviating the overfitting problem. Experiments on Voicebank + DEMAND dataset for enhancement show that this approach achieves a new state of the art for some objective enhancement scores. In combination with distortion-independent training, our approach gets a WER of 2.80\% on the test set, which is more than 20\% relative better recognition performance than joint training, and 14\% relative better than distortion-independent mask training.


title: A Matsumoto type theorem for GL_n over rings of non-commutative Laurent polynomials

abstract: We give a Matsumoto-type presentation of $K_2$-groups over rings of non-commutative Laurent polynomials, which is a non-commutative version of M. Tomie's result for loop groups. Our main idea is due to U. Rehmann's approach in case of division rings.


title: A Comparative Study on Robust Graph Neural Networks to Structural Noises

abstract: Graph neural networks (GNNs) learn node representations by passing and aggregating messages between neighboring nodes. GNNs have been applied successfully in several application domains and achieved promising performance. However, GNNs could be vulnerable to structural noise because of the message passing mechanism where noise may be propagated through the entire graph. Although a series of robust GNNs have been proposed, they are evaluated with different structural noises, and it lacks a systematic comparison with consistent settings. In this work, we conduct a comprehensive and systematical comparative study on different types of robust GNNs under consistent structural noise settings. From the noise aspect, we design three different levels of structural noises, i.e., local, community, and global noises. From the model aspect, we select some representative models from sample-based, revision-based, and construction-based robust GNNs. Based on the empirical results, we provide some practical suggestions for robust GNNs selection.


title: Multi-Attention Multiple Instance Learning

abstract: A new multi-attention based method for solving the MIL problem (MAMIL), which takes into account the neighboring patches or instances of each analyzed patch in a bag, is proposed. In the method, one of the attention modules takes into account adjacent patches or instances, several attention modules are used to get a diverse feature representation of patches, and one attention module is used to unite different feature representations to provide an accurate classification of each patch (instance) and the whole bag. Due to MAMIL, a combined representation of patches and their neighbors in the form of embeddings of a small dimensionality for simple classification is realized. Moreover, different types of patches are efficiently processed, and a diverse feature representation of patches in a bag by using several attention modules is implemented. A simple approach for explaining the classification predictions of patches is proposed. Numerical experiments with various datasets illustrate the proposed method.


title: A tight bound for the clique query problem in two rounds

abstract: We consider a problem introduced by Feige, Gamarnik, Neeman, R\'acz and Tetali [2020], that of finding a large clique in a random graph $G\sim G(n,\frac{1}{2})$, where the graph $G$ is accessible by queries to entries of its adjacency matrix. The query model allows some limited adaptivity, with a constant number of rounds of queries, and $n^\delta$ queries in each round. With high probability, the maximum clique in $G$ is of size roughly $2\log n$, and the goal is to find cliques of size $\alpha\log n$, for $\alpha$ as large as possible. We prove that no two-rounds algorithm is likely to find a clique larger than $\frac{4}{3}\delta\log n$, which is a tight upper bound when $1\leq\delta\leq \frac{6}{5}$. For other ranges of parameters, namely, two-rounds with $\frac{6}{5}<\delta<2$, and three-rounds with $1\leq\delta<2$, we improve over the previously known upper bounds on $\alpha$, but our upper bounds are not tight. If early rounds are restricted to have fewer queries than the last round, then for some such restrictions we do prove tight upper bounds.


title: Death rate during the exponential growth of E. coli

abstract: So fast is the growth of a culture of E. coli that it led researchers to overlook a possible death rate. As a matter of fact, the experiments done in the first half of the 20th century were unable to detect any mortality. It is only at the beginning of the 21th century that positive evidence emerged which confirmed the existence of a sizeable (albeit small) mortality. In the present paper this mortality was measured at successive 45mn time intervals from early exponential growth into the stationary phase. Done with a flow cytometer, the successive measurements of the ratio dead/living also provided an estimate of the standard deviation of the mortality rate. In a forthcoming experiment we are planning to focus more closely on the stationary phase in order to find out if its mortality rate is lower or higher than in the exponential phase.


title: Early Stopping for Deep Image Prior

abstract: Deep image prior (DIP) and its variants have showed remarkable potential for solving inverse problems in computer vision, without any extra training data. Practical DIP models are often substantially overparameterized. During the fitting process, these models learn mostly the desired visual content first, and then pick up the potential modeling and observational noise, i.e., overfitting. Thus, the practicality of DIP often depends critically on good early stopping (ES) that captures the transition period. In this regard, the majority of DIP works for vision tasks only demonstrates the potential of the models -- reporting the peak performance against the ground truth, but provides no clue about how to operationally obtain near-peak performance without access to the groundtruth. In this paper, we set to break this practicality barrier of DIP, and propose an efficient ES strategy, which consistently detects near-peak performance across several vision tasks and DIP variants. Based on a simple measure of dispersion of consecutive DIP reconstructions, our ES method not only outpaces the existing ones -- which only work in very narrow domains, but also remains effective when combined with a number of methods that try to mitigate the overfitting. The code is available at https://github.com/sun-umn/Early_Stopping_for_DIP.


title: Orbits of vectors in some representations. III

abstract: Let $\Phi$ be a root system of type $E_6$, $E_7$, or $E_8$. Let $K$ be a field of characteristic $2$. Let $\delta$ be the maximal root of $\Phi$ and set $\Phi_0 = \{\alpha\in\Phi; \delta\perp\alpha\}$. We describe orbits of the group $G_{\text{\rm sc}}(\Phi_0, K)$ acting on the set $\langle e_\alpha; \angle(\alpha, \delta) = \pi/3\rangle$.


title: The curious case of Betelgeuse

abstract: Betelgeuse is the nearest red supergiant, one of the brightest stars in our sky, and statistically speaking it would be expected to be "typical". Yet it exhibits many features that seem "curious", to say the least. For instance it has a high proper motion. It rotates fast. It has little dust. It dimmed unexpectedly. Is any of these, and other, phenomena atypical, and taken together does it make Betelgeuse atypical? This is important to know, because we need to know whether Betelgeuse might be a prototype of red supergiants in general, or certain subclasses of red supergiants, since we can study it in such great detail. It is also important to know as it may be a link to understanding other, apparently atypical cases such as supernova 1987A, and maybe even such exotica as Thorne-\.Zytkov objects. Studying this question in itself helps us understand how we deal with rarity and coincidence in understanding the Universe we live in.


title: Orbits of vectors in some representations. II

abstract: Let $\Phi$ be a root system of type $A_l$ or $D_l$. Let $K$ be a field of characteristic not $2$. Let $\delta$ be the maximal root of $\Phi$ and set $\Phi_0 = \{\alpha\in\Phi; \delta\perp\alpha\}$. We describe orbits of the group $G_{\text{\rm sc}}(\Phi_0, K)$ acting on the set $\langle e_\alpha; \angle(\alpha, \delta) = \pi/3\rangle$.


title: A Note on the Post-Quantum Security of (Ring) Signatures

abstract: This work revisits the security of classical signatures and ring signatures in a quantum world. For (ordinary) signatures, we focus on the arguably preferable security notion of blind-unforgeability recently proposed by Alagic et al. (Eurocrypt'20). We present two short signature schemes achieving this notion: one is in the quantum random oracle model, assuming quantum hardness of SIS; and the other is in the plain model, assuming quantum hardness of LWE with super-polynomial modulus. Prior to this work, the only known blind-unforgeable schemes are Lamport's one-time signature and the Winternitz one-time signature, and both of them are in the quantum random oracle model. For ring signatures, the recent work by Chatterjee et al. (Crypto'21) proposes a definition trying to capture adversaries with quantum access to the signer. However, it is unclear if their definition, when restricted to the classical world, is as strong as the standard security notion for ring signatures. They also present a construction that only partially achieves (even) this seeming weak definition, in the sense that the adversary can only conduct superposition attacks over the messages, but not the rings. We propose a new definition that does not suffer from the above issue. Our definition is an analog to the blind-unforgeability in the ring signature setting. Moreover, assuming the quantum hardness of LWE, we construct a compiler converting any blind-unforgeable (ordinary) signatures to a ring signature satisfying our definition.


title: A characterization of the symmetry groups of mono-monostatic convex bodies

abstract: Answering a question of Conway and Guy in a 1968 paper, L\'angi in 2021 proved the existence of a monostable polyhedron with $n$-fold rotational symmetry for any $n \geq 3$, and arbitrarily close to a Euclidean ball. In this paper we strengthen this result by characterizing the possible symmetry groups of all mono-monostatic smooth convex bodies and convex polyhedra. Our result also answers a stronger version of the question of Conway and Guy, asked in the above paper of L\'angi.


title: UPV at TREC Health Misinformation Track 2021 Ranking with SBERT and Quality Estimators

abstract: Health misinformation on search engines is a significant problem that could negatively affect individuals or public health. To mitigate the problem, TREC organizes a health misinformation track. This paper presents our submissions to this track. We use a BM25 and a domain-specific semantic search engine for retrieving initial documents. Later, we examine a health news schema for quality assessment and apply it to re-rank documents. We merge the scores from the different components by using reciprocal rank fusion. Finally, we discuss the results and conclude with future works.


title: Second-Order Fast-Slow Stochastic Systems

abstract: This paper focuses on systems of nonlinear second-order stochastic differential equations with multi-scales. The motivation for our study stems from mathematical physics and statistical mechanics, for examples, Langevin dynamics and stochastic acceleration in a random environment. Our effort is to carry out asymptotic analysis to establish large deviations principles. Our focus is on obtaining the desired results for systems under weaker conditions. When the fast-varying process is a diffusion, neither Lipschitz continuity nor linear growth needs to be assumed. Our approach is based on combinations of the intuition from Smoluchowski-Kramers approximation, and the methods initiated in [34] relying on the concepts of relatively large deviations compactness and the identification of rate functions. When the fast-varying process is under a general setup with no specified structure, the paper establishes the large deviations principle of the underlying system under the assumption on the local large deviations principles of the corresponding first-order system.


title: UrbanRama: Navigating Cities in Virtual Reality

abstract: Exploring large virtual environments, such as cities, is a central task in several domains, such as gaming and urban planning. VR systems can greatly help this task by providing an immersive experience; however, a common issue with viewing and navigating a city in the traditional sense is that users can either obtain a local or a global view, but not both at the same time, requiring them to continuously switch between perspectives, losing context and distracting them from their analysis. In this paper, our goal is to allow users to navigate to points of interest without changing perspectives. To accomplish this, we design an intuitive navigation interface that takes advantage of the strong sense of spatial presence provided by VR. We supplement this interface with a perspective that warps the environment, called UrbanRama, based on a cylindrical projection, providing a mix of local and global views. The design of this interface was performed as an iterative process in collaboration with architects and urban planners. We conducted a qualitative and a quantitative pilot user study to evaluate UrbanRama and the results indicate the effectiveness of our system in reducing perspective changes, while ensuring that the warping doesn't affect distance and orientation perception.


title: Gravitational waves from first-order electroweak phase transition in a model with light sgoldstinos

abstract: We study previously unexplored possibility of triggering the first order electroweak phase transition (EWPT) by interactions of the Standard Model (SM) particles with the sector responsible for low scale supersymmetry breaking. The low-energy theory apart from the SM particles contains additional scalar degrees of freedom -- sgoldstinos -- which contribute to the effective scalar potential and thus can trigger the first order EWPT. Remarkably, the latter requires only moderate couplings in the scalar sector. The perturbative description in terms of the effective theory seems formally to be applicable upto the scale of supersymmetry breaking: the Landau pole in the scalar sector is above $10^8$-$10^9$ GeV. We calculate the gravitational wave signal generated at this transition (it can be tested, e.g. by LISA, BBO and DECIGO) and briefly discuss the collider phenomenology of this scenario.


title: Generation of nonclassical states of light via truncation of mixed states

abstract: A possible way of generating nonclassical states of light, especially non-Gaussian states, is via the truncation of a given state in the Fock basis. In recent work, we presented an alternative scheme for such quantum scissors [Phys. Rev. A 104, 033715 (2021)], employing a nondegenerate parametric amplifier, a beam splitter and photodetectors. An advantage of this setup is that it does not require the generation of Fock states beforehand, as in previous proposals. Here we extend this treatment to mixed input states. We show the possibilities of generating truncated states with either a maximum Fock number N or states having a minimum Fock number N. We discuss two specific examples of states to be truncated: i) the thermal state, and ii) the phase-diffused coherent state. In both cases, we show that the generated states can have significant sub-Poissonian statistics as well as non-Gaussian character. The degree of such nonclassical properties, as well as the success probabilities, can be changed by adjusting the parametric amplifier strength and the beam splitter transmittance.


title: Using a $q$-shuffle algebra to describe the basic module $V(\Lambda_0)$ for the quantized enveloping algebra $U_q(\widehat{\mathfrak{sl}}_2)$

abstract: We consider the quantized enveloping algebra $U_q(\widehat{\mathfrak{sl}}_2)$ and its basic module $V(\Lambda_0)$. This module is infinite-dimensional, irreducible, integrable, and highest-weight. We describe $V(\Lambda_0)$ using a $q$-shuffle algebra in the following way. Start with the free associative algebra $\mathbb V$ on two generators $x,y$. The standard basis for $\mathbb V$ consists of the words in $x,y$. In 1995 M. Rosso introduced an associative algebra structure on $\mathbb V$, called a $q$-shuffle algebra. For $u,v\in \lbrace x,y\rbrace$ their $q$-shuffle product is $u\star v = uv+q^{(u,v)}vu$, where $( u,v) =2$ (resp. $(u,v) =-2$) if $u=v$ (resp. $u\not=v$). Let $\mathbb U$ denote the subalgebra of the $q$-shuffle algebra $\mathbb V$ that is generated by $x, y$. Rosso showed that the algebra $\mathbb U$ is isomorphic to the positive part of $U_q(\widehat{\mathfrak{sl}}_2)$. In our first main result, we turn $\mathbb U$ into a $U_q(\widehat{\mathfrak{sl}}_2)$-module. Let $\bf U$ denote the $U_q(\widehat{\mathfrak{sl}}_2)$-submodule of $\mathbb U$ generated by the empty word. In our second main result, we show that the $U_q(\widehat{\mathfrak{sl}}_2)$-modules $\bf U$ and $V(\Lambda_0)$ are isomorphic. Let $\bf V$ denote the subspace of $\mathbb V$ spanned by the words that do not begin with $y$ or $xx$. In our third main result, we show that $\bf U = \mathbb U \cap {\bf V}$.


title: Quantum Signal Processing for simulating cold plasma waves

abstract: Numerical modeling of radio-frequency waves in plasma with sufficiently high spatial and temporal resolution remains challenging even with modern computers. However, such simulations can be sped up using quantum computers in the future. Here, we propose how to do such modeling for cold plasma waves, in particular, for an X wave propagating in an inhomogeneous one-dimensional plasma. The wave system is represented in the form of a vector Schr\"odinger equation with a Hermitian Hamiltonian. Block-encoding is used to represent the Hamiltonian through unitary operations that can be implemented on a quantum computer. To perform the modeling, we apply the so-called Quantum Signal Processing algorithm and construct the corresponding circuit. Quantum simulations with this circuit are emulated on a classical computer, and the results show agreement with traditional classical calculations. We also discuss how our quantum circuit scales with the resolution.


title: Convergence of Generalized Belief Propagation Algorithm on Graphs with Motifs

abstract: Belief propagation is a fundamental message-passing algorithm for numerous applications in machine learning. It is known that belief propagation algorithm is exact on tree graphs. However, belief propagation is run on loopy graphs in most applications. So, understanding the behavior of belief propagation on loopy graphs has been a major topic for researchers in different areas. In this paper, we study the convergence behavior of generalized belief propagation algorithm on graphs with motifs (triangles, loops, etc.) We show under a certain initialization, generalized belief propagation converges to the global optimum of the Bethe free energy for ferromagnetic Ising models on graphs with motifs.


title: Dissipative quantum generative adversarial networks

abstract: Noisy intermediate-scale quantum (NISQ) devices build the first generation of quantum computers. Quantum neural networks (QNNs) gained high interest as one of the few suitable quantum algorithms to run on these NISQ devices. Most of the QNNs exploit supervised training algorithms with quantum states in form of pairs to learn their underlying relation. However, only little attention has been given to unsupervised training algorithms despite interesting applications where the quantum data does not occur in pairs. Here we propose an approach to unsupervised learning and reproducing characteristics of any given set of quantum states. We build a generative adversarial model using two dissipative quantum neural networks (DQNNs), leading to the dissipative quantum generative adversarial network (DQGAN). The generator DQNN aims to produce quantum states similar to the training data while the discriminator DQNN aims to distinguish the generator's output from the training data. We find that training both parts in a competitive manner results in a well trained generative DQNN. We see our contribution as a proof of concept for using DQGANs to learn and extend unlabeled training sets.


title: Anomaly Detection in Blockchain Networks: A Comprehensive Survey

abstract: Over the past decade, blockchain technology has attracted a huge attention from both industry and academia because it can be integrated with a large number of everyday applications of modern information and communication technologies (ICT). Peer-to-peer (P2P) architecture of blockchain enhances these applications by providing strong security and trust-oriented guarantees, such as immutability, verifiability, and decentralization. Despite these incredible features that blockchain technology brings to these ICT applications, recent research has indicated that the strong guarantees are not sufficient enough and blockchain networks may still be prone to various security, privacy, and reliability issues. In order to overcome these issues, it is important to identify the anomalous behaviour within the actionable time frame. In this article, we provide an in-depth survey regarding integration of anomaly detection models in blockchain technology. For this, we first discuss how anomaly detection can aid in ensuring security of blockchain based applications. Then, we demonstrate certain fundamental evaluation metrics and key requirements that can play a critical role while developing anomaly detection models for blockchain. Afterwards, we present a thorough survey of various anomaly detection models from the perspective of each layer of blockchain. Finally, we conclude the article by highlighting certain important challenges alongside discussing how they can serve as future research directions for new researchers in the field.


title: Equidistribution of mass for random processes on finite-volume spaces

abstract: Let $G$ be a real Lie group, $\Lambda\subseteq G$ a lattice, and $X=G/\Lambda$. We fix a probability measure $\mu$ on $G$ and consider the left random walk induced on $X$. It is assumed that $\mu$ is aperiodic, has a finite first moment, spans a semisimple algebraic group without compact factors, and has two non mutually singular convolution powers. We show that for every starting point $x\in X$, the $n$-th step distribution $\mu^n*\delta_{x}$ of the walk weak-$\ast$ converges toward some homogeneous probability measure on $X$.


title: Continuous Human Action Detection Based on Wearable Inertial Data

abstract: Human action detection is a hot topic, which is widely used in video surveillance, human machine interface, healthcare monitoring, gaming, dancing training and musical instrument teaching. As inertial sensors are low cost, portable, and having no operating space, it is suitable to detect human action. In real-world applications, actions that are of interest appear among actions of non interest without pauses in between. Recognizing and detecting actions of interests from continuous action streams is more challenging and useful for real applications. Based on inertial sensor and C-MHAD smart TV gesture recognition dataset, this paper utilized different inertial sensor feature formats, then compared the performance with different deep neural network structures according to these feature formats. Experiment results show the best performance was achieved by image based inertial feature with convolution neural network, which got 51.1% F1 score.


title: An homotopical description of small presheaves

abstract: This article describes the cocompletion of a category $C$ with finite limits as the homotopy category of some equivalence 2-groupoids in coproducts of elements of $C$. This yields a simple link between several definitions of an infinitary pretopos.


title: Rare decays of the $B_s-$meson into four charged leptons in the framework of the Standard Model

abstract: In the framework of the Standard Model we present new theoretical predictions for the branching ratios, double and single differential distributions and forward -- backward leptonic asymmetries for the $\bar B_s \to \mu^+ \mu^- e^+ e^-$ decay. In our consideration we take into account the $\phi(1020)$ -- resonance contribution; the main contributions of four charmonium resonances : $\psi(3770)$, $\psi(4040)$, $\psi(4160)$ and $\psi(4415)$; $u\bar{u}$ -- resonant contribution from $\rho(770)$ and $\omega(782)$; tails contributions from $J/\psi$ and $\psi(2S)$ resonances; non -- resonant contribution of the $b\,\bar{b}$ - pairs, bremsstrahlung and the contribution of the weak annihilation. We provide the prediction for the branching ratio of $\bar B_s \to \mu^+ \mu^- e^+ e^-$ decay with and without the $\phi(1020)$ -- resonance contribution. We use the model of vector meson dominance (VMD) for calculation of resonances contributions and take into account all substantive terms in $\bar B_s \to \mu^+ \mu^- e^+ e^-$ amplitude that was not considered in the previously papers.


title: (Un)balanced holographic superconductors with electric and spin motive force coupling

abstract: We study holographic phase transitions in (2+1) dimensions that possess interacting phases which result from a direct coupling between the two U(1) gauge fields. This can be interpreted as a non-minimal interaction between the electric and spin motive forces of the dual model. We first present a new analytical solution of the Einstein-Maxwell equations that describes a black hole with charge non-equivalent to the sum of the asymptotic charges of the two U(1) gauge fields and briefly discuss formation of uncharged scalar hair on this solution. We then study the formation of charged scalar hair on an uncharged black hole background and discuss the dual description of balanced as well as unbalanced superconductors.


title: Unlocking the Power of Inline Floating-Point Operations on Programmable Switches

abstract: The advent of switches with programmable dataplanes has enabled the rapid development of new network functionality, as well as providing a platform for acceleration of a broad range of application-level functionality. However, existing switch hardware was not designed with application acceleration in mind, and thus applications requiring operations or datatypes not used in traditional network protocols must resort to expensive workarounds. Applications involving floating point data, including distributed training for machine learning and distributed query processing, are key examples. In this paper, we propose FPISA, a floating point representation designed to work efficiently in programmable switches. We first implement FPISA on an Intel Tofino switch, but find that it has limitations that impact throughput and accuracy. We then propose hardware changes to address these limitations based on the open-source Banzai switch architecture, and synthesize them in a 15-nm standard-cell library to demonstrate their feasibility. Finally, we use FPISA to implement accelerators for training for machine learning and for query processing, and evaluate their performance on a switch implementing our changes using emulation. We find that FPISA allows distributed training to use 25-75% fewer CPU cores and provide up to 85.9% better throughput in a CPU-constrained environment than SwitchML. For distributed query processing with floating point data, FPISA enables up to 2.7x better throughput than Spark.


title: Selecting Parallel In-domain Sentences for Neural Machine Translation Using Monolingual Texts

abstract: Continuously-growing data volumes lead to larger generic models. Specific use-cases are usually left out, since generic models tend to perform poorly in domain-specific cases. Our work addresses this gap with a method for selecting in-domain data from generic-domain (parallel text) corpora, for the task of machine translation. The proposed method ranks sentences in parallel general-domain data according to their cosine similarity with a monolingual domain-specific data set. We then select the top K sentences with the highest similarity score to train a new machine translation system tuned to the specific in-domain data. Our experimental results show that models trained on this in-domain data outperform models trained on generic or a mixture of generic and domain data. That is, our method selects high-quality domain-specific training instances at low computational cost and data size.


title: Latent Community Adaptive Network Regression

abstract: The study of network data in the social and health sciences frequently concentrates on two distinct tasks (1) detecting community structures among nodes and (2) associating covariate information to edge formation. In much of this data, it is likely that the effects of covariates on edge formation differ between communities (e.g. age might play a different role in friendship formation in communities across a city). In this work, we introduce a latent space network model where coefficients associated with certain covariates can depend on latent community membership of the nodes. We show that ignoring such structure can lead to either over- or under-estimation of covariate importance to edge formation and propose a Markov Chain Monte Carlo approach for simultaneously learning the latent community structure and the community specific coefficients. We leverage efficient spectral methods to improve the computational tractability of our approach.


title: CHAMP: Coherent Hardware-Aware Magnitude Pruning of Integrated Photonic Neural Networks

abstract: We propose a novel hardware-aware magnitude pruning technique for coherent photonic neural networks. The proposed technique can prune 99.45% of network parameters and reduce the static power consumption by 98.23% with a negligible accuracy loss.


title: A Multirate Discontinuous-Galerkin-in-Time Framework for Interface-Coupled Problems

abstract: A framework is presented to design multirate time stepping algorithms for two dissipative models with coupling across a physical interface. The coupling takes the form of boundary conditions imposed on the interface, relating the solution variables for both models to each other. The multirate aspect arises when numerical time integration is performed with different time step sizes for the component models. In this paper, we seek to identify a unified approach to develop multirate algorithms for these coupled problems. This effort is pursued though the use of discontinuous-Galerkin time stepping methods, acting as a general unified framework, with different time step sizes. The subproblems are coupled across user-defined intervals of time, called {\it coupling windows}, using polynomials that are continuous on the window. The coupling method is shown to reproduce the correct interfacial energy dissipation, discrete conservation of fluxes, and asymptotic accuracy. In principle, methods of arbitrary order are possible. As a first step, herein we focus on the presentation and analysis of monolithic methods for advection-diffusion models coupled via generalized Robin-type conditions. The monolithic methods could be computed using a Schur-complement approach. We conclude with some discussion of future developments, such as different interface conditions and partitioned methods.


title: Tuning Stoichiometry to Promote Formation of Binary Colloidal Superlattices

abstract: The self-assembly of binary nanoparticle superlattices from colloidal mixtures is a promising method for the fabrication of complex colloidal co-crystal structures. However, binary mixtures often form amorphous or metastable phases instead of the thermodynamically stable phase. Here we show that in binary mixtures of differently sized spherical particles, an excess of the smaller component can promote -- and, in some cases, may be necessary for -- the self-assembly of a binary co-crystal. Using computer simulations, we identify two mechanisms responsible for this phenomenon. First, excess small particles act like plasticizers and enable systems to reach a greater supersaturation before kinetic arrest occurs. Second, they can disfavor competing structures that may interfere with the growth of the target structure. We find the phase behavior of simulated mixtures of hard spheres closely matches published experimental results. We demonstrate the generality of our findings for mixtures of particles of arbitrary shape by presenting a binary mixture of hard shapes that only self-assembles with an excess of the smaller component. mixtures of particles of arbitrary shape by presenting a binary mixture of hard shapes that only self-assembles with an excess of the smaller component.


title: Confidence intervals for the random forest generalization error

abstract: We show that the byproducts of the standard training process of a random forest yield not only the well known and almost computationally free out-of-bag point estimate of the model generalization error, but also give a direct path to compute confidence intervals for the generalization error which avoids processes of data splitting and model retraining. Besides the low computational cost involved in their construction, these confidence intervals are shown through simulations to have good coverage and appropriate shrinking rate of their width in terms of the training sample size.


title: NeuroHSMD: Neuromorphic Hybrid Spiking Motion Detector

abstract: Vertebrate retinas are highly-efficient in processing trivial visual tasks such as detecting moving objects, yet a complex challenges for modern computers. In vertebrates, the detection of object motion is performed by specialised retinal cells named Object Motion Sensitive Ganglion Cells (OMS-GC). OMS-GC process continuous visual signals and generate spike patterns that are post-processed by the Visual Cortex. Our previous Hybrid Sensitive Motion Detector (HSMD) algorithm was the first hybrid algorithm to enhance Background subtraction (BS) algorithms with a customised 3-layer Spiking Neural Network (SNN) that generates OMS-GC spiking-like responses. In this work, we present a Neuromorphic Hybrid Sensitive Motion Detector (NeuroHSMD) algorithm that accelerates our HSMD algorithm using Field-Programmable Gate Arrays (FPGAs). The NeuroHSMD was compared against the HSMD algorithm, using the same 2012 Change Detection (CDnet2012) and 2014 Change Detection (CDnet2014) benchmark datasets. When tested against the CDnet2012 and CDnet2014 datasets, NeuroHSMD performs object motion detection at 720x480 at 28.06 Frames Per Second (fps) and 720x480 at 28.71 fps, respectively, with no degradation of quality. Moreover, the NeuroHSMD proposed in this paper was completely implemented in Open Computer Language (OpenCL) and therefore is easily replicated in other devices such as Graphical Processing Units (GPUs) and clusters of Central Processing Units (CPUs).


title: Improving Vision Transformers for Incremental Learning

abstract: This paper proposes a working recipe of using Vision Transformer (ViT) in class incremental learning. Although this recipe only combines existing techniques, developing the combination is not trivial. Firstly, naive application of ViT to replace convolutional neural networks (CNNs) in incremental learning results in serious performance degradation. Secondly, we nail down three issues of naively using ViT: (a) ViT has very slow convergence when the number of classes is small, (b) more bias towards new classes is observed in ViT than CNN-based architectures, and (c) the conventional learning rate of ViT is too low to learn a good classifier layer. Finally, our solution, named ViTIL (ViT for Incremental Learning) achieves new state-of-the-art on both CIFAR and ImageNet datasets for all three class incremental learning setups by a clear margin. We believe this advances the knowledge of transformer in the incremental learning community. Code will be publicly released.


title: Synthetic Map Generation to Provide Unlimited Training Data for Historical Map Text Detection

abstract: Many historical map sheets are publicly available for studies that require long-term historical geographic data. The cartographic design of these maps includes a combination of map symbols and text labels. Automatically reading text labels from map images could greatly speed up the map interpretation and helps generate rich metadata describing the map content. Many text detection algorithms have been proposed to locate text regions in map images automatically, but most of the algorithms are trained on out-ofdomain datasets (e.g., scenic images). Training data determines the quality of machine learning models, and manually annotating text regions in map images is labor-extensive and time-consuming. On the other hand, existing geographic data sources, such as Open- StreetMap (OSM), contain machine-readable map layers, which allow us to separate out the text layer and obtain text label annotations easily. However, the cartographic styles between OSM map tiles and historical maps are significantly different. This paper proposes a method to automatically generate an unlimited amount of annotated historical map images for training text detection models. We use a style transfer model to convert contemporary map images into historical style and place text labels upon them. We show that the state-of-the-art text detection models (e.g., PSENet) can benefit from the synthetic historical maps and achieve significant improvement for historical map text detection.