title: Intra-Day Variability Observations of Two Dozens of Blazars at 4.8 GHz

abstract: Two dozens of radio loud active galactic nuclei (AGNs) have been observed with Urumqi 25 m radio telescope in order to search for intra-day variability (IDV). The target sources are blazars (namely flat spectrum radio quasars and BL Lac objects) which are mostly selected from the observing list of RadioAstron AGN monitoring campaigns. The observations were carried out at 4.8 GHz in two sessions of 8-12 February 2014 and 7-9 March respectively. We report the data reduction and the first results of observations. The results show that the majority of the blazars exhibit IDV in 99.9% confidence level, some of them show quite strong IDV. We find the strong IDV of blazar 1357 + 769 for the first time. The IDV at centimeter-wavelength is believed to be predominately caused by the scintillation of blazar emission through the local interstellar medium in a few hundreds parsecs away from Sun. No significant correlation between the IDV strength and either redshift or Galactic latitude is found in our sample. The IDV timescale along with source structure and brightness temperature analysis will be presented in a forthcoming paper.


title: Unoccupied Topological Surface State in MnBi$_2$Te$_4$

abstract: The unoccupied part of the band structure in the magnetic topological insulator MnBi$_2$Te$_4$ is studied by first-principles calculations. We find a second, unoccupied topological surface state with similar electronic structure to the celebrated occupied topological surface state. This state is energetically located approximate $1.6$ eV above the occupied Dirac surface state around $\Gamma$ point, which permit it to be directly observed by the two-photon angle-resolved photoemission spectroscopy. We propose a unified effective model for the occupied and unoccupied surface states. Due to the direct optical coupling between these two surface states, we further propose two optical effects to detect the unoccupied surface state. One is the polar Kerr effect in odd layer from nonvanishing ac Hall conductance $\sigma_{xy}(\omega)$, and the other is higher-order terahertz-sideband generation in even layer, where the non-vanishining Berry curvature of the unoccupied surface state is directly observed from the giant Faraday rotation of optical emission.


title: Joint order assignment and picking station scheduling in KIVA warehouses with multiple stations

abstract: We consider the problem of allocating orders to multiple stations and sequencing the interlinked order and rack processing flows in each station in the robot-assisted KIVA warehouse. The various decisions involved in the problem, which are closely associated and must be solved in real time, are often tackled separately for ease of treatment. However, exploiting the synergy between order assignment and picking station scheduling benefits picking efficiency. We develop a comprehensive mathematical model that takes the synergy into consideration to minimize the total number of rack visits. To solve this intractable problem, we develop an efficient algorithm based on simulated annealing and beam search. Computational studies show that our proposed approach outperforms the rule-based greedy policy and the independent picking station scheduling method in terms of solution quality, saving over one-third and one-fifth of rack visits compared with the former and latter, respectively.


title: Spectral radius, edge-disjoint cycles and cycles of the same length

abstract: In this paper, we give spectral conditions to guarantee the existence of two edge disjoint cycles and two cycles of the same length. These two results can be seen as spectral analogues of Erd\H{o}s and Posa's size condition and Erd\H{o}s' classic problem on non existence of two cycles of the same length. By using double leading eigenvectors skill, we further give spectral condition to guarantee the existence of $k$ edge disjoint triangles.


title: Estimation of Playable Piano Fingering by Pitch-difference Fingering Matching Model

abstract: The existing piano fingering labeling statistical models usually consider the constraints among the fingers and the correlation between fingering and notes, and rarely include the relationship among the notes directly. The limited learned finger-transfer rules often cause that some parts of the fingering cannot be playable in fact. And traditional models often adopt the original notes, which cannot help to explore the mapping nature between the pitches and fingering. Inspired from manual-ly annotation which acquire the fingering knowledge directly from pitch-difference, we proposed a pitch-difference sequence and fingering (PdF) matching model. And to get playable fingering, be-sides learned finger-transfer rules, prior finger-transfer knowledge is especially combined into the model. In order to characterize the playable performance of the model, we also presented a new evaluation index named incapable-performing fingering rate (IFR). Comprehensive experimental re-sults show that compared with the existing state-of-the-art third-order hidden Markov labeling model, the general and the highest matching rate of our model increases by 3% and 1.6% respective-ly, and the fingering for all scores can be playable.


title: Search for heavy particles in the $b$-tagged dijet mass distribution with additional $b$-tagged jets in proton-proton collisions at $\sqrt{s} = 13$ TeV with the ATLAS experiment

abstract: A search optimized for new heavy particles decaying to two $b$-quarks and produced in association with additional $b$-quarks is reported. The sensitivity is improved by $b$-tagging at least one lower-$p_{\rm{T}}$ jet in addition to the two highest-$p_{\rm{T}}$ jets. The data used in this search correspond to an integrated luminosity of 103 $\text{fb}^{-1}$ collected with a dedicated trijet trigger during the 2017 and 2018 $\sqrt{s} = 13$ TeV proton-proton collision runs with the ATLAS detector at the LHC. The search looks for resonant peaks in the $b$-tagged dijet invariant mass spectrum over a smoothly falling background. The background is estimated with an innovative data-driven method based on orthonormal functions. The observed $b$-tagged dijet invariant mass spectrum is compatible with the background-only hypothesis. Upper limits at 95% confidence level on a heavy vector-boson production cross section times branching ratio to a pair of $b$-quarks are derived.


title: ASASSN-V J205543.90+240033.5: another white dwarf pulsar?

abstract: I found that ASASSN-V J205543.90+240033.5 shows large-amplitude (1.2-1.4 mag) nearly sinusoidal variations with a period of 10.803(2) d and very short period variations with a period of 0.0068 d using Public Data Release of Zwicky Transient Facility observations. The only known object that shows a similar combination of nearly sinusoidal reflection variations and very short period, large-amplitude variations is the unique white dwarf pulsar AR Sco. ASASSN-V J205543.90+240033.5 appears to be very similar to AR Sco and observations at various wavelengths are desired.


title: A Grover search-based algorithm for the list coloring problem

abstract: Graph coloring is a computationally difficult problem, and currently the best known classical algorithm for $k$-coloring of graphs on $n$ vertices has runtimes $\Omega(2^n)$ for $k\ge 5$. The list coloring problem asks the following more general question: given a list of available colors for each vertex in a graph, does it admit a proper coloring? We propose a quantum algorithm based on Grover search to quadratically speed up exhaustive search. Our algorithm loses in complexity to classical ones in specific restricted cases, but improves exhaustive search for cases where the lists and graphs considered are arbitrary in nature.


title: Suspicious ARP Activity Detection and Clustering Based on Autoencoder Neural Networks

abstract: The rapidly increasing number of smart devices on the Internet necessitates an efficient inspection system for safeguarding our networks from suspicious activities such as Address Resolution Protocol (ARP) probes. In this research, we analyze sequence data of ARP traffic on LAN based on the numerical count and degree of its packets. Moreover, a dynamic threshold is employed to detect underlying suspicious activities, which are further converted into feature vectors to train an unsupervised autoencoder neural network. Then, we leverage K-means clustering to separate the extracted latent features of suspicious activities from the autoencoder into various patterns. Besides, to evaluate the performance, we collect and adopt a real-world network traffic dataset from five different LANs. At last, we successfully detect suspicious ARP patterns varying in scale, lifespan, and regularity on the LANs.


title: The PICASSO map-making code: application to a simulation of the QUIJOTE northern sky survey

abstract: Map-making is an important step for the data analysis of Cosmic Microwave Background (CMB) experiments. It consists of converting the data, which are typically a long, complex and noisy collection of measurements, into a map, which is an image of the observed sky. We present in this paper a new map-making code named PICASSO (Polarization and Intensity CArtographer for Scanned Sky Observations), which was implemented to construct intensity and polarization maps from the Multi Frequency Instrument (MFI) of the QUIJOTE (Q-U-I Joint TEnerife) CMB polarization experiment. PICASSO is based on the destriping algorithm, and is suited to address specific issues of ground-based microwave observations, with a technique that allows the fit of a template function in the time domain, during the map-making step. This paper describes the PICASSO code, validating it with simulations and assessing its performance. For this purpose, we produced realistic simulations of the QUIJOTE-MFI survey of the northern sky (approximately $\sim 20,000\,$deg$^2$), and analysed the reconstructed maps with PICASSO, using real and harmonic space statistics. We show that, for this sky area, PICASSO is able to reconstruct, with high fidelity, the injected signal, recovering all the scales with $\ell>10$ in TT, EE and BB. The signal error is better than 0.001% at $20<\ell<200$. Finally, we validated some of the methods that will be applied to the real wide-survey data, like the detection of the CMB anisotropies via cross-correlation analyses. Despite that the implementation of PICASSO is specific for QUIJOTE-MFI data, it could be adapted to other experiments.


title: Intersection spaces and multiple transverse recurrence

abstract: We study multiple recurrence properties along separated cross sections for pmp actions of unimodular lcsc group on Polish spaces. We establish a multiple transverse recurrence theorem under the assumption that sufficiently large powers of the return time set are Delone sets. Typical examples of such situations arise from the theory of uniform approximate lattices.


title: Regulating Ownership Verification for Deep Neural Networks: Scenarios, Protocols, and Prospects

abstract: With the broad application of deep neural networks, the necessity of protecting them as intellectual properties has become evident. Numerous watermarking schemes have been proposed to identify the owner of a deep neural network and verify the ownership. However, most of them focused on the watermark embedding rather than the protocol for provable verification. To bridge the gap between those proposals and real-world demands, we study the deep learning model intellectual property protection in three scenarios: the ownership proof, the federated learning, and the intellectual property transfer. We present three protocols respectively. These protocols raise several new requirements for the bottom-level watermarking schemes.


title: Testing the Effect of Solar Wind Parameters and Geomagnetic Storm Indices on Galactic Cosmic Ray Flux Variation with Automated-Selected Forbush Decreases

abstract: Forbush decrease (FD), discovered by Scott E. Forbush about 80 years ago, is reffered to as the non-repetitive short-term depression in galactic cosmic ray (GCR) flux, presumed to be associated with large-scale perturbations in solar wind and interplanetary magnetic field (IMF). It is the most spectacular variability in the GCR intensity which appear to be the compass for investigators seeking solar-terrestrial relationships. The method of selection and validation of FD events are very important to cosmic ray scientists. We have deployed a new computer software to determine the amplitude and timing of FDs from daily-averaged cosmic ray (CR) data at OULU neutron monitor station. The code selected 230 FDs between 1998 and 2002. In an attempt to validate the new FD automated catalog, the relationship between the amplitude of FDs, and IMF, solar wind speed (SWS) and geomagnetic storm indices (Dst, kp, ap) is tested here. A two-dimensional regression analysis indicates significant linear relationship between large FDs (CR(\%) $\leq-3$) and solar wind data and geomagnetic storm indices in the present sample. The implications of the relationship among these parameters are discussed.


title: Relativistic corrections for measuring Hubble's constant to 1% using stellar standard candles

abstract: Relativistic corrections are estimated for classical Cepheids and the Tip of the Red Giant Branch (TRGB stars), to enable future unbiased 1% measurements of Hubble's constant, $H_0$. We considered four effects: $K-$corrections, time-dilation, the apparent change of host dust extinction due to non-comoving reference frames, and the change of observed color due to redshift. Extinction-dependent $K-$corrections were computed using stellar atmosphere models applicable to giant stars for $0.005 < z < 0.03$ in HST, JWST, and 2MASS filters. The optical-NIR Wesenheit function advantageously combines filters with oppositely signed $K-$corrections and avoids complications due to host extinction. For TRGB stars, the JWST/NIRCAM F277W filter combines insensitivity to reddening with $K-$corrections $<1$% at Coma cluster distances. Missing corrections for host extinction due to circumgalactic or circumstellar material are discussed as potential systematics for TRGB distances although their impacts are insufficient to explain differences between $H_0$ based on Cepheid or TRGB supernova calibrations. All stellar standard candles require relativistic corrections to achieve an unbiased 1% $H_0$ measurement in the future. The combined relativistic correction involving $K$, redshift-Leavitt bias, and the redshift-dependence of the Wesenheit function yield an increase of the Cepheid-based $H_0$ by $0.45 \pm 0.05$ km/s/Mpc to $73.65 \pm 1.30$ km/s/Mpc and raises the tension with the {\it Planck} value from $4.2\sigma$ to $4.4\sigma$. For TRGB stars, we estimate a $\sim 0.5\%$ increase of $H_0$ reported by Freedman et al. (to $70.2\pm1.7$km/s/Mpc) and a small decrease by $-0.15\%$ for $H_0$ reported by Anand et al. (to $71.4 \pm 1.8$km/s/Mpc). The opposite sign of these corrections is due to different reddening systematics and reduces the difference between the studies by $\sim 0.46$km/s/Mpc.[abridged]


title: Natural vibrations of curved nano-beams and nano-arches

abstract: The natural vibrations of curved nano-beams and nano-arches are studied. The nano-arches under consideration have piece-wise constant thickness; these are weakened with stable cracks located at-entrant corners of the steps. A method of determination of natural frequencies is developed making use of the method of weightless rotating spring. The aim of the paper is to assess the sensitivity of the eigenfrequencies on the geometrical and physical parameters of the nano-arch. The results of the calculations favourably compare with similar works of other researchers.


title: An Adaptive Interpolation Scheme for Wideband Frequency Sweep in Electromagnetic Simulations

abstract: An adaptive interpolation scheme is proposed to accurately calculate the wideband responses in electromagnetic simulations. In the proposed scheme, the sampling points are first carefully divided into several groups based on their responses to avoid the Runge phenomenon and the error fluctuations, and then different interpolation strategies are used to calculate the responses in the whole frequency band. If the relative error does not satisfy the predefined threshold in a specific frequency band, it will be refined until the error criteria is met. The detailed error analysis is also presented to verify the accuracy of the interpolation scheme. At last, two numerical examples including the antenna radiation and the filter simulation are carried out to validate its accuracy and efficiency.


title: SoMeSci- A 5 Star Open Data Gold Standard Knowledge Graph of Software Mentions in Scientific Articles

abstract: Knowledge about software used in scientific investigations is important for several reasons, for instance, to enable an understanding of provenance and methods involved in data handling. However, software is usually not formally cited, but rather mentioned informally within the scholarly description of the investigation, raising the need for automatic information extraction and disambiguation. Given the lack of reliable ground truth data, we present SoMeSci (Software Mentions in Science) a gold standard knowledge graph of software mentions in scientific articles. It contains high quality annotations (IRR: $\kappa{=}.82$) of 3756 software mentions in 1367 PubMed Central articles. Besides the plain mention of the software, we also provide relation labels for additional information, such as the version, the developer, a URL or citations. Moreover, we distinguish between different types, such as application, plugin or programming environment, as well as different types of mentions, such as usage or creation. To the best of our knowledge, SoMeSci is the most comprehensive corpus about software mentions in scientific articles, providing training samples for Named Entity Recognition, Relation Extraction, Entity Disambiguation, and Entity Linking. Finally, we sketch potential use cases and provide baseline results.


title: CP-violating Axions

abstract: While the axion was originally introduced to wash out CP violation from strong interactions, new sources of CP violation beyond QCD might manifest themselves via a tiny scalar axion-nucleon component. The latter can be experimentally probed in axion-mediated force experiments, as suggested long ago by J.E. Moody and F. Wilczek. In the present note, I review the physical origin of CP-violating axion couplings and point out the special role of the QCD axion as a low-energy portal to high-energy sources of CP violation.


title: Kompetenzerwerbsf\"orderung durch E-Assessment: Individuelle Kompetenzerfassung am Beispiel des Fachs Mathematik

abstract: In this article, we present a concept of how micro- and e-assessments can be used for the mathematical domain to automatically determine acquired and missing individual skills and, based on these information, guide individuals to acquire missing or additional skills in a software-supported process. The models required for this concept are a digitally prepared and annotated e-assessment item pool, a digital modeling of the domain that includes topics, necessary competencies, as well as introductory and continuative material, as well as a digital individual model, which can reliably record competencies and integrates aspects about the loss of such.


title: From Research to Proof-of-Concept: Analysis of a Deployment of FPGAs on a Commercial Search Engine

abstract: FPGAs are quickly becoming available in the cloud as a one more heterogeneous processing element complementing CPUs and GPUs. There are many reports in the literature showing the potential for FPGAs to accelerate a wide variety of algorithms, which combined with their growing availability, would seem to also indicate a widespread use in many applications. Unfortunately, there is not much published research exploring what it takes to integrate an FPGA into an existing application in a cost-effective way and keeping the algorithmic performance advantages. Building on recent results exploring how to employ FPGAs to improve the search engines used in the travel industry, this paper analyses the end-to-end performance of the search engine when using FPGAs, as well as the necessary changes to the software and the cost of such deployments. The results provide important insights on current FPGA deployments and what needs to be done to make FPGAs more widely used. For instance, the large potential performance gains provided by an FPGA are greatly diminished in practice if the application cannot submit request in the most optimal way, something that is not always possible and might require significant changes to the application. Similarly, some existing cloud deployments turn out to use a very imbalanced architecture: a powerful FPGA connected to a not so powerful CPU. The result is that the CPU cannot generate enough load for the FPGA, which potentially eliminates all performance gains and might even result in a more expensive system. In this paper, we report on an extensive study and development effort to incorporate FPGAs into a search engine and analyse the issues encountered and their practical impact. We expect that these results will inform the development and deployment of FPGAs in the future by providing important insights on the end-to-end integration of FPGAs within existing systems.


title: Modular Nuclearity and Entanglement Entropy

abstract: In the framework of Quantum Field Theory, several operator algebraic notions of entanglement entropy can be associated to any couple of causally disjoint and distant spacetime regions $\mathcal{S}_A$ and $\mathcal{S}_B$. In this work we show that the Longo's canonical entanglement entropy is finite in any local QFT verifying a modular $p$-nuclearity condition for some $0 < p <1$. Furthermore, if we assume conformal covariance then by comparison with other entanglement measures we can state that this entanglement entropy satisfies lower bounds of area law type when the distance between $\mathcal{S}_A$ and $\mathcal{S}_B$ approaches to zero. As application, in $1+1$-dimensional integrable models with factorizing S-matrices we study the asymptotic behavior of the canonical entanglement entropy as the distance between two causally disjoint wedges diverges.


title: Semi-supervised learning for joint SAR and multispectral land cover classification

abstract: Semi-supervised learning techniques are gaining popularity due to their capability of building models that are effective, even when scarce amounts of labeled data are available. In this paper, we present a framework and specific tasks for self-supervised pretraining of \textit{multichannel} models, such as the fusion of multispectral and synthetic aperture radar images. We show that the proposed self-supervised approach is highly effective at learning features that correlate with the labels for land cover classification. This is enabled by an explicit design of pretraining tasks which promotes bridging the gaps between sensing modalities and exploiting the spectral characteristics of the input. In a semi-supervised setting, when limited labels are available, using the proposed self-supervised pretraining, followed by supervised finetuning for land cover classification with SAR and multispectral data, outperforms conventional approaches such as purely supervised learning, initialization from training on ImageNet and other recent self-supervised approaches.


title: PASTO: Strategic Parameter Optimization in Recommendation Systems -- Probabilistic is Better than Deterministic

abstract: Real-world recommendation systems often consist of two phases. In the first phase, multiple predictive models produce the probability of different immediate user actions. In the second phase, these predictions are aggregated according to a set of 'strategic parameters' to meet a diverse set of business goals, such as longer user engagement, higher revenue potential, or more community/network interactions. In addition to building accurate predictive models, it is also crucial to optimize this set of 'strategic parameters' so that primary goals are optimized while secondary guardrails are not hurt. In this setting with multiple and constrained goals, this paper discovers that a probabilistic strategic parameter regime can achieve better value compared to the standard regime of finding a single deterministic parameter. The new probabilistic regime is to learn the best distribution over strategic parameter choices and sample one strategic parameter from the distribution when each user visits the platform. To pursue the optimal probabilistic solution, we formulate the problem into a stochastic compositional optimization problem, in which the unbiased stochastic gradient is unavailable. Our approach is applied in a popular social network platform with hundreds of millions of daily users and achieves +0.22% lift of user engagement in a recommendation task and +1.7% lift in revenue in an advertising optimization scenario comparing to using the best deterministic parameter strategy.


title: The Haj{\l}asz capacity density condition is self-improving

abstract: We prove a self-improvement property of a capacity density condition for a nonlocal Hajlasz gradient in complete geodesic spaces. The proof relates the capacity density condition with boundary Poincar\'e inequalities, adapts Keith-Zhong techniques for establishing local Hardy inequalities and applies Koskela-Zhong arguments for proving self-improvement properties of local Hardy inequalities. This leads to a characterization of the Hajlasz capacity density condition in terms of a strict upper bound on the upper Assouad codimension of the underlying set, which shows the self-improvement property of the Hajlasz capacity density condition.


title: Sensitivity of the Cherenkov Telescope Array to a dark matter signal from the Galactic centre

abstract: High-energy gamma rays are promising tools to constrain or reveal the nature of dark matter, in particular Weakly Interacting Massive Particles. Being well into its pre-construction phase, the Cherenkov Telescope Array (CTA) will soon probe the sky in the 20 GeV - 300 TeV energy range. Thanks to its improved energy and angular resolutions as well as significantly larger effective area when compared to the current generation of Cherenkov telescopes, CTA is expected to probe heavier dark matter, with unprecedented sensitivity, reaching the thermal annihilation cross-section at ~1 TeV. This talk will summarise the planned dark matter search strategies with CTA, focusing on the signal from the Galactic centre. As observed with the Fermi LAT at lower energies, this region is rather complex and CTA will be the first ground-based observatory sensitive to the large scale diffuse astrophysical emission from that region. We report on the collaboration effort to study the impact of such extended astrophysical backgrounds on the dark matter search, based on Fermi-LAT data in order to guide our observational strategies, taking into account various sources of systematic uncertainty.


title: Structure-Preserving Deraining with Residue Channel Prior Guidance

abstract: Single image deraining is important for many high-level computer vision tasks since the rain streaks can severely degrade the visibility of images, thereby affecting the recognition and analysis of the image. Recently, many CNN-based methods have been proposed for rain removal. Although these methods can remove part of the rain streaks, it is difficult for them to adapt to real-world scenarios and restore high-quality rain-free images with clear and accurate structures. To solve this problem, we propose a Structure-Preserving Deraining Network (SPDNet) with RCP guidance. SPDNet directly generates high-quality rain-free images with clear and accurate structures under the guidance of RCP but does not rely on any rain-generating assumptions. Specifically, we found that the RCP of images contains more accurate structural information than rainy images. Therefore, we introduced it to our deraining network to protect structure information of the rain-free image. Meanwhile, a Wavelet-based Multi-Level Module (WMLM) is proposed as the backbone for learning the background information of rainy images and an Interactive Fusion Module (IFM) is designed to make full use of RCP information. In addition, an iterative guidance strategy is proposed to gradually improve the accuracy of RCP, refining the result in a progressive path. Extensive experimental results on both synthetic and real-world datasets demonstrate that the proposed model achieves new state-of-the-art results. Code: https://github.com/Joyies/SPDNet


title: Programmed Wrapping and Assembly of Droplets with Mesoscale Polymers

abstract: Nature is remarkably adept at using interfaces to build structures, encapsulate reagents, and regulate biological processes. Inspired by Nature, we describe flexible polymer-based ribbons, termed "mesoscale polymers" (MSPs), to modulate interfacial interactions with liquid droplets. This produces unprecedented hybrid assemblies in the forms of flagellum-like structures and MSP-wrapped droplets. Successful preparation of these hybrid structures hinges on interfacial interactions and tailored MSP compositions, such as MSPs with domains possessing distinctly different affinity for fluid-fluid interfaces as well as mechanical properties. In situ measurements of MSP-droplet interactions confirm that MSPs possess a negligible bending stiffness, allowing interfacial energy to drive mesoscale assembly. By exploiting these interfacial driving forces, mesoscale polymers are demonstrated as a powerful platform that underpins the preparation of sophisticated hybrid structures in fluids.


title: FedSkel: Efficient Federated Learning on Heterogeneous Systems with Skeleton Gradients Update

abstract: Federated learning aims to protect users' privacy while performing data analysis from different participants. However, it is challenging to guarantee the training efficiency on heterogeneous systems due to the various computational capabilities and communication bottlenecks. In this work, we propose FedSkel to enable computation-efficient and communication-efficient federated learning on edge devices by only updating the model's essential parts, named skeleton networks. FedSkel is evaluated on real edge devices with imbalanced datasets. Experimental results show that it could achieve up to 5.52$\times$ speedups for CONV layers' back-propagation, 1.82$\times$ speedups for the whole training process, and reduce 64.8% communication cost, with negligible accuracy loss.


title: The luminosity function of TeV-emitting BL Lacs: observations of an HBL sample with VERITAS

abstract: High-frequency-peaked BL Lacs (HBLs) dominate the extragalactic TeV sky, with more than 50 objects detected by the current generation of TeV observatories. Still, the properties of TeV-emitting HBLs as a population are poorly understood due to biases introduced by the observing strategies of Cherenkov Telescopes, limiting our ability to estimate the potential contribution of TeV blazars to the diffuse neutrino, gamma-ray, and cosmic-ray background as well as their role in the late-stage evolution of active galactic nuclei. The VERITAS telescope array has designed a program to quantify and minimize observational biases by selecting a sample of 36 HBLs and measuring their TeV flux at times that are not weighted towards high-flux states. Such a survey could form the basis for a measurement of the luminosity function of TeV-emitting HBLs.


title: A Theoretical Analysis of the Stationarity of an Unrestricted Autoregression Process

abstract: The higher dimensional autoregressive models would describe some of the econometric processes relatively generically if they incorporate the heterogeneity in dependence on times. This paper analyzes the stationarity of an autoregressive process of dimension $k>1$ having a sequence of coefficients $\beta$ multiplied by successively increasing powers of $0<\delta<1$. The theorem gives the conditions of stationarity in simple relations between the coefficients and $k$ in terms of $\delta$. Computationally, the evidence of stationarity depends on the parameters. The choice of $\delta$ sets the bounds on $\beta$ and the number of time lags for prediction of the model.


title: Fastformer: Additive Attention Can Be All You Need

abstract: Transformer is a powerful model for text understanding. However, it is inefficient due to its quadratic complexity to input sequence length. Although there are many methods on Transformer acceleration, they are still either inefficient on long sequences or not effective enough. In this paper, we propose Fastformer, which is an efficient Transformer model based on additive attention. In Fastformer, instead of modeling the pair-wise interactions between tokens, we first use additive attention mechanism to model global contexts, and then further transform each token representation based on its interaction with global context representations. In this way, Fastformer can achieve effective context modeling with linear complexity. Extensive experiments on five datasets show that Fastformer is much more efficient than many existing Transformer models and can meanwhile achieve comparable or even better long text modeling performance.


title: On the distribution function of suprathermal particles at collisionless shocks

abstract: The departure of particle distributions from the Maxwellian is commonly observed in space plasmas. These non-Maxwellian distributions which are typical for plasmas that are not in thermal equilibrium, can be modeled with $\kappa$-distribution. Kinetic simulations of quasi-parallel collisionless shocks show that proton distribution is a composite of thermal, suprathermal, and non-thermal parts. By using particle-in-cell shock simulations, we show that $\kappa$-distribution adequately fits thermal and suprathermal parts together, as a single continuous distribution in early proton spectra. We derive suprathermal proton distribution directly from the generalized entropy of non-extensive statistical mechanics, and show that thermal and suprathermal populations are both naturally embedded in $\kappa$-distribution. We find that the index $\kappa$ of the distribution increases with the distance from the shock, following the decrease in suprathermal part. The non-equilibrium plasma distribution which is continuously being enriched with suprathermal particles at the reforming shock barrier, reaches the thermal equilibrium in the far downstream. The suprathermal part completely fades there, and the shape of proton distribution becomes a Maxwellian from which directly emerges a power-law.


title: Spectral and norm estimates for matrix sequences arising from a finite difference approximation of elliptic operators

abstract: When approximating elliptic problems by using specialized approximation techniques, we obtain large structured matrices whose analysis provides information on the stability of the method. Here we provide spectral and norm estimates for matrix sequences arising from the approximation of the Laplacian via ad hoc finite differences. The analysis involves several tools from matrix theory and in particular from the setting of Toeplitz operators and Generalized Locally Toeplitz matrix sequences. Several numerical experiments are conducted, which confirm the correctness of the theoretical findings.


title: High-dimensional acousto-optoelectric correlation spectroscopy reveals coupled carrier dynamics in polytypic nanowires

abstract: The authors combine acousto-optoelectric and multi-channel photon correlation spectroscopy to probe spatio-temporal carrier dynamics induced by a piezoelectric surface acoustic wave (SAW). The technique is implemented by combining phase-locked optical micro-photoluminescence spectroscopy and simultaneous three-channel time resolved detection. From the recorded time correlated single photon counting data the time transients of individual channels and the second and third order correlation functions are obtained with sub-nanosecond resolution. The method is validated by probing the correlations SAW-driven carrier dynamics between three decay channels of a single polytypic semiconductor nanowire on a conventional LiNbO$_\mathrm{3}$ SAW delay line chip. The method can be readily applied to other types of nanosystems and probe SAW-regulated charge state preparation in quantum dots, charge transfer processes in van der Waals heterostructures or other types of hybrid nanoarchitectures.


title: Self-similar blow-up patterns for a reaction-diffusion equation with weighted reaction in general dimension

abstract: We classify the finite time blow-up profiles for the following reaction-diffusion equation with unbounded weight: $$ \partial_tu=\Delta u^m+|x|^{\sigma}u^p, $$ posed in any space dimension $x\in\mathbf{R}^N$, $t\geq0$ and with exponents $m>1$, $p\in(0,1)$ and $\sigma>2(1-p)/(m-1)$. We prove that blow-up profiles in backward self-similar form exist for the indicated range of parameters, showing thus that the unbounded weight has a strong influence on the dynamics of the equation, merging with the nonlinear reaction in order to produce finite time blow-up. We also prove that all the blow-up profiles are \emph{compactly supported} and might present two different types of interface behavior and three different possible \emph{good behaviors} near the origin, with direct influence on the blow-up behavior of the solutions. We classify all these profiles with respect to these different local behaviors depending on the magnitude of $\sigma$. This paper generalizes in dimension $N>1$ previous results by the authors in dimension $N=1$ and also includes some finer classification of the profiles for $\sigma$ large that is new even in dimension $N=1$.


title: Large and very singular solutions to semilinear elliptic equations

abstract: We consider equation $-\Delta u+f(x,u)=0$ in smooth bounded domain $\Omega\in\mathbb{R}^N$, $N\geqslant2$, with $f(x,r)>0$ in $\Omega\times\mathbb{R}^1_+$ and $f(x,r)=0$ on $\partial\Omega$. We find the condition on the order of degeneracy of $f(x,r)$ near $\partial\Omega$, which is a criterion of the existence-nonexistence of a very singular solution with a strong point singularity on $\partial\Omega$. Moreover, we prove that the mentioned condition is a sufficient condition for the uniqueness of a large solution and conjecture that this condition is also a necessary condition of the uniqueness.


title: 4/-hybridization strength in CemMnIn3m+2n heavy-fermion compounds studied by Angle-Resolved Photoemission Spectroscopy

abstract: We systemically investigate the nature of Ce 4f electrons in structurally layered heavy-fermion compounds CcmMnIn3m+2n (with M =Co, Rh, Ir, and Pt, m=l, 2, n=0 - 2), at low temperature using on-resonance angle-resolved photoemission spectroscopy. Three heavy quasiparticle bands f^0, f^1_7/2 and f^1_5/2 are observed in all compounds, but their intensities and energy locations vary greatly with materials. The strong f^0 states imply that the localized electron behavior dominates the Ce 4f states. The Ce 4f electrons are partially hybridized with the conduction electrons, making them have the dual nature of localization and itinerant. Our quantitative comparison reveals that the f^1_5/2 / f^0 intensity ratio is more suitable to reflect the 4f-state hybridization strength.


title: DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Prediction

abstract: Nowadays, with the rapid development of IoT (Internet of Things) and CPS (Cyber-Physical Systems) technologies, big spatiotemporal data are being generated from mobile phones, car navigation systems, and traffic sensors. By leveraging state-of-the-art deep learning technologies on such data, urban traffic prediction has drawn a lot of attention in AI and Intelligent Transportation System community. The problem can be uniformly modeled with a 3D tensor (T, N, C), where T denotes the total time steps, N denotes the size of the spatial domain (i.e., mesh-grids or graph-nodes), and C denotes the channels of information. According to the specific modeling strategy, the state-of-the-art deep learning models can be divided into three categories: grid-based, graph-based, and multivariate time-series models. In this study, we first synthetically review the deep traffic models as well as the widely used datasets, then build a standard benchmark to comprehensively evaluate their performances with the same settings and metrics. Our study named DL-Traff is implemented with two most popular deep learning frameworks, i.e., TensorFlow and PyTorch, which is already publicly available as two GitHub repositories https://github.com/deepkashiwa20/DL-Traff-Grid and https://github.com/deepkashiwa20/DL-Traff-Graph. With DL-Traff, we hope to deliver a useful resource to researchers who are interested in spatiotemporal data analysis.


title: Exact Response Theory and Kuramoto dynamics

abstract: The dynamics of Kuramoto oscillators is investigated in terms of the exact response theory based on the Dissipation Function, which has been introduced in the field of nonequilibrium molecular dynamics. While linear response theory is a cornerstone of nonequilibrium statistical mechanics, it does not apply, in general, to systems undergoing phase transitions. Indeed, even a small perturbation may in that case result in a large modification of the state. An exact theory is instead expected to handle such situations. The Kuramoto dynamics, which undergoes synchronization transitions, is thus investigated as a testbed for the exact theory mentioned above. A comparison between the two approaches shows how the linear theory fails, while the exact theory yields the correct response.


title: Towards Understanding the Generative Capability of Adversarially Robust Classifiers

abstract: Recently, some works found an interesting phenomenon that adversarially robust classifiers can generate good images comparable to generative models. We investigate this phenomenon from an energy perspective and provide a novel explanation. We reformulate adversarial example generation, adversarial training, and image generation in terms of an energy function. We find that adversarial training contributes to obtaining an energy function that is flat and has low energy around the real data, which is the key for generative capability. Based on our new understanding, we further propose a better adversarial training method, Joint Energy Adversarial Training (JEAT), which can generate high-quality images and achieve new state-of-the-art robustness under a wide range of attacks. The Inception Score of the images (CIFAR-10) generated by JEAT is 8.80, much better than original robust classifiers (7.50).


title: The Fermionic influence superoperator: a canonical derivation for the development of methods to simulate the influence of a Fermionic environment on a quantum system with arbitrary parity symmetry

abstract: We present a canonical derivation of an influence superoperator which generates the reduced dynamics of a Fermionic quantum system linearly coupled to a Fermionic environment initially at thermal equilibrium. We use this formalism to derive a generalized-Lindblad master equation (in the Markovian limit) and a generalized version of the hierarchical equations of motion valid in arbitrary parity-symmetry conditions, important for the correct evaluation of system correlation functions and spectra.


title: On the maximal $\alpha$-spectral radius of graphs with given matching number

abstract: Let $\mathscr{G}_{n,\beta}$ be the set of graphs of order $n$ with given matching number $\beta$. Let $D(G)$ be the diagonal matrix of the degrees of the graph $G$ and $A(G)$ be the adjacency matrix of the graph $G$. The largest eigenvalue of the nonnegative matrix $A_{\alpha}(G)=\alpha D(G)+A(G)$ is called the $\alpha$-spectral radius of $G$. The graphs with maximal $\alpha$-spectral radius in $\mathscr{G}_{n,\beta}$ are completely characterized in this paper. In this way we provide a general framework to attack the problem of extremal spectral radius in $\mathscr{G}_{n,\beta}$. More precisely, we generalize the known results on the maximal adjacency spectral radius in $\mathscr{G}_{n,\beta}$ and the signless Laplacian spectral radius.


title: Antisymmetric magnetoresistance due to domain wall tilting in perpendicular magnetized films

abstract: We report the observation of the antisymmetric magnetoresistance (MR) in perpendicular magnetized CoTb films with inhomogeneous magnetization distribution driven by gradient magnetic field. By synchronously charactering the domain pattern evolution during transport measurements, we demonstrate that the nonequilibrium currents in the vicinity of tilting domain walls give rise to such anomalous MR. Moreover, theoretical calculation and analysis reveal that the geometry factor of the multidomain texture plays a dominant role in generating the nonequilibrium current. The explicitly established interplay between the anomalous transport behaviors and the particular domain wall geometry is essential to deepening understanding of the antisymmetric MR, and pave a new way for designing novel domain wall electronic devices.


title: The Eigenvalues of Hyperoctahedral Descent Operators and Applications to Card-Shuffling

abstract: We extend an algebra of Mantaci and Reutenauer, acting on the free associative algebra, to a vector space of operators acting on all graded connected Hopf algebras. These operators are convolution products of certain involutions, which we view as hyperoctahedral variants of Patras's descent operators. We obtain the eigenvalues and multiplicities of all our new operators, as well as a basis of eigenvectors for a subclass akin to Adams operations. We outline how to apply this eigendata to study Markov chains, and examine in detail the case of card-shuffles with flips or rotations.


title: A fuzzy-rough uncertainty measure to discover bias encoded explicitly or implicitly in features of structured pattern classification datasets

abstract: The need to measure bias encoded in tabular data that are used to solve pattern recognition problems is widely recognized by academia, legislators and enterprises alike. In previous work, we proposed a bias quantification measure, called fuzzy-rough uncer-tainty, which relies on the fuzzy-rough set theory. The intuition dictates that protected features should not change the fuzzy-rough boundary regions of a decision class significantly. The extent to which this happens is a proxy for bias expressed as uncertainty in adecision-making context. Our measure's main advantage is that it does not depend on any machine learning prediction model but adistance function. In this paper, we extend our study by exploring the existence of bias encoded implicitly in non-protected featuresas defined by the correlation between protected and unprotected attributes. This analysis leads to four scenarios that domain experts should evaluate before deciding how to tackle bias. In addition, we conduct a sensitivity analysis to determine the fuzzy operatorsand distance function that best capture change in the boundary regions.


title: PDF4LHC21: Update on the benchmarking of the CT, MSHT and NNPDF global PDF fits

abstract: There have been recent updates to the three global PDF fits (CT, MSHT and NNPDF), all adding large amounts of data from the LHC, and this has resulted in significant changes to the global PDFs. Given the impact that the new PDFs will have on physics comparisons at the LHC, it is crucial to perform a benchmarking among the PDFs, similar in spirit to that which was carried out for PDF4LHC15, widely used for LHC physics. In this article we detail a benchmarking comparison of three global PDF sets - CT18, MSHT20 and NNPDF3.1 - and their similarities and differences that have been observed. The end result of this study will be a new PDF4LHC21 ensemble of combined PDFs suitable for a wide range of LHC applications.


title: Semi-device-independent full randomness amplification based on energy bounds

abstract: Quantum Bell nonlocality allows for the design of protocols that amplify the randomness of public and arbitrarily biased Santha-Vazirani sources, a classically impossible task. Information-theoretical security in these protocols is certified in a device-independent manner, i.e. solely from the observed nonlocal statistics and without any assumption about the inner-workings of the intervening devices. On the other hand, if one is willing to trust on a complete quantum-mechanical description of a protocol's devices, the elementary scheme in which a qubit is alternatively measured in a pair of mutually unbiased bases is, straightforwardly, a protocol for randomness amplification. In this work, we study the unexplored middle ground. We prove that full randomness amplification can be achieved without requiring entanglement or a complete characterization of the intervening quantum states and measurements. Based on the energy-bounded framework introduced in [Van Himbeeck et al., Quantum 1, 33 (2017)], our prepare-and-measure protocol is able to amplify the randomness of any public Santha-Vazirani source, requiring the smallest number of inputs and outcomes possible and being secure against quantum adversaries.


title: Abduction of trap invariants in parameterized systems

abstract: In a previous paper we have presented a CEGAR approach for the verification of parameterized systems with an arbitrary number of processes organized in an array or a ring. The technique is based on the iterative computation of parameterized invariants, i.e., infinite families of invariants for the infinitely many instances of the system. Safety properties are proved by checking that every global configuration of the system satisfying all parameterized invariants also satisfies the property; we have shown that this check can be reduced to the satisfiability problem for Monadic Second Order on words, which is decidable. A strong limitation of the approach is that processes can only have a fixed number of variables with a fixed finite range. In particular, they cannot use variables with range [0,N-1], where N is the number of processes, which appear in many standard distributed algorithms. In this paper, we extend our technique to this case. While conducting the check whether a safety property is inductive assuming a computed set of invariants becomes undecidable, we show how to reduce it to checking satisfiability of a first-order formula. We report on experiments showing that automatic first-order theorem provers can still perform this check for a collection of non-trivial examples. Additionally, we can give small sets of readable invariants for these checks.


title: Centers of Braided Tensor Categories

abstract: Let $\mathcal{C}$ be a finite braided multitensor category. Let $B$ be Majid's automorphism braided group of $\mathcal{C}$, then $B$ is a cocommutative Hopf algebra in $\mathcal{C}$. We show that the center of $\mathcal{C}$ is isomorphic to the category of left $B$-comodules in $\mathcal{C}$, and the decomposition of $B$ into a direct sum of indecomposable $\mathcal{C}$-subcoalgebras leads to a decomposition of $B$-$\operatorname*{Comod}_{\mathcal{C}}$ into a direct sum of indecomposable $\mathcal{C}$-module subcategories. As an application, we present an explicit characterization of the structure of irreducible Yetter-Drinfeld modules over semisimple quasi-triangular weak Hopf algebras. Our results generalize those results on finite groups and on quasi-triangular Hopf algebras.


title: Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks

abstract: Implementing federated learning (FL) algorithms in wireless networks has garnered a wide range of attention. However, few works have considered the impact of user mobility on the learning performance. To fill this research gap, firstly, we develop a theoretical model to characterize the hierarchical federated learning (HFL) algorithm in wireless networks where the mobile users may roam across multiple edge access points, leading to incompletion of inconsistent FL training. Secondly, we provide the convergence analysis of HFL with user mobility. Our analysis proves that the learning performance of HFL deteriorates drastically with highly-mobile users. And this decline in the learning performance will be exacerbated with small number of participants and large data distribution divergences among local data of users. To circumvent these issues, we propose a mobility-aware cluster federated learning (MACFL) algorithm by redesigning the access mechanism, local update rule and model aggregation scheme. Finally, we provide experiments to evaluate the learning performance of HFL and our MACFL. The results show that our MACFL can enhance the learning performance, especially for three different cases, namely, the case of users with non-independent and identical distribution data, the case of users with high mobility, and the cases with a small number of users.


title: GEDIT: Geographic-Enhanced and Dependency-Guided Tagging for Joint POI and Accessibility Extraction at Baidu Maps

abstract: Providing timely accessibility reminders of a point-of-interest (POI) plays a vital role in improving user satisfaction of finding places and making visiting decisions. However, it is difficult to keep the POI database in sync with the real-world counterparts due to the dynamic nature of business changes. To alleviate this problem, we formulate and present a practical solution that jointly extracts POI mentions and identifies their coupled accessibility labels from unstructured text. We approach this task as a sequence tagging problem, where the goal is to produce <POI name, accessibility label> pairs from unstructured text. This task is challenging because of two main issues: (1) POI names are often newly-coined words so as to successfully register new entities or brands and (2) there may exist multiple pairs in the text, which necessitates dealing with one-to-many or many-to-one mapping to make each POI coupled with its accessibility label. To this end, we propose a Geographic-Enhanced and Dependency-guIded sequence Tagging (GEDIT) model to concurrently address the two challenges. First, to alleviate challenge #1, we develop a geographic-enhanced pre-trained model to learn the text representations. Second, to mitigate challenge #2, we apply a relational graph convolutional network to learn the tree node representations from the parsed dependency tree. Finally, we construct a neural sequence tagging model by integrating and feeding the previously pre-learned representations into a CRF layer. Extensive experiments conducted on a real-world dataset demonstrate the superiority and effectiveness of GEDIT. In addition, it has already been deployed in production at Baidu Maps. Statistics show that the proposed solution can save significant human effort and labor costs to deal with the same amount of documents, which confirms that it is a practical way for POI accessibility maintenance.


title: Airbert: In-domain Pretraining for Vision-and-Language Navigation

abstract: Vision-and-language navigation (VLN) aims to enable embodied agents to navigate in realistic environments using natural language instructions. Given the scarcity of domain-specific training data and the high diversity of image and language inputs, the generalization of VLN agents to unseen environments remains challenging. Recent methods explore pretraining to improve generalization, however, the use of generic image-caption datasets or existing small-scale VLN environments is suboptimal and results in limited improvements. In this work, we introduce BnB, a large-scale and diverse in-domain VLN dataset. We first collect image-caption (IC) pairs from hundreds of thousands of listings from online rental marketplaces. Using IC pairs we next propose automatic strategies to generate millions of VLN path-instruction (PI) pairs. We further propose a shuffling loss that improves the learning of temporal order inside PI pairs. We use BnB pretrain our Airbert model that can be adapted to discriminative and generative settings and show that it outperforms state of the art for Room-to-Room (R2R) navigation and Remote Referring Expression (REVERIE) benchmarks. Moreover, our in-domain pretraining significantly increases performance on a challenging few-shot VLN evaluation, where we train the model only on VLN instructions from a few houses.


title: Energy and pairing dependence of dissipation in real-time fission dynamics

abstract: This work presents a microscopic study of dissipation in fission dynamical evolutions with the time-dependent Hartree-Fock+BCS method in terms of energy dependence and pairing dependence. The friction coefficients and dissipation energies are extracted by mapping the symmetric fission process of $^{258}$Fm into a classical equation of motion. Density-constrained calculations are used to obtain the dynamical potential. The obtained friction coefficients have a strong dependence of deformations, and averagely match the coefficients adopted in statistical models. The dissipation indeed increase with increasing initial excitation energies or with decreasing pairings. It is also shown that post-scission dissipations play a significant role. The demonstrated characteristics of dissipations will be valuable for calibrations of various fission models.


title: MUSE observations of the blue compact dwarf galaxy Haro 14. Data analysis and first results on morphology and stellar populations

abstract: (Abriged) Blue compact galaxies (BCGs) are low-luminosity, metal-poor, gas-rich objects that form stars at high rates, excellent analogs to the high-redshift star-forming galaxy population. Being low-mass starbursts, they also constitute ideal laboratories for investigating star formation and massive stellar feedback. This work presents results from integral field spectroscopic observations of the BCG Haro 14 taken with the Multi Unit Spectroscopic Explorer (MUSE). The large MUSE field of view enables simultaneous observations of the starburst and the host galaxy. We built galaxy maps in continuum and in emission lines and generated synthetic VRI images, from which we produced color index maps and surface brightness profiles. We detected numerous clumps spread throughout the galaxy, both in continuum and in emission lines, and produced a catalog with their position, size, and photometry. This analysis allowed us to study the morphology and stellar populations of Haro 14 in detail. The stellar distribution shows a pronounced asymmetry; the intensity peak in continuum is not centered with respect to the stellar host but is displaced by about 500 pc southwest. At the position of the continuum peak we find a bright stellar cluster that with M$_{V}=-12.18$ appears as a strong super stellar cluster candidate. We also find a highly asymmetric, blue, but nonionizing stellar component that occupies almost the whole eastern part of the galaxy. We conclude that there are at least three different stellar populations in Haro 14: the current starburst of about 6 Myr; an intermediate-age component of between ten and several hundred million years; and a red and regular host of several gigayears. The pronounced lopsidedness in the continuum and also in the color maps, and the presence of numerous stellar clusters, are consistent with a scenario of mergers or interactions acting in Haro 14.


title: Single Image Defocus Deblurring Using Kernel-Sharing Parallel Atrous Convolutions

abstract: This paper proposes a novel deep learning approach for single image defocus deblurring based on inverse kernels. In a defocused image, the blur shapes are similar among pixels although the blur sizes can spatially vary. To utilize the property with inverse kernels, we exploit the observation that when only the size of a defocus blur changes while keeping the shape, the shape of the corresponding inverse kernel remains the same and only the scale changes. Based on the observation, we propose a kernel-sharing parallel atrous convolutional (KPAC) block specifically designed by incorporating the property of inverse kernels for single image defocus deblurring. To effectively simulate the invariant shapes of inverse kernels with different scales, KPAC shares the same convolutional weights among multiple atrous convolution layers. To efficiently simulate the varying scales of inverse kernels, KPAC consists of only a few atrous convolution layers with different dilations and learns per-pixel scale attentions to aggregate the outputs of the layers. KPAC also utilizes the shape attention to combine the outputs of multiple convolution filters in each atrous convolution layer, to deal with defocus blur with a slightly varying shape. We demonstrate that our approach achieves state-of-the-art performance with a much smaller number of parameters than previous methods.


title: A 20-Second Cadence View of Solar-Type Stars and Their Planets with TESS: Asteroseismology of Solar Analogs and a Re-characterization of pi Men c

abstract: We present an analysis of the first 20-second cadence light curves obtained by the TESS space telescope during its extended mission. We find a precision improvement of 20-second data compared to 2-minute data for bright stars when binned to the same cadence (~10-25% better for T<~8 mag, reaching equal precision at T~13 mag), consistent with pre-flight expectations based on differences in cosmic ray mitigation algorithms. We present two results enabled by this improvement. First, we use 20-second data to detect oscillations in three solar analogs (gamma Pav, zeta Tuc and pi Men) and use asteroseismology to measure their radii, masses, densities and ages to ~1%, ~3%, ~1% and ~20% respectively, including systematic errors. Combining our asteroseismic ages with chromospheric activity measurements we find evidence that the spread in the activity-age relation is linked to stellar mass and thus convection-zone depth. Second, we combine 20-second data and published radial velocities to re-characterize pi Men c, which is now the closest transiting exoplanet for which detailed asteroseismology of the host star is possible. We show that pi Men c is located at the upper edge of the planet radius valley for its orbital period, confirming that it has likely retained a volatile atmosphere and that the "asteroseismic radius valley" remains devoid of planets. Our analysis favors a low eccentricity for pi Men c (<0.1 at 68% confidence), suggesting efficient tidal dissipation (Q/k <~ 2400) if it formed via high-eccentricity migration. Combined, these early results demonstrate the strong potential of TESS 20-second cadence data for stellar astrophysics and exoplanet science.


title: A magnetic accretion disk-outflow model for state transition in X-ray binaries

abstract: The hard to soft state transition of the outbursts in X-ray binaries (XRBs) is triggered by the rising of the mass accretion rate due to the disk instability. In order to explain the observed correlation between the hard X-ray transition luminosity and the soft X-ray peak luminosity in the soft state, we construct a magnetic disk-outflow model for the state transition in XRBs. We assume that the large-scale magnetic field in the outer thin disk is formed through inverse cascade of small-scale dynamo generated field, and it is then advected by the inner advection dominated accretion flow (ADAF), which accelerates a fraction of the gas into the outflows. During the outbursts, the heating front moves inwards, and the field strength at the heating front of the outer disk is proportional to the accretion rate of the disk. Much angular momentum of the inner ADAF is carried away by the outflows for a stronger magnetic field, which leads to a high radial velocity of the ADAF. This makes the critical mass accretion rate of the ADAF increases with the field strength, and it therefore leads to a correlation between transition luminosity and the peak luminosity in the thermal state. We found that the values of the viscosity parameter $\alpha$ of the neutron star XRBs are systematically higher for those of the black hole (BH) XRBs ($\alpha\sim 0.05-0.15$ for BHs, and $\alpha\sim 0.15-0.4$ for neutron stars). Our model predicts the transition luminosity may be higher than the peak luminosity provided $\alpha$ is sufficiently high, which is able to explain a substantial fraction of outbursts in BHXRBs not reaching the thermally dominant accretion state.


title: Novel Concept of Circular-Linear Energy Recovery Accelerator to Probe the Energy Frontier

abstract: Energy-frontier accelerators provide powerful tools performing high precision measurements confirming the fundamental of the physics and broadening new research horizons. Such machines are either driven by circular or linear accelerators. The circular machines, having the center-mass (CM) energy values reaching 200 GeV (for leptons) and above, experience beam energy loss and quality dilution, for example, due to synchrotron radiation, limiting the overall CM energy achievable and requiring a constant energy top-up to compensate the loss and the beam quality dilution. Linear colliders overcome these limitations, while the finite capabilities of generating high average current beams limits the luminosity. This is partially compensated by the quality of the colliding beams. In this work, we suggest a novel design of circular-linear accelerator based on the merging of the "non-emitting", low-energy storage rings and energy recovery linear accelerators. We suggest using the recently considered dual-axis asymmetric cavities to enable the operation of such a system, and in particular the energy recovery from spent, high-intensity beams. The machine considered, under the scope of the SNOWMASS-2021 initiative, can be potentially used to reach ultimate energy frontiers in high-energy physics as well as to drive next generation light sources. The merging of circular and linear systems, and applications of dual axes cavities, should allow the maintaining of high beam quality, high luminosity, and high energy efficiency - "The Best of Both Words". It also offers a flexible energy management, opening clear opportunity for reducing the running cost. We note that the numbers shown in the paper are for illustration purpose and can be improved further.


title: Continual Learning for Image-Based Camera Localization

abstract: For several emerging technologies such as augmented reality, autonomous driving and robotics, visual localization is a critical component. Directly regressing camera pose/3D scene coordinates from the input image using deep neural networks has shown great potential. However, such methods assume a stationary data distribution with all scenes simultaneously available during training. In this paper, we approach the problem of visual localization in a continual learning setup -- whereby the model is trained on scenes in an incremental manner. Our results show that similar to the classification domain, non-stationary data induces catastrophic forgetting in deep networks for visual localization. To address this issue, a strong baseline based on storing and replaying images from a fixed buffer is proposed. Furthermore, we propose a new sampling method based on coverage score (Buff-CS) that adapts the existing sampling strategies in the buffering process to the problem of visual localization. Results demonstrate consistent improvements over standard buffering methods on two challenging datasets -- 7Scenes, 12Scenes, and also 19Scenes by combining the former scenes.


title: Neutron star deformability with hyperonization in density-dependent relativistic mean-field models

abstract: Neutron star tidal deformability extracted from gravitational wave data provides a novel probe to the interior neutron star structures and the associated nuclear equation of state (EOS). Instead of the popular composition of nucleons and leptons in neutron stars, we include hyperons and examine the role of hyperons in the tidal deformability and its impact on the symmetry energy in a relativistic mean-field approach with the density-dependent parametrizations. The hyperons are found to have significant impact on the deformability, correlated sensitively with the onset density and fraction of hyperons in neutron star matter. Moderately lower onset density of hyperons can yield considerable modification to the tidal deformability and shift its inference on the nuclear EOS. The future measurements of the tidal deformability at multi-fiducial star masses are anticipated to lift the degeneracy between the contributions from the hyperon component and symmetry energy.


title: CNN-Based Deep Learning in Solar Wind Forecasting

abstract: This article implements a Convolutional Neural Network (CNN)-based deep learning model for solar-wind prediction. Images from the Atmospheric Imaging Assembly (AIA) at 193\.A wavelength are used for training. Solar-wind speed is taken from the Advanced Composition Explorer (ACE) located at the Lagrangian L1 point. The proposed CNN architecture is designed from scratch for training with four years' data. The solar-wind has been ballistically traced back to the Sun assuming a constant speed during propagation, to obtain the corresponding coronal intensity data from AIA images. This forecasting scheme can predict the solar-wind speed well with a RMSE of 76.3 km\s and an overall correlation coefficient of 0.57 for the year 2018, while significantly outperforming benchmark models. The threat score for the model is around 0.46 in identifying the HSEs with zero false alarms.


title: Does Preprocessing help in Fast Sequence Comparisons?

abstract: We study edit distance computation with preprocessing: the preprocessing algorithm acts on each string separately, and then the query algorithm takes as input the two preprocessed strings. This model is inspired by scenarios where we would like to compute edit distance between many pairs in the same pool of strings. Our results include: Permutation-LCS: If the LCS between two permutations has length $n-k$, we can compute it \textit{ exactly} with $O(n \log(n))$ preprocessing and $O(k \log(n))$ query time. Small edit distance: For general strings, if their edit distance is at most $k$, we can compute it \textit{ exactly} with $O(n\log(n))$ preprocessing and $O(k^2 \log(n))$ query time. Approximate edit distance: For the most general input, we can approximate the edit distance to within factor $(7+o(1))$ with preprocessing time $\tilde{O}(n^2)$ and query time $\tilde{O}(n^{1.5+o(1)})$. All of these results significantly improve over the state of the art in edit distance computation without preprocessing. Interestingly, by combining ideas from our algorithms with preprocessing, we provide new improved results for approximating edit distance without preprocessing in subquadratic time.


title: Sparse Signal Processing for Massive Connectivity via Mixed-Integer Programming

abstract: Massive connectivity is a critical challenge of Internet of Things (IoT) networks. In this paper, we consider the grant-free uplink transmission of an IoT network with a multi-antenna base station (BS) and a large number of single-antenna IoT devices. Due to the sporadic nature of IoT devices, we formulate the joint activity detection and channel estimation (JADCE) problem as a group-sparse matrix estimation problem. Although many algorithms have been proposed to solve the JADCE problem, most of them are developed based on compressive sensing technique, yielding suboptimal solutions. In this paper, we first develop an efficient weighted $l_1$-norm minimization algorithm to better approximate the group sparsity than the existing mixed $l_1/l_2$-norm minimization. Although an enhanced estimation performance in terms of the mean squared error (MSE) can be achieved, the weighted $l_1$-norm minimization algorithm is still a convex relaxation of the original group-sparse matrix estimation problem, yielding a suboptimal solution. To this end, we further reformulate the JADCE problem as a mixed integer programming (MIP) problem, which can be solved by using the branch-and-bound method. As a result, we are able to obtain an optimal solution of the JADCE problem, which can be adopted as an upper bound to evaluate the effectiveness of the existing algorithms. Moreover, we also derive the minimum pilot sequence length required to fully recover the estimated matrix in the noiseless scenario. Simulation results show the performance gains of the proposed optimal algorithm over the proposed weighted $l_1$-norm algorithm and the conventional mixed $l_1/l_2$-norm algorithm. Results also show that the proposed algorithms require a short pilot sequence than the conventional algorithm to achieve the same estimation performance.


title: OpenStreetMap-based Autonomous Navigation With LiDAR Naive-Valley-Path Obstacle Avoidance

abstract: OpenStreetMaps (OSM) is currently studied as the environment representation for autonomous navigation. It provides advantages such as global consistency, a heavy-less map construction process, and a wide variety of road information publicly available. However, the location of this information is usually not very accurate locally. In this paper, we present a complete autonomous navigation pipeline using OSM information as environment representation for global planning. To avoid the flaw of local low-accuracy, we offer the novel LiDAR-based Naive-Valley-Path (NVP) method that exploits the concept of "valley" areas to infer the local path always furthest from obstacles. This behavior allows navigation always through the center of trafficable areas following the road's shape independently of OSM error. Furthermore, NVP is a naive method that is highly sample-time-efficient. This time efficiency also enables obstacle avoidance, even for dynamic objects. We demonstrate the system's robustness in our research platform BLUE, driving autonomously across the University of Alicante Scientific Park for more than 20 km with 0.24 meters of average error against the road's center with a 19.8 ms of average sample time. Our vehicle avoids static obstacles in the road and even dynamic ones, such as vehicles and pedestrians.


title: CybORG: A Gym for the Development of Autonomous Cyber Agents

abstract: Autonomous Cyber Operations (ACO) involves the development of blue team (defender) and red team (attacker) decision-making agents in adversarial scenarios. To support the application of machine learning algorithms to solve this problem, and to encourage researchers in this field to attend to problems in the ACO setting, we introduce CybORG, a work-in-progress gym for ACO research. CybORG features a simulation and emulation environment with a common interface to facilitate the rapid training of autonomous agents that can then be tested on real-world systems. Initial testing demonstrates the feasibility of this approach.


title: Semantic Communication with Adaptive Universal Transformer

abstract: With the development of deep learning (DL), natural language processing (NLP) makes it possible for us to analyze and understand a large amount of language texts. Accordingly, we can achieve a semantic communication in terms of joint semantic source and channel coding over a noisy channel with the help of NLP. However, the existing method to realize this goal is to use a fixed transformer of NLP while ignoring the difference of semantic information contained in each sentence. To solve this problem, we propose a new semantic communication system based on Universal Transformer. Compared with the traditional transformer, an adaptive circulation mechanism is introduced in the Universal Transformer. Through the introduction of the circulation mechanism, the new semantic communication system can be more flexible to transmit sentences with different semantic information, and achieve better end-to-end performance under various channel conditions.


title: Arc-shaped structure factor in the $J_1$-$J_2$-$J_3$ classical Heisenberg model on the triangular lattice

abstract: We study the $J_1$-$J_2$-$J_3$ classical Heisenberg model with ferromagnetic $J_1$ on the triangular lattice using the nematic bond theory. For parameters where the momentum space coupling function $J_{\vec{q}}$ shows a discrete set of minima, we find that the system in general exhibits a single first-order phase transition between the high-temperature ring liquid and the low-temperature single-$\vec{q}$ planar spiral state. Close to where $J_{\vec{q}}$ shows a continuous minimum, we on the other hand find several phase transitions upon lowering the temperature. Most interestingly, we find an intermediate temperature "arc" regime, where the structure factor breaks rotational symmetry and shows a broad arc-shaped maximum. We map out the parameter region over which this arc regime exists and characterize details of its static structure factor over the same region.


title: FAST early pulsar discoveries: Effelsberg follow-up

abstract: We report the follow-up of 10 pulsars discovered by the Five-hundred-meter Aperture Spherical radio-Telescope (FAST) during its commissioning. The pulsars were discovered at a frequency of 500-MHz using the ultra-wide-band (UWB) receiver in drift-scan mode, as part of the Commensal Radio Astronomy FAST Survey (CRAFTS). We carried out the timing campaign with the 100-m Effelsberg radio-telescope at L-band around 1.36 GHz. Along with 11 FAST pulsars previously reported, FAST seems to be uncovering a population of older pulsars, bordering and/or even across the pulsar death-lines. We report here two sources with notable characteristics. PSR J1951$+$4724 is a young and energetic pulsar with nearly 100% of linearly polarized flux density and visible up to an observing frequency of 8 GHz. PSR J2338+4818, a mildly recycled pulsar in a 95.2-d orbit with a Carbon-Oxygen white dwarf (WD) companion of $\gtrsim 1\rm{M}_{\odot}$, based on estimates from the mass function. This system is the widest WD binary with the most massive companion known to-date. Conspicuous discrepancy was found between estimations based on NE2001 and YMW16 electron density models, which can be attributed to under-representation of pulsars in the sky region between Galactic longitudes $70^o<l<100^o$. This work represents one of the early CRAFTS results, which start to show potential to substantially enrich the pulsar sample and refine the Galactic electron density model.


title: Optimized Planar Microwave Antenna for Nitrogen Vacancy Center based Sensing Applications

abstract: Individual nitrogen vacancy (NV) color centers in diamond are versatile, spin-based quantum sensors. Coherently controlling the spin of NV centers using microwaves in a typical frequency range between 2.5 and 3.5 GHz is necessary for sensing applications. In this work, we present a stripline-based, planar, {\Omega}-shaped microwave antenna that enables to reliably manipulate NV spins. We find an optimal antenna design using finite integral simulations. We fabricate our antennas on low-cost, transparent glass substrate. We demonstrate highly uniform microwave fields in areas of roughly 400 x 400 {\mu}m^2 while realizing high Rabi frequencies of up to 10 MHz in an ensemble of NV centers.


title: A large octupole magnetic trap for research with atomic hydrogen

abstract: We describe the design and performance of a large magnetic trap for storing and cooling of atomic hydrogen (H). The trap operates in the vacuum space of a dilution refrigerator at a temperature of 1.5 K. Aiming at a large volume of the trap we implemented the octupole configuration of linear currents (Ioffe bars) for the radial confinement, combined with two axial pinch coils and a 3 T solenoid for the cryogenic H dissociator. The octupole magnet consists of eight race-track segments which are compressed towards each other with magnetic forces. This provides a mechanically stable and robust construction with a possibility of replacement or repair of each segment. A maximum trap depth of 0.54 K (0.8 T) was reached, corresponding to an effective volume of 0.5 liters for hydrogen gas at 50 mK. This is an order of magnitude larger than ever used for trapping atoms.


title: On the structure of graded $3-$Leibniz algebras

abstract: We study the structure of a $3-$Leibniz algebra $T$ graded by an arbitrary abelian group $G,$ which is considered of arbitrary dimension and over an arbitrary base field $\bbbf.$ We show that $T$ is of the form $T=\uu\oplus\sum_jI_j,$ with $\uu$ a linear subspace of $T_1,$ the homogeneous component associated to the unit element $1$ in $G,$ and any $I_j$ a well described graded ideal of $T,$ satisfying $$ [I_j, T, I_k] = [I_j, I_k, T] = [T, I_j, I_k] = 0, $$ if $j\neq k.$ In the case of $T$ being of maximal length, we characterize the gr-simplicity of the algebra in terms of connections in the support of the grading.


title: Uncertainties and output feedback in rollout event-triggered control

abstract: The fact that event-triggered control (ETC) often exhibits an improved performance-communication tradeoff over time-triggered control renders it especially useful for Networked Control Systems (NCSs). However, it has proven difficult to characterize the traffic produced by ETC a priori. Rollout ETC addresses this issue by using a triggering and control law that is implicitly defined by the solution to an optimal control problem (OCP), instead of an explicit one as in classical ETC. This allows to directly incorporate predefined constraints on the transmission traffic as well as on states and inputs. In this article, we examine the practically relevant case when output instead of state measurements are available, and measurements as well as the LTI plant are subject to uncertainties. To address these challenges, we adapt methods from robust tube-based model predictive control and propose three different strategies to implement an error feedback in an NCSs setup, the applicability of which depends on the capabilities of the actuator. We establish recursive feasibility, robust constraint satisfaction and convergence. Finally, we illustrate our results in a numerical example.


title: Lessons from the Clustering Analysis of a Search Space: A Centroid-based Approach to Initializing NAS

abstract: Lots of effort in neural architecture search (NAS) research has been dedicated to algorithmic development, aiming at designing more efficient and less costly methods. Nonetheless, the investigation of the initialization of these techniques remain scare, and currently most NAS methodologies rely on stochastic initialization procedures, because acquiring information prior to search is costly. However, the recent availability of NAS benchmarks have enabled low computational resources prototyping. In this study, we propose to accelerate a NAS algorithm using a data-driven initialization technique, leveraging the availability of NAS benchmarks. Particularly, we proposed a two-step methodology. First, a calibrated clustering analysis of the search space is performed. Second, the centroids are extracted and used to initialize a NAS algorithm. We tested our proposal using Aging Evolution, an evolutionary algorithm, on NAS-bench-101. The results show that, compared to a random initialization, a faster convergence and a better performance of the final solution is achieved.


title: TabGNN: Multiplex Graph Neural Network for Tabular Data Prediction

abstract: Tabular data prediction (TDP) is one of the most popular industrial applications, and various methods have been designed to improve the prediction performance. However, existing works mainly focus on feature interactions and ignore sample relations, e.g., users with the same education level might have a similar ability to repay the debt. In this work, by explicitly and systematically modeling sample relations, we propose a novel framework TabGNN based on recently popular graph neural networks (GNN). Specifically, we firstly construct a multiplex graph to model the multifaceted sample relations, and then design a multiplex graph neural network to learn enhanced representation for each sample. To integrate TabGNN with the tabular solution in our company, we concatenate the learned embeddings and the original ones, which are then fed to prediction models inside the solution. Experiments on eleven TDP datasets from various domains, including classification and regression ones, show that TabGNN can consistently improve the performance compared to the tabular solution AutoFE in 4Paradigm.


title: Semi-supervised Network Embedding with Differentiable Deep Quantisation

abstract: Learning accurate low-dimensional embeddings for a network is a crucial task as it facilitates many downstream network analytics tasks. For large networks, the trained embeddings often require a significant amount of space to store, making storage and processing a challenge. Building on our previous work on semi-supervised network embedding, we develop d-SNEQ, a differentiable DNN-based quantisation method for network embedding. d-SNEQ incorporates a rank loss to equip the learned quantisation codes with rich high-order information and is able to substantially compress the size of trained embeddings, thus reducing storage footprint and accelerating retrieval speed. We also propose a new evaluation metric, path prediction, to fairly and more directly evaluate model performance on the preservation of high-order information. Our evaluation on four real-world networks of diverse characteristics shows that d-SNEQ outperforms a number of state-of-the-art embedding methods in link prediction, path prediction, node classification, and node recommendation while being far more space- and time-efficient.


title: Spatially indirect intervalley excitons in bilayer WSe2

abstract: Spatially indirect excitons with displaced wavefunctions of electrons and holes play a pivotal role in a large portfolio of fascinating physical phenomena and emerging optoelectronic applications, such as valleytronics, exciton spin Hall effect, excitonic integrated circuit and high-temperature superfluidity. Here, we uncover three types of spatially indirect excitons (including their phonon replicas) and their quantum-confined Stark effects in hexagonal boron nitride encapsulated bilayer WSe2, by performing electric field-tunable photoluminescence measurements. Because of different out-of-plane electric dipole moments, the energy order between the three types of spatially indirect excitons can be switched by a vertical electric field. Remarkably, we demonstrate, assisted by first-principles calculations, that the observed spatially indirect excitons in bilayer WSe2 are also momentum-indirect, involving electrons and holes from Q and K/{\Gamma} valleys in the Brillouin zone, respectively. This is in contrast to the previously reported spatially indirect excitons with electrons and holes localized in the same valley. Furthermore, we find that the spatially indirect intervalley excitons in bilayer WSe2 can exhibit considerable, doping-sensitive circular polarization. The spatially indirect excitons with momentum-dark nature and highly tunable circular polarization open new avenues for exotic valley physics and technological innovations in photonics and optoelectronics.


title: ReGenMorph: Visibly Realistic GAN Generated Face Morphing Attacks by Attack Re-generation

abstract: Face morphing attacks aim at creating face images that are verifiable to be the face of multiple identities, which can lead to building faulty identity links in operations like border checks. While creating a morphed face detector (MFD), training on all possible attack types is essential to achieve good detection performance. Therefore, investigating new methods of creating morphing attacks drives the generalizability of MADs. Creating morphing attacks was performed on the image level, by landmark interpolation, or on the latent-space level, by manipulating latent vectors in a generative adversarial network. The earlier results in varying blending artifacts and the latter results in synthetic-like striping artifacts. This work presents the novel morphing pipeline, ReGenMorph, to eliminate the LMA blending artifacts by using a GAN-based generation, as well as, eliminate the manipulation in the latent space, resulting in visibly realistic morphed images compared to previous works. The generated ReGenMorph appearance is compared to recent morphing approaches and evaluated for face recognition vulnerability and attack detectability, whether as known or unknown attacks.


title: Transfer-Recursive-Ensemble Learning for Multi-Day COVID-19 Prediction in India using Recurrent Neural Networks

abstract: The current COVID-19 pandemic has put a huge challenge on the Indian health infrastructure. With more and more people getting affected during the second wave, the hospitals were over-burdened, running out of supplies and oxygen. In this scenario, prediction of the number of COVID-19 cases beforehand might have helped in the better utilization of limited resources and supplies. This manuscript deals with the prediction of new COVID-19 cases, new deaths and total active cases for multiple days in advance. The proposed method uses gated recurrent unit networks as the main predicting model. A study is conducted by building four models that are pre-trained on the data from four different countries (United States of America, Brazil, Spain and Bangladesh) and are fine-tuned or retrained on India's data. Since the four countries chosen have experienced different types of infection curves, the pre-training provides a transfer learning to the models incorporating diverse situations into account. Each of the four models then give a multiple days ahead predictions using recursive learning method for the Indian test data. The final prediction comes from an ensemble of the predictions of the combination of different models. This method with two countries, Spain and Brazil, is seen to achieve the best performance amongst all the combinations as well as compared to other traditional regression models.


title: Probing anisotropy in epitaxial Fe/Pt bilayers by spin-orbit torque ferromagnetic resonance

abstract: We report the generation and detection of spin-orbit torque ferromagnetic resonance (STFMR) in micropatterned epitaxial Fe/Pt bilayers grown by molecular beam epitaxy. The magnetic field dependent measurements at an in-plane magnetic field angle of 45 degrees with respect to the microwave-current direction reveal the presence of two distinct voltage peaks indicative of a strong magnetic anisotropy. We show that STFMR can be employed to probe the underlying magnetic properties including the anisotropies in the Fe layer. We compare our STFMR results with broadband ferromagnetic resonance spectroscopy of the unpatterned bilayer thin films. The experimental STFMR measurements are interpreted using an analytical formalism and further confirmed using micromagnetic modeling, which shed light on the field-dependent magnetization alignment in the microstructures responsible for the STFMR rectification. Our results demonstrate a simple and efficient method for determining magnetic anisotropies in microstructures by means of rf spectroscopy.


title: Estimation of Convex Polytopes for Automatic Discovery of Charge State Transitions in Quantum Dot Arrays

abstract: In spin based quantum dot arrays, material or fabrication imprecisions affect the behaviour of the device, which must be taken into account when controlling it. This requires measuring the shape of specific convex polytopes. In this work, we present an algorithm that automatically discovers count, shape and size of the facets of a convex polytope from measurements. Results on simulated devices as well as a real 2x2 spin qubit array show that we can reliably find the facets of the convex polytopes, including small facets with sizes on the order of the measurement precision.


title: Accelerating Federated Learning with a Global Biased Optimiser

abstract: Federated Learning (FL) is a recent development in distributed machine learning that collaboratively trains models without training data leaving client devices, preserving data privacy. In real-world FL, the training set is distributed over clients in a highly non-Independent and Identically Distributed (non-IID) fashion, harming model convergence speed and final performance. To address this challenge, we propose a novel, generalised approach for incorporating adaptive optimisation into FL with the Federated Global Biased Optimiser (FedGBO) algorithm. FedGBO accelerates FL by employing a set of global biased optimiser values during training, reducing 'client-drift' from non-IID data whilst benefiting from adaptive optimisation. We show that in FedGBO, updates to the global model can be reformulated as centralised training using biased gradients and optimiser updates, and apply this framework to prove FedGBO's convergence on nonconvex objectives when using the momentum-SGD (SGDm) optimiser. We also conduct extensive experiments using 4 FL benchmark datasets (CIFAR100, Sent140, FEMNIST, Shakespeare) and 3 popular optimisers (SGDm, RMSProp, Adam) to compare FedGBO against six state-of-the-art FL algorithms. The results demonstrate that FedGBO displays superior or competitive performance across the datasets whilst having low data-upload and computational costs, and provide practical insights into the trade-offs associated with different adaptive-FL algorithms and optimisers.


title: PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifier

abstract: The adversarial patch attack against image classification models aims to inject adversarially crafted pixels within a restricted image region (i.e., a patch) for inducing model misclassification. This attack can be realized in the physical world by printing and attaching the patch to the victim object; thus, it imposes a real-world threat to computer vision systems. To counter this threat, we design PatchCleanser as a certifiably robust defense against adversarial patches. In PatchCleanser, we perform two rounds of pixel masking on the input image to neutralize the effect of the adversarial patch. This image-space operation makes PatchCleanser compatible with any state-of-the-art image classifier for achieving high accuracy. Furthermore, we can prove that PatchCleanser will always predict the correct class labels on certain images against any adaptive white-box attacker within our threat model, achieving certified robustness. We extensively evaluate PatchCleanser on the ImageNet, ImageNette, CIFAR-10, CIFAR-100, SVHN, and Flowers-102 datasets and demonstrate that our defense achieves similar clean accuracy as state-of-the-art classification models and also significantly improves certified robustness from prior works. Remarkably, PatchCleanser achieves 83.9% top-1 clean accuracy and 62.1% top-1 certified robust accuracy against a 2%-pixel square patch anywhere on the image for the 1000-class ImageNet dataset.


title: Unsupervised Domain-adaptive Hash for Networks

abstract: Abundant real-world data can be naturally represented by large-scale networks, which demands efficient and effective learning algorithms. At the same time, labels may only be available for some networks, which demands these algorithms to be able to adapt to unlabeled networks. Domain-adaptive hash learning has enjoyed considerable success in the computer vision community in many practical tasks due to its lower cost in both retrieval time and storage footprint. However, it has not been applied to multiple-domain networks. In this work, we bridge this gap by developing an unsupervised domain-adaptive hash learning method for networks, dubbed UDAH. Specifically, we develop four {task-specific yet correlated} components: (1) network structure preservation via a hard groupwise contrastive loss, (2) relaxation-free supervised hashing, (3) cross-domain intersected discriminators, and (4) semantic center alignment. We conduct a wide range of experiments to evaluate the effectiveness and efficiency of our method on a range of tasks including link prediction, node classification, and neighbor recommendation. Our evaluation results demonstrate that our model achieves better performance than the state-of-the-art conventional discrete embedding methods over all the tasks.


title: The binary central star of the bipolar pre-planetary nebula IRAS 08005-2356 (V510 Pup)

abstract: Current models predict that binary interactions are a major ingredient for the formation of bipolar planetary nebulae (PNe) and pre-planetary nebulae (PPNe). Despite years of radial velocity (RV) monitoring, the paucity of known binaries amongst the latter systems is insufficient to examine this relationship in detail. In this paper, we report on the discovery of a long period (P=2654$\pm$124 d) binary at the centre of the Galactic bipolar PPN, IRAS 08005-2356 (V510 Pup) determined from long-term spectroscopic and near-infrared time series data. The spectroscopic orbit is fit with an eccentricity of 0.36$\pm$0.05 that is similar to other long period post-AGB binaries. Time resolved H$\alpha$ profiles reveal high-velocity outflows (jets) with de-projected velocities up to 231$_{-27}^{+31}$ km s$^{-1}$ seen at phases when the luminous primary is behind the jet. The outflow traced by H$\alpha$ is likely produced via accretion onto a main sequence companion for which we calculate a mass of 0.63$\pm$0.13 M$_\odot$. This discovery is one of the first cases of a confirmed binary PPN and demonstrates the importance of high-resolution spectroscopic monitoring surveys on large telescopes in revealing binarity among these systems.


title: deep unfolding for non-negative matrix factorization with application to mutational signature analysis

abstract: Non-negative matrix factorization (NMF) is a fundamental matrix decomposition technique that is used primarily for dimensionality reduction and is increasing in popularity in the biological domain. Although finding a unique NMF is generally not possible, there are various iterative algorithms for NMF optimization that converge to locally optimal solutions. Such techniques can also serve as a starting point for deep learning methods that unroll the algorithmic iterations into layers of a deep network. Here we develop unfolded deep networks for NMF and several regularized variants in both a supervised and an unsupervised setting. We apply our method to various mutation data sets to reconstruct their underlying mutational signatures and their exposures. We demonstrate the increased accuracy of our approach over standard formulations in analyzing simulated and real mutation data.