title: Thermodynamic uncertainty relation for underdamped dynamics driven by time-dependent protocols

abstract: The thermodynamic uncertainty relation (TUR) for underdamped dynamics has intriguing problems while its counterpart for overdamped dynamics has recently been derived. Even for the case of steady states, a proper way to match underdamped and overdamped TURs has not been found. We derive the TUR for underdamped systems subject to general time-dependent protocols, that covers steady states, by using the Cram\'{e}r-Rao inequality. We show the resultant TUR to give rise to the inequality of the product of the variance and entropy production. We prove it to approach to the known overdamped result for large viscosity limit. We present three examples to confirm our rigorous result.


title: Towards the adoption of model-based engineering for the development of safety-critical systems in industrial practice

abstract: Model-based engineering promises to boost productivity and quality of complex systems development. In the context of safety-critical systems, a traditionally highly regulated and conservative domain, the use of models gained importance in the recent years. In this paper, we present a set of practical challenges in developing safety-critical systems with the help of several examples of development projects that belong to different application domains. Following this, we show how could the adoption of model-based engineering for the development of safety-critical systems cope with these challenges.


title: Transforming Fading Channel from Fast to Slow: Intelligent Refracting Surface Aided High-Mobility Communication

abstract: Intelligent reflecting/refracting surface (IRS) has recently emerged as a promising solution to reconfigure wireless propagation environment for enhancing the communication performance. In this paper, we study a new IRS-aided high-mobility communication system by employing the intelligent refracting surface with a high-speed vehicle to aid its passenger's communication with a remote base station (BS). Due to the environment's random scattering and vehicle's high mobility, a rapidly time-varying channel is typically resulted between the static BS and fast-moving IRS/user, which renders the channel estimation for IRS with a large number of elements more challenging. In order to reap the high IRS passive beamforming gain with low channel training overhead, we propose a new and efficient transmission protocol to achieve both IRS channel estimation and refraction optimization for data transmission. Specifically, by exploiting the quasi-static channel between the IRS and user both moving at the same high speed as well as the line-of-sight (LoS) dominant channel between the BS and IRS, the user first estimates the LoS component of the cascaded BS-IRS-user channel, based on which IRS passive refraction is designed to maximize the corresponding IRS-refracted channel gain. Then, the user estimates the resultant IRS-refracted channel as well as the non-IRS-refracted channel for setting an additional common phase shift at all IRS refracting elements so as to align these two channels for maximizing the overall channel gain for data transmission. Simulation results show significant performance improvement of the proposed design as compared to various benchmark schemes. The proposed on-vehicle IRS system is further compared with a baseline scheme of deploying fixed intelligent reflecting surfaces on the roadside to assist high-speed vehicular communications, which achieves significant rate improvement.


title: Does the Geminga, Monogem and PSR J0622+3749 $\gamma$-ray halos imply slow diffusion around pulsars?

abstract: The HAWC Collaboration has reported the detection of an extended $\gamma$-ray emission around the Geminga and Monogem pulsars of a few degree extension. Very recently, the LHAASO Collaboration released also the data for an extended $\gamma$-ray emission around the pulsar PSR J0622+3749. This flux can be explained with electrons and positrons injected from these sources and their inverse Compton Scattering on the interstellar radiation fields. So far the size of such $\gamma-$ray halos has been interpreted as the result of the diffusion coefficient around the sources being about two orders of magnitude smaller than the average in the Galaxy. However, this conclusion is driven by the assumption that particles propagate diffusively right away after the injection without taking into account the ballistic propagation. The propagation of cosmic-ray leptons in the proximity of the Geminga, Monogem and PSR J0622+3749 pulsars is examined here considering the transition from the quasi-ballistic, valid for the most recently injected particles, to the diffusive transport regime. For typical interstellar values of the diffusion coefficient, the quasi-ballistic regime dominates the lepton distribution up to distances of a few tens of parsec from the pulsar for particle energies above $\sim 10$ TeV. In this regime the resulting $\gamma-$ray source tends to be rather compact, despite particles travel a long distance. Indeed, for larger values of the diffusion coefficient, particles propagate ballistically up to larger distances with the result of a more point-like $\gamma-$ray source. When such transition is taken into account, a good fit to the HAWC and LHAASO $\gamma-$ray data around Geminga, Monogem and PSR J0622+3749 is obtained without the need to invoke a strong suppression of the diffusion coefficient.


title: Relativistic Dynamical Stability Criterion of Multi-Planet Systems with a Distant Companion

abstract: Multi-planetary systems are prevalent in our Galaxy. The long-term stability of such systems may be disrupted if a distant inclined companion excites the eccentricity and inclination of the inner planets via the eccentric Kozai-Lidov mechanism. However, the star-planet and the planet-planet interactions can help stabilize the system. In this work, we extend the previous stability criterion that only considered the companion-planet and planet-planet interactions by also accounting for short-range forces or effects, specifically, relativistic precession induced by the host star. A general analytical stability criterion is developed for planetary systems with $N$ inner planets and a relatively distant inclined perturber by comparing precession rates of relevant dynamical effects. Furthermore, we demonstrate as examples that in systems with $2$ and $3$ inner planets, the analytical criterion is consistent with numerical simulations using a combination of Gauss's averaging method and direct N-body integration. Finally, the criterion is applied to observed systems, constraining the orbital parameter space of a possible undiscovered companion. This new stability criterion extends the parameter space in which an inclined companion of multi-planet systems can inhabit.


title: Glance-and-Gaze Vision Transformer

abstract: Recently, there emerges a series of vision Transformers, which show superior performance with a more compact model size than conventional convolutional neural networks, thanks to the strong ability of Transformers to model long-range dependencies. However, the advantages of vision Transformers also come with a price: Self-attention, the core part of Transformer, has a quadratic complexity to the input sequence length. This leads to a dramatic increase of computation and memory cost with the increase of sequence length, thus introducing difficulties when applying Transformers to the vision tasks that require dense predictions based on high-resolution feature maps. In this paper, we propose a new vision Transformer, named Glance-and-Gaze Transformer (GG-Transformer), to address the aforementioned issues. It is motivated by the Glance and Gaze behavior of human beings when recognizing objects in natural scenes, with the ability to efficiently model both long-range dependencies and local context. In GG-Transformer, the Glance and Gaze behavior is realized by two parallel branches: The Glance branch is achieved by performing self-attention on the adaptively-dilated partitions of the input, which leads to a linear complexity while still enjoying a global receptive field; The Gaze branch is implemented by a simple depth-wise convolutional layer, which compensates local image context to the features obtained by the Glance mechanism. We empirically demonstrate our method achieves consistently superior performance over previous state-of-the-art Transformers on various vision tasks and benchmarks. The codes and models will be made available at https://github.com/yucornetto/GG-Transformer.


title: AgreeSum: Agreement-Oriented Multi-Document Summarization

abstract: We aim to renew interest in a particular multi-document summarization (MDS) task which we call AgreeSum: agreement-oriented multi-document summarization. Given a cluster of articles, the goal is to provide abstractive summaries that represent information common and faithful to all input articles. Given the lack of existing datasets, we create a dataset for AgreeSum, and provide annotations on article-summary entailment relations for a subset of the clusters in the dataset. We aim to create strong baselines for the task by applying the top-performing pretrained single-document summarization model PEGASUS onto AgreeSum, leveraging both annotated clusters by supervised losses, and unannotated clusters by T5-based entailment-related and language-related losses. Compared to other baselines, both automatic evaluation and human evaluation show better article-summary and cluster-summary entailment in generated summaries. On a separate note, we hope that our article-summary entailment annotations contribute to the community's effort in improving abstractive summarization faithfulness.


title: Charge radii of potassium isotopes in the RMF(BCS)* approach

abstract: We apply the recently proposed RMF(BCS)* ansatz to study the charge radii of the potassium isotopic chain up to $^{52}$K. It is shown that the experimental data can be reproduced rather well, qualitatively similar to the Fayans nuclear density functional theory, but with a slightly better description of the odd-even staggerings (OES). Nonetheless, both methods fail for $^{50}$K and to a lesser extent for $^{48,52}$K. It is shown that if these nuclei are deformed with a $\beta_{20}\approx-0.2$, then one can obtain results consistent with experiments for both charge radii and spin-parities. We argue that beyond mean field studies are needed to properly describe the charge radii of these three nuclei, particularly for $^{50}$K.


title: Human-Adversarial Visual Question Answering

abstract: Performance on the most commonly used Visual Question Answering dataset (VQA v2) is starting to approach human accuracy. However, in interacting with state-of-the-art VQA models, it is clear that the problem is far from being solved. In order to stress test VQA models, we benchmark them against human-adversarial examples. Human subjects interact with a state-of-the-art VQA model, and for each image in the dataset, attempt to find a question where the model's predicted answer is incorrect. We find that a wide range of state-of-the-art models perform poorly when evaluated on these examples. We conduct an extensive analysis of the collected adversarial examples and provide guidance on future research directions. We hope that this Adversarial VQA (AdVQA) benchmark can help drive progress in the field and advance the state of the art.


title: Oscillation and non oscillation criteria for linear nonhomogeneous systems of two first-order ordinary differential equations

abstract: The Riccati equation method is used to establish an oscillatory and a non oscillatory criteria for nonhomogeneous linear systems of two first-order ordinary differential equations. It is shown that the obtained oscillatory criterion is a generalization of J. S. W. Wong's oscillatory criterion.


title: Decoupled Dialogue Modeling and Semantic Parsing for Multi-Turn Text-to-SQL

abstract: Recently, Text-to-SQL for multi-turn dialogue has attracted great interest. Here, the user input of the current turn is parsed into the corresponding SQL query of the appropriate database, given all previous dialogue history. Current approaches mostly employ end-to-end models and consequently face two challenges. First, dialogue history modeling and Text-to-SQL parsing are implicitly combined, hence it is hard to carry out interpretable analysis and obtain targeted improvement. Second, SQL annotation of multi-turn dialogue is very expensive, leading to training data sparsity. In this paper, we propose a novel decoupled multi-turn Text-to-SQL framework, where an utterance rewrite model first explicitly solves completion of dialogue context, and then a single-turn Text-to-SQL parser follows. A dual learning approach is also proposed for the utterance rewrite model to address the data sparsity problem. Compared with end-to-end approaches, the proposed decoupled method can achieve excellent performance without any annotated in-domain data. With just a few annotated rewrite cases, the decoupled method outperforms the released state-of-the-art end-to-end models on both SParC and CoSQL datasets.


title: Privacy Preference Signals: Past, Present and Future

abstract: Privacy preference signals are digital representations of how users want their personal data to be processed. Such signals must be adopted by both the sender (users) and intended recipients (data processors). Adoption represents a coordination problem that remains unsolved despite efforts dating back to the 1990s. Browsers implemented standards like the Platform for Privacy Preferences (P3P) and Do Not Track (DNT), but vendors profiting from personal data faced few incentives to receive and respect the expressed wishes of data subjects. In the wake of recent privacy laws, a coalition of AdTech firms published the Transparency and Consent Framework (TCF), which defines an opt-in consent signal. This paper integrates post-GDPR developments into the wider history of privacy preference signals. Our main contribution is a high-frequency longitudinal study describing how TCF signal gained dominance as of February 2021. We explore which factors correlate with adoption at the website level. Both the number of third parties on a website and the presence of Google Ads are associated with higher adoption of TCF. Further, we show that vendors acted as early adopters of TCF 2.0 and provide two case-studies describing how Consent Management Providers shifted existing customers to TCF 2.0. We sketch ways forward for a pro-privacy signal.


title: Fourier modal method for Moir\'e lattices

abstract: In recent years twisted bi-layers of 2D materials became very popular in the field due to the possibility to totally change their electronic properties by simple rotation. At the same time, in the wide field of photonic crystals, this idea still remains almost untouched, and only some particular problems were considered. One of the reasons is the computational difficulty of the accurate consideration of Moir\'e superlattices that appear due to the superimposition of misaligned lattices. Indeed, the unit cell of the complex lattice is typically much larger than the original crystals and requires much more computational resources for the computations. Here, we propose a careful adaptation of the Fourier modal method in the form of the scattering matrices for the description of twisted 1D gratings' stacks. Our approach allows us to consider sublattices in close vicinity to each other and account for their interaction via the near-field. In the developed numerical scheme, we utilize the fact that each sublattice is only 1D-periodic and therefore simpler than the resulting 2D superlattice, as well as the fact that even a small gap between the lattices filters out high Fourier harmonics due to their evanescent origin. This accelerates the computations from 1 up to 3 and more orders of magnitude for typical structures depending on the number of harmonics. This paves the way for rigorous study of almost any photonic crystals of the proposed geometry and demonstration of specific Moir\'e-associated effects.


title: Subdivision-Based Mesh Convolution Networks

abstract: Convolutional neural networks (CNNs) have made great breakthroughs in 2D computer vision. However, their irregular structure makes it hard to harness the potential of CNNs directly on meshes. A subdivision surface provides a hierarchical multi-resolution structure, in which each face in a closed 2-manifold triangle mesh is exactly adjacent to three faces. Motivated by these two observations, this paper presents SubdivNet, an innovative and versatile CNN framework for 3D triangle meshes with Loop subdivision sequence connectivity. Making an analogy between mesh faces and pixels in a 2D image allows us to present a mesh convolution operator to aggregate local features from nearby faces. By exploiting face neighborhoods, this convolution can support standard 2D convolutional network concepts, e.g. variable kernel size, stride, and dilation. Based on the multi-resolution hierarchy, we make use of pooling layers which uniformly merge four faces into one and an upsampling method which splits one face into four. Thereby, many popular 2D CNN architectures can be easily adapted to process 3D meshes. Meshes with arbitrary connectivity can be remeshed to have Loop subdivision sequence connectivity via self-parameterization, making SubdivNet a general approach. Extensive evaluation and various applications demonstrate SubdivNet's effectiveness and efficiency.


title: Efficient conversion of orbital Hall current to spin current for spin-orbit torque switching

abstract: Spin Hall effect, an electric generation of spin current, allows for efficient control of magnetization. Recent theory revealed that orbital Hall effect creates orbital current, which can be much larger than spin Hall-induced spin current. However, orbital current cannot directly exert a torque on a ferromagnet, requiring a conversion process from orbital current to spin current. Here, we report two effective methods of the conversion through spin-orbit coupling engineering, which allows us to unambiguously demonstrate orbital-current-induced spin torque, or orbital Hall torque. We find that orbital Hall torque is greatly enhanced by introducing either a rare-earth ferromagnet Gd or a Pt interfacial layer with strong spin-orbit coupling in Cr/ferromagnet structures, indicating that the orbital current generated in Cr is efficiently converted into spin current in the Gd or Pt layer. Furthermore, we show that the orbital Hall torque can facilitate the reduction of switching current of perpendicular magnetization in spin-orbit-torque-based spintronic devices.


title: Dutch Named Entity Recognition and De-identification Methods for the Human Resource Domain

abstract: The human resource (HR) domain contains various types of privacy-sensitive textual data, such as e-mail correspondence and performance appraisal. Doing research on these documents brings several challenges, one of them anonymisation. In this paper, we evaluate the current Dutch text de-identification methods for the HR domain in four steps. First, by updating one of these methods with the latest named entity recognition (NER) models. The result is that the NER model based on the CoNLL 2002 corpus in combination with the BERTje transformer give the best combination for suppressing persons (recall 0.94) and locations (recall 0.82). For suppressing gender, DEDUCE is performing best (recall 0.53). Second NER evaluation is based on both strict de-identification of entities (a person must be suppressed as a person) and third evaluation on a loose sense of de-identification (no matter what how a person is suppressed, as long it is suppressed). In the fourth and last step a new kind of NER dataset is tested for recognising job titles in texts.


title: Tackling the Background Bias in Sparse Object Detection via Cropped Windows

abstract: Object detection on Unmanned Aerial Vehicles (UAVs) is still a challenging task. The recordings are mostly sparse and contain only small objects. In this work, we propose a simple tiling method that improves the detection capability in the remote sensing case without modifying the model itself. By reducing the background bias and enabling the usage of higher image resolutions during training, our method can improve the performance of models substantially. The procedure was validated on three different data sets and outperformed similar approaches in performance and speed.


title: Modeling the Unigram Distribution

abstract: The unigram distribution is the non-contextual probability of finding a specific word form in a corpus. While of central importance to the study of language, it is commonly approximated by each word's sample frequency in the corpus. This approach, being highly dependent on sample size, assigns zero probability to any out-of-vocabulary (oov) word form. As a result, it produces negatively biased probabilities for any oov word form, while positively biased probabilities to in-corpus words. In this work, we argue in favor of properly modeling the unigram distribution -- claiming it should be a central task in natural language processing. With this in mind, we present a novel model for estimating it in a language (a neuralization of Goldwater et al.'s (2011) model) and show it produces much better estimates across a diverse set of 7 languages than the na\"ive use of neural character-level language models.


title: Matrix completion with data-dependent missingness probabilities

abstract: The problem of completing a large matrix with lots of missing entries has received widespread attention in the last couple of decades. Two popular approaches to the matrix completion problem are based on singular value thresholding and nuclear norm minimization. Most of the past works on this subject assume that there is a single number $p$ such that each entry of the matrix is available independently with probability $p$ and missing otherwise. This assumption may not be realistic for many applications. In this work, we replace it with the assumption that the probability that an entry is available is an unknown function $f$ of the entry itself. For example, if the entry is the rating given to a movie by a viewer, then it seems plausible that high value entries have greater probability of being available than low value entries. We propose two new estimators, based on singular value thresholding and nuclear norm minimization, to recover the matrix under this assumption. The estimators involve no tuning parameters, and are shown to be consistent under a low rank assumption. We also provide a consistent estimator of the unknown function $f$.

categories: math.ST cs.IT math.IT math.PR stat.ME stat.TH


title: Finite element stress analysis of a combined stacker-reclaimer machine: A design audit report

abstract: Design audit or design verification is an important step in engineering of heavy mobile materials handling equipment. Usually, the costumers employ third parties for audition of contractors engineering. Here a part of design audit of a combined stacker-reclaimer machine is reported. This equipment is designed and constructed by a local supplier in Iran for the iron ore pelletizing plants at GOHARZAMIN Iron Ore Company. The structure plays an important role in mobile material handling machines such as Stackers and Reclaimers and its failure and damage may cause considerable financial and human life losses. In this report the undercarriage of stacker-reclaimer machine including gantry and traveling system are numerically analyzed. The Finite Element Method is used for stress prediction under the critical operating loads according to the design standards. The critical areas of the undercarriage are identified and it is observed that, the maximum stress is in the safe range.


title: Observation of the Decay $D^0\to \rho^-\mu^+\nu_\mu$

abstract: By analyzing an $e^+e^-$ annihilation data sample corresponding to an integrated luminosity of $2.93~\mathrm{fb}^{-1}$ collected at a center-of-mass energy of 3.773 GeV with the BESIII detector, we measure the branching fraction of the $D^0\to \rho^- \mu^+\nu_\mu$ decay for the first time. We obtain ${\mathcal B}_{D^0\to \rho^- \mu^+\nu_\mu}=(1.35\pm0.09_{\rm stat}\pm0.09_{\rm syst})\times 10^{-3}$. Using the world average of ${\mathcal B}_{D^0\to \rho^- e^+\nu_e}$, we find a branching fraction ratio of ${\mathcal B}_{D^0\to \rho^- \mu^+\nu_\mu}/{\mathcal B}_{D^0\to \rho^- e^+\nu_e}=0.90\pm0.11$, which agrees with the theoretical expectation of lepton flavor universality within the uncertainty. Combining the world average of ${\mathcal B}_{D^+\to \rho^0 \mu^+ \nu_\mu}$ and the lifetimes of $D^{0(+)}$, we obtain a partial decay width ratio of ${\Gamma}_{D^0\to \rho^- \mu^+ \nu_{\mu}}/(2{\Gamma}_{D^+\to \rho^0 \mu^+ \nu_{\mu}}) = 0.71\pm0.14$, which is consistent with the isospin symmetry expectation of one within $2.1\sigma$. For the reported values of ${\mathcal B}_{D^0\to \rho^- \mu^+\nu_\mu}/{\mathcal B}_{D^0\to \rho^- e^+\nu_e}$ and ${\Gamma}_{D^0\to \rho^- \mu^+ \nu_{\mu}}/2{\Gamma}_{D^+\to \rho^0 \mu^+ \nu_{\mu}}$, the uncertainty is the quadratic sum of the statistical and systematic uncertainties.


title: Cross-language Sentence Selection via Data Augmentation and Rationale Training

abstract: This paper proposes an approach to cross-language sentence selection in a low-resource setting. It uses data augmentation and negative sampling techniques on noisy parallel sentence data to directly learn a cross-lingual embedding-based query relevance model. Results show that this approach performs as well as or better than multiple state-of-the-art machine translation + monolingual retrieval systems trained on the same parallel data. Moreover, when a rationale training secondary objective is applied to encourage the model to match word alignment hints from a phrase-based statistical machine translation model, consistent improvements are seen across three language pairs (English-Somali, English-Swahili and English-Tagalog) over a variety of state-of-the-art baselines.


title: On the effect of scalar fields on Hawking radiation and quasinormal modes of black holes

abstract: The present thesis attempts to study the effect of scalar fields on Hawking radiation and quasinormal modes of black holes. We selected a static, spherically symmetric electrically charged black hole with an additional scalar 'hair' for our analysis. The scalar 'hair' is sourced by a scalar field, conformally coupled to the Einstein-Hilbert action. The scalar field can survive even in the absence of the black hole's electric charge and is characterized as a 'primary hair'. This scalar field changes the gravitational constant, and hence modifies the ADM (Arnowitt-Deser-Missner) mass of the black hole. The scalar field's strength is determined by a scalar 'charge' that manifests itself as an additive correction to the square of the electric charge in the standard Reissner-Nordstr\"{o}m metric. This seemingly simple modification leads to nontrivial physical implications.


title: Differentiable Dynamic Quantization with Mixed Precision and Adaptive Resolution

abstract: Model quantization is challenging due to many tedious hyper-parameters such as precision (bitwidth), dynamic range (minimum and maximum discrete values) and stepsize (interval between discrete values). Unlike prior arts that carefully tune these values, we present a fully differentiable approach to learn all of them, named Differentiable Dynamic Quantization (DDQ), which has several benefits. (1) DDQ is able to quantize challenging lightweight architectures like MobileNets, where different layers prefer different quantization parameters. (2) DDQ is hardware-friendly and can be easily implemented using low-precision matrix-vector multiplication, making it capable in many hardware such as ARM. (3) Extensive experiments show that DDQ outperforms prior arts on many networks and benchmarks, especially when models are already efficient and compact. e.g., DDQ is the first approach that achieves lossless 4-bit quantization for MobileNetV2 on ImageNet.


title: Torricelli's Curtain: Morphology of Horizontal Laminar Jets Under Gravity

abstract: Viscous fluid exiting a long horizontal circular pipe develops a complex structure comprising a primary jet above and a smaller secondary jet below with a thin fluid curtain connecting them. We present here a combined experimental, theoretical and numerical study of this 'Torricelli's curtain' phenomenon, focusing on the factors that control its morphology. We propose a theoretical model for the curtain in which particle trajectories result from the composition of two motions: a horizontal component corresponding to the evolving axial velocity profile of an axisymmetric viscous jet, and a vertical component due to free fall under gravity. The model predicts well the trajectory of the primary jet, but somewhat less well that of the secondary jet. We suggest that the remaining discrepancy may be explained by surface tension-driven (Taylor-Culick) retraction of the secondary jet. Finally, direct numerical simulation reveals recirculating 'Dean' vortices in vertical sections of the primary jet, placing Torricelli's curtain firmly within the context of flow in curved pipes.


title: Fre-GAN: Adversarial Frequency-consistent Audio Synthesis

abstract: Although recent works on neural vocoder have improved the quality of synthesized audio, there still exists a gap between generated and ground-truth audio in frequency space. This difference leads to spectral artifacts such as hissing noise or reverberation, and thus degrades the sample quality. In this paper, we propose Fre-GAN which achieves frequency-consistent audio synthesis with highly improved generation quality. Specifically, we first present resolution-connected generator and resolution-wise discriminators, which help learn various scales of spectral distributions over multiple frequency bands. Additionally, to reproduce high-frequency components accurately, we leverage discrete wavelet transform in the discriminators. From our experiments, Fre-GAN achieves high-fidelity waveform generation with a gap of only 0.03 MOS compared to ground-truth audio while outperforming standard models in quality.


title: Measurements of Born Cross Sections of $e^+e^-\to D_s^{*+} D_{sJ}^{-} +c.c.$

abstract: The Born cross sections are measured for the first time for the processes $e^+e^-\to D_s^{*+}D_{s0}^*(2317)^- +c.c.$ and $e^+e^-\to D_s^{*+}D_{s1}(2460)^- +c.c.$ at the center-of-mass energy $\sqrt{s}=$ 4.600~GeV, 4.612~GeV, 4.626~GeV, 4.640~GeV, 4.660~GeV, 4.68~GeV, and 4.700~GeV, and for $e^+e^-\to D_s^{*+}D_{s1}(2536)^- +c.c.$ at $\sqrt{s}=$ 4.660~GeV, 4.680~GeV, and 4.700~GeV, using data samples collected with the BESIII detector at the BEPCII collider. No structures are observed in cross-section distributions for any of the processes.


title: MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolution

abstract: Reference-based image super-resolution (RefSR) has shown promising success in recovering high-frequency details by utilizing an external reference image (Ref). In this task, texture details are transferred from the Ref image to the low-resolution (LR) image according to their point- or patch-wise correspondence. Therefore, high-quality correspondence matching is critical. It is also desired to be computationally efficient. Besides, existing RefSR methods tend to ignore the potential large disparity in distributions between the LR and Ref images, which hurts the effectiveness of the information utilization. In this paper, we propose the MASA network for RefSR, where two novel modules are designed to address these problems. The proposed Match & Extraction Module significantly reduces the computational cost by a coarse-to-fine correspondence matching scheme. The Spatial Adaptation Module learns the difference of distribution between the LR and Ref images, and remaps the distribution of Ref features to that of LR features in a spatially adaptive way. This scheme makes the network robust to handle different reference images. Extensive quantitative and qualitative experiments validate the effectiveness of our proposed model.


title: AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER

abstract: Neural methods have been shown to achieve high performance in Named Entity Recognition (NER), but rely on costly high-quality labeled data for training, which is not always available across languages. While previous works have shown that unlabeled data in a target language can be used to improve cross-lingual model performance, we propose a novel adversarial approach (AdvPicker) to better leverage such data and further improve results. We design an adversarial learning framework in which an encoder learns entity domain knowledge from labeled source-language data and better shared features are captured via adversarial training - where a discriminator selects less language-dependent target-language data via similarity to the source language. Experimental results on standard benchmark datasets well demonstrate that the proposed method benefits strongly from this data selection process and outperforms existing state-of-the-art methods; without requiring any additional external resources (e.g., gazetteers or via machine translation). The code is available at https://aka.ms/AdvPicker


title: Event Classification with Multi-step Machine Learning

abstract: The usefulness and value of Multi-step Machine Learning (ML), where a task is organized into connected sub-tasks with known intermediate inference goals, as opposed to a single large model learned end-to-end without intermediate sub-tasks, is presented. Pre-optimized ML models are connected and better performance is obtained by re-optimizing the connected one. The selection of an ML model from several small ML model candidates for each sub-task has been performed by using the idea based on Neural Architecture Search (NAS). In this paper, Differentiable Architecture Search (DARTS) and Single Path One-Shot NAS (SPOS-NAS) are tested, where the construction of loss functions is improved to keep all ML models smoothly learning. Using DARTS and SPOS-NAS as an optimization and selection as well as the connections for multi-step machine learning systems, we find that (1) such a system can quickly and successfully select highly performant model combinations, and (2) the selected models are consistent with baseline algorithms, such as grid search, and their outputs are well controlled.


title: Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition

abstract: Integrating external language models (LMs) into end-to-end (E2E) models remains a challenging task for domain-adaptive speech recognition. Recently, internal language model estimation (ILME)-based LM fusion has shown significant word error rate (WER) reduction from Shallow Fusion by subtracting a weighted internal LM score from an interpolation of E2E model and external LM scores during beam search. However, on different test sets, the optimal LM interpolation weights vary over a wide range and have to be tuned extensively on well-matched validation sets. In this work, we perform LM fusion in the minimum WER (MWER) training of an E2E model to obviate the need for LM weights tuning during inference. Besides MWER training with Shallow Fusion (MWER-SF), we propose a novel MWER training with ILME (MWER-ILME) where the ILME-based fusion is conducted to generate N-best hypotheses and their posteriors. Additional gradient is induced when internal LM is engaged in MWER-ILME loss computation. During inference, LM weights pre-determined in MWER training enable robust LM integrations on test sets from different domains. Experimented with 30K-hour trained transformer transducers, MWER-ILME achieves on average 8.8% and 5.8% relative WER reductions from MWER and MWER-SF training, respectively, on 6 different test sets


title: Future Radio Continuum Cosmology Clustering Surveys

abstract: The use of continuum emission radio galaxies as cosmological tracers of the large-scale structure will soon move into a new phase. Upcoming surveys from the Australian Square Kilometre Array Pathfinder (ASKAP), MeerKAT, and the Square Kilometre Array project (SKA) will survey the entire available sky down to an ~100uJy flux limit, increasing the number of detected extra-galactic radio sources by several orders of magnitude. External data and machine learning algorithms will also enable some low resolution radial selection (photometric redshift binning) of the sample, increasing the cosmological utility of the sample observed. In this paper, we discuss the flux limit required to detect enough galaxies to decrease the shot noise term in the error to be 10% of the total. We show how future surveys of this type will be limited by available technology. The confusion generated by the intrinsic sizes of galaxies may have the consequence that surveys of this type eventually reach a hard flux limit of ~100nJy, as is predicted by the current modelling of AGN sizes by simulations such as the Tiered Radio Extragalactic Continuum Simulation (T-RECS). Finally, when considering the multi-tracer approach, where galaxies are split by type to measure some bias ratio, we find that there are not enough AGN present to achieve a reasonable level of shot noise for this kind of measurement.


title: Low-bandwidth Modular Mathematical Modeling of DC Microgrid Systems for Control Development with Application to Shipboard Power Systems

abstract: In recent years, DC and AC microgrid (MG) systems have attracted a major attention due to various potential for integration of future technology into conventional systems and control. The integration of such technology requires appropriate tools for complex design, analysis and optimization. This paper presents a mathematical low-bandwidth modeling (LBM) approach that can be used for control development in DC and further be extended to AC MG systems. In this work, first a simplified mathematical model of a medium voltage DC (MVDC) shipboard MG system is presented, next, the overall system-level connection convention is presented to display the overall mathematical coupling of the individual sub-systems, then, a simplified example of the control development is presented, and last, the overall system under a test scenario is implemented in Simulink Real-time.


title: Local Adaptivity in Federated Learning: Convergence and Consistency

abstract: The federated learning (FL) framework trains a machine learning model using decentralized data stored at edge client devices by periodically aggregating locally trained models. Popular optimization algorithms of FL use vanilla (stochastic) gradient descent for both local updates at clients and global updates at the aggregating server. Recently, adaptive optimization methods such as AdaGrad have been studied for server updates. However, the effect of using adaptive optimization methods for local updates at clients is not yet understood. We show in both theory and practice that while local adaptive methods can accelerate convergence, they can cause a non-vanishing solution bias, where the final converged solution may be different from the stationary point of the global objective function. We propose correction techniques to overcome this inconsistency and complement the local adaptive methods for FL. Extensive experiments on realistic federated training tasks show that the proposed algorithms can achieve faster convergence and higher test accuracy than the baselines without local adaptivity.


title: Automatic Patch Linkage Detection in Code Review Using TextualContent and File Location Features

abstract: Context: Contemporary code review tools are a popular choice for software quality assurance. Using these tools, reviewers are able to post a linkage between two patches during a review discussion. Large development teams that use a review-then-commit model risk being unaware of these linkages. Objective: Our objective is to first explore how patch linkage impacts the review process. We then propose and evaluate models that detect patch linkage based on realistic time intervals. Method: First, we carry out an exploratory study on three open source projects to conduct linkage impact analysis using 942 manually classified linkages. Second, we propose two techniques using textual and file location similarity to build detection models and evaluate their performance. Results: The study provides evidence of latency in the linkage notification. We show that a patch with the Alternative Solution linkage (i.e., patches that implement similar functionality)undergoes a quicker review and avoids additional revisions after the team has been notified, compared to other linkage types. Our detection model experiments show promising recall rates for the Alternative Solution linkage (from 32% to 95%), but precision has room for improvement. Conclusion: Patch linkage detection is promising, with likely improvements if the practice of posting linkages becomes more prevalent. From our implications, this paper lays the groundwork for future research on how to increase patch linkage awareness to facilitate efficient reviews.


title: Thermoelectric transport in a correlated electron system on the surface of liquid helium

abstract: We report on the direct observation of the thermoelectric transport in a nondegenerate correlated electron system formed on the surface of liquid helium. We find that the microwave-induced excitation of the vertical transitions of electrons between the surface-bound states leads to their lateral flow, which we were able to detect by employing a segmented electrode configuration. We show that this flow of electrons arises due to the Seebeck effect, thus our method provides a new tool to study thermoelectricity in a disorder-free correlated electron system. Our experimental results are in good agreement with the theoretical calculations based on kinetic equations, with proper account of fast electron-electron collisions.


title: On arithmetic Dijkgraaf-Witten theory

abstract: We present basic constructions and properties in arithmetic Chern-Simons theory with finite gauge group along the line of topological quantum field theory. For a finite set $S$ of finite primes of a number field $k$, we construct arithmetic analogues of the Chern-Simons 1-cocycle, the prequantization bundle for a surface and the Chern-Simons functional for a $3$-manifold. We then construct arithmetic analogues for $k$ and $S$ of the quantum Hilbert space (space of conformal blocks) and the Dijkgraaf-Witten partition function in (2+1)-dimensional Chern-Simons TQFT. We show some basic and functorial properties of those arithmetic analogues. Finally we show decomposition and gluing formulas for arithmetic Chern-Simons invariants and arithmetic Dijkgraaf-Witten partition functions.


title: On (co-lex) Ordering Automata

abstract: The states of a deterministic finite automaton A can be identified with collections of words in Pf(L(A)) -- the set of prefixes of words belonging to the regular language accepted by A. But words can be ordered and among the many possible orders a very natural one is the co-lexicographic one. Such naturalness stems from the fact that it suggests a transfer of the order from words to the automaton's states. In a number of papers automata admitting a total ordering of states coherent with the ordering of the set of words reaching them have been proposed. Such class of ordered automata -- the Wheeler automata -- turned out to be efficiently stored/searched using an index. Unfortunately not all automata can be totally ordered as previously outlined. However, automata can always be partially ordered and an intrinsic measure of their complexity can be defined and effectively determined, as the minimum width of one of their admissible partial orders. As shown in previous works, this new concept of width of an automaton has useful consequences in the fields of graph compression, indexing data structures, and automata theory. In this paper we prove that a canonical, minimum-width, partially-ordered automaton accepting a language L -- dubbed the Hasse automaton H of L -- can be exhibited. H provides, in a precise sense, the best possible way to (partially) order the states of any automaton accepting L, as long as we want to maintain an operational link with the (co-lexicographic) order of Pf(L(A)). Using H we prove that the width of the language can be effectively computed from the minimum automaton recognizing the language. Finally, we explore the relationship between two (often conflicting) objectives: minimizing the width and minimizing the number of states of an automaton.


title: FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning

abstract: Client contribution evaluation, also known as data valuation, is a crucial approach in federated learning(FL) for client selection and incentive allocation. However, due to restrictions of accessibility of raw data, only limited information such as local weights and local data size of each client is open for quantifying the client contribution. Using data size from available information, we introduce an empirical evaluation method called Federated Client Contribution Evaluation through Accuracy Approximation(FedCCEA). This method builds the Accuracy Approximation Model(AAM), which estimates a simulated test accuracy using inputs of sampled data size and extracts the clients' data quality and data size to measure client contribution. FedCCEA strengthens some advantages: (1) enablement of data size selection to the clients, (2) feasible evaluation time regardless of the number of clients, and (3) precise estimation in non-IID settings. We demonstrate the superiority of FedCCEA compared to previous methods through several experiments: client contribution distribution, client removal, and robustness test to partial participation.


title: Theoretical description of semi-inclusive T2K, Miner$\nu$A and MicroBooNE neutrino-nucleus data in the relativistic plane wave impulse approximation

abstract: We present the results of semi-inclusive neutrino-nucleus cross sections within the plane wave impulse approximation (PWIA) for three nuclear models: relativistic Fermi gas (RFG), independent-particle shell model (IPSM) and natural orbital shell model (NO) in comparison with the available CC0$\pi$ measurements from the T2K, MINER$\nu$A and MicroBooNE collaborations where a muon and at least one proton are detected in the final state. Results are presented as a function of the momenta and angles of the final particles, as well as in terms of the imbalances between proton and muon kinematics. The analysis reveals that contributions beyond PWIA are crucial to explain the experimental measurements and that the study of correlations between final-state proton and muon kinematics can provide valuable information on relevant nuclear effects such as the Fermi motion and final state interactions.


title: Verification Tools for Checking some kinds of Testability

abstract: A locally testable language L is a language with the property that for some non negative integer k, called the order of local testability, whether or not a word u is in the language L depends on (1) the prefix and suffix of the word u of length k + 1 and (2) the set of intermediate substrings of length k of the word u. For given k the language is called k-testable. The local testability has a wide spectrum of generalizations. A set of procedures for deciding whether or not a language given by its minimal automaton or by its syntactic semigroup is locally testable, right or left locally testable, threshold locally testable, strictly locally testable, or piecewise testable was implemented in the package TESTAS written in C=C++. The bounds on order of local testability of transition graph and order of local testability of transition semigroup are also found. For given k, the k-testability of transition graph is verified. We consider some approaches to verify these procedures and use for this aim some auxiliary programs. The approaches are based on distinct forms of presentation of a given finite automaton and on algebraic properties of the presentation. New proof and fresh wording of necessary and sufficient conditions for local testability of deterministic finite automaton is presented.


title: Algebraic structure underlying spherical, parabolic and prolate spheroidal bases of the nine-dimensional MICZ-Kepler problem

abstract: The nonrelativistic motion of a charged particle around a dyon in (9+1) spacetime is known as the nine-dimensional MICZ-Kepler problem. This problem has been solved exactly by the variables-separation method in three different coordinate systems, spherical, parabolic, and prolate spheroidal. In the present study, we establish a relationship between the variable separation and the algebraic structure of SO(10) symmetry. Each of the spherical, parabolic, or prolate spheroidal bases is proved to be a set of eigenfunctions of a corresponding nonuplet of algebraically-independent integrals of motion. This finding also helps us establish connections between the bases by the algebraic method. This connection, in turn, allows calculating complicated integrals of confluent Heun, generalized Laguerre, and generalized Jacobi polynomials, which are important in physics and analytics.


title: Isomers in 203Tl and core excitations built on a five-nucleon-hole structure

abstract: Isomers with three- and five-nucleon-hole configurations have been established in $^{203}$Tl. These include newly identified levels with a three-nucleon structure: {\it I}$^{\pi }$ = (15/2$^{-}$) with {\it T}$_{1/2}$ = 7.9(5) ns, and {\it I}$^{\pi }$ = (35/2$^{-}$) with {\it T}$_{1/2}$ = 4.0(5) ns. In addition, five-quasiparticle states: {\it I}$^{\pi }$ = (39/2$^{-}$) with {\it T}$_{1/2}$ = 1.9(2) ns, and {\it I}$^{\pi }$ = (49/2$^{+}$) with {\it T}$_{1/2}$ = 3.4(4) ns have also been established. The previously determined long-lived decay [{\it T}$_{1/2}$ = 6.6(3) $\mu $s from this work] is associated with isomerism of the {\it I}$^{\pi }$ = (29/2$^{+}$) state. Levels above this long-lived isomer have been identified through a delayed-prompt coincidence measurement. Five-nucleon-hole states with excitation energies {\it E}$_{x}$ $\approx $ 7 MeV have been established as well as possible octupole excitations of the $^{208}$Pb core built on these levels. The level scheme of $^{203}$Tl is extended up to {\it E}$_{x}$ $\approx $ 11 MeV with the inclusion of 25 new transitions. Empirical and shell-model calculations have been performed to aid in the description of the observed states which are found to be predominantly of intrinsic character.


title: Intelligent Transportation Systems to Mitigate Road Traffic Congestion

abstract: Intelligent transport systems have efficiently and effectively proved themselves in settling up the problem of traffic congestion around the world. The multi-agent based transportation system is one of the most important intelligent transport systems, which represents an interaction among the neighbouring vehicles, drivers, roads, infrastructure and vehicles. In this paper, two traffic management models have been created to mitigate congestion and to ensure that emergency vehicles arrive as quickly as possible. A tool-chain SUMO-JADE is employed to create a microscopic simulation symbolizing the interactions of traffic. The simulation model has showed a significant reduction of at least 50% in the average time delay and thus a real improvement in the entire journey time.


title: Test of a small prototype of the COMET cylindrical drift chamber

abstract: The performance of a small prototype of a cylindrical drift chamber (CDC) used in the COMET Phase-I experiment was studied by using an electron beam. The prototype chamber was constructed with alternating all-stereo wire configuration and operated with the He-iC$_{4}$H$_{10}$ (90/10) gas mixture without a magnetic field. The drift space-time relation, drift velocity, d$E$/d$x$ resolution, hit efficiency, and spatial resolution as a function of distance from the wire were investigated. The average spatial resolution of 150 $\mu$m with the hit efficiency of 99% was obtained at applied voltages higher than 1800 V. We have demonstrated that the design and gas mixture of the prototype match the operation of the COMET CDC.


title: Retrieve & Memorize: Dialog Policy Learning with Multi-Action Memory

abstract: Dialogue policy learning, a subtask that determines the content of system response generation and then the degree of task completion, is essential for task-oriented dialogue systems. However, the unbalanced distribution of system actions in dialogue datasets often causes difficulty in learning to generate desired actions and responses. In this paper, we propose a retrieve-and-memorize framework to enhance the learning of system actions. Specially, we first design a neural context-aware retrieval module to retrieve multiple candidate system actions from the training set given a dialogue context. Then, we propose a memory-augmented multi-decoder network to generate the system actions conditioned on the candidate actions, which allows the network to adaptively select key information in the candidate actions and ignore noises. We conduct experiments on the large-scale multi-domain task-oriented dialogue dataset MultiWOZ 2.0 and MultiWOZ 2.1. Experimental results show that our method achieves competitive performance among several state-of-the-art models in the context-to-response generation task.


title: AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding

abstract: Automatic extraction of product attribute values is an important enabling technology in e-Commerce platforms. This task is usually modeled using sequence labeling architectures, with several extensions to handle multi-attribute extraction. One line of previous work constructs attribute-specific models, through separate decoders or entirely separate models. However, this approach constrains knowledge sharing across different attributes. Other contributions use a single multi-attribute model, with different techniques to embed attribute information. But sharing the entire network parameters across all attributes can limit the model's capacity to capture attribute-specific characteristics. In this paper we present AdaTag, which uses adaptive decoding to handle extraction. We parameterize the decoder with pretrained attribute embeddings, through a hypernetwork and a Mixture-of-Experts (MoE) module. This allows for separate, but semantically correlated, decoders to be generated on the fly for different attributes. This approach facilitates knowledge sharing, while maintaining the specificity of each attribute. Our experiments on a real-world e-Commerce dataset show marked improvements over previous methods.


title: Lorentzian area and volume estimates for integral mean curvature bounds

abstract: In the present paper we establish area and volume estimates for spacetimes satisfying the strong energy condition in terms of the area and the $L^n$-norm of the second fundamental form or the mean curvature of an initial Cauchy hypersurface. We believe that these estimates will lay some of the groundwork in establishing new convergence results for Cauchy developments $(M_j, g_j)$ of suitably converging initial data $(\Sigma_j ,h_j ,K_j )$.


title: Few-Shot Segmentation via Cycle-Consistent Transformer

abstract: Few-shot segmentation aims to train a segmentation model that can fast adapt to novel classes with few exemplars. The conventional training paradigm is to learn to make predictions on query images conditioned on the features from support images. Previous methods only utilized the semantic-level prototypes of support images as conditional information. These methods cannot utilize all pixel-wise support information for the query predictions, which is however critical for the segmentation task. In this paper, we focus on utilizing pixel-wise relationships between support and query images to facilitate the few-shot segmentation task. We design a novel Cycle-Consistent TRansformer (CyCTR) module to aggregate pixel-wise support features into query ones. CyCTR performs cross-attention between features from different images, i.e. support and query images. We observe that there may exist unexpected irrelevant pixel-level support features. Directly performing cross-attention may aggregate these features from support to query and bias the query features. Thus, we propose using a novel cycle-consistent attention mechanism to filter out possible harmful support features and encourage query features to attend to the most informative pixels from support images. Experiments on all few-shot segmentation benchmarks demonstrate that our proposed CyCTR leads to remarkable improvement compared to previous state-of-the-art methods. Specifically, on Pascal-$5^i$ and COCO-$20^i$ datasets, we achieve 67.5% and 45.6% mIoU for 5-shot segmentation, outperforming previous state-of-the-art methods by 5.6% and 7.1% respectively.


title: A statistical analysis of pores and micro-cracks in nuclear graphite

abstract: Microstructure characterization is of great value to understanding nuclear graphite's properties and irradiation behavior. However, graphite is soft and could be easily damaged during sample preparation. A three-step polishing method involving mechanical polishing, ion milling and rapid oxidation is proposed for graphite. Ion milling is adopted to remove the broken graphite pieces produced by mechanical polishing. Rapid oxidation is then adopted to remove irradiation-induced damage layer during ion milling. The Raman spectra show very low G peak width and ID/IG ratio after rapid oxidation, indicating a surface completely free from artificial defects. The micro-cracks which were conventionally observed via a transmission electron microscope can be observed on rapid-oxidized surface in a scanning electron microscope. By digital image processing, the micro-cracks along with the gas-escape pores in nuclear graphite IG-110 are statistically analyzed. Porosity's distributions on crack (pore) size (spanning from 10 nm to 100 um) are given, which could help to understand and simulate graphite's performances in reactors.


title: UAV Swarm Path Planning with Reinforcement Learning for Field prospecting

abstract: Unmanned Aerial Vehicle (UAV) swarms adoption shows a steady growth among operators due to the benefits in time and cost arisen from their use. However, this kind of system faces an important problem which is the calculation of many optimal paths for each UAV. Solving this problem would allow a to control many UAVs without human intervention at the same time while saving battery between recharges and performing several tasks simultaneously. The main aim is to develop a system capable of calculating the optimal flight path for a UAV swarm. The aim of these paths is to achieve full coverage of a flight area for tasks such as field prospection. All this, regardless of the size of maps and the number of UAVs in the swarm. It is not necessary to establish targets or any other previous knowledge other than the given map. Experiments have been conducted to determine whether it is optimal to establish a single control for all UAVs in the swarm or a control for each UAV. The results show that it is better to use one control for all UAVs because of the shorter flight time. In addition, the flight time is greatly affected by the size of the map. The results give starting points for future research such as finding the optimal map size for each situation.


title: Probabilistic forecasting for sizing in the capacity firming framework

abstract: This paper proposes a strategy to size a grid-connected photovoltaic plant coupled with a battery energy storage device within the \textit{capacity firming} specifications of the French Energy Regulatory Commission. In this context, the sizing problem is challenging due to the two-phase engagement control with a day-ahead nomination and an intraday control to minimize deviations from the planning. The two-phase engagement control is modeled with deterministic and stochastic approaches. The optimization problems are formulated as mixed-integer quadratic problems, using a Gaussian copula methodology to generate PV scenarios, to approximate the mixed-integer non-linear problem of the capacity firming. Then, a grid search is conducted to approximate the optimal sizing for a given selling price using both the deterministic and stochastic approaches. The case study is composed of PV production monitored on-site at the Li\`ege University (ULi\`ege), Belgium.


title: Hybrid attention network based on progressive embedding scale-context for crowd counting

abstract: The existing crowd counting methods usually adopted attention mechanism to tackle background noise, or applied multi-level features or multi-scales context fusion to tackle scale variation. However, these approaches deal with these two problems separately. In this paper, we propose a Hybrid Attention Network (HAN) by employing Progressive Embedding Scale-context (PES) information, which enables the network to simultaneously suppress noise and adapt head scale variation. We build the hybrid attention mechanism through paralleling spatial attention and channel attention module, which makes the network to focus more on the human head area and reduce the interference of background objects. Besides, we embed certain scale-context to the hybrid attention along the spatial and channel dimensions for alleviating these counting errors caused by the variation of perspective and head scale. Finally, we propose a progressive learning strategy through cascading multiple hybrid attention modules with embedding different scale-context, which can gradually integrate different scale-context information into the current feature map from global to local. Ablation experiments provides that the network architecture can gradually learn multi-scale features and suppress background noise. Extensive experiments demonstrate that HANet obtain state-of-the-art counting performance on four mainstream datasets.


title: ERICA: An Empathetic Android Companion for Covid-19 Quarantine

abstract: Over the past year, research in various domains, including Natural Language Processing (NLP), has been accelerated to fight against the COVID-19 pandemic, yet such research has just started on dialogue systems. In this paper, we introduce an end-to-end dialogue system which aims to ease the isolation of people under self-quarantine. We conduct a control simulation experiment to assess the effects of the user interface, a web-based virtual agent called Nora vs. the android ERICA via a video call. The experimental results show that the android offers a more valuable user experience by giving the impression of being more empathetic and engaging in the conversation due to its nonverbal information, such as facial expressions and body gestures.


title: Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax Problems

abstract: Modern minimax problems, such as generative adversarial network and adversarial training, are often under a nonconvex-nonconcave setting, and developing an efficient method for such setting is of interest. Recently, two variants of the extragradient (EG) method are studied in that direction. First, a two-time-scale variant of the EG, named EG+, was proposed under a smooth structured nonconvex-nonconcave setting, with a slow $\mathcal{O}(1/k)$ rate on the squared gradient norm, where $k$ denotes the number of iterations. Second, another variant of EG with an anchoring technique, named extra anchored gradient (EAG), was studied under a smooth convex-concave setting, yielding a fast $\mathcal{O}(1/k^2)$ rate on the squared gradient norm. Built upon EG+ and EAG, this paper proposes a two-time-scale EG with anchoring, named fast extragradient (FEG), that has a fast $\mathcal{O}(1/k^2)$ rate on the squared gradient norm for smooth structured nonconvex-nonconcave problems; the corresponding saddle-gradient operator satisfies the negative comonotonicity condition. This paper further develops its backtracking line-search version, named FEG-A, for the case where the problem parameters are not available. The stochastic analysis of FEG is also provided.


title: Bi-Granularity Contrastive Learning for Post-Training in Few-Shot Scene

abstract: The major paradigm of applying a pre-trained language model to downstream tasks is to fine-tune it on labeled task data, which often suffers instability and low performance when the labeled examples are scarce.~One way to alleviate this problem is to apply post-training on unlabeled task data before fine-tuning, adapting the pre-trained model to target domains by contrastive learning that considers either token-level or sequence-level similarity. Inspired by the success of sequence masking, we argue that both token-level and sequence-level similarities can be captured with a pair of masked sequences.~Therefore, we propose complementary random masking (CRM) to generate a pair of masked sequences from an input sequence for sequence-level contrastive learning and then develop contrastive masked language modeling (CMLM) for post-training to integrate both token-level and sequence-level contrastive learnings.~Empirical results show that CMLM surpasses several recent post-training methods in few-shot settings without the need for data augmentation.


title: Temporally coherent video anonymization through GAN inpainting

abstract: This work tackles the problem of temporally coherent face anonymization in natural video streams.We propose JaGAN, a two-stage system starting with detecting and masking out faces with black image patches in all individual frames of the video. The second stage leverages a privacy-preserving Video Generative Adversarial Network designed to inpaint the missing image patches with artificially generated faces. Our initial experiments reveal that image based generative models are not capable of inpainting patches showing temporal coherent appearance across neighboring video frames. To address this issue we introduce a newly curated video collection, which is made publicly available for the research community along with this paper. We also introduce the Identity Invariance Score IdI as a means to quantify temporal coherency between neighboring frames.


title: Deep Switching State Space Model (DS$^3$M) for Nonlinear Time Series Forecasting with Regime Switching

abstract: Modern time series data often display complex nonlinear dependencies along with irregular regime-switching behaviors. These features present technical challenges in modeling, inference, and in offering insightful understanding into the underlying stochastic phenomena. To tackle these challenges, we introduce a novel modeling framework known as the Deep Switching State Space Model (DS$^3$M). This framework is engineered to make accurate forecasts for such time series while adeptly identifying the irregular regimes hidden within the dynamics. These identifications not only have significant economic ramifications but also contribute to a deeper understanding of the underlying phenomena. In DS$^3$M, the architecture employs discrete latent variables to represent regimes and continuous latent variables to account for random driving factors. By melding a Recurrent Neural Network (RNN) with a nonlinear Switching State Space Model (SSSM), we manage to capture the nonlinear dependencies and irregular regime-switching behaviors, governed by a Markov chain and parameterized using multilayer perceptrons. We validate the effectiveness and regime identification capabilities of DS$^3$M through short- and long-term forecasting tests on a wide array of simulated and real-world datasets, spanning sectors such as healthcare, economics, traffic, meteorology, and energy. Experimental results reveal that DS$^3$M outperforms several state-of-the-art models in terms of forecasting accuracy, while providing meaningful regime identifications.


title: Slither code and the independence number of a random tree

abstract: We give a simple characterisation of the distribution of the independence number, and equivalently the matching number, of a random tree on $n$ labelled vertices chosen uniformly among the $n^{n-2}$ such trees: Roll an $n$-sided die repeatedly, and let $\alpha$ be the smallest number such that after $\alpha$ throws, at least $n-\alpha$ distinct numbers have occurred. Then $\alpha$ has the same distribution as the independence number, and $n-\alpha$ has the same distribution as the matching number. We obtain a similar characterisation of the path cover number. The proofs are bijective and based on modifications of the Pr\"ufer code.


title: Manifold-Aware Deep Clustering: Maximizing Angles between Embedding Vectors Based on Regular Simplex

abstract: This paper presents a new deep clustering (DC) method called manifold-aware DC (M-DC) that can enhance hyperspace utilization more effectively than the original DC. The original DC has a limitation in that a pair of two speakers has to be embedded having an orthogonal relationship due to its use of the one-hot vector-based loss function, while our method derives a unique loss function aimed at maximizing the target angle in the hyperspace based on the nature of a regular simplex. Our proposed loss imposes a higher penalty than the original DC when the speaker is assigned incorrectly. The change from DC to M-DC can be easily achieved by rewriting just one term in the loss function of DC, without any other modifications to the network architecture or model parameters. As such, our method has high practicability because it does not affect the original inference part. The experimental results show that the proposed method improves the performances of the original DC and its expansion method.


title: On the Estimation of the Depth of Maximum of Extensive Air Showers Using the Steepness Parameter of the Lateral Distribution of Cherenkov Radiation

abstract: Using Monte Carlo simulation of extensive air showers, we showed that the maximum depth of showers, $X_{max}$ can be estimated using $P=Q(100)/Q(200)$, the ratio of Cherenkov photon densities at 100 and 200 meters from the shower core, which is known as the steepness parameter of the lateral distribution of Cherenkov radiation on the ground. A simple quadratic model has been fitted to a set of data from simulated extensive air showers, relating the steepness parameter and the shower maximum depth. Then the model has been tested on another set of simulated showers. The average difference between the actual maximum depth of the simulated showers and the maximum depth obtained from the lateral distribution of Cherenkov light is about 9 $g/cm^2$. In addition, possibility of a more direct estimation of the mass of the initial particle from $P$ has been investigated. An exponential relation between these two quantities has been fitted. Applying the model to another set of showers, we found that the average difference between the estimated and the actual mass of primary particles is less than 0.5 atomic mass unit.


title: Readout of a antiferromagnetic spintronics systems by strong exchange coupling of Mn2Au and Permalloy

abstract: In antiferromagnetic spintronics, the read-out of the staggered magnetization or Neel vector is the key obstacle to harnessing the ultra-fast dynamics and stability of antiferromagnets for novel devices. Here, we demonstrate strong exchange coupling of Mn2Au, a unique metallic antiferromagnet that exhibits Neel spin-orbit torques, with thin ferromagnetic Permalloy layers. This allows us to benefit from the well-estabished read-out methods of ferromagnets, while the essential advantages of antiferromagnetic spintronics are retained. We show one-to-one imprinting of the antiferromagnetic on the ferromagnetic domain pattern. Conversely, alignment of the Permalloy magnetization reorients the Mn2Au Neel vector, an effect, which can be restricted to large magnetic fields by tuning the ferromagnetic layer thickness. To understand the origin of the strong coupling, we carry out high resolution electron microscopy imaging and we find that our growth yields an interface with a well-defined morphology that leads to the strong exchange coupling.


title: Statistics for Unimodal Sequences

abstract: We prove a number of limiting distributions for statistics for unimodal sequences of positive integers by adapting a probabilistic framework for integer partitions introduced by Fristedt. The difficulty in applying the direct analogue of Fristedt's techniques to unimodal sequences lies in the fact that the generating function for partitions is an infinite product, while that of unimodal sequences is not. Essentially, we get around this by conditioning on the size of the largest part and working uniformly on contributing summands. Our framework may be used to derive many distributions, and our results include joint distributions for largest parts and multiplicities of small parts. We discuss ranks as well. We further obtain analogous results for strongly unimodal sequences.


title: Covering Polygons is Even Harder

abstract: In the MINIMUM CONVEX COVER (MCC) problem, we are given a simple polygon $\mathcal P$ and an integer $k$, and the question is if there exist $k$ convex polygons whose union is $\mathcal P$. It is known that MCC is $\mathsf{NP}$-hard [Culberson & Reckhow: Covering polygons is hard, FOCS 1988/Journal of Algorithms 1994] and in $\exists\mathbb{R}$ [O'Rourke: The complexity of computing minimum convex covers for polygons, Allerton 1982]. We prove that MCC is $\exists\mathbb{R}$-hard, and the problem is thus $\exists\mathbb{R}$-complete. In other words, the problem is equivalent to deciding whether a system of polynomial equations and inequalities with integer coefficients has a real solution. If a cover for our constructed polygon exists, then so does a cover consisting entirely of triangles. As a byproduct, we therefore also establish that it is $\exists\mathbb{R}$-complete to decide whether $k$ triangles cover a given polygon. The issue that it was not known if finding a minimum cover is in $\mathsf{NP}$ has repeatedly been raised in the literature, and it was mentioned as a "long-standing open question" already in 2001 [Eidenbenz & Widmayer: An approximation algorithm for minimum convex cover with logarithmic performance guarantee, ESA 2001/SIAM Journal on Computing 2003]. We prove that assuming the widespread belief that $\mathsf{NP}\neq\exists\mathbb{R}$, the problem is not in $\mathsf{NP}$. An implication of the result is that many natural approaches to finding small covers are bound to give suboptimal solutions in some cases, since irrational coordinates of arbitrarily high algebraic degree can be needed for the corners of the pieces in an optimal solution.


title: On an inverse scattering transform for the nonlinear Sch\"odinger equation on the half-line

abstract: In this paper, we develop an inverse scattering transform for the integrable focusing nonlinear Schr\"odinger (NLS) equation on the half-line subject to a class of boundary conditions. The method is based on the notions of integrable boundary conditions and double-row monodromy matrix, developed by Sklyanin, which characterize initial-boundary value problems for NLS on an interval. It follows from Sklyanin's approach that a hierarchy of integrable boundary conditions can be derived based on a semi-discrete type Lax pair involving the time-part Lax matrix of NLS and a reflection matrix. The inverse scattering transform relies on the formulation of a scattering system for the double-row monodromy matrix characterizing an interval problem. The scattering system for the half-line problem for NLS is obtained by extending one endpoint of the interval to infinity. Then, we derive spectral and analytic properties of the scattering systems, and set up the inverse part using a Riemann-Hilbert formulation. We also show that our approach is equivalent to a nonlinear method of reflection by extending the initial-boundary value problem on the half-line to an initial value on the whole axis. Explicit examples of soliton solutions on the half-line are provided. Although we only consider the NLS model as a particular example, the method we present in this paper can be readily applied to a wide range of integrable PDEs on the half-line.


title: Eliminating uncertainty of thermal emittance measurement in solenoid scans due to rf and solenoid fields overlap

abstract: The solenoid scan is one of the most common methods for the in-situ measurement of the thermal emittance of a photocathode in an rf photoinjector. The fringe field of the solenoid overlaps with the gun rf field in quite a number of photoinjectors, which makes accurate knowledge of the transfer matrix challenging, thus increases the measurement uncertainty of the thermal emittance. This paper summarizes two methods that have been used to solve the overlap issue and explains their deficiencies. Furthermore, we provide a new method to eliminate the measurement error due to the overlap issue in solenoid scans. The new method is systematically demonstrated using theoretical derivations, beam dynamics simulations, and experimental data based on the photoinjector configurations from three different groups, proving that the measurement error with the new method is very small and can be ignored in most of the photoinjector configurations.


title: Projection-Based Reduced Order Model for Simulations of Nonlinear Flows with Multiple Moving Objects

abstract: This paper presents a reduced order approach for transient modeling of multiple moving objects in nonlinear crossflows. The Proper Orthogonal Decomposition method and the Galerkin projection are used to construct a reduced version of the nonlinear Navier-Stokes equations. The Galerkin projection implemented in OpenFOAM platform allows accurate impositions of arbitrary time-dependent boundary conditions at the moving boundaries. A modelling technique based on moving domain and immersed boundary techniques is proposed to overcome the challenge of handling moving boundaries due to movements of the multiple objects. The model is demonstrated capable to capture the complex flow fields past one and two oscillating cylinders and the forces acting on the cylinders. Simulation time could be reduced by more than three orders for a small case on a fine mesh as compared to an existing method and could be more for large cases. In general, the simulation time of the reduced model is of order of seconds as compared to hours of the full order Computational Fluid Dynamics models.


title: Cavitation and charge separation in laser-produced copper and carbon plasma in transverse magnetic field

abstract: In the present work, we report the dynamics and geometrical features of the plasma plume formed by the laser ablation of copper and graphite (carbon) targets in the presence of different transverse magnetic field. This work emphasizes on the effect of atomic mass of the plume species on the diamagnetic behaviour and geometrical aspect of the expanding plasma plume in the magnetic field. The time-resolved analysis of the simultaneously captured two directional images in orthogonal to the expansion axis is carried out for the comparative study of projected three-dimensional structure of copper and carbon plasma plume. In the presence of magnetic field, sharp differences are observed between the copper and carbon plasma plumes in terms of formation of diamagnetic cavity and structure formation. An elliptical cavity-like structure is observed in case of copper plasma plume which attains the sharp conical shape with increasing the time delay or magnetic field strength. On the other hand, splitted carbon plasma plume appears as a Y-shape structure in the presence of magnetic field where the cavity-like structure is not observed for the considered time and magnetic field. Based on the modified energy balance relation for the elliptic cylindrical geometry, we have also simulated the dynamics of the plume which is in close agreement with observed plasma expansion in diamagnetic and non-diamagnetic regions.


title: cs60075_team2 at SemEval-2021 Task 1 : Lexical Complexity Prediction using Transformer-based Language Models pre-trained on various text corpora

abstract: This paper describes the performance of the team cs60075_team2 at SemEval 2021 Task 1 - Lexical Complexity Prediction. The main contribution of this paper is to fine-tune transformer-based language models pre-trained on several text corpora, some being general (E.g., Wikipedia, BooksCorpus), some being the corpora from which the CompLex Dataset was extracted, and others being from other specific domains such as Finance, Law, etc. We perform ablation studies on selecting the transformer models and how their individual complexity scores are aggregated to get the resulting complexity scores. Our method achieves a best Pearson Correlation of $0.784$ in sub-task 1 (single word) and $0.836$ in sub-task 2 (multiple word expressions).


title: Systematic study of near yrast band structures in odd-mass $^{125-137}$Pr and $^{127-139}$Pm isotopes

abstract: In the present work, the basis space in the triaxial projected shell model approach is expanded to include three and five quasiparticle configurations for odd-proton systems. This extension allows to investigate the high-spin band structures observed in odd-proton systems up to and including the second band crossing region, and as a first major application of this development, the high-spin properties are investigated for odd-mass $^{125-137}$Pr and $^{127-139}$Pm isotopes. It is shown that band crossings in the studied isotopes have mixed structures with first crossing dominated by one-proton coupled to two-neutron configuration for the lighter isotopes which then changes to three-proton configuration with increasing neutron number. Further, $\gamma$-bands based on quasiparticle states are also delineated in the present work, and it is predicted that these band structures built on three-quasiparticle configurations become favoured in energy for heavier systems in the high-spin region.


title: ASCNet: Self-supervised Video Representation Learning with Appearance-Speed Consistency

abstract: We study self-supervised video representation learning, which is a challenging task due to 1) lack of labels for explicit supervision; 2) unstructured and noisy visual information. Existing methods mainly use contrastive loss with video clips as the instances and learn visual representation by discriminating instances from each other, but they need a careful treatment of negative pairs by either relying on large batch sizes, memory banks, extra modalities or customized mining strategies, which inevitably includes noisy data. In this paper, we observe that the consistency between positive samples is the key to learn robust video representation. Specifically, we propose two tasks to learn the appearance and speed consistency, respectively. The appearance consistency task aims to maximize the similarity between two clips of the same video with different playback speeds. The speed consistency task aims to maximize the similarity between two clips with the same playback speed but different appearance information. We show that optimizing the two tasks jointly consistently improves the performance on downstream tasks, e.g., action recognition and video retrieval. Remarkably, for action recognition on the UCF-101 dataset, we achieve 90.8\% accuracy without using any extra modalities or negative pairs for unsupervised pretraining, which outperforms the ImageNet supervised pretrained model. Codes and models will be available.


title: F-Drop&Match: GANs with a Dead Zone in the High-Frequency Domain

abstract: Generative adversarial networks built from deep convolutional neural networks (GANs) lack the ability to exactly replicate the high-frequency components of natural images. To alleviate this issue, we introduce two novel training techniques called frequency dropping (F-Drop) and frequency matching (F-Match). The key idea of F-Drop is to filter out unnecessary high-frequency components from the input images of the discriminators. This simple modification prevents the discriminators from being confused by perturbations of the high-frequency components. In addition, F-Drop makes the GANs focus on fitting in the low-frequency domain, in which there are the dominant components of natural images. F-Match minimizes the difference between real and fake images in the frequency domain for generating more realistic images. F-Match is implemented as a regularization term in the objective functions of the generators; it penalizes the batch mean error in the frequency domain. F-Match helps the generators to fit in the high-frequency domain filtered out by F-Drop to the real image. We experimentally demonstrate that the combination of F-Drop and F-Match improves the generative performance of GANs in both the frequency and spatial domain on multiple image benchmarks.


title: Phase-locking of lasers with Gaussian coupling

abstract: A unique approach for steady in-phase locking of lasers in an array, regardless of the array geometry, position, orientation, period or size, is presented. The approach relies on the insertion of an intra-cavity Gaussian aperture in the far-field plane of the laser array. Steady in-phase locking of $90$ lasers, whose far-field patterns are comprised of sharp spots with extremely high power density, was obtained for various array geometries, even in the presence of near-degenerate solutions, geometric frustration or superimposed independent longitudinal modes. The internal phase structures of the lasers can also be suppressed so as to obtain pure Gaussian mode laser outputs with uniform phase and overall high beam quality. The approach could potentially improve the performances of recently developed laser simulators that are used for solving various computational problems.


title: Precise Measurements of the Decay of Free Neutrons

abstract: The impact of new and highly precise neutron \b{eta} decay data is reviewed. We focus on recent results from neutron lifetime, \b{eta} asymmetry, and electron-neutrino correlation experiments. From these results, weak interaction parameters are extracted with unprecedented precision, possible also due to progress in effective field theory and lattice QCD. Limits on New Physics beyond the Standard Model derived from neutron decay data are sharper than those derived from high-energy experiments, except for processes involving right-handed neutrinos.


title: Provably Strict Generalisation Benefit for Invariance in Kernel Methods

abstract: It is a commonly held belief that enforcing invariance improves generalisation. Although this approach enjoys widespread popularity, it is only very recently that a rigorous theoretical demonstration of this benefit has been established. In this work we build on the function space perspective of Elesedy and Zaidi arXiv:2102.10333 to derive a strictly non-zero generalisation benefit of incorporating invariance in kernel ridge regression when the target is invariant to the action of a compact group. We study invariance enforced by feature averaging and find that generalisation is governed by a notion of effective dimension that arises from the interplay between the kernel and the group. In building towards this result, we find that the action of the group induces an orthogonal decomposition of both the reproducing kernel Hilbert space and its kernel, which may be of interest in its own right.


title: SE(3)-equivariant prediction of molecular wavefunctions and electronic densities

abstract: Machine learning has enabled the prediction of quantum chemical properties with high accuracy and efficiency, allowing to bypass computationally costly ab initio calculations. Instead of training on a fixed set of properties, more recent approaches attempt to learn the electronic wavefunction (or density) as a central quantity of atomistic systems, from which all other observables can be derived. This is complicated by the fact that wavefunctions transform non-trivially under molecular rotations, which makes them a challenging prediction target. To solve this issue, we introduce general SE(3)-equivariant operations and building blocks for constructing deep learning architectures for geometric point cloud data and apply them to reconstruct wavefunctions of atomistic systems with unprecedented accuracy. Our model achieves speedups of over three orders of magnitude compared to ab initio methods and reduces prediction errors by up to two orders of magnitude compared to the previous state-of-the-art. This accuracy makes it possible to derive properties such as energies and forces directly from the wavefunction in an end-to-end manner. We demonstrate the potential of our approach in a transfer learning application, where a model trained on low accuracy reference wavefunctions implicitly learns to correct for electronic many-body interactions from observables computed at a higher level of theory. Such machine-learned wavefunction surrogates pave the way towards novel semi-empirical methods, offering resolution at an electronic level while drastically decreasing computational cost. Additionally, the predicted wavefunctions can serve as initial guess in conventional ab initio methods, decreasing the number of iterations required to arrive at a converged solution, thus leading to significant speedups without any loss of accuracy or robustness.


title: A Residual Network based Deep Learning Model for Detection of COVID-19 from Cough Sounds

abstract: The present work proposes a deep-learning-based approach for the classification of COVID-19 coughs from non-COVID-19 coughs and that can be used as a low-resource-based tool for early detection of the onset of such respiratory diseases. The proposed system uses the ResNet-50 architecture, a popularly known Convolutional Neural Network (CNN) for image recognition tasks, fed with the log-Mel spectrums of the audio data to discriminate between the two types of coughs. For the training and validation of the proposed deep learning model, this work utilizes the Track-1 dataset provided by the DiCOVA Challenge 2021 organizers. Additionally, to increase the number of COVID-positive samples and to enhance variability in the training data, it has also utilized a large open-source database of COVID-19 coughs collected by the EPFL CoughVid team. Our developed model has achieved an average validation AUC of 98.88%. Also, applying this model on the Blind Test Set released by the DiCOVA Challenge, the system has achieved a Test AUC of 75.91%, Test Specificity of 62.50%, and Test Sensitivity of 80.49%. Consequently, this submission has secured 16th position in the DiCOVA Challenge 2021 leader-board.


title: Inferring couplings in networks across order-disorder phase transitions

abstract: Statistical inference is central to many scientific endeavors, yet how it works remains unresolved. Answering this requires a quantitative understanding of the intrinsic interplay between statistical models, inference methods and data structure. To this end, we characterize the efficacy of direct coupling analysis (DCA)--a highly successful method for analyzing amino acid sequence data--in inferring pairwise interactions from samples of ferromagnetic Ising models on random graphs. Our approach allows for physically motivated exploration of qualitatively distinct data regimes separated by phase transitions. We show that inference quality depends strongly on the nature of generative models: optimal accuracy occurs at an intermediate temperature where the detrimental effects from macroscopic order and thermal noise are minimal. Importantly our results indicate that DCA does not always outperform its local-statistics-based predecessors; while DCA excels at low temperatures, it becomes inferior to simple correlation thresholding at virtually all temperatures when data are limited. Our findings offer new insights into the regime in which DCA operates so successfully and more broadly how inference interacts with data structure.

categories: physics.bio-ph cond-mat.dis-nn cond-mat.stat-mech physics.data-an q-bio.QM


title: Parallel and External-Memory Construction of Minimal Perfect Hash Functions with PTHash

abstract: A function $f : U \to \{0,\ldots,n-1\}$ is a minimal perfect hash function for a set $S \subseteq U$ of size $n$, if $f$ bijectively maps $S$ into the first $n$ natural numbers. These functions are important for many practical applications in computing, such as search engines, computer networks, and databases. Several algorithms have been proposed to build minimal perfect hash functions that: scale well to large sets, retain fast evaluation time, and take very little space, e.g., 2 - 3 bits/key. PTHash is one such algorithm, achieving very fast evaluation in compressed space, typically several times faster than other techniques. In this work, we propose a new construction algorithm for PTHash enabling: (1) multi-threading, to either build functions more quickly or more space-efficiently, and (2) external-memory processing to scale to inputs much larger than the available internal memory. Only few other algorithms in the literature share these features, despite of their big practical impact. We conduct an extensive experimental assessment on large real-world string collections and show that, with respect to other techniques, PTHash is competitive in construction time and space consumption, but retains 2 - 6$\times$ better lookup time.


title: SOLQ: Segmenting Objects by Learning Queries

abstract: In this paper, we propose an end-to-end framework for instance segmentation. Based on the recently introduced DETR [1], our method, termed SOLQ, segments objects by learning unified queries. In SOLQ, each query represents one object and has multiple representations: class, location and mask. The object queries learned perform classification, box regression and mask encoding simultaneously in an unified vector form. During training phase, the mask vectors encoded are supervised by the compression coding of raw spatial masks. In inference time, mask vectors produced can be directly transformed to spatial masks by the inverse process of compression coding. Experimental results show that SOLQ can achieve state-of-the-art performance, surpassing most of existing approaches. Moreover, the joint learning of unified query representation can greatly improve the detection performance of DETR. We hope our SOLQ can serve as a strong baseline for the Transformer-based instance segmentation. Code is available at https://github.com/megvii-research/SOLQ.


title: COLD: Concurrent Loads Disaggregator for Non-Intrusive Load Monitoring

abstract: The modern artificial intelligence techniques show the outstanding performances in the field of Non-Intrusive Load Monitoring (NILM). However, the problem related to the identification of a large number of appliances working simultaneously is underestimated. One of the reasons is the absence of a specific data. In this research we propose the Synthesizer of Normalized Signatures (SNS) algorithm to simulate the aggregated consumption with up to 10 concurrent loads. The results show that the synthetic data provides the models with at least as a powerful identification accuracy as the real-world measurements. We have developed the neural architecture named Concurrent Loads Disaggregator (COLD) which is relatively simple and easy to understand in comparison to the previous approaches. Our model allows identifying from 1 to 10 appliances working simultaneously with mean F1-score 78.95%. The source code of the experiments performed is available at https://github.com/arx7ti/cold-nilm.


title: Spectral Hypergraph Sparsifiers of Nearly Linear Size

abstract: Graph sparsification has been studied extensively over the past two decades, culminating in spectral sparsifiers of optimal size (up to constant factors). Spectral hypergraph sparsification is a natural analogue of this problem, for which optimal bounds on the sparsifier size are not known, mainly because the hypergraph Laplacian is non-linear, and thus lacks the linear-algebraic structure and tools that have been so effective for graphs. Our main contribution is the first algorithm for constructing $\epsilon$-spectral sparsifiers for hypergraphs with $O^*(n)$ hyperedges, where $O^*$ suppresses $(\epsilon^{-1} \log n)^{O(1)}$ factors. This bound is independent of the rank $r$ (maximum cardinality of a hyperedge), and is essentially best possible due to a recent bit complexity lower bound of $\Omega(nr)$ for hypergraph sparsification. This result is obtained by introducing two new tools. First, we give a new proof of spectral concentration bounds for sparsifiers of graphs; it avoids linear-algebraic methods, replacing e.g.~the usual application of the matrix Bernstein inequality and therefore applies to the (non-linear) hypergraph setting. To achieve the result, we design a new sequence of hypergraph-dependent $\epsilon$-nets on the unit sphere in $\mathbb{R}^n$. Second, we extend the weight assignment technique of Chen, Khanna and Nagda [FOCS'20] to the spectral sparsification setting. Surprisingly, the number of spanning trees after the weight assignment can serve as a potential function guiding the reweighting process in the spectral setting.


title: Quantum state smoothing as an optimal estimation problem with three different cost functions

abstract: Quantum state smoothing is a technique to estimate an unknown true state of an open quantum system based on partial measurement information both prior and posterior to the time of interest. In this paper, we show that the smoothed quantum state is an optimal state estimator; that is, it minimizes a risk (expected cost) function. Specifically, we show that the smoothed quantum state is optimal with respect to two cost functions: the trace-square deviation from and the relative entropy to the unknown true state. However, when we consider a related risk function, the linear infidelity, we find, contrary to what one might expect, that the smoothed state is not optimal. For this case, we derive the optimal state estimator, which we call the lustrated smoothed state. It is a pure state, the eigenstate of the smoothed quantum state with the largest eigenvalue.