title: Visualization of nuclear many-body correlations with the most probable configuration of nucleons

abstract: A method to visualize many-body correlations using the information of the full wave function is presented. The set of nucleon coordinates which maximizes the square of the wave function, that is, the most probable spatial configuration of nucleons, is visualized. The method is applied to Hartree-Fock (HF) and HF+BCS wave functions of $p$- and $sd$-shell $N=Z$ even-even nuclei to analyze the many-body correlations in those systems. It is found that there are $\alpha$-cluster-like four-body correlations already at the HF level in some of the nuclei. The effects of pairing on the most probable configuration are also investigated. The method is useful to analyze the nuclear many-body correlations, and it suggests a new viewpoint to microscopic nuclear wave functions.


title: Vision-and-Language Pretrained Models: A Survey

abstract: Pretrained models have produced great success in both Computer Vision (CV) and Natural Language Processing (NLP). This progress leads to learning joint representations of vision and language pretraining by feeding visual and linguistic contents into a multi-layer transformer, Visual-Language Pretrained Models (VLPMs). In this paper, we present an overview of the major advances achieved in VLPMs for producing joint representations of vision and language. As the preliminaries, we briefly describe the general task definition and genetic architecture of VLPMs. We first discuss the language and vision data encoding methods and then present the mainstream VLPM structure as the core content. We further summarise several essential pretraining and fine-tuning strategies. Finally, we highlight three future directions for both CV and NLP researchers to provide insightful guidance.


title: Rational numbers in $\times b$-invariant sets

abstract: Let $b \geq 2$ be an integer and $S$ be a finite non-empty set of primes not containing divisors of $b$. For any non-dense set $A \subset [0,1)$ such that $A \cap \mathbb{Q}$ is invariant under $\times b$ operation, we prove the finiteness of rational numbers in $A$ whose denominators can only be divided by primes in $S$. A quantitative result on the largest prime divisors of the denominators of rational numbers in $A$ is also obtained.


title: Prototype-based Domain Generalization Framework for Subject-Independent Brain-Computer Interfaces

abstract: Brain-computer interface (BCI) is challenging to use in practice due to the inter/intra-subject variability of electroencephalography (EEG). The BCI system, in general, necessitates a calibration technique to obtain subject/session-specific data in order to tune the model each time the system is utilized. This issue is acknowledged as a key hindrance to BCI, and a new strategy based on domain generalization has recently evolved to address it. In light of this, we've concentrated on developing an EEG classification framework that can be applied directly to data from unknown domains (i.e. subjects), using only data acquired from separate subjects previously. For this purpose, in this paper, we proposed a framework that employs the open-set recognition technique as an auxiliary task to learn subject-specific style features from the source dataset while helping the shared feature extractor with mapping the features of the unseen target dataset as a new unseen domain. Our aim is to impose cross-instance style in-variance in the same domain and reduce the open space risk on the potential unseen subject in order to improve the generalization ability of the shared feature extractor. Our experiments showed that using the domain information as an auxiliary network increases the generalization performance.


title: Text Revision by On-the-Fly Representation Optimization

abstract: Text revision refers to a family of natural language generation tasks, where the source and target sequences share moderate resemblance in surface form but differentiate in attributes, such as text formality and simplicity. Current state-of-the-art methods formulate these tasks as sequence-to-sequence learning problems, which rely on large-scale parallel training corpus. In this paper, we present an iterative in-place editing approach for text revision, which requires no parallel data. In this approach, we simply fine-tune a pre-trained Transformer with masked language modeling and attribute classification. During inference, the editing at each iteration is realized by two-step span replacement. At the first step, the distributed representation of the text optimizes on the fly towards an attribute function. At the second step, a text span is masked and another new one is proposed conditioned on the optimized representation. The empirical experiments on two typical and important text revision tasks, text formalization and text simplification, show the effectiveness of our approach. It achieves competitive and even better performance than state-of-the-art supervised methods on text simplification, and gains better performance than strong unsupervised methods on text formalization \footnote{Code and model are available at \url{https://github.com/jingjingli01/OREO}}.


title: Spatio-Temporal-Frequency Graph Attention Convolutional Network for Aircraft Recognition Based on Heterogeneous Radar Network

abstract: This paper proposes a knowledge-and-data-driven graph neural network-based collaboration learning model for reliable aircraft recognition in a heterogeneous radar network. The aircraft recognizability analysis shows that: (1) the semantic feature of an aircraft is motion patterns driven by the kinetic characteristics, and (2) the grammatical features contained in the radar cross-section (RCS) signals present spatial-temporal-frequency (STF) diversity decided by both the electromagnetic radiation shape and motion pattern of the aircraft. Then a STF graph attention convolutional network (STFGACN) is developed to distill semantic features from the RCS signals received by the heterogeneous radar network. Extensive experiment results verify that the STFGACN outperforms the baseline methods in terms of detection accuracy, and ablation experiments are carried out to further show that the expansion of the information dimension can gain considerable benefits to perform robustly in the low signal-to-noise ratio region.


title: The asymptotic of the number of permutations whose cycle lengths are prime numbers

abstract: Let $A$ be a set of natural numbers and let $S_{n,A}$ be the set of all permutations of $[n]=\{1,2,...,n\}$ with cycle lengths belonging to $A$. Furthermore, let $\mid A(n)\mid$ denote the cardinality of the set $A(n)=A\cap [n]$. The limit $\rho=\lim_{n\to\infty}\mid A(n)\mid/n$ (if it exists) is called the density of set $A$. It turns out that, as $n\to\infty$, the cardinality $\mid S_{n,A}\mid$ of the set $S_{n,A}$ essentially depends on $\rho$. The case $\rho>0$ was studied by several authors under certain additional conditions on $A$. In 1999, Kolchin noticed that there is a lack studies on classes of permutations for which $\rho=0$. In this context, he also proposed investigations on certain particular cases. In this paper, we consider the permutations whose cycle lengths are prime numbers, that is, we assume that $A=\mathcal{P}$, where $\mathcal{P}$ denotes the set of all primes. For this class of permutations, the Prime Number Theorem implies that $\rho=0$. In this paper, we show that, as $n\to\infty$, the ratio $S_{n,\mathcal{P}}/(n-1)!$ approaches a finite limit and determine its value explicitly. Our method of proof employs classical Tauberian theorems.


title: Decoding Neural Correlation of Language-Specific Imagined Speech using EEG Signals

abstract: Speech impairments due to cerebral lesions and degenerative disorders can be devastating. For humans with severe speech deficits, imagined speech in the brain-computer interface has been a promising hope for reconstructing the neural signals of speech production. However, studies in the EEG-based imagined speech domain still have some limitations due to high variability in spatial and temporal information and low signal-to-noise ratio. In this paper, we investigated the neural signals for two groups of native speakers with two tasks with different languages, English and Chinese. Our assumption was that English, a non-tonal and phonogram-based language, would have spectral differences in neural computation compared to Chinese, a tonal and ideogram-based language. The results showed the significant difference in the relative power spectral density between English and Chinese in specific frequency band groups. Also, the spatial evaluation of Chinese native speakers in the theta band was distinctive during the imagination task. Hence, this paper would suggest the key spectral and spatial information of word imagination with specialized language while decoding the neural signals of speech.


title: Is Surprisal in Issue Trackers Actionable?

abstract: Background. From information theory, surprisal is a measurement of how unexpected an event is. Statistical language models provide a probabilistic approximation of natural languages, and because surprisal is constructed with the probability of an event occuring, it is therefore possible to determine the surprisal associated with English sentences. The issues and pull requests of software repository issue trackers give insight into the development process and likely contain the surprising events of this process. Objective. Prior works have identified that unusual events in software repositories are of interest to developers, and use simple code metrics-based methods for detecting them. In this study we will propose a new method for unusual event detection in software repositories using surprisal. With the ability to find surprising issues and pull requests, we intend to further analyse them to determine if they actually hold importance in a repository, or if they pose a significant challenge to address. If it is possible to find bad surprises early, or before they cause additional troubles, it is plausible that effort, cost and time will be saved as a result. Method. After extracting the issues and pull requests from 5000 of the most popular software repositories on GitHub, we will train a language model to represent these issues. We will measure their perceived importance in the repository, measure their resolution difficulty using several analogues, measure the surprisal of each, and finally generate inferential statistics to describe any correlations.


title: Sum expressions for $p$-adic Hecke $L$-functions of totally real fields

abstract: As a continuation of previous work, we establish sum expressions for $p$-adic Hecke $L$-functions of totally real fields in the sense of Delbourgo, assuming a totally real analog of Heegner hypothesis. This is done by finding explicit formulas of the periods of the corresponding $p$-adic measures. As an application, we extend the Ferrero-Greenberg formula of derivatives of $p$-adic $L$-functions to this setting.


title: Revisiting the Hubble constant, spatial curvature and cosmography with time-delay and cosmic chronometer observations

abstract: In this paper, we go further and propose a cosmological model-independent approach to simultaneously determine the Hubble constant and cosmic curvature with strong lensing time-delay measurements, without any prior assumptions regarding the content of the Universe. The data we use comprises the recent compilation of six well studied strongly lensed quasars, while the cosmic chronometer data are utilized to reconstruct distances via cosmographic parameters. In the framework of third-order Taylor expansion and (2, 1) order Pad\'{e} approximation for for cosmographic analysis, our results provides model-independent estimation of the Hubble constant $H_0 = 72.24^{+2.73}_{-2.52} ~km~s^{-1}~Mpc^{-1}$ and $H_0 = 72.45^{+1.95}_{-2.02} ~km~s^{-1}~Mpc^{-1}$, which is well consistent with that derived from the local distance ladder by SH0ES collaboration. The measured cosmic curvature $\Omega_k=0.062^{+0.117}_{-0.078}$ and $\Omega_k=0.069^{+0.116}_{-0.103}$ shows that zero spatial curvature is supported by the current observations of strong lensing time delays and cosmic chronometers. Imposing the prior of spatial flatness leads to more precise (at 1.6$\%$ level) determination of the Hubble constant $H_0=70.47^{+1.14}_{-1.15} ~km~s^{-1}~Mpc^{-1}$ and $H_0=71.66^{+1.15}_{-1.57} ~km~s^{-1}~Mpc^{-1}$, a value located between the results from \textit{Planck} and SH0ES collaboration. If a prior of local (SH0ES) $H_0$ measurement is adopted, the curvature parameter constraint can be further improved to $\Omega_k=0.123^{+0.060}_{-0.046}$ and $\Omega_k=0.101^{+0.090}_{-0.072}$, supporting no significant deviation from a flat universe. Finally, we also discuss the effectiveness of Pad\'{e} approximation in reconstructing the cosmic expansion history within the redshift range of $z\sim2.3$, considering its better performance in the Bayes Information Criterion (BIC).


title: ResT V2: Simpler, Faster and Stronger

abstract: This paper proposes ResTv2, a simpler, faster, and stronger multi-scale vision Transformer for visual recognition. ResTv2 simplifies the EMSA structure in ResTv1 (i.e., eliminating the multi-head interaction part) and employs an upsample operation to reconstruct the lost medium- and high-frequency information caused by the downsampling operation. In addition, we explore different techniques for better apply ResTv2 backbones to downstream tasks. We found that although combining EMSAv2 and window attention can greatly reduce the theoretical matrix multiply FLOPs, it may significantly decrease the computation density, thus causing lower actual speed. We comprehensively validate ResTv2 on ImageNet classification, COCO detection, and ADE20K semantic segmentation. Experimental results show that the proposed ResTv2 can outperform the recently state-of-the-art backbones by a large margin, demonstrating the potential of ResTv2 as solid backbones. The code and models will be made publicly available at \url{https://github.com/wofmanaf/ResT}


title: On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART

abstract: Word ordering is a constrained language generation task taking unordered words as input. Existing work uses linear models and neural networks for the task, yet pre-trained language models have not been studied in word ordering, let alone why they help. We use BART as an instance and show its effectiveness in the task. To explain why BART helps word ordering, we extend analysis with probing and empirically identify that syntactic dependency knowledge in BART is a reliable explanation. We also report performance gains with BART in the related partial tree linearization task, which readily extends our analysis.


title: Nonclassical correlated deterministic single-photon pairs for a trapped atom in bimodal cavities

abstract: Single photons and single-photon pairs, inherently nonclassical in their nature, are fundamental elements of quantum sciences and technologies. Here, we propose to realize the nonclassical correlated deterministic photon pairs at the single-photon level for a single atom trapped in bimodal cavities. It is shown that the photon emissions for bimodal cavities exhibit a high single photon purity and relatively large intracavity photon numbers, which are ascribed to the combination of optical Stark shift enhanced energy-spectrum anharmonicity and quantum interference suppressed two-photon excitation. Our scheme generates photon-photon pairs with strong photon blockade for cavity modes via constructing a highly tunable cavity-enhanced deterministic parametric down-conversion process. Furthermore, we show that the cross-correlation function between the two cavity modes vastly violates the Cauchy-Schwarz inequality of the classical boundary, which unambiguously demonstrates the nonclassicality of the single-photon pairs. Our result reveals a prominent strategy to generate the high-quality two-mode single-photon sources with strong nonclassical correlation, which could provide versatile applications in distribution of quantum networks, long distance quantum communication, and fundamental tests of quantum physics.


title: Insight-HXMT dedicated 33-day observation of SGR J1935+2154 II. Burst Spectral Catalog

abstract: Since April 28, 2020, Insight-HXMT has implemented a dedicated observation on the magnetar SGR J1935+2154. Thanks to the wide energy band (1-250 keV) and high sensitivity of Insight-HXMT, we obtained 75 bursts from SGR J1935+2154 during a month-long activity episode after the emission of FRB 200428. Here, we report the detailed time-integrated spectral analysis of these bursts and the statistical distribution of the spectral parameters. We find that for 15%(11/75) of SGR J1935+2154 bursts, the CPL model is preferred, and most of them occurred in the latter part of this active epoch. In the cumulative fluence distribution, we find that the fluence of bursts in our sample is about an order of magnitude weaker than that of Fermi/GBM, but follows the same power law distribution. Finally, we find a burst with similar peak energy to the time-integrated spectrum of the X-ray burst associated with FRB 200428 (FRB 200428-Associated Burst), but the low energy index is harder.


title: 2D Human Pose Estimation: A Survey

abstract: Human pose estimation aims at localizing human anatomical keypoints or body parts in the input data (e.g., images, videos, or signals). It forms a crucial component in enabling machines to have an insightful understanding of the behaviors of humans, and has become a salient problem in computer vision and related fields. Deep learning techniques allow learning feature representations directly from the data, significantly pushing the performance boundary of human pose estimation. In this paper, we reap the recent achievements of 2D human pose estimation methods and present a comprehensive survey. Briefly, existing approaches put their efforts in three directions, namely network architecture design, network training refinement, and post processing. Network architecture design looks at the architecture of human pose estimation models, extracting more robust features for keypoint recognition and localization. Network training refinement tap into the training of neural networks and aims to improve the representational ability of models. Post processing further incorporates model-agnostic polishing strategies to improve the performance of keypoint detection. More than 200 research contributions are involved in this survey, covering methodological frameworks, common benchmark datasets, evaluation metrics, and performance comparisons. We seek to provide researchers with a more comprehensive and systematic review on human pose estimation, allowing them to acquire a grand panorama and better identify future directions.


title: How to Save Lives with Microblogs? Lessons From the Usage of Weibo for Requests for Medical Assistance During COVID-19

abstract: During recent crises like COVID-19, microblogging platforms have become popular channels for affected people seeking assistance such as medical supplies and rescue operations from emergency responders and the public. Despite this common practice, the affordances of microblogging services for help-seeking during crises that needs immediate attention are not well understood. To fill this gap, we analyzed 8K posts from COVID-19 patients or caregivers requesting urgent medical assistance on Weibo, the largest microblogging site in China. Our mixed-methods analyses suggest that existing microblogging functions need to be improved in multiple aspects to sufficiently facilitate help-seeking in emergencies, including capabilities of search and tracking requests, ease of use, and privacy protection. We also find that people tend to stick to certain well-established functions for publishing requests, even after better alternatives emerge. These findings have implications for designing microblogging tools to better support help requesting and responding during crises.


title: A Personalized Dialogue Generator with Implicit User Persona Detection

abstract: Current works in the generation of personalized dialogue primarily contribute to the agent presenting a consistent personality and driving a more informative response. However, we found that the generated responses from most previous models tend to be self-centered, with little care for the user in the dialogue. Moreover, we consider that human-like conversation is essentially built based on inferring information about the persona of the other party. Motivated by this, we propose a novel personalized dialogue generator by detecting an implicit user persona. Because it is hard to collect a large number of detailed personas for each user, we attempted to model the user's potential persona and its representation from dialogue history, with no external knowledge. The perception and fader variables were conceived using conditional variational inference. The two latent variables simulate the process of people being aware of each other's persona and producing a corresponding expression in conversation. Finally, posterior-discriminated regularization was presented to enhance the training procedure. Empirical studies demonstrate that, compared to state-of-the-art methods, our approach is more concerned with the user's persona and achieves a considerable boost across the evaluations.


title: Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learning

abstract: Adversarial training (i.e., training on adversarially perturbed input data) is a well-studied method for making neural networks robust to potential adversarial attacks during inference. However, the improved robustness does not come for free but rather is accompanied by a decrease in overall model accuracy and performance. Recent work has shown that, in practical robot learning applications, the effects of adversarial training do not pose a fair trade-off but inflict a net loss when measured in holistic robot performance. This work revisits the robustness-accuracy trade-off in robot learning by systematically analyzing if recent advances in robust training methods and theory in conjunction with adversarial robot learning, are capable of making adversarial training suitable for real-world robot applications. We evaluate three different robot learning tasks ranging from autonomous driving in a high-fidelity environment amenable to sim-to-real deployment to mobile robot navigation and gesture recognition. Our results demonstrate that, while these techniques make incremental improvements on the trade-off on a relative scale, the negative impact on the nominal accuracy caused by adversarial training still outweighs the improved robustness by an order of magnitude. We conclude that although progress is happening, further advances in robust learning methods are necessary before they can benefit robot learning tasks in practice.


title: Image Captioning In the Transformer Age

abstract: Image Captioning (IC) has achieved astonishing developments by incorporating various techniques into the CNN-RNN encoder-decoder architecture. However, since CNN and RNN do not share the basic network component, such a heterogeneous pipeline is hard to be trained end-to-end where the visual encoder will not learn anything from the caption supervision. This drawback inspires the researchers to develop a homogeneous architecture that facilitates end-to-end training, for which Transformer is the perfect one that has proven its huge potential in both vision and language domains and thus can be used as the basic component of the visual encoder and language decoder in an IC pipeline. Meantime, self-supervised learning releases the power of the Transformer architecture that a pre-trained large-scale one can be generalized to various tasks including IC. The success of these large-scale models seems to weaken the importance of the single IC task. However, we demonstrate that IC still has its specific significance in this age by analyzing the connections between IC with some popular self-supervised learning paradigms. Due to the page limitation, we only refer to highly important papers in this short survey and more related works can be found at https://github.com/SjokerLily/awesome-image-captioning.


title: Speaker-Aware Mixture of Mixtures Training for Weakly Supervised Speaker Extraction

abstract: Dominant researches adopt supervised training for speaker extraction, while the scarcity of ideally clean corpus and channel mismatch problem are rarely considered. To this end, we propose speaker-aware mixture of mixtures training (SAMoM), utilizing the consistency of speaker identity among target source, enrollment utterance and target estimate to weakly supervise the training of a deep speaker extractor. In SAMoM, the input is constructed by mixing up different speaker-aware mixtures (SAMs), each contains multiple speakers with their identities known and enrollment utterances available. Informed by enrollment utterances, target speech is extracted from the input one by one, such that the estimated targets can approximate the original SAMs after a remix in accordance with the identity consistency. Moreover, using SAMoM in a semi-supervised setting with a certain amount of clean sources enables application in noisy scenarios. Extensive experiments on Libri2Mix show that the proposed method achieves promising results without access to any clean sources (11.06dB SI-SDRi). With a domain adaptation, our approach even outperformed supervised framework in a cross-domain evaluation on AISHELL-1.


title: The semi-random tree process

abstract: The online semi-random graph process is a one-player game which starts with the empty graph on $n$ vertices. At every round, a player (called Builder) is presented with a vertex $v$ chosen uniformly at random and independently from previous rounds, and constructs an edge of their choice that is incident to $v$. Inspired by recent advances on the semi-random graph process, we define a family of generalised online semi-random models. We analyse a particular instance that shares similar features with the original semi-random graph process and determine the hitting times of the classical graph properties minimum degree $k$, $k$-connectivity, containment of a perfect matching, a Hamiltonian cycle and an $H$-factor for a fixed graph $H$ possessing an additional tree-like property. Along the way, we derive a few consequences of the famous Aldous-Broder algorithm that may be of independent interest.


title: Scaling limits for a class of regular $\Xi$-coalescents

abstract: The block counting process with initial state $n$ counts the number of blocks of an exchangeable coalescent ($\Xi$-coalescent) restricted to a sample of size $n$. This work provides scaling limits for the block counting process of regular $\Xi$-coalescents that stay infinite, including $\Xi$-coalescents with dust and a large class of dust-free $\Xi$-coalescents. The main convergence result states that the block counting process, properly logarithmically scaled, converges in the Skorohod space to an Ornstein--Uhlenbeck type process as $n$ tends to infinity. The existence of such a scaling depends on a sort of curvature condition of a particular function well-known from the literature. This curvature condition is intrinsically related to the behavior of the measure $\Xi$ near the origin. The method of proof is to show the uniform convergence of the associated generators. Via Siegmund duality an analogous result for the fixation line is proven. Several examples are studied.


title: The Probabilistic Profitable Tour Problem under a specific graph structure

abstract: Among the most important variants of the traveling salesman problem (TSP) are those relaxing the constraint that every locus should necessarily get visited, rather taking into account a revenue (prize) for visiting customers. In the Profitable Tour Problem (PTP), we seek for a tour visiting a subset of customers while maximizing net gain (profit) as difference between total revenue collected from visited customers and incurred traveling costs. The metric TSP can be modeled as a PTP with large revenues. As such, PTP is well-known to be NP-hard and also APX-hardness follows. Nevertheless, PTP is solvable in polynomial time on particular graph structures like lines, trees and circles. Following recent emphasis on robust optimization, and motivated by current flourishing of retail delivery services, we study the Probabilistic Profitable Tour Problem (PPTP), the generalization of PTP where customers will show up with a known probability, in their respective loci,only after the tour has been planned. Here, the selection of customers has to be made a priori, before knowing if a customer will actually submit his request or will not. While the tour has to be designed without this knowledge, revenues will only be collected from customers who will require the service. The objective is to maximize the expected net gain obtained by visiting only the customers that show up. We provide a polynomial time algorithm computing and characterizing the space of optimal solutions for the special case of the PPTP where customers are distributed on a line.


title: Inverse design of focused vector beams for mode excitation in optical nanoantennas

abstract: We propose a free-space, inverse design of nanostructure's effective mode-matching fields via a backward propagation of tightly focused vector beams to the pupil plane of an aplanatic system of high numerical aperture. First, we study the nanostructure's eigenmodes without considering any excitation fields and then extract the modal near fields in the focal plane. Each modal field is then taken as the desired focal field, the band-limited waves of which are backward propagated to the pupil plane via a reversal of the Richards--Wolf vector diffraction formula. The pupil fields can be designed to be genuinely paraxial by associating the longitudinal electric/magnetic field component with the radial one on the reference sphere. The inversely designed pupil field in turn is propagated forwardly into the focal region to generate the designed focal field, whose distribution over the nanostructure's surface is used to evaluate the overlap between the designed focal field and the modal fields, i.e., the modal expansion coefficients. Studies for a silicon nanodisk monomer, dimer, and tetramer demonstrate the ability of our inverse approach to design the necessary tightly focused vector field that can effectively and exclusively match a certain eigenmode of interest. Compared with the forward beam-shaping method, the inverse design approach tends to yield quantitatively more precise mode-matching field profiles. This work can have a significant impact on optical applications that rely on controllable and tunable mode excitation and light scattering.


title: Crowd counting with segmentation attention convolutional neural network

abstract: Deep learning occupies an undisputed dominance in crowd counting. In this paper, we propose a novel convolutional neural network (CNN) architecture called SegCrowdNet. Despite the complex background in crowd scenes, the proposeSegCrowdNet still adaptively highlights the human head region and suppresses the non-head region by segmentation. With the guidance of an attention mechanism, the proposed SegCrowdNet pays more attention to the human head region and automatically encodes the highly refined density map. The crowd count can be obtained by integrating the density map. To adapt the variation of crowd counts, SegCrowdNet intelligently classifies the crowd count of each image into several groups. In addition, the multi-scale features are learned and extracted in the proposed SegCrowdNet to overcome the scale variations of the crowd. To verify the effectiveness of our proposed method, extensive experiments are conducted on four challenging datasets. The results demonstrate that our proposed SegCrowdNet achieves excellent performance compared with the state-of-the-art methods.


title: Absolute Quantification of sp$^{3}$ Defects in Semiconducting Single-Wall Carbon Nanotubes by Raman Spectroscopy

abstract: The functionalization of semiconducting single-wall carbon nanotubes (SWCNTs) with luminescent sp$^{3}$ defects creates red-shifted emission features in the near-infrared and boosts their photoluminescence quantum yields (PLQYs). While multiple synthetic routes for the selective introduction of sp$^{3}$ defects have been developed, a convenient metric to precisely quantify the number of defects on a SWCNT lattice is not available. Here, we present a direct and simple quantification protocol based on a linear correlation of the integrated Raman D/G$^{+}$ signal ratios and defect densities as extracted from PLQY measurements. Corroborated by a statistical analysis of single-nanotube emission spectra at cryogenic temperature, this method enables the quantitative evaluation of sp$^{3}$ defect densities in (6,5) SWCNTs with an error of $\pm$ 3 defects per micrometer and the determination of oscillator strengths for different defect types. The developed protocol requires only standard Raman spectroscopy and is independent of the defect configuration, dispersion solvent and nanotube length.


title: On basic $2$-arc-transitive graphs

abstract: A connected graph $\Gamma=(V,E)$ of valency at least $3$ is called a basic $2$-arc-transitive graph if its full automorphism group has a subgroup $G$ with the following properties: (i) $G$ acts transitively on the set of $2$-arcs of $\Gamma$, and (ii) every minimal normal subgroup of $G$ has at most two orbits on $V$. In her papers [17,18], Praeger proved a connected $2$-arc-transitive graph of valency at least $3$ is a normal cover of some basic $2$-arc-transitive graph, and characterized the group-theoretic structures for basic $2$-arc-transitive graphs. Based on Praeger's theorems on $2$-arc-transitive graphs, this paper presents a further understanding on basic $2$-arc-transitive graphs.


title: Geodesic words in central extension of the Klein bottle group

abstract: In this work, we give a complete description of the language of geodesic words for a central extension of the fundamental group of the Klein Bottle with respect to the standard two-element generating set. Besides, we prove that there are no dead ends in the group. Finally, we give a new sufficient condition for the absence of dead ends.


title: First-principles Calculation of Magnetocrystalline Anisotropy of Y(Co,Fe,Ni,Cu)$_5$ Based on Full-potential KKR Green's Function Method

abstract: The performance of permanent magnets YCo$_5$ can be improved by replacing cobalt with other elements, such as iron, copper, and nickel. In order to determine its optimum composition, it is necessary to perform systematic theoretical calculations in a consistent framework. In this study, we calculated the magnetocrystalline anisotropy constant $K_{\rm u}$ of Y(Co$_{1-x-y}$Fe$_{x}$Cu$_{y}$)$_3$(Co$_{1-z}$Ni$_{z}$)$_2$ on the basis of the full-potential Korringa-Kohn-Rostoker Green's function method in conjunction with the coherent potential approximation. The calculated $K_{\rm u}$ of YCo$_5$ was smaller than the experimental value because of a missing enhancement due to orbital polarization. Although the value of $K_{\rm u}$ of Y(Co$_{1-x-y}$Fe$_{x}$Cu$_{y}$)$_3$(Co$_{1-z}$Ni$_{z}$)$_2$ was systematically underestimated compared to their experimental counterparts, the doping effect can be analyzed within a consistent framework. The results have shown that YFe$_3$Co$_2$ has much higher $K_{\rm u}=5.00$ MJ/m$^3$ than pristine YCo$_5$ ($K_{\rm u}=1.82$ MJ/m$^3$), and that nickel as a stabilization element decreases $K_{\rm u}$ and magnetization in YFe$_3$(Co$_{1-z}$Ni$_z$)$_2$. However, the anisotropy field of $z\sim0.5$ can compete with the value of YCo$_5$.


title: In situ small-angle X-ray scattering reveals strong condensation of DNA origami during silicification

abstract: The silicification of DNA origami structures increases their mechanical and thermal stability and provides chemical protection. So far, it is unclear how silicification affects the internal structure of the DNA origami and whether the whole DNA framework is embedded or if silica just forms an outer shell. By using in situ small-angle X-ray scattering (SAXS), we show that the net-cationic silica precursor TMAPS induces substantial condensation of the DNA origami, which is further enhanced by the addition of TEOS at early reaction times to an almost 10 % size reduction. We identify the SAXS Porod invariant as a reliable, model-free parameter for the evaluation of the amount of silica formation at a given time. Contrast matching of the DNA double helix Lorentzian peak reveals that silica growth also occurs on the inner surfaces of the origami. The less polar silica forming within the origami structure, replacing more than 40 % of the internal hydration water causes a hydrophobic effect: origami condensation. In the maximally condensed state, thermal stabilization of the origami up to 60 {\deg}C could be observed. If the reaction is driven beyond this point, the overall size of the silicified origami increases again due to more and more silica deposition on the DNA origami. DNA origami objects with flat surfaces show a strong tendency towards aggregation during silicification, presumably driven by the very same entropic forces causing condensation. Our studies provide novel insights into the silicification reaction and hints for the formulation of optimized reaction protocols.


title: Chloroplasts in plant cells show active glassy behavior under low light conditions

abstract: Plants have developed intricate mechanisms to adapt to changing light conditions. Besides photo- and helio- tropism -- the differential growth towards light and the diurnal motion with respect to sunlight -- chloroplast motion acts as a fast mechanism to change the intracellular structure of leaf cells. While chloroplasts move towards the sides of the plant cell to avoid strong light, they accumulate and spread out into a layer on the bottom of the cell at low light to increase the light absorption efficiency. Although the motion of chloroplasts has been studied for over a century, the collective organelle-motion leading to light adapting self-organized structures remains elusive. Here we study the active motion of chloroplasts under dim light conditions, leading to an accumulation in a densely packed quasi-2D layer. We observe burst-like re-arrangements and show that these dynamics resemble colloidal systems close to the glass transition by tracking individual chloroplasts. Furthermore, we provide a minimal mathematical model to uncover relevant system parameters controlling the stability of the dense configuration of chloroplasts. Our study suggests that the meta-stable caging close to the glass-transition in the chloroplast mono-layer serves a physiological relevance. Chloroplasts remain in a spread-out configuration to increase the light uptake, but can easily fluidize when the activity is increased to efficiently re-arrange the structure towards an avoidance state. Our research opens new questions about the role that dynamical phase transitions could play in self-organized intracellular responses of plant cells towards environmental cues.


title: AID: Accuracy Improvement of Analog Discharge-Based in-SRAM Multiplication Accelerator

abstract: This paper presents a novel circuit (AID) to improve the accuracy of an energy-efficient in-memory multiplier using a standard 6T-SRAM. The state-of-the-art discharge-based in-SRAM multiplication accelerators suffer from a non-linear behavior in their bit-line (BL, BLB) due to the quadratic nature of the access transistor that leads to a poor signal-to-noise ratio (SNR). In order to achieve linearity in the BLB voltage, we propose a novel root function technique on the access transistor's gate that results in accuracy improvement of on average 10.77 dB SNR compared to state-of-the-art discharge-based topologies. Our analytical methods and a circuit simulation in a 65 nm CMOS technology verify that the proposed technique consumes 0.523 pJ per computation (multiplication, accumulation, and preset) from a power supply of 1V, which is 51.18% lower compared to other state-of-the-art techniques. We have performed an extensive Monte Carlo based simulation for a 4x4 multiplication operation, and our novel technique presents less than 0.086 standard deviations for the worst-case incorrect output scenario.


title: Speed limit for a highly irreversible process and tight finite-time Landauer's bound

abstract: Landauer's bound is the minimum thermodynamic cost for erasing one bit of information. As this bound is achievable only for quasistatic processes, finite-time operation incurs additional energetic costs. We find a tight finite-time Landauer's bound by establishing a general form of the classical speed limit. This tight bound well captures the divergent behavior associated with the additional cost of a highly irreversible process, which scales differently from a nearly irreversible process. We also find an optimal dynamics which saturates the equality of the bound. We demonstrate the validity of this bound via discrete one-bit and coarse-grained bit systems. Our work implies that more heat dissipation than expected occurs during high-speed irreversible computation.


title: Boundary regularity of mixed local-nonlocal operators and its application

abstract: Let $\Omega$ be a bounded $C^2$ domain in $\mathbb{R}^n$ and $u\in C(\mathbb{R}^n)$ solves \begin{equation*} \begin{aligned} \Delta u + a Iu + C_0|Du| \geq -K\quad \text{in}\; \Omega, \quad \Delta u + a Iu - C_0|Du|\leq K \quad \text{in}\; \Omega, \quad u=0\quad \text{in}\; \Omega^c, \end{aligned} \end{equation*} in the viscosity sense, where $0\leq a\leq A_0$, $C_0, K\geq 0$, and $I$ is a suitable nonlocal operator. We show that $u/\delta$ is in $C^{\kappa}(\bar \Omega)$ for some $\kappa\in (0,1)$, where $\delta(x)={\rm dist}(x, \Omega^c)$. Using this result, we also establish that $u\in C^{1, \gamma}(\bar\Omega)$. Finally, we apply these results to study an overdetermined problem for mixed local-nonlocal operators.


title: Email Spam Detection Using Hierarchical Attention Hybrid Deep Learning Method

abstract: Email is one of the most widely used ways to communicate, with millions of people and businesses relying on it to communicate and share knowledge and information on a daily basis. Nevertheless, the rise in email users has occurred a dramatic increase in spam emails in recent years. Processing and managing emails properly for individuals and companies are getting increasingly difficult. This article proposes a novel technique for email spam detection that is based on a combination of convolutional neural networks, gated recurrent units, and attention mechanisms. During system training, the network is selectively focused on necessary parts of the email text. The usage of convolution layers to extract more meaningful, abstract, and generalizable features by hierarchical representation is the major contribution of this study. Additionally, this contribution incorporates cross-dataset evaluation, which enables the generation of more independent performance results from the model's training dataset. According to cross-dataset evaluation results, the proposed technique advances the results of the present attention-based techniques by utilizing temporal convolutions, which give us more flexible receptive field sizes are utilized. The suggested technique's findings are compared to those of state-of-the-art models and show that our approach outperforms them.


title: Characterizing metastable states with the help of machine learning

abstract: Present-day atomistic simulations generate long trajectories of ever more complex systems. Analyzing these data, discovering metastable states, and uncovering their nature is becoming increasingly challenging. In this paper, we first use the variational approach to conformation dynamics to discover the slowest dynamical modes of the simulations. This allows the different metastable states of the system to be located and organized hierarchically. The physical descriptors that characterize metastable states are discovered by means of a machine learning method. We show in the cases of two proteins, Chignolin and Bovine Pancreatic Trypsin Inhibitor, how such analysis can be effortlessly performed in a matter of seconds. Another strength of our approach is that it can be applied to the analysis of both unbiased and biased simulations.


title: Survival probability of random walks and L\'evy flights with stochastic resetting

abstract: We perform a thorough analysis of the survival probability of symmetric random walks with stochastic resetting, defined as the probability for the walker not to cross the origin up to time $n$. For continuous symmetric distributions of step lengths with either finite (random walks) or infinite variance (L\'evy flights), this probability can be expressed in terms of the survival probability of the walk without resetting, given by Sparre Andersen theory. It is therefore universal, i.e., independent of the step length distribution. We analyze this survival probability at depth, deriving both exact results at finite times and asymptotic late-time results. We also investigate the case where the step length distribution is symmetric but not continuous, focussing our attention onto arithmetic distributions generating random walks on the lattice of integers. We investigate in detail the example of the simple Polya walk and propose an algebraic approach for lattice walks with a larger range.


title: When a completion of the universal enveloping algebra is a Banach PI-algebra?

abstract: We prove that a Banach algebra $B$ that is a completion of the universal enveloping algebra of a finite-dimensional complex Lie algebra $\mathfrak{g}$ satisfies a polynomial identity if and only if the nilpotent radical $\mathfrak{n}$ of $\mathfrak{g}$ is associatively nilpotent in $B$. Furthermore, this holds if and only if a certain polynomial growth condition is satisfied on $\mathfrak{n}$.


title: FasterVideo: Efficient Online Joint Object Detection And Tracking

abstract: Object detection and tracking in videos represent essential and computationally demanding building blocks for current and future visual perception systems. In order to reduce the efficiency gap between available methods and computational requirements of real-world applications, we propose to re-think one of the most successful methods for image object detection, Faster R-CNN, and extend it to the video domain. Specifically, we extend the detection framework to learn instance-level embeddings which prove beneficial for data association and re-identification purposes. Focusing on the computational aspects of detection and tracking, our proposed method reaches a very high computational efficiency necessary for relevant applications, while still managing to compete with recent and state-of-the-art methods as shown in the experiments we conduct on standard object tracking benchmarks


title: The multi elliptic-localized solutions and their asymptotic behaviors for the mKdV equation

abstract: We mainly construct and analyze the multi elliptic-localized solutions under the background of elliptic function solutions for the focusing modified Korteweg-de Vries (mKdV) equation. Based on the Darboux-B\"{a}cklund transformation, we provide a uniform expression for these solutions by the Jacobi theta functions. The asymptotic behaviors of multi elliptic-localized solutions are provided directly in two categories. By the consistent asymptotic expression of those solutions, we obtain that the collisions between the elliptic-breathers/solitons are elastic. Moreover, a sufficient condition of the strictly elastic collision between the solitons and breathers has been given by the symmetric analysis. In addition, as $k\rightarrow0^{+}$, the multi elliptic-localized solutions degenerate into solitons, breathers or soliton-breather solutions, which implies that we extend the solutions from the constant and vanishing backgrounds to the periodic solutions backgrounds. Moreover, we illustrate figures of the multi elliptic-localized solutions to visualize the above analysis.


title: Variation in solar differential rotation and activity in the period 1964-2016 determined by the Kanzelh\"ohe data set

abstract: We determined the differential rotation (DR) parameters $A$ and $B$ (corresponding to the equatorial rotation velocity and the gradient of the solar DR) by tracing sunspot groups in sunspot drawings of the Kanzelh\"ohe Observatory for Solar and Environmental Research (KSO; 1964-2008, for solar cycles (SC) 20-23) and KSO white-light images (2009-2016, for SC 24). We used different statistical methods and approaches to analyse cycle related variations, solar cycle phase-related variations and long-term variations of the DR. $A$ and $B$ show statistically significant periodic variability. The changes in $A$ related to solar cycle phase are in accordance with previously reported theoretical and experimental results (higher $A$ during solar minimum, lower $A$ during the maximum of activity), while changes in $B$ differ from the theoretical predictions as we observe more negative values of $B$, that is, a more pronounced DR during activity maximum. The main result of this paper for the long-term variations in $A$ is the detection of a phase shift between the activity flip (in the 1970s) and the equatorial rotation velocity flip (in the early 1990s). During this time period both $A$ and activity show a secular decreasing trend, indicating their correlation. Therefore, the theoretical model fails in the phase-shift time period that occurs after the modern Gleissberg maximum, while in the time period thereafter (after the 1990s), theoretical and experimental results are consistent. The long-term variations in $B$ in general yield an anticorrelation of $B$ and activity, as a rise of $B$ is observed during the entire time period (1964-2016) we analysed, during which activity decreased. We study for the first time the variation in solar DR and activity based on 53 years of KSO data. Our results agree well with the results related to the solar cycle phase from corona observations.


title: An exploration of dust grain growth within WCd systems using an advected scalar dust model

abstract: Dust production is one of the more curious phenomena observed in massive binary systems with interacting winds. The high temperatures, UV photon flux and violent shocks should destroy any dust grains that condense. However, in some extreme cases dust production yields of approximately 30% of the total mass loss rate of the stellar winds have been observed. In order to better understand this phenomenon a parameter space exploration was performed using a series of numerical models of dust producing carbon phase Wolf-Rayet (WCd) systems. These models incorporated a passive scalar dust model simulating dust growth, destruction and radiative cooling. We find that reasonable dust yields were produced by these simulations. Significant changes in the dust yield were caused by changing the mass loss rates of the stars, with a greater mass loss rate contributing to increased dust yields. Similarly, a close orbit between the stars also resulted in higher dust yields. Finally, a high velocity wind shear, which induces Kelvin-Helmholtz (KH) instabilities and wind mixing, drastically increases the dust yields.


title: Generalized Universal Coding of Integers

abstract: Universal coding of integers~(UCI) is a class of variable-length code, such that the ratio of the expected codeword length to $\max\{1,H(P)\}$ is within a constant factor, where $H(P)$ is the Shannon entropy of the decreasing probability distribution $P$. However, if we consider the ratio of the expected codeword length to $H(P)$, the ratio tends to infinity by using UCI, when $H(P)$ tends to zero. To solve this issue, this paper introduces a class of codes, termed generalized universal coding of integers~(GUCI), such that the ratio of the expected codeword length to $H(P)$ is within a constant factor $K$. First, the definition of GUCI is proposed and the coding structure of GUCI is introduced. Next, we propose a class of GUCI $\mathcal{C}$ to achieve the expansion factor $K_{\mathcal{C}}=2$ and show that the optimal GUCI is in the range $1\leq K_{\mathcal{C}}^{*}\leq 2$. Then, by comparing UCI and GUCI, we show that when the entropy is very large or $P(0)$ is not large, there are also cases where the average codeword length of GUCI is shorter. Finally, the asymptotically optimal GUCI is presented.


title: Simulation of the LSD Response to the Neutrino Burst from SN 1987A

abstract: Using the Geant4 code, we have performed a full-scale simulation of the LSD response to the neutrino burst from SN1987A. The neutrino flux parameters were chosen according to one of the models: the standard collapse model or the rotational supernova explosion model. We showed that, depending on the chosen parameters, one can either obtain the required number of pulses in the detector or reproduce their energy spectrum, but not both together. The interaction of neutrino radiation both with LSD itself and with the material of the surrounding soil was taken into account in our simulation. We also explored the hypothesis that the entire unique LSD signal at 2:52 UT was produced by neutron fluxes from the surrounding granite. However, this hypothesis was not confirmed by our simulation. The results obtained provide a rich material for possible interpretations.


title: Strength of Correlations in a Silver Based Cuprate Analogue

abstract: AgF2 has been proposed as a cuprate analogue which requires strong correlation and marked covalence. On the other hand, fluorides are usually quite ionic and 4d transition metals tend to be less correlated than their 3d counterparts, which calls for further scrutiny. We combine valence band photoemission and Auger-Meitner spectroscopy of AgF and AgF2 together with computations in small clusters to estimate values of the Ag 4d Coulomb interaction U 4d and charge-transfer energy. Based on these values, AgF2 can be classified as a charge-transfer correlated insulator according to the Zaanen-Sawatzky-Allen classification scheme. Thus, we confirm that the material is a cuprate analogue from the point of view of correlations, suggesting that it should become a high-temperature superconductor if metallization is achieved by doping. We present also a computation of the Hubbard U in density functional "+U" methods and discuss its relation to the Hubbard U in spectroscopies.


title: Gate-Controlled Quantum Dots Based on Two-Dimensional Materials

abstract: Two-dimensional (2D) materials are a family of layered materials exhibiting rich exotic phenomena, such as valley-contrasting physics. Down to single-particle level, unraveling fundamental physics and potential applications including quantum information processing in these materials attracts significant research interests. To unlock these great potentials, gate-controlled quantum dot architectures have been applied in 2D materials and their heterostructures. Such systems provide the possibility of electrical confinement, control, and manipulation of single carriers in these materials. In this review, efforts in gate-controlled quantum dots in 2D materials are presented. Following basic introductions to valley degree of freedom and gate-controlled quantum dot systems, the up-to-date progress in etched and gate-defined quantum dots in 2D materials, especially in graphene and transition metal dichalcogenides, is provided. The challenges and opportunities for future developments in this field, from views of device design, fabrication scheme, and control technology, are discussed. The rapid progress in this field not only sheds light on the understanding of spin-valley physics, but also provides an ideal platform for investigating diverse condensed matter physics phenomena and realizing quantum computation in the 2D limit.


title: BYOL for Audio: Exploring Pre-trained General-purpose Audio Representations

abstract: Pre-trained models are essential as feature extractors in modern machine learning systems in various domains. In this study, we hypothesize that representations effective for general audio tasks should provide multiple aspects of robust features of the input sound. For recognizing sounds regardless of perturbations such as varying pitch or timbre, features should be robust to these perturbations. For serving the diverse needs of tasks such as recognition of emotions or music genres, representations should provide multiple aspects of information, such as local and global features. To implement our principle, we propose a self-supervised learning method: Bootstrap Your Own Latent (BYOL) for Audio (BYOL-A, pronounced "viola"). BYOL-A pre-trains representations of the input sound invariant to audio data augmentations, which makes the learned representations robust to the perturbations of sounds. Whereas the BYOL-A encoder combines local and global features and calculates their statistics to make the representation provide multi-aspect information. As a result, the learned representations should provide robust and multi-aspect information to serve various needs of diverse tasks. We evaluated the general audio task performance of BYOL-A compared to previous state-of-the-art methods, and BYOL-A demonstrated generalizability with the best average result of 72.4% and the best VoxCeleb1 result of 57.6%. Extensive ablation experiments revealed that the BYOL-A encoder architecture contributes to most performance, and the final critical portion resorts to the BYOL framework and BYOL-A augmentations. Our code is available online at https://github.com/nttcslab/byol-a for future studies.


title: Deep learning model solves change point detection for multiple change types

abstract: A change points detection aims to catch an abrupt disorder in data distribution. Common approaches assume that there are only two fixed distributions for data: one before and another after a change point. Real-world data are richer than this assumption. There can be multiple different distributions before and after a change. We propose an approach that works in the multiple-distributions scenario. Our approach learn representations for semi-structured data suitable for change point detection, while a common classifiers-based approach fails. Moreover, our model is more robust, when predicting change points. The datasets used for benchmarking are sequences of images with and without change points in them.


title: Divide & Conquer Imitation Learning

abstract: When cast into the Deep Reinforcement Learning framework, many robotics tasks require solving a long horizon and sparse reward problem, where learning algorithms struggle. In such context, Imitation Learning (IL) can be a powerful approach to bootstrap the learning process. However, most IL methods require several expert demonstrations which can be prohibitively difficult to acquire. Only a handful of IL algorithms have shown efficiency in the context of an extreme low expert data regime where a single expert demonstration is available. In this paper, we present a novel algorithm designed to imitate complex robotic tasks from the states of an expert trajectory. Based on a sequential inductive bias, our method divides the complex task into smaller skills. The skills are learned into a goal-conditioned policy that is able to solve each skill individually and chain skills to solve the entire task. We show that our method imitates a non-holonomic navigation task and scales to a complex simulated robotic manipulation task with very high sample efficiency.


title: Monotonicity of the quantum 2-Wasserstein distance

abstract: We study a quantum analogue of the 2-Wasserstein distance as a measure of proximity on the set $\Omega_N$ of density matrices of dimension $N$. We show that such (semi-)distances do not induce Riemannian metrics on the tangent bundle of $\Omega_N$ and are typically not unitary invariant. Nevertheless, we prove that for $N=2$ dimensional Hilbert space the quantum 2-Wasserstein distance (unique up to rescaling) is monotonous with respect to any single-qubit quantum operation and the solution of the quantum transport problem is essentially unique. Furthermore, for any $N \geq 3$ and the quantum cost matrix proportional to a projector we demonstrate the monotonicity under arbitrary mixed unitary channels. Finally, we provide numerical evidence which allows us to conjecture that the unitary invariant quantum 2-Wasserstein semi-distance is monotonous with respect to all CPTP maps in any dimension $N$.


title: SSR-HEF: Crowd Counting with Multi-Scale Semantic Refining and Hard Example Focusing

abstract: Crowd counting based on density maps is generally regarded as a regression task.Deep learning is used to learn the mapping between image content and crowd density distribution. Although great success has been achieved, some pedestrians far away from the camera are difficult to be detected. And the number of hard examples is often larger. Existing methods with simple Euclidean distance algorithm indiscriminately optimize the hard and easy examples so that the densities of hard examples are usually incorrectly predicted to be lower or even zero, which results in large counting errors. To address this problem, we are the first to propose the Hard Example Focusing(HEF) algorithm for the regression task of crowd counting. The HEF algorithm makes our model rapidly focus on hard examples by attenuating the contribution of easy examples.Then higher importance will be given to the hard examples with wrong estimations. Moreover, the scale variations in crowd scenes are large, and the scale annotations are labor-intensive and expensive. By proposing a multi-Scale Semantic Refining (SSR) strategy, lower layers of our model can break through the limitation of deep learning to capture semantic features of different scales to sufficiently deal with the scale variation. We perform extensive experiments on six benchmark datasets to verify the proposed method. Results indicate the superiority of our proposed method over the state-of-the-art methods. Moreover, our designed model is smaller and faster.


title: A new entanglement measure based dual entropy

abstract: Quantum entropy is an important measure for describing the uncertainty of a quantum state, more uncertainty in subsystems implies stronger quantum entanglement between subsystems. Our goal in this work is to quantify bipartite entanglement using both von Neumann entropy and its complementary dual. We first propose a type of dual entropy from Shannon entropy. We define $S^{t}$-entropy entanglement based on von Neumann entropy and its complementary dual. This implies an analytic formula for two-qubit systems. We show that the monogamy properties of the $S^{t}$-entropy entanglement and the entanglement of formation are inequivalent for high-dimensional systems. We finally prove a new type of entanglement polygon inequality in terms of $S^{t}$-entropy entanglement for quantum entangled networks. These results show new features of multipartite entanglement in quantum information processing.


title: Towards Fine-grained Causal Reasoning and QA

abstract: Understanding causality is key to the success of NLP applications, especially in high-stakes domains. Causality comes in various perspectives such as enable and prevent that, despite their importance, have been largely ignored in the literature. This paper introduces a novel fine-grained causal reasoning dataset and presents a series of novel predictive tasks in NLP, such as causality detection, event causality extraction, and Causal QA. Our dataset contains human annotations of 25K cause-effect event pairs and 24K question-answering pairs within multi-sentence samples, where each can have multiple causal relationships. Through extensive experiments and analysis, we show that the complex relations in our dataset bring unique challenges to state-of-the-art methods across all three tasks and highlight potential research opportunities, especially in developing "causal-thinking" methods.


title: How transpiration by forests and other vegetation determines alternate moisture regimes

abstract: The terrestrial water cycle links the soil and atmosphere moisture reservoirs through four fluxes: precipitation, evaporation, runoff and atmospheric moisture convergence. Each of these fluxes is essential for human and ecosystem well-being. However, predicting how the water cycle responds to changes in vegetation cover, remains a challenge (Lawrence and Vandecar, 2015; Ellison et al., 2017; te Wierik et al., 2021). Recently, rainfall was shown to decrease disproportionally with reduced forest transpiration following deforestation (Baudena et al., 2021). Here, combining these findings with the law of matter conservation, we show that in a sufficiently wet atmosphere forest transpiration can control atmospheric moisture convergence such that increased transpiration enhances atmospheric moisture import. Conversely, in a drier atmosphere increased transpiration reduces atmospheric moisture convergence and runoff. This previously unrecognized dichotomy can explain the seemingly random observations of runoff and soil moisture sometimes increasing and sometimes reducing in response to re-greening (e.g., Zheng et al., 2021). Evaluating the transition between the two regimes is crucial both for characterizing the risk posed by deforestation as well as for motivating and guiding global ecosystem restoration.


title: Initialisation and Grammar Design in Grammar-Guided Evolutionary Computation

abstract: Grammars provide a convenient and powerful mechanism to define the space of possible solutions for a range of problems. However, when used in grammatical evolution (GE), great care must be taken in the design of a grammar to ensure that the polymorphic nature of the genotype-to-phenotype mapping does not impede search. Additionally, recent work has highlighted the importance of the initialisation method on GE's performance. While recent work has shed light on the matters of initialisation and grammar design with respect to GE, their impact on other methods, such as random search and context-free grammar genetic programming (CFG-GP), is largely unknown. This paper examines GE, random search and CFG-GP under a range of benchmark problems using several different initialisation routines and grammar designs. The results suggest that CFG-GP is less sensitive to initialisation and grammar design than both GE and random search: we also demonstrate that observed cases of poor performance by CFG-GP are managed through simple adjustment of tuning parameters. We conclude that CFG-GP is a strong base from which to conduct grammar-guided evolutionary search, and that future work should focus on understanding the parameter space of CFG-GP for better application.


title: A model explaining the new CDF II W boson mass linking to muon $g-2$ and dark matter

abstract: We propose a model to explain the W boson mass anomaly reported by the CDFII collaboration that would suggest new physics (NP). We introduce exotic fermions; one isospin doublet vector-like lepton, one isospin singlet singly-charged vector-like lepton, and an isospin doublet inert scalar. The proposed model provides sizable muon anomalous magnetic moment (muon $g-2$) due to no chiral suppression and nonzero mass difference between the real and imaginary parts of neutral inert scalar bosons. The inert scalar mass squared difference and vector-like exotic leptons ($L', E'$ in the main text) affect oblique parameters. Especially, the $T$-parameter shift from zero explains the W boson mass anomaly. We search for the allowed parameter region to explain both muon $g-2$ and W boson mass anomaly at the same time. We also discuss a dark matter (DM) candidate assuming the real part of the inert scalar field to be the one. We find that lighter DM mass is favored to be consistent with experimental constraints.


title: End-to-End Sensitivity-Based Filter Pruning

abstract: In this paper, we present a novel sensitivity-based filter pruning algorithm (SbF-Pruner) to learn the importance scores of filters of each layer end-to-end. Our method learns the scores from the filter weights, enabling it to account for the correlations between the filters of each layer. Moreover, by training the pruning scores of all layers simultaneously our method can account for layer interdependencies, which is essential to find a performant sparse sub-network. Our proposed method can train and generate a pruned network from scratch in a straightforward, one-stage training process without requiring a pretrained network. Ultimately, we do not need layer-specific hyperparameters and pre-defined layer budgets, since SbF-Pruner can implicitly determine the appropriate number of channels in each layer. Our experimental results on different network architectures suggest that SbF-Pruner outperforms advanced pruning methods. Notably, on CIFAR-10, without requiring a pretrained baseline network, we obtain 1.02% and 1.19% accuracy gain on ResNet56 and ResNet110, compared to the baseline reported for state-of-the-art pruning algorithms. This is while SbF-Pruner reduces parameter-count by 52.3% (for ResNet56) and 54% (for ResNet101), which is better than the state-of-the-art pruning algorithms with a high margin of 9.5% and 6.6%.


title: Super Resolution for Turbulent Flows in 2D: Stabilized Physics Informed Neural Networks

abstract: We propose a new design of a neural network for solving a zero shot super resolution problem for turbulent flows. We embed Luenberger-type observer into the network's architecture to inform the network of the physics of the process, and to provide error correction and stabilization mechanisms. In addition, to compensate for decrease of observer's performance due to the presence of unknown destabilizing forcing, the network is designed to estimate the contribution of the unknown forcing implicitly from the data over the course of training. By running a set of numerical experiments, we demonstrate that the proposed network does recover unknown forcing from data and is capable of predicting turbulent flows in high resolution from low resolution noisy observations.


title: SOTVerse: A User-defined Task Space of Single Object Tracking

abstract: Single object tracking (SOT) research falls into a cycle -- trackers perform well on most benchmarks but quickly fail in challenging scenarios, causing researchers to doubt the insufficient data content and take more effort to construct larger datasets with more challenging situations. However, inefficient data utilization and limited evaluation methods more seriously hinder SOT research. The former causes existing datasets can not be exploited comprehensively, while the latter neglects challenging factors in the evaluation process. In this article, we systematize the representative benchmarks and form a Single Object Tracking metaverse (SOTVerse) -- a user-defined SOT task space to break through the bottleneck. We first propose a 3E Paradigm to describe tasks by three components (i.e., environment, evaluation, and executor). Then, we summarize task characteristics, clarify the organization standards, and construct SOTVerse with 12.56 million frames. Specifically, SOTVerse automatically labels challenging factors per frame, allowing users to generate user-defined spaces efficiently via construction rules. Besides, SOTVerse provides two mechanisms with new indicators and successfully evaluates trackers under various subtasks. Consequently, SOTVerse first provides a strategy to improve resource utilization in the computer vision area, making research more standardized and scientific. The SOTVerse, toolkit, evaluation server, and results are available at http://metaverse.aitestunion.com.


title: Universal approximation property of invertible neural networks

abstract: Invertible neural networks (INNs) are neural network architectures with invertibility by design. Thanks to their invertibility and the tractability of Jacobian, INNs have various machine learning applications such as probabilistic modeling, generative modeling, and representation learning. However, their attractive properties often come at the cost of restricting the layer designs, which poses a question on their representation power: can we use these models to approximate sufficiently diverse functions? To answer this question, we have developed a general theoretical framework to investigate the representation power of INNs, building on a structure theorem of differential geometry. The framework simplifies the approximation problem of diffeomorphisms, which enables us to show the universal approximation properties of INNs. We apply the framework to two representative classes of INNs, namely Coupling-Flow-based INNs (CF-INNs) and Neural Ordinary Differential Equations (NODEs), and elucidate their high representation power despite the restrictions on their architectures.


title: Generalized uncertainty principle and Asymptotic Safe gravity

abstract: We present a procedure to link the deformation parameter $\beta$ of the generalized uncertainty principle (GUP) to the two free parameters $\om$ and $\gamma$ of the running Newtonian coupling constant of the Asymptotic Safe gravity (ASG) program. To this aim, we compute the Hawking temperature of a black hole in two different ways. The first way involves the use of the GUP in place of the Heisenberg uncertainty relations, and therefore we get a deformed Hawking temperature containing the parameter $\beta$. The second way involves the deformation of the Schwarzschild metric due to the Newtonian coupling constant running according to the AS gravity prescription. The comparison of the two techniques yields a relation between $\beta$ and $\om$, $\gamma$. As a particular case, we discuss also the so called $\xi$-model. The relations between $\beta$ and $\om$, $\xi$ allow us to transfer upper bounds from one parameter to the others.


title: Safe Reinforcement Learning Using Black-Box Reachability Analysis

abstract: Reinforcement learning (RL) is capable of sophisticated motion planning and control for robots in uncertain environments. However, state-of-the-art deep RL approaches typically lack safety guarantees, especially when the robot and environment models are unknown. To justify widespread deployment, robots must respect safety constraints without sacrificing performance. Thus, we propose a Black-box Reachability-based Safety Layer (BRSL) with three main components: (1) data-driven reachability analysis for a black-box robot model, (2) a trajectory rollout planner that predicts future actions and observations using an ensemble of neural networks trained online, and (3) a differentiable polytope collision check between the reachable set and obstacles that enables correcting unsafe actions. In simulation, BRSL outperforms other state-of-the-art safe RL methods on a Turtlebot 3, a quadrotor, a trajectory-tracking point mass, and a hexarotor in wind with an unsafe set adjacent to the area of highest reward.


title: The gravitational wave and short gamma-ray burst GW170817/SHB170817A, not your everyday binary neutron star merger

abstract: This event, so far unique, beautifully confirmed the standard views on the gravitational waves produced by a merger of two neutron stars, but its electromagnetic multi-wavelenth observations disagreed with the numerous initial versions of the "standard fireball model(s)" of gamma ray bursts. Contrariwise, they provided strong evidence in favour of the "cannonball" model. Most uncontroversially, a cannonball was observed at radio wavelengths, with an overwhelming statistical significance ($>\! 17\,\sigma$), and travelling in the plane of the sky, as expected, at an apparent superluminal velocity $V_{app}\sim 4\, c$.


title: Some properties of differentiable p-adic functions

abstract: In this paper, using the tools from the lineability theory, we distinguish certain subsets of $p$-adic differentiable functions. Specifically, we show that the following sets of functions are large enough to contain an infinite dimensional algebraic structure: (i) continuously differentiable but not strictly differentiable functions, (ii) strictly differentiable functions of order $r$ but not strictly differentiable of order $r+1$, (iii) strictly differentiable functions with zero derivative that are not Lipschitzian of any order $\alpha >1$, (iv) differentiable functions with unbounded derivative, and (v) continuous functions that are differentiable on a full set with respect to the Haar measure but not differentiable on its complement having cardinality the continuum.


title: Deep CardioSound-An Ensembled Deep Learning Model for Heart Sound MultiLabelling

abstract: Heart sound diagnosis and classification play an essential role in detecting cardiovascular disorders, especially when the remote diagnosis becomes standard clinical practice. Most of the current work is designed for single category based heard sound classification tasks. To further extend the landscape of the automatic heart sound diagnosis landscape, this work proposes a deep multilabel learning model that can automatically annotate heart sound recordings with labels from different label groups, including murmur's timing, pitch, grading, quality, and shape. Our experiment results show that the proposed method has achieved outstanding performance on the holdout data for the multi-labelling task with sensitivity=0.990, specificity=0.999, F1=0.990 at the segments level, and an overall accuracy=0.969 at the patient's recording level.


title: An interpretable machine learning approach for ferroalloys consumptions

abstract: This paper is devoted to a practical method for ferroalloys consumption modeling and optimization. We consider the problem of selecting the optimal process control parameters based on the analysis of historical data from sensors. We developed approach, which predicts results of chemical reactions and give ferroalloys consumption recommendation. The main features of our method are easy interpretation and noise resistance. Our approach is based on k-means clustering algorithm, decision trees and linear regression. The main idea of the method is to identify situations where processes go similarly. For this, we propose using a k-means based dataset clustering algorithm and a classification algorithm to determine the cluster. This algorithm can be also applied to various technological processes, in this article, we demonstrate its application in metallurgy. To test the application of the proposed method, we used it to optimize ferroalloys consumption in Basic Oxygen Furnace steelmaking when finishing steel in a ladle furnace. The minimum required element content for a given steel grade was selected as the predictive model's target variable, and the required amount of the element to be added to the melt as the optimized variable. Keywords: Clustering, Machine Learning, Linear Regression, Steelmaking, Optimization, Gradient Boosting, Artificial Intelligence, Decision Trees, Recommendation services


title: Using Restart Sequences to Determine Beneficial First Passage Under Restart

abstract: First Passage (FP) processes are utilized widely to model phenomena in many areas of mathematical applications, from biology to computer science. Introducing a mechanism to restart the parent process can alter the first passage characteristics, and the properties of the resulting First Passage Under Restart (FPUR) process have been subject to much recent investigation. Here we seek to more fully characterize whether a discrete FP process can have its mean hitting time reduced through the implementation of restart by analyzing a construct we call the restart sequence, which is determined solely by the distribution of the FP process.


title: On graphic degree sequences and matching numbers

abstract: The recently introduced Degree Preserving Growth model (Nature Physics, DOI:10.1038/s41567-021-01417-7) uses matchings to insert new vertices of prescribed degrees into the current graph of an ever-growing graph sequence. In this paper we are presenting lower bounds on the matching numbers of the graphs in the growth sequence, based on their degree sequence only. We are interested in bounds on maximal/maximum matchings in some realizations (potential matching number), and also on common bounds on all realizations (forcible matching number). Particularly, we prove that whether a degree sequence can be extended with a new degree $2\delta$ is equivalent to the existence of a realization of the original degree sequence with a matching of size $\delta$ that covers the largest $2\delta$ degrees. Second, we estimate the minimum size of both the maximal and the maximum matchings, as determined by the degree sequence, independently of the graphical realization. Furthermore, we also estimate the maximum value of the matching number over all possible realizations for the degree sequence. Along this line we answer a question raised by Biedl, Demaine et. al. (DOI:10.1016/j.disc.2004.05.003). We briefly discuss an application to prime gap sequences.


title: Singular quadratic eigenvalue problems: Linearization and weak condition numbers

abstract: The numerical solution of singular eigenvalue problems is complicated by the fact that small perturbations of the coefficients may have an arbitrarily bad effect on eigenvalue accuracy. However, it has been known for a long time that such perturbations are exceptional and standard eigenvalue solvers, such as the QZ algorithm, tend to yield good accuracy despite the inevitable presence of roundoff error. Recently, Lotz and Noferini quantified this phenomenon by introducing the concept of $\delta$-weak eigenvalue condition numbers. In this work, we consider singular quadratic eigenvalue problems and two popular linearizations. Our results show that a correctly chosen linearization increases $\delta$-weak eigenvalue condition numbers only marginally, justifying the use of these linearizations in numerical solvers also in the singular case. We propose a very simple but often effective algorithm for computing well-conditioned eigenvalues of a singular quadratic eigenvalue problems by adding small random perturbations to the coefficients. We prove that the eigenvalue condition number is, with high probability, a reliable criterion for detecting and excluding spurious eigenvalues created from the singular part.


title: Finding Hall blockers by matrix scaling

abstract: For a given nonnegative matrix $A=(A_{ij})$, the matrix scaling problem asks whether $A$ can be scaled to a doubly stochastic matrix $D_1AD_2$ for some positive diagonal matrices $D_1,D_2$.The Sinkhorn algorithm is a simple iterative algorithm, which repeats row-normalization $A_{ij} \leftarrow A_{ij}/\sum_{j}A_{ij}$ and column-normalization $A_{ij} \leftarrow A_{ij}/\sum_{i}A_{ij}$ alternatively. By this algorithm, $A$ converges to a doubly stochastic matrix in limit if and only if the bipartite graph associated with $A$ has a perfect matching. This property can decide the existence of a perfect matching in a given bipartite graph $G$, which is identified with the $0,1$-matrix $A_G$.Linial, Samorodnitsky, and Wigderson showed that $O(n^2 \log n)$ iterations for $A_G$ decide whether $G$ has a perfect matching. Here $n$ is the number of vertices in one of the color classes of $G$. In this paper, we show an extension of this result:If $G$ has no perfect matching, then a polynomial number of the Sinkhorn iterations identifies a Hall blocker -- a vertex subset $X$ having neighbors $\Gamma(X)$ with $|X| > |\Gamma(X)|$. Specifically, we show that $O(n^2 \log n)$ iterations can identify one Hall blocker, and that further polynomial iterations can also identify all parametric Hall blockers $X$ of maximizing $(1-\lambda) |X| - \lambda |\Gamma(X)|$ for $\lambda \in [0,1]$.The former result is based on an interpretation of the Sinkhorn algorithm as alternating minimization for geometric programming. The latter is on an interpretation as alternating minimization for KL-divergence (Csisz\'{a}r and Tusn\'{a}dy 1984, Gietl and Reffel 2013) and its limiting behavior for a nonscalable matrix (Aas 2014). We also relate the Sinkhorn limit with parametric network flow, principal partition of polymatroids, and the Dulmage-Mendelsohn decomposition of a bipartite graph.


title: A Novel CFD-DEM Coarse-Graining Method Based on the Voronoi Tessellation

abstract: In unresolved flow CFD-DEM simulations, the porosity values for each CFD cell are determined using a coarse-graining algorithm. While this approach enables coupled simulations of representative numbers of particles, the influence of the porosity local to the particles on the fluid-particle interaction force is not captured. This contribution considers a two-grid coarse-graining method that determines a local porosity for each particle using a radical Voronoi tessellation of the system. A relatively fine, regular point cloud is used to map these local porosity data to the CFD cells. The method is evaluated using two different cases considering both disperse and tightly packed particles. The data show that the method conserves porosity data, is reasonably grid-independent and can generate a relatively smooth porosity field. The new method can more accurately predict the fluid-particle interactive force for polydisperse particle system than alternative methods that have been implemented in unresolved CFD-DEM codes.


title: On certain Semigroup of Order-decreasing Full Contraction Mappings of a Finite Chain

abstract: Let $\mathcal{CT}_n$ be the semigroup of full contraction mappings on $[n]=\{1,2,\ldots,n\}$, and let $\mathcal{OCT}_n$ and $\mathcal{ODCT}_n$ be the subsemigroups consisting of all order-preserving full contraction and subsemigroup of order-decreasing and order-preserving full contraction mappings, respectively. In this paper, we show that the semigroup $\mathcal{ODCT}_n$ is left adequate. We further study the rank properties and as well obtain the rank of the semigroup, $\mathcal{ODCT}_n$. Moreover, we obtain a characterization of natural partial order for the semigroup $\mathcal{OCT}_n$ and its subsemigroup $\mathcal{ODCT}_n$, respectively.


title: Decision-making with E-admissibility given a finite assessment of choices

abstract: Given information about which options a decision-maker definitely rejects from given finite sets of options, we study the implications for decision-making with E-admissibility. This means that from any finite set of options, we reject those options that no probability mass function compatible with the given information gives the highest expected utility. We use the mathematical framework of choice functions to specify choices and rejections, and specify the available information in the form of conditions on such functions. We characterise the most conservative extension of the given information to a choice function that makes choices based on E-admissibility, and provide an algorithm that computes this extension by solving linear feasibility problems.


title: Experimentally realized memristive memory augmented neural network

abstract: Lifelong on-device learning is a key challenge for machine intelligence, and this requires learning from few, often single, samples. Memory augmented neural network has been proposed to achieve the goal, but the memory module has to be stored in an off-chip memory due to its size. Therefore the practical use has been heavily limited. Previous works on emerging memory-based implementation have difficulties in scaling up because different modules with various structures are difficult to integrate on the same chip and the small sense margin of the content addressable memory for the memory module heavily limited the degree of mismatch calculation. In this work, we implement the entire memory augmented neural network architecture in a fully integrated memristive crossbar platform and achieve an accuracy that closely matches standard software on digital hardware for the Omniglot dataset. The successful demonstration is supported by implementing new functions in crossbars in addition to widely reported matrix multiplications. For example, the locality-sensitive hashing operation is implemented in crossbar arrays by exploiting the intrinsic stochasticity of memristor devices. Besides, the content-addressable memory module is realized in crossbars, which also supports the degree of mismatches. Simulations based on experimentally validated models show such an implementation can be efficiently scaled up for one-shot learning on the Mini-ImageNet dataset. The successful demonstration paves the way for practical on-device lifelong learning and opens possibilities for novel attention-based algorithms not possible in conventional hardware.


title: Stateless and Rule-Based Verification For Compliance Checking Applications

abstract: Underlying computational model has an important role in any computation. The state and transition (such as in automata) and rule and value (such as in Lisp and logic programming) are two comparable and counterpart computational models. Both of deductive and model checking verification techniques are relying on a notion of state and as a result, their underlying computational models are state dependent. Some verification problems (such as compliance checking by which an under compliance system is verified against some regulations and rules) have not a strong notion of state nor transition. Behalf of it, these systems have a strong notion of value symbols and declarative rules defined on them. SARV (Stateless And Rule-Based Verification) is a verification framework that designed to simplify the overall process of verification for stateless and rule-based verification problems (e.g. compliance checking). In this paper, a formal logic-based framework for creating intelligent compliance checking systems is presented. We define and introduce this framework, report a case study and present results of an experiment on it. The case study is about protocol compliance checking for smart cities. Using this solution, a Rescue Scenario use case and its compliance checking are sketched and modeled. An automation engine for and a compliance solution with SARV are introduced. Based on 300 data experiments, the SARV-based compliance solution outperforms famous machine learning methods on a 3125-records software quality dataset.


title: The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants

abstract: Selecting the most suitable algorithm and determining its hyperparameters for a given optimization problem is a challenging task. Accurately predicting how well a certain algorithm could solve the problem is hence desirable. Recent studies in single-objective numerical optimization show that supervised machine learning methods can predict algorithm performance using landscape features extracted from the problem instances. Existing approaches typically treat the algorithms as black-boxes, without consideration of their characteristics. To investigate in this work if a selection of landscape features that depends on algorithms properties could further improve regression accuracy, we regard the modular CMA-ES framework and estimate how much each landscape feature contributes to the best algorithm performance regression models. Exploratory data analysis performed on this data indicate that the set of most relevant features does not depend on the configuration of individual modules, but the influence that these features have on regression accuracy does. In addition, we have shown that by using classifiers that take the features relevance on the model accuracy, we are able to predict the status of individual modules in the CMA-ES configurations.


title: ML_LTU at SemEval-2022 Task 4: T5 Towards Identifying Patronizing and Condescending Language

abstract: This paper describes the system used by the Machine Learning Group of LTU in subtask 1 of the SemEval-2022 Task 4: Patronizing and Condescending Language (PCL) Detection. Our system consists of finetuning a pretrained Text-to-Text-Transfer Transformer (T5) and innovatively reducing its out-of-class predictions. The main contributions of this paper are 1) the description of the implementation details of the T5 model we used, 2) analysis of the successes & struggles of the model in this task, and 3) ablation studies beyond the official submission to ascertain the relative importance of data split. Our model achieves an F1 score of 0.5452 on the official test set.


title: Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policy

abstract: Proactive dialogue system is able to lead the conversation to a goal topic and has advantaged potential in bargain, persuasion and negotiation. Current corpus-based learning manner limits its practical application in real-world scenarios. To this end, we contribute to advance the study of the proactive dialogue policy to a more natural and challenging setting, i.e., interacting dynamically with users. Further, we call attention to the non-cooperative user behavior -- the user talks about off-path topics when he/she is not satisfied with the previous topics introduced by the agent. We argue that the targets of reaching the goal topic quickly and maintaining a high user satisfaction are not always converge, because the topics close to the goal and the topics user preferred may not be the same. Towards this issue, we propose a new solution named I-Pro that can learn Proactive policy in the Interactive setting. Specifically, we learn the trade-off via a learned goal weight, which consists of four factors (dialogue turn, goal completion difficulty, user satisfaction estimation, and cooperative degree). The experimental results demonstrate I-Pro significantly outperforms baselines in terms of effectiveness and interpretability.


title: ERGO: Event Relational Graph Transformer for Document-level Event Causality Identification

abstract: Document-level Event Causality Identification (DECI) aims to identify causal relations between event pairs in a document. It poses a great challenge of across-sentence reasoning without clear causal indicators. In this paper, we propose a novel Event Relational Graph TransfOrmer (ERGO) framework for DECI, which improves existing state-of-the-art (SOTA) methods upon two aspects. First, we formulate DECI as a node classification problem by constructing an event relational graph, without the needs of prior knowledge or tools. Second, ERGO seamlessly integrates event-pair relation classification and global inference, which leverages a Relational Graph Transformer (RGT) to capture the potential causal chain. Besides, we introduce edge-building strategies and adaptive focal loss to deal with the massive false positives caused by common spurious correlation. Extensive experiments on two benchmark datasets show that ERGO significantly outperforms previous SOTA methods (13.1% F1 gains on average). We have conducted extensive quantitative analysis and case studies to provide insights for future research directions (Section 4.8).


title: Performance and Construction of Polar Codes: The Perspective of Bit Error Probability

abstract: Most existing works of polar codes focus on the analysis of block error probability. However, in many scenarios, bit error probability is also important for evaluating the performance of channel codes. In this paper, we establish a new framework to analyze the bit error probability of polar codes. Specifically, by revisiting the error event of bit-channel, we first introduce the conditional bit error probability as a metric to evaluate the reliability of bit-channel for both systematic and non-systematic polar codes. Guided by the concept of polar subcode, we then derive an upper bound on the conditional bit error probability of each bit-channel, and accordingly, an upper bound on the bit error probability of polar codes. Based on these, two types of construction metrics aiming at minimizing the bit error probability of polar codes are proposed, which are of linear computational complexity and explicit forms. Simulation results show that the polar codes constructed by the proposed methods can outperform those constructed by the conventional methods.


title: Political Communities on Twitter: Case Study of the 2022 French Presidential Election

abstract: With the significant increase in users on social media platforms, a new means of political campaigning has appeared. Twitter and Facebook are now notable campaigning tools during elections. Indeed, the candidates and their parties now take to the internet to interact and spread their ideas. In this paper, we aim to identify political communities formed on Twitter during the 2022 French presidential election and analyze each respective community. We create a large-scale Twitter dataset containing 1.2 million users and 62.6 million tweets that mention keywords relevant to the election. We perform community detection on a retweet graph of users and propose an in-depth analysis of the stance of each community. Finally, we attempt to detect offensive tweets and automatic bots, comparing across communities in order to gain insight into each candidate's supporter demographics and online campaign strategy.


title: Transfer Learning for Instance Segmentation of Waste Bottles using Mask R-CNN Algorithm

abstract: This paper proposes a methodological approach with a transfer learning scheme for plastic waste bottle detection and instance segmentation using the \textit{mask region proposal convolutional neural network} (Mask R-CNN). Plastic bottles constitute one of the major pollutants posing a serious threat to the environment both in oceans and on land. The automated identification and segregation of bottles can facilitate plastic waste recycling. We prepare a custom-made dataset of 192 bottle images with pixel-by pixel-polygon annotation for the automatic segmentation task. The proposed transfer learning scheme makes use of a Mask R-CNN model pre-trained on the Microsoft COCO dataset. We present a comprehensive scheme for fine-tuning the base pre-trained Mask-RCNN model on our custom dataset. Our final fine-tuned model has achieved 59.4 \textit{mean average precision} (mAP), which corresponds to the MS COCO metric. The results indicate a promising application of deep learning for detecting waste bottles.