title: Strong Solutions for Three-dimensional Nonhomogeneous Incompressible Heat Conducting Magnetohydrodynamic Equations with Vacuum

abstract: This paper is concerned with a Cauchy problem for the three-dimensional (3D) nonhomogeneous incompressible heat conducting magnetohydrodynamic (MHD) equations in the whole space. First of all, we establish a weak Serrin-type blowup criterion for the strong solutions. It is shown that for the Cauchy problem of the 3D nonhomogeneous heat conducting MHD equations, the strong solution exists globally if the velocity satisfies the weak Serrin's condition. In particular, this criterion is independent of the absolute temperature and magnetic field. Then as an immediate application, we prove the global existence and uniqueness of strong solution to the 3D nonhomogeneous heat conducting MHD equations under some smallness condition on the initial data. In addition, the initial vacuum is allowed.


title: Decay No More: A Persistent Twitter Dataset for Learning Social Meaning

abstract: With the proliferation of social media, many studies resort to social media to construct datasets for developing social meaning understanding systems. For the popular case of Twitter, most researchers distribute tweet IDs without the actual text contents due to the data distribution policy of the platform. One issue is that the posts become increasingly inaccessible over time, which leads to unfair comparisons and a temporal bias in social media research. To alleviate this challenge of data decay, we leverage a paraphrase model to propose a new persistent English Twitter dataset for social meaning (PTSM). PTSM consists of $17$ social meaning datasets in $10$ categories of tasks. We experiment with two SOTA pre-trained language models and show that our PTSM can substitute the actual tweets with paraphrases with marginal performance loss.


title: Confidence Estimation Transformer for Long-term Renewable Energy Forecasting in Reinforcement Learning-based Power Grid Dispatching

abstract: The expansion of renewable energy could help realizing the goals of peaking carbon dioxide emissions and carbon neutralization. Some existing grid dispatching methods integrating short-term renewable energy prediction and reinforcement learning (RL) have been proved to alleviate the adverse impact of energy fluctuations risk. However, these methods omit the long-term output prediction, which leads to stability and security problems on the optimal power flow. This paper proposes a confidence estimation Transformer for long-term renewable energy forecasting in reinforcement learning-based power grid dispatching (Conformer-RLpatching). Conformer-RLpatching predicts long-term active output of each renewable energy generator with an enhanced Transformer to boost the performance of hybrid energy grid dispatching. Furthermore, a confidence estimation method is proposed to reduce the prediction error of renewable energy. Meanwhile, a dispatching necessity evaluation mechanism is put forward to decide whether the active output of a generator needs to be adjusted. Experiments carried out on the SG-126 power grid simulator show that Conformer-RLpatching achieves great improvement over the second best algorithm DDPG in security score by 25.8% and achieves a better total reward compared with the golden medal team in the power grid dispatching competition sponsored by State Grid Corporation of China under the same simulation environment. Codes are outsourced in https://github.com/buptlxh/Conformer-RLpatching.


title: On an exponential sum related to the M\"{o}bius function

abstract: Let $\mu(n)$ be the M\"{o}bius function and $e(\alpha)=e^{2\pi i\alpha}$. In this paper, we study upper bounds of the classical sum $$S(x,\alpha):=\sum_{1\leq n\leq x}\mu(n)e(\alpha n).$$ We can improve some classical results of Baker and Harman \cite{BH}.


title: Reaction Network Analysis of Metabolic Insulin Signaling

abstract: Absolute concentration robustness (ACR) and concordance are novel concepts in the theory of robustness and stability within Chemical Reaction Network Theory. In this paper, we have extended Shinar and Feinberg's reaction network analysis approach to the insulin signaling system based on recent advances in decomposing reaction networks. We have shown that the network with 20 species, 35 complexes, and 35 reactions is concordant, implying at most one positive equilibrium in each of its stoichiometric compatibility class. We have obtained the system's finest independent decomposition consisting of 10 subnetworks, a coarsening of which reveals three subnetworks which are not only functionally but also structurally important. Utilizing the network's deficiency-oriented coarsening, we have developed a method to determine positive equilibria for the entire network. Our analysis has also shown that the system has ACR in 8 species all coming from a deficiency zero subnetwork. Interestingly, we have shown that, for a set of rate constants, the insulin-regulated glucose transporter GLUT4 (important in glucose energy metabolism), has stable ACR.


title: Learning Pixel-Level Distinctions for Video Highlight Detection

abstract: The goal of video highlight detection is to select the most attractive segments from a long video to depict the most interesting parts of the video. Existing methods typically focus on modeling relationship between different video segments in order to learning a model that can assign highlight scores to these segments; however, these approaches do not explicitly consider the contextual dependency within individual segments. To this end, we propose to learn pixel-level distinctions to improve the video highlight detection. This pixel-level distinction indicates whether or not each pixel in one video belongs to an interesting section. The advantages of modeling such fine-level distinctions are two-fold. First, it allows us to exploit the temporal and spatial relations of the content in one video, since the distinction of a pixel in one frame is highly dependent on both the content before this frame and the content around this pixel in this frame. Second, learning the pixel-level distinction also gives a good explanation to the video highlight task regarding what contents in a highlight segment will be attractive to people. We design an encoder-decoder network to estimate the pixel-level distinction, in which we leverage the 3D convolutional neural networks to exploit the temporal context information, and further take advantage of the visual saliency to model the spatial distinction. State-of-the-art performance on three public benchmarks clearly validates the effectiveness of our framework for video highlight detection.


title: Impedance modelling and collective effects in the Future Circular e$^+$e$^-$ Collider with 4 IPs

abstract: The FCC-ee impedance model is being constantly updated closely following the vacuum chamber design and parameters evolution. In particular, at present, a thicker NEG coating of 150 nm (instead of previous 100 nm) has been suggested by the vacuum experts, and a more realistic impedance model of the bellows has been investigated. Moreover, also the transverse impedance has been updated by considering the same sources as for the longitudinal case. Therefore, the FCC-ee impedance database is getting more complete and the impedance model is being refined. In this paper we describe the presently available machine coupling impedance in both longitudinal and transverse planes, and study the impedance-driven single bunch instabilities (with and without beam-beam interaction) for the new FCC-ee parameter set with 4 interaction points (IPs). The results are compared with the previously obtained ones and a further possible mitigation of the beam-beam head-tail instability (X-Z instability) is proposed.


title: W49N MCN-a: a disk accreting massive protostar embedded in an early-phase hot molecular core

abstract: We present ALMA archival data for 219-235 GHz continuum and line observations toward the hot molecular core (HMC) W49N MCN-a (UCHII region J1) at a resolution of ~0."3. The dust continuum emission, showing an elongated structure of 1."40x0."95 (PA=43.5deg) perpendicular to the outflow seen in SiO and SO, represents a rotating flattened envelope, or torus, with a radius of 7,800au inclined at 47.5deg or larger. The emissions from CH3CN and 11 molecular lines exhibit a consistent velocity gradient as a result of rotation. The magnitude of each velocity gradient is different, reflecting that each line samples a specific radial region. This allows us to derive a rotation curve as Vrot prop R^0.44+-0.11 for 2,400au < R < 14,000au, giving the dynamical mass as Mdyn = 57.0+24.5-17.1 (R [au]/3, 000)^1.88 Msun. The envelope mass independently estimated from the dustemission is 910Msun (for Tdust =180K) for R<7,800au and 32Msun (for Tdust=300K) for R<1,700 au. The dynamical mass formula agrees well with these mass estimates within an uncertainty of a factor of three in the latter. The envelope is self-gravitating and is unstable to form spiral arms and fragments, allowing rapid accretion to the inner radii with a rate of order 10^-2 Msun yr^-1, although inward motion was not detected. The envelope may become a non self-gravitating Keplerian disk at R<(300-1,000) au. The formula is also consistent with the total mass ~10^4 Msun of the entire HMC 0.15 pc (31,000 au) in radius. Multiple transitions of CH3CN, HNCO and CH3OH provide the rotation temperatures, suggesting that the central source of MCN-a has an intrinsic bolometric luminosity of ~10^6 Lsun. These results have revealed the structure and kinematics of MCN-a at its intermediate radii. With no broad-line H30alpha emission detected, MCN-a may be in the earliest phase of massive star formation.


title: ME-GCN: Multi-dimensional Edge-Embedded Graph Convolutional Networks for Semi-supervised Text Classification

abstract: Compared to sequential learning models, graph-based neural networks exhibit excellent ability in capturing global information and have been used for semi-supervised learning tasks. Most Graph Convolutional Networks are designed with the single-dimensional edge feature and failed to utilise the rich edge information about graphs. This paper introduces the ME-GCN (Multi-dimensional Edge-enhanced Graph Convolutional Networks) for semi-supervised text classification. A text graph for an entire corpus is firstly constructed to describe the undirected and multi-dimensional relationship of word-to-word, document-document, and word-to-document. The graph is initialised with corpus-trained multi-dimensional word and document node representation, and the relations are represented according to the distance of those words/documents nodes. Then, the generated graph is trained with ME-GCN, which considers the edge features as multi-stream signals, and each stream performs a separate graph convolutional operation. Our ME-GCN can integrate a rich source of graph edge information of the entire text corpus. The results have demonstrated that our proposed model has significantly outperformed the state-of-the-art methods across eight benchmark datasets.


title: A New Framework for Fast Automated Phonological Reconstruction Using Trimmed Alignments and Sound Correspondence Patterns

abstract: Computational approaches in historical linguistics have been increasingly applied during the past decade and many new methods that implement parts of the traditional comparative method have been proposed. Despite these increased efforts, there are not many easy-to-use and fast approaches for the task of phonological reconstruction. Here we present a new framework that combines state-of-the-art techniques for automated sequence comparison with novel techniques for phonetic alignment analysis and sound correspondence pattern detection to allow for the supervised reconstruction of word forms in ancestral languages. We test the method on a new dataset covering six groups from three different language families. The results show that our method yields promising results while at the same time being not only fast but also easy to apply and expand.


title: On Principal Curve-Based Classifiers and Similarity-Based Selective Sampling in Time-Series

abstract: Considering the concept of time-dilation, there exist some major issues with recurrent neural Architectures. Any variation in time spans between input data points causes performance attenuation in recurrent neural network architectures. Principal curve-based classifiers have the ability of handling any kind of variation in time spans. In other words, principal curve-based classifiers preserve the relativity of time while neural network architecture violates this property of time. On the other hand, considering the labeling costs and problems in online monitoring devices, there should be an algorithm that finds the data points which knowing their labels will cause in better performance of the classifier. Current selective sampling algorithms have lack of reliability due to the randomness of the proposed algorithms. This paper proposes a classifier and also a deterministic selective sampling algorithm with the same computational steps, both by use of principal curve as their building block in model definition.


title: Unsupervised Manga Character Re-identification via Face-body and Spatial-temporal Associated Clustering

abstract: In the past few years, there has been a dramatic growth in e-manga (electronic Japanese-style comics). Faced with the booming demand for manga research and the large amount of unlabeled manga data, we raised a new task, called unsupervised manga character re-identification. However, the artistic expression and stylistic limitations of manga pose many challenges to the re-identification problem. Inspired by the idea that some content-related features may help clustering, we propose a Face-body and Spatial-temporal Associated Clustering method (FSAC). In the face-body combination module, a face-body graph is constructed to solve problems such as exaggeration and deformation in artistic creation by using the integrity of the image. In the spatial-temporal relationship correction module, we analyze the appearance features of characters and design a temporal-spatial-related triplet loss to fine-tune the clustering. Extensive experiments on a manga book dataset with 109 volumes validate the superiority of our method in unsupervised manga character re-identification.


title: Valley polarization fluctuations, bistability, and switching in two-dimensional semiconductors

abstract: We study theoretically nonlinear valley polarization dynamics of excitons in atom-thin semiconductors. The presence of significant polarization slows down valley relaxation due to an effective magnetic field resulting from exciton-exciton interactions. We address temporal dynamics of valley polarized excitons and study the steady states of the polarized exciton gas. We demonstrate bistability of the valley polarization where two steady states with low and high valley polarization are formed. We study the effects of fluctuations and noise in such system. We evaluate valley polarization autocorrelation functions and demonstrate that for a high-polarization regime the fluctuations are characterized by high amplitude and long relaxation time. We study the switching between the low- and high-valley polarized states caused by the noise in the system and demonstrate that the state with high valley polarization is preferential in a wide range of pumping rates.


title: Efficient route to achieve superconductivity improvement via substitutional La-Ce alloy superhydride at high pressure

abstract: The discovery of clathrate superhydrides has approached the long-standing dream of room-temperature superconductivity and thus inspired their prosperous research under high pressure. However, how to experimentally optimize these compelling superhydrides is still a formidable challenge. Here, we find that half of the Ce atoms in the recently discovered hexagonal close packed (hcp) CeH9 structure can be randomly replaced by adjacent La, resulting in the formation of LaH9 unit that is impossible in a binary system. Our experiments show that hcp (La, Ce)H9 can be synthesized at ~110 GPa and possesses a maximum Tc of 178 K at higher pressure, which is evidenced by in-situ X-ray diffraction and electronic transport measurement where a sharp drop of resistivity to zero and a characteristic decrease of Tc under a magnetic field up to 9 T. More importantly, the Tc of (La, Ce)H9 is significantly increased by ~50-80 K compared to CeH9, showing the hitherto highest Tc at megabar pressure. Our experimental results not only verify the feasibility of improving the superconductivity of hydrides by introducing other suitable metals, but also provide important inspiration for finding high-Tc superconductors in various multinary superhydrides.


title: Rational Points in Translations of The Cantor Set

abstract: Given two coprime integers $p\ge 2$ and $q \ge 3$, let $D_p\subset[0,1)$ consist of all rational numbers which have a finite $p$-ary expansion, and let $$ K(q, \mathcal{A})=\bigg\{ \sum_{i=1}^\infty \frac{d_i}{q^i}: d_i\in \mathcal{A}~ \forall i\in\mathbb{N} \bigg\}, $$ where $\mathcal{A} \subset \{0,1,\ldots, q-1\}$ with cardinality $1<\#\mathcal{A}< q$. In 2021 Schleischitz showed that $\#(D_p\cap K(q,\mathcal{A}))<+\infty$. In this paper we show that for any $r\in\mathbb{Q}$ and for any $\alpha\in\mathbb{R}$, $$ \#\big((r D_p+\alpha)\cap K(q,\mathcal{A})\big)<+\infty. $$


title: Gap probability for the hard edge Pearcey process

abstract: The hard edge Pearcey process is universal in random matrix theory and many other stochastic models. This paper deals with the gap probability for the thinned/unthinned hard edge Pearcey process over the interval $(0,s)$ by working on the relevant Fredholm determinants. We establish an integral representation of the gap probability via a Hamiltonian related a system of coupled differential equations. Together with some remarkable differential identities for the Hamiltonian, we derive the large gap asymptotics for the thinned case, up to and including the constant term. As an application, we also obtain the asymptotic statistical properties of the counting function for the hard edge Pearcey process.


title: Plucker Formulas for Plane Algebraic Curves with a Given Newton Polygon

abstract: Let $C$ be a generic complex plane plane curve with a given Newton polygon $P$. We compute the number of its inflection points and bitangents (equivalently, the number of singularities of the projectively dual curve $C^\vee$). We also prove that $C^\vee$ has no singularities other than nodes and cusps for large enough polygons $P$.


title: Stripformer: Strip Transformer for Fast Image Deblurring

abstract: Images taken in dynamic scenes may contain unwanted motion blur, which significantly degrades visual quality. Such blur causes short- and long-range region-specific smoothing artifacts that are often directional and non-uniform, which is difficult to be removed. Inspired by the current success of transformers on computer vision and image processing tasks, we develop, Stripformer, a transformer-based architecture that constructs intra- and inter-strip tokens to reweight image features in the horizontal and vertical directions to catch blurred patterns with different orientations. It stacks interlaced intra-strip and inter-strip attention layers to reveal blur magnitudes. In addition to detecting region-specific blurred patterns of various orientations and magnitudes, Stripformer is also a token-efficient and parameter-efficient transformer model, demanding much less memory usage and computation cost than the vanilla transformer but works better without relying on tremendous training data. Experimental results show that Stripformer performs favorably against state-of-the-art models in dynamic scene deblurring.


title: A Skyline and ranking query odyssey: a journey from skyline and ranking queries up to f-skyline queries

abstract: Skyline and ranking queries are two of the most used tools to manage large data sets. The former is based on non-dominance, while the latter on a scoring function. Despite their effectiveness, they have some drawbacks like the result size or the need for a utility function that must be taken into account. To do this, in the last years, new kinds of queries, called flexible skyline queries, have been developed. In the present article, a description of skyline and ranking queries, f-skyline queries and a comparison among them are provided to highlight the improvements achieved and how some limitations have been overcome.


title: Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features

abstract: Research at the intersection of personality psychology, computer science, and linguistics has recently focused increasingly on modeling and predicting personality from language use. We report two major improvements in predicting personality traits from text data: (1) to our knowledge, the most comprehensive set of theory-based psycholinguistic features and (2) hybrid models that integrate a pre-trained Transformer Language Model BERT and Bidirectional Long Short-Term Memory (BLSTM) networks trained on within-text distributions ('text contours') of psycholinguistic features. We experiment with BLSTM models (with and without Attention) and with two techniques for applying pre-trained language representations from the transformer model - 'feature-based' and 'fine-tuning'. We evaluate the performance of the models we built on two benchmark datasets that target the two dominant theoretical models of personality: the Big Five Essay dataset and the MBTI Kaggle dataset. Our results are encouraging as our models outperform existing work on the same datasets. More specifically, our models achieve improvement in classification accuracy by 2.9% on the Essay dataset and 8.28% on the Kaggle MBTI dataset. In addition, we perform ablation experiments to quantify the impact of different categories of psycholinguistic features in the respective personality prediction models.


title: Spectral Analysis and its applications for a class of scale-free network based on the weighted m-clique annex operation

abstract: The spectrum of network is an important tool to study the function and dynamic properties of network, and graph operation and product is an effective mechanism to construct a specific local and global topological structure. In this study, a class of weighted $m-$clique annex operation $\tau_m^r(\cdot)$ controlled by scale factor $m$ and weight factor $r$ is defined, through which an iterative weighted network model $G_t$ with small-world and scale-free properties is constructed. In particular, when the number of iterations $t$ tends to infinity, the network has transfinite fractal property. Then, through the iterative features of the network structure, the iterative relationship of the eigenvalues of the normalized Laplacian matrix corresponding to the network is studied. Accordingly, some applications of the spectrum of the network, including the Kenemy constant, Multiplicative Degree-Kirchhoff index and the number of weighted spanning trees, are further given. In addition, we also study the effect of the two factors controlling network operation on the structure and function of the iterative weighted network $G_t$, so that the network operation can better simulate the real network and have more application potential in the field of artificial network.


title: Numerical ranges of Foguel operators revisited

abstract: The Foguel operator is defined as $F_T=\begin{bmatrix}S^* & T \\ 0 & S\end{bmatrix}$, where $S$ is the right shift on a Hilbert space $\mathcal H$ and $T$ can be an arbitrary bounded linear operator acting on $\mathcal H$. Obviously, the numerical range $W(F_0)$ of $F_T$ with $T=0$ is the open unit disk, and it was suggested by Gau, Wang and Wu in their LAA'2021 paper that $W(F_{aI})$ for non-zero $a\in\mathbb C$ might be an elliptical disk. In this paper, we described $W(F_{aI})$ explicitly and, as it happens, it is not.


title: Michael selections and Castaing representations with cadlag functions

abstract: Michael's selection theorem implies that a closed convex nonempty-valued mapping from the Sorgenfrey line to a euclidean space is inner semicontinuous if and only if the mapping can be represented as the image closure of right-continuous selections of the mapping. This article gives necessary and sufficient conditions for the representation to hold for cadlag selections, i.e., for selections that are right-continuous and have left limits. The characterization is motivated by continuous time stochastic optimization problems over cadlag processes. Here, an application to integral functionals of cadlag functions is given.


title: A Distributed Real-Time Recommender System for Big Data Streams

abstract: In today's data-driven world, recommender systems (RS) play a crucial role to support the decision-making process. As users become continuously connected to the internet, they become less patient and less tolerant to obsolete recommendations made by an RS, e.g., movie recommendations on Netflix or books to read on Amazon. This, in turn, requires continuous training of the RS to cope with both the online fashion of data and the changing nature of user tastes and interests, known as concept drift. Streaming (online) RS has to address three requirements: continuous training and recommendation, handling concept drifts, and ability to scale. Streaming recommender systems proposed in the literature mostly, address the first two requirements and do not consider scalability. That is because they run the training process on a single machine. Such a machine, no matter how powerful it is, will eventually fail to cope with the volume of the data, a lesson learned from big data processing. To tackle the third challenge, we propose a Splitting and Replication mechanism for building distributed streaming recommender systems. Our mechanism is inspired by the successful shared-nothing architecture that underpins contemporary big data processing systems. We have applied our mechanism to two well-known approaches for online recommender systems, namely, matrix factorization and item-based collaborative filtering. We have implemented our mechanism on top of Apache Flink. We conducted experiments comparing the performance of the baseline (single machine) approach with our distributed approach. Evaluating different data sets, improvement in processing latency, throughput, and accuracy have been observed. Our experiments show online recall improvement by 40\% with more than 50\% less memory consumption.


title: Intersection Prediction from Single 360{\deg} Image via Deep Detection of Possible Direction of Travel

abstract: Movie-Map, an interactive first-person-view map that engages the user in a simulated walking experience, comprises short 360{\deg} video segments separated by traffic intersections that are seamlessly connected according to the viewer's direction of travel. However, in wide urban-scale areas with numerous intersecting roads, manual intersection segmentation requires significant human effort. Therefore, automatic identification of intersections from 360{\deg} videos is an important problem for scaling up Movie-Map. In this paper, we propose a novel method that identifies an intersection from individual frames in 360{\deg} videos. Instead of formulating the intersection identification as a standard binary classification task with a 360{\deg} image as input, we identify an intersection based on the number of the possible directions of travel (PDoT) in perspective images projected in eight directions from a single 360{\deg} image detected by the neural network for handling various types of intersections. We constructed a large-scale 360{\deg} Image Intersection Identification (iii360) dataset for training and evaluation where 360{\deg} videos were collected from various areas such as school campus, downtown, suburb, and china town and demonstrate that our PDoT-based method achieves 88\% accuracy, which is significantly better than that achieved by the direct naive binary classification based method. The source codes and a partial dataset will be shared in the community after the paper is published.


title: ConsInstancy: Learning Instance Representations for Semi-Supervised Panoptic Segmentation of Concrete Aggregate Particles

abstract: We present a semi-supervised method for panoptic segmentation based on ConsInstancy regularisation, a novel strategy for semi-supervised learning. It leverages completely unlabelled data by enforcing consistency between predicted instance representations and semantic segmentations during training in order to improve the segmentation performance. To this end, we also propose new types of instance representations that can be predicted by one simple forward path through a fully convolutional network (FCN), delivering a convenient and simple-to-train framework for panoptic segmentation. More specifically, we propose the prediction of a three-dimensional instance orientation map as intermediate representation and two complementary distance transform maps as final representation, providing unique instance representations for a panoptic segmentation. We test our method on two challenging data sets of both, hardened and fresh concrete, the latter being proposed by the authors in this paper demonstrating the effectiveness of our approach, outperforming the results achieved by state-of-the-art methods for semi-supervised segmentation. In particular, we are able to show that by leveraging completely unlabeled data in our semi-supervised approach the achieved overall accuracy (OA) is increased by up to 5% compared to an entirely supervised training using only labeled data. Furthermore, we exceed the OA achieved by state-of-the-art semi-supervised methods by up to 1.5%.


title: "That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attacks

abstract: Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in computer vision has been carried to develop reliable defense strategies. However, the same issue remains less explored in natural language processing. Our work presents a model-agnostic detector of adversarial text examples. The approach identifies patterns in the logits of the target classifier when perturbing the input text. The proposed detector improves the current state-of-the-art performance in recognizing adversarial inputs and exhibits strong generalization capabilities across different NLP models, datasets, and word-level attacks.


title: UniDU: Towards A Unified Generative Dialogue Understanding Framework

abstract: With the development of pre-trained language models, remarkable success has been witnessed in dialogue understanding (DU). However, current DU approaches usually employ independent models for each distinct DU task without considering shared knowledge across different DU tasks. In this paper, we propose a unified generative dialogue understanding framework, named {\em UniDU}, to achieve effective information exchange across diverse DU tasks. Here, we reformulate all DU tasks into a unified prompt-based generative model paradigm. More importantly, a novel model-agnostic multi-task training strategy (MATS) is introduced to dynamically adapt the weights of diverse tasks for best knowledge sharing during training, based on the nature and available data of each task. Experiments on ten DU datasets covering five fundamental DU tasks show that the proposed UniDU framework largely outperforms task-specific well-designed methods on all tasks. MATS also reveals the knowledge-sharing structure of these tasks. Finally, UniDU obtains promising performance in the unseen dialogue domain, showing the great potential for generalization.


title: Spectral Unmixing of Hyperspectral Images Based on Block Sparse Structure

abstract: Spectral unmixing (SU) of hyperspectral images (HSIs) is one of the important areas in remote sensing (RS) that needs to be carefully addressed in different RS applications. Despite the high spectral resolution of the hyperspectral data, the relatively low spatial resolution of the sensors may lead to mixture of different pure materials within the image pixels. In this case, the spectrum of a given pixel recorded by the sensor can be a combination of multiple spectra each belonging to a unique material in that pixel. Spectral unmixing is then used as a technique to extract the spectral characteristics of the different materials within the mixed pixels and to recover the spectrum of each pure spectral signature, called endmember. Block-sparsity exists in hyperspectral images as a result of spectral similarity between neighboring pixels. In block-sparse signals, the nonzero samples occur in clusters and the pattern of the clusters is often supposed to be unavailable as prior information. This paper presents an innovative spectral unmixing approach for HSIs based on block-sparse structure. Hyperspectral unmixing problem is solved using pattern coupled sparse Bayesian learning strategy (PCSBL). To evaluate the performance of the proposed SU algorithm, it is tested on both synthetic and real hyperspectral data and the quantitative results are compared to those of other state-of-the-art methods in terms of abundance angle distance and mean squared error. The achieved results show the superiority of the proposed algorithm over the other competing methods by a significant margin.


title: Lipschitz stability of $\gamma$-FOCS and RC canonical Jordan bases of real $H$-selfadjoint matrices under small perturbations

abstract: In 2008 Bella, Olshevsky and Prasad proved that the flipped orthogonal (FO) Jordan bases of H-selfadjoint matrices are Lipschitz stable under small perturbations. In 2022, Dogruer, Minenkova and Olshevsky considered the real case, and proved that for real H-selfadjoint matrices there exist a more refined bases called FOCS bases. In addition to flipped orthogonality they also possess the conjugate symmetric (CS) property. In this paper we prove that these new FOCS bases are Lipschitz stable under small perturbations as well. We also establish the Lipschitz stability for the classical real canonical Jordan bases.


title: Conservation laws with discontinuous flux function on networks: a splitting algorithm

abstract: In this article, we present an extension of the splitting algorithm proposed in [22] to networks of conservation laws with piecewise linear discontinuous flux functions in the unknown. We start with the discussion of a suitable Riemann solver at the junction and then describe a strategy how to use the splitting algorithm on the network. In particular, we focus on two types of junctions, i.e., junctions where the number of outgoing roads does not exceed the number of incoming roads (dispersing type) and junctions with two incoming and one outgoing road (merging type). Finally, numerical examples demonstrate the accuracy of the splitting algorithm by comparisons to the exact solution and other approaches used in the literature.


title: Capacitively coupled distinct mechanical resonators for room temperature phonon-cavity electromechanics

abstract: Coupled electromechanical resonators that can be independently driven/detected and easily integrated with external circuits are essential for exploring mechanical modes based signal processing. Here, we present a room temperature phonon-cavity electromechanical system, consisting of two distinct resonators: a silicon nitride electromechanical drum capacitively coupled to an aluminum one. We demonstrate electromechanically induced transparency and amplification in a two-tone driving scheme and observe the phonon-cavity force affecting the mechanical damping rates of both movable objects. We also develop an analytical model based on linearly coupled motion equations, which captures the optomechanical features in the classical limit and enables to fit quantitatively our measurements. Our results open up new possibilities in the study of phonon-cavity based signal processing in the classical and potentially in the future in the quantum regimes.


title: Gliding on ice in search of accurate and cost-effective computational methods for astrochemistry on grains: the puzzling case of the HCN isomerization

abstract: The isomerization of hydrogen cyanide to hydrogen isocyanide on icy grain surfaces is investigated by an accurate composite method (jun-Cheap) rooted in the coupled cluster ansatz and by density functional approaches. After benchmarking density functional predictions of both geometries and reaction energies against jun-Cheap results for the relatively small model system HCN -- (H2O)2 the best performing DFT methods are selected. A large cluster containing 20 water molecules is then employed within a QM/QM$'$ approach to include a realistic environment mimicking the surface of icy grains. Our results indicate that four water molecules are directly involved in a proton relay mechanism, which strongly reduces the activation energy with respect to the direct hydrogen transfer occurring in the isolated molecule. Further extension of the size of the cluster up to 192 water molecules in the framework of a three-layer QM/QM'/MM model has a negligible effect on the energy barrier ruling the isomerization. Computation of reaction rates by transition state theory indicates that on icy surfaces the isomerization of HNC to HCN could occur quite easily even at low temperatures thanks to the reduced activation energy that can be effectively overcome by tunneling.


title: A Palm Calculus Approach to the Distribution of the Age of Information

abstract: A key metric to express the timeliness of status updates in latency-sensitive networked systems is the age of information (AoI), i.e., the time elapsed since the generation of the last received informative status message. This metric allows studying a number of applications including updates of sensory and control information in cyber-physical systems and vehicular networks as well as, job and resource allocation in cloud clusters. State-of-the-art approaches to analyzing the AoI rely on queueing models that are composed of one or many queuing systems endowed with service order, e.g., FIFO, LIFO, or last-generated-first-out order. A major difficulty arising in these analysis methods is capturing the AoI under message reordering when the delivery is non-preemptive and non-FIFO, i.e., when messages can overtake each other and the reception of informative messages may obsolete some messages that are underway. In this paper, we derive an exact formulation for the distribution of AoI in non-preemptive, non-FIFO systems where the main ingredients of our analysis are Palm calculus and time inversion. Owing to the rationality of the Laplace-Stieltjes transforms that are used in our approach, we obtain computable exact expressions for the distribution of AoI.


title: From graphs to DAGs: a low-complexity model and a scalable algorithm

abstract: Learning directed acyclic graphs (DAGs) is long known a critical challenge at the core of probabilistic and causal modeling. The NoTears approach of (Zheng et al., 2018), through a differentiable function involving the matrix exponential trace $\mathrm{tr}(\exp(\cdot))$, opens up a way to learning DAGs via continuous optimization, though with a $O(d^3)$ complexity in the number $d$ of nodes. This paper presents a low-complexity model, called LoRAM for Low-Rank Additive Model, which combines low-rank matrix factorization with a sparsification mechanism for the continuous optimization of DAGs. The main contribution of the approach lies in an efficient gradient approximation method leveraging the low-rank property of the model, and its straightforward application to the computation of projections from graph matrices onto the DAG matrix space. The proposed method achieves a reduction from a cubic complexity to quadratic complexity while handling the same DAG characteristic function as NoTears, and scales easily up to thousands of nodes for the projection problem. The experiments show that the LoRAM achieves efficiency gains of orders of magnitude compared to the state-of-the-art at the expense of a very moderate accuracy loss in the considered range of sparse matrices, and with a low sensitivity to the rank choice of the model's low-rank component.


title: Self-Supervised Audio-and-Text Pre-training with Extremely Low-Resource Parallel Data

abstract: Multimodal pre-training for audio-and-text has recently been proved to be effective and has significantly improved the performance of many downstream speech understanding tasks. However, these state-of-the-art pre-training audio-text models work well only when provided with large amount of parallel audio-and-text data, which brings challenges on many languages that are rich in unimodal corpora but scarce of parallel cross-modal corpus. In this paper, we investigate whether it is possible to pre-train an audio-text multimodal model with extremely low-resource parallel data and extra non-parallel unimodal data. Our pre-training framework consists of the following components: (1) Intra-modal Denoising Auto-Encoding (IDAE), which is able to reconstruct input text (audio) representations from a noisy version of itself. (2) Cross-modal Denoising Auto-Encoding (CDAE), which is pre-trained to reconstruct the input text (audio), given both a noisy version of the input text (audio) and the corresponding translated noisy audio features (text embeddings). (3) Iterative Denoising Process (IDP), which iteratively translates raw audio (text) and the corresponding text embeddings (audio features) translated from previous iteration into the new less-noisy text embeddings (audio features). We adapt a dual cross-modal Transformer as our backbone model which consists of two unimodal encoders for IDAE and two cross-modal encoders for CDAE and IDP. Our method achieves comparable performance on multiple downstream speech understanding tasks compared with the model pre-trained on fully parallel data, demonstrating the great potential of the proposed method. Our code is available at: \url{https://github.com/KarlYuKang/Low-Resource-Multimodal-Pre-training}.


title: Deep Embeddings for Robust User-Based Amateur Vocal Percussion Classification

abstract: Vocal Percussion Transcription (VPT) is concerned with the automatic detection and classification of vocal percussion sound events, allowing music creators and producers to sketch drum lines on the fly. Classifier algorithms in VPT systems learn best from small user-specific datasets, which usually restrict modelling to small input feature sets to avoid data overfitting. This study explores several deep supervised learning strategies to obtain informative feature sets for amateur vocal percussion classification. We evaluated the performance of these sets on regular vocal percussion classification tasks and compared them with several baseline approaches including feature selection methods and a speech recognition engine. These proposed learning models were supervised with several label sets containing information from four different levels of abstraction: instrument-level, syllable-level, phoneme-level, and boxeme-level. Results suggest that convolutional neural networks supervised with syllable-level annotations produced the most informative embeddings for classification, which can be used as input representations to fit classifiers with. Finally, we used back-propagation-based saliency maps to investigate the importance of different spectrogram regions for feature learning.


title: Self-tuning inflation

abstract: We develop an inflationary model without small parameters on the basis of multidimensional $f(R)$ gravity with a minimally coupled scalar field. The model is described by two stages of space expansion. The first one begins at energy scales about the D-dimensional Planck mass and ends with the de Sitter metric of our space and the maximally symmetric extra dimensions. In the following, the quantum fluctuations produce a wide set of inhomogeneous extra metrics in causally disconnected regions quickly generated in the de Sitter space. We find a specific extra space metric that leads to the effective Starobinsky model that fits the observational data.


title: Gaussian Processes for Missing Value Imputation

abstract: Missing values are common in many real-life datasets. However, most of the current machine learning methods can not handle missing values. This means that they should be imputed beforehand. Gaussian Processes (GPs) are non-parametric models with accurate uncertainty estimates that combined with sparse approximations and stochastic variational inference scale to large data sets. Sparse GPs can be used to compute a predictive distribution for missing data. Here, we present a hierarchical composition of sparse GPs that is used to predict missing values at each dimension using all the variables from the other dimensions. We call the approach missing GP (MGP). MGP can be trained simultaneously to impute all observed missing values. Specifically, it outputs a predictive distribution for each missing value that is then used in the imputation of other missing values. We evaluate MGP in one private clinical data set and four UCI datasets with a different percentage of missing values. We compare the performance of MGP with other state-of-the-art methods for imputing missing values, including variants based on sparse GPs and deep GPs. The results obtained show a significantly better performance of MGP.


title: Neutron spectroscopy evidence for a possible magnetic-field-induced gapless quantum-spin-liquid phase in a Kitaev material $\alpha$-RuCl$_3$

abstract: As one of the most promising Kitaev quantum-spin-liquid (QSL) candidates, $\alpha$-RuCl$_3$ has received a great amount of attention. However, its ground state exhibits a long-range zigzag magnetic order, which defies the QSL phase. Nevertheless, the magnetic order is fragile and can be completely suppressed by applying an external magnetic field. Here, we explore the evolution of magnetic excitations of $\alpha$-RuCl$_3$ under an in-plane magnetic field, by carrying out inelastic neutron scattering measurements on high-quality single crystals. Under zero field, there exist spin-wave excitations near the $M$ point and a continuum near the $\mit\Gamma$ point, which are believed to be associated with the zigzag magnetic order and fractional excitations of the Kitaev QSL state, respectively. By increasing the magnetic field, the spin-wave excitations gradually give way to the continuous excitations. On the verge of the critical field $\mu_0H_{\rm c}=7.5$ T, the former vanish and only the latter is left, indicating the emergence of a pure QSL state. By further increasing the field strength, the excitations near the $\mit\Gamma$ point become more intense. By following the gap evolution of the excitations near the $\mit\Gamma$ point, we are able to establish a phase diagram composed of three interesting phases, including a gapped zigzag order phase at low fields, possibly-gapless QSL phase near $\mu_0H_{\rm c}$, and gapped partially polarized phase at high fields. These results demonstrate that an in-plane magnetic field can drive $\alpha$-RuCl$_3$ into a long-sought QSL state near the critical field.


title: Maximum principal ratio of the signless Laplacian of graphs

abstract: Let $G$ be a connected graph and $Q(G)$ be the signless Laplacian of $G$. The principal ratio $\gamma(G)$ of $Q(G)$ is the ratio of the maximum and minimum entries of the Perron vector of $Q(G)$. In this paper, we consider the maximum principal ratio $\gamma(G)$ among all connected graphs of order $n$, and show that for sufficiently large $n$ the extremal graph is a kite graph obtained by identifying an end vertex of a path to any vertex of a complete graph.


title: Deep Conditional Representation Learning for Drum Sample Retrieval by Vocalisation

abstract: Imitating musical instruments with the human voice is an efficient way of communicating ideas between music producers, from sketching melody lines to clarifying desired sonorities. For this reason, there is an increasing interest in building applications that allow artists to efficiently pick target samples from big sound libraries just by imitating them vocally. In this study, we investigated the potential of conditional autoencoder models to learn informative features for Drum Sample Retrieval by Vocalisation (DSRV). We assessed the usefulness of their embeddings using four evaluation metrics, two of them relative to their acoustic properties and two of them relative to their perceptual properties via human listeners' similarity ratings. Results suggest that models conditioned on both sound-type labels (drum vs imitation) and drum-type labels (kick vs snare vs closed hi-hat vs opened hi-hat) learn the most informative embeddings for DSRV. We finally looked into individual differences in vocal imitation style via the Mantel test and found salient differences among participants, highlighting the importance of user information when designing DSRV systems.


title: Large deviations in chaotic systems: exact results and dynamical phase transition

abstract: Large deviations in chaotic dynamics have potentially significant and dramatic consequences. We study large deviations of series of finite lengths $N$ generated by chaotic maps. The distributions generally display an exponential decay with $N$, associated with large-deviation (rate) functions. We obtain the exact rate functions analytically for the doubling, tent, and logistic maps. For the latter two, the solution is given as a power series whose coefficients can be systematically calculated to any order. We also obtain the rate function for the cat map numerically, uncovering strong evidence for the existence of a remarkable singularity of it that we interpret as a second order dynamical phase transition. Furthermore, we develop a numerical tool for efficiently simulating atypical realizations of sequences if the chaotic map is not invertible, and we apply it to the tent and logistic maps.


title: Counting in the 2020s: Binned Representations and Inclusive Performance Measures for Deep Crowd Counting Approaches

abstract: The data distribution in popular crowd counting datasets is typically heavy tailed and discontinuous. This skew affects all stages within the pipelines of deep crowd counting approaches. Specifically, the approaches exhibit unacceptably large standard deviation wrt statistical measures (MSE, MAE). To address such concerns in a holistic manner, we make two fundamental contributions. Firstly, we modify the training pipeline to accommodate the knowledge of dataset skew. To enable principled and balanced minibatch sampling, we propose a novel smoothed Bayesian binning approach. More specifically, we propose a novel cost function which can be readily incorporated into existing crowd counting deep networks to encourage bin-aware optimization. As the second contribution, we introduce additional performance measures which are more inclusive and throw light on various comparative performance aspects of the deep networks. We also show that our binning-based modifications retain their superiority wrt the newly proposed performance measures. Overall, our contributions enable a practically useful and detail-oriented characterization of performance for crowd counting approaches.


title: Fashionformer: A simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition

abstract: Human fashion understanding is one crucial computer vision task since it has comprehensive information for real-world applications. This focus on joint human fashion segmentation and attribute recognition. Contrary to the previous works that separately model each task as a multi-head prediction problem, our insight is to bridge these two tasks with one unified model via vision transformer modeling to benefit each task. In particular, we introduce the object query for segmentation and the attribute query for attribute prediction. Both queries and their corresponding features can be linked via mask prediction. Then we adopt a two-stream query learning framework to learn the decoupled query representations.We design a novel Multi-Layer Rendering module for attribute stream to explore more fine-grained features. The decoder design shares the same spirit as DETR. Thus we name the proposed method \textit{Fahsionformer}. Extensive experiments on three human fashion datasets illustrate the effectiveness of our approach. In particular, our method with the same backbone achieve \textbf{relative 10\% improvements} than previous works in case of \textit{a joint metric (AP$^{\text{mask}}_{\text{IoU+F}_1}$) for both segmentation and attribute recognition}. To the best of our knowledge, we are the first unified end-to-end vision transformer framework for human fashion analysis. We hope this simple yet effective method can serve as a new flexible baseline for fashion analysis. Code is available at https://github.com/xushilin1/FashionFormer.


title: Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentation

abstract: Panoptic Part Segmentation (PPS) aims to unify panoptic segmentation and part segmentation into one task. Previous work mainly utilizes separated approaches to handle thing, stuff, and part predictions individually without performing any shared computation and task association. In this work, we aim to unify these tasks at the architectural level, designing the first end-to-end unified method named Panoptic-PartFormer. In particular, motivated by the recent progress in Vision Transformer, we model things, stuff, and part as object queries and directly learn to optimize the all three predictions as unified mask prediction and classification problem. We design a decoupled decoder to generate part feature and thing/stuff feature respectively. Then we propose to utilize all the queries and corresponding features to perform reasoning jointly and iteratively. The final mask can be obtained via inner product between queries and the corresponding features. The extensive ablation studies and analysis prove the effectiveness of our framework. Our Panoptic-PartFormer achieves the new state-of-the-art results on both Cityscapes PPS and Pascal Context PPS datasets with at least 70% GFlops and 50% parameters decrease. In particular, we get 3.4% relative improvements with ResNet50 backbone and 10% improvements after adopting Swin Transformer on Pascal Context PPS dataset. To the best of our knowledge, we are the first to solve the PPS problem via \textit{a unified and end-to-end transformer model. Given its effectiveness and conceptual simplicity, we hope our Panoptic-PartFormer can serve as a good baseline and aid future unified research for PPS. Our code and models are available at https://github.com/lxtGH/Panoptic-PartFormer.


title: Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation

abstract: This paper presents Video K-Net, a simple, strong, and unified framework for fully end-to-end video panoptic segmentation. The method is built upon K-Net, a method that unifies image segmentation via a group of learnable kernels. We observe that these learnable kernels from K-Net, which encode object appearances and contexts, can naturally associate identical instances across video frames. Motivated by this observation, Video K-Net learns to simultaneously segment and track "things" and "stuff" in a video with simple kernel-based appearance modeling and cross-temporal kernel interaction. Despite the simplicity, it achieves state-of-the-art video panoptic segmentation results on Citscapes-VPS, KITTI-STEP, and VIPSeg without bells and whistles. In particular, on KITTI-STEP, the simple method can boost almost 12\% relative improvements over previous methods. On VIPSeg, Video K-Net boosts almost 15\% relative improvements and results in 39.8 % VPQ. We also validate its generalization on video semantic segmentation, where we boost various baselines by 2\% on the VSPW dataset. Moreover, we extend K-Net into clip-level video framework for video instance segmentation, where we obtain 40.5% mAP for ResNet50 backbone and 54.1% mAP for Swin-base on YouTube-2019 validation set. We hope this simple, yet effective method can serve as a new, flexible baseline in unified video segmentation design. Both code and models are released at https://github.com/lxtGH/Video-K-Net.


title: Tunable Magnetic Scattering and Ferroelectric Switching at the LaAlO$_3$/EuTiO$_3$/Sr$_{0.99}$Ca$_{0.01}$TiO$_3$ Interface

abstract: Ferroelectric and ferromagnetic orders rarely coexist, and magnetoelectric coupling is even more scarce. A possible avenue for combining these orders is by interface design, where orders formed at the constituent materials can overlap and interact. Using a combination of magneto-transport and scanning SQUID measurements, we explore the interactions between ferroelectricity, magnetism, and the 2D electron system (2DES) formed at the novel LaAlO$_3$/EuTiO$_3$/Sr$_{0.99}$Ca$_{0.01}$TiO$_3$ heterostructure. We find that the electrons at the interface experience magnetic scattering appearing along with a diverging Curie-Weiss-type behaviour in the EuTiO$_3$ layer. The 2DES is also affected by the switchable ferroelectric polarization at the Sr$_{0.99}$Ca$_{0.01}$TiO$_3$ bulk. While the 2DES interacts with both magnetism and ferroelectricity, we show that the presence of the conducting electrons has no effect on magnetization in the EuTiO$_3$ layer. Our results provide a first step towards realizing a new multiferroic system where magnetism and ferroelectricity can interact via an intermediate conducting layer.


title: Flag matroids with coefficients

abstract: This paper is a direct generalization of Baker-Bowler theory to flag matroids, including its moduli interpretation as developed by Baker and the second author for matroids. More explicitly, we extend the notion of flag matroids to flag matroids over any tract, provide cryptomorphic descriptions in terms of basis axioms (Grassmann-Pl\"ucker functions), circuit/vector axioms and dual pairs, including additional characterizations in the case of perfect tracts. We establish duality of flag matroids and construct minors. Based on the theory of ordered blue schemes, we introduce flag matroid bundles and construct their moduli space, which leads to algebro-geometric descriptions of duality and minors. Taking rational points recovers flag varieties in several geometric contexts: over (topological) fields, in tropical geometry, and as a generalization of the MacPhersonian.


title: Amalgamation of Indirect Gamification into Development and Operations (DEVOPS) Course Teaching

abstract: In DevOps Course, the Installation and configuration of the various software tools are useful in the context of application development. To teach DevOps Tools precisely to achieve the learning outcome is a skilled task for a trainer. From the perspective of the learner, the learning environment has to be encouraging and exciting. The author used the third-party Competition as an indirect Gamification technique to achieve the learning outcomes of the Course. The author encouraged the students to participate in the Hacktoberfest Competition to use the practical skills learned in the Course. The Under Graduate and Post Graduate Students have gone through the regular sessions of DevOps. For the participation purpose, both groups of students communicated on one platform. The students who succeeded faster during the GitHub Pull Request submission shared their experiences with other participants. The PG students participated 68.75% higher than UG students. The active participation of the small number of UG students became a motivational factor for the PG students. The Gaussian distribution on the marks obtained by the experimental group shows the absence of outliers. The research shows that the effectiveness of indirect Gamification depends on the age group, level, course content, and learning environment. The participation of a faculty member in the Competition during the learning activity boosts the desire of the Student to complete the task. The experimental group of 15 Students has outperformed in terms of the marks obtained compared to the control group of 52 students.


title: Measuring the randomness of micro and nanostructure spatial distributions: Effects of Scanning Electron Microscope image processing and analysis

abstract: The quantitative characterization of the degree of randomness and aggregation of surface micro and nanostructures is critical to evaluate their effects on targeted functionalities. To this end, the methods of Point Pattern Analysis (PPA), largely used in ecology and medical imaging, seem to provide a powerful toolset. However, the application of these techniques requires the extraction of the point pattern of nanostructures from their microscope images. In this work, we address the issue of the impact that Scanning Electron Microscope (SEM) image processing may have on the fundamental metric of PPA, i.e. the Nearest Neighbour Index (NNI). Using as examples two typical SEM images of polymer micro- and nanostructures taken from secondary and backscattered electrons, we report the effects of the a) noise filtering and b) binarization threshold on the value of NNI as well as the impact of the image finite size effects. Based on these results, we draw conclusions for the safe choice of SEM settings to provide accurate measurement of nanostructure randomness through NNI estimation.


title: Expressiveness and Approximation Properties of Graph Neural Networks

abstract: Characterizing the separation power of graph neural networks (GNNs) provides an understanding of their limitations for graph learning tasks. Results regarding separation power are, however, usually geared at specific GNN architectures, and tools for understanding arbitrary GNN architectures are generally lacking. We provide an elegant way to easily obtain bounds on the separation power of GNNs in terms of the Weisfeiler-Leman (WL) tests, which have become the yardstick to measure the separation power of GNNs. The crux is to view GNNs as expressions in a procedural tensor language describing the computations in the layers of the GNNs. Then, by a simple analysis of the obtained expressions, in terms of the number of indexes and the nesting depth of summations, bounds on the separation power in terms of the WL-tests readily follow. We use tensor language to define Higher-Order Message-Passing Neural Networks (or k-MPNNs), a natural extension of MPNNs. Furthermore, the tensor language point of view allows for the derivation of universality results for classes of GNNs in a natural way. Our approach provides a toolbox with which GNN architecture designers can analyze the separation power of their GNNs, without needing to know the intricacies of the WL-tests. We also provide insights in what is needed to boost the separation power of GNNs.


title: FOSTER: Feature Boosting and Compression for Class-Incremental Learning

abstract: The ability to learn new concepts continually is necessary in this ever-changing world. However, deep neural networks suffer from catastrophic forgetting when learning new categories. Many works have been proposed to alleviate this phenomenon, whereas most of them either fall into the stability-plasticity dilemma or take too much computation or storage overhead. Inspired by the gradient boosting algorithm to gradually fit the residuals between the target model and the previous ensemble model, we propose a novel two-stage learning paradigm FOSTER, empowering the model to learn new categories adaptively. Specifically, we first dynamically expand new modules to fit the residuals between the target and the output of the original model. Next, we remove redundant parameters and feature dimensions through an effective distillation strategy to maintain the single backbone model. We validate our method FOSTER on CIFAR-100 and ImageNet-100/1000 under different settings. Experimental results show that our method achieves state-of-the-art performance. Code is available at: https://github.com/G-U-N/ECCV22-FOSTER.


title: A note on "exotic integrals"

abstract: We consider Bernoulli measures $\mu_p$ on the interval $[0,1]$. For the standard Lebesgue measure the digits $0$ and $1$ in the binary representation of real numbers appear with an equal probability $1/2$. For the Bernoulli measures, the digits $0$ and $1$ appear with probabilities $p$ and $1-p$, respectively. We provide explicit expressions for various $\mu_p$-integrals. In particular, integrals of polynomials are expressed in terms of the determinants of special Hessenberg matrices, which, in turn, are constructed from the Pascal matrices of binomial coefficients. This allows us to find closed-form expressions for the Fourier coefficients of $\mu_p$ in the Legendre polynomial basis. At the same time, the trigonometric Fourier coefficients are values of some special entire function, which admits an explicit infinite product expansion and satisfies interesting properties, including connections with the Stirling numbers and the polylogarithm.


title: Optimization of IoT-Enabled Physical Location Monitoring Using DT and VAR

abstract: This study shows an enhancement of IoT that gets sensor data and performs real-time face recognition to screen physical areas to find strange situations and send an alarm mail to the client to make remedial moves to avoid any potential misfortune in the environment. Sensor data is pushed onto the local system and GoDaddy Cloud whenever the camera detects a person to optimize the physical location monitoring system by reducing the bandwidth requirement and storage cost onto the cloud using edge computation. The study reveals that decision tree (DT) and random forest give reasonably similar macro average f1-scores to predict a person using sensor data. Experimental results show that DT is the most reliable predictive model for the cloud datasets of three different physical locations to predict a person using timestamp with an accuracy of 83.99%, 88.92%, and 80.97%. This study also explains multivariate time series prediction using vector auto regression that gives reasonably good root mean squared error to predict temperature, humidity, light-dependent resistor, and gas time series.


title: Effective Out-of-Distribution Detection in Classifier Based on PEDCC-Loss

abstract: Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. Thus, it is an urgent and challenging task to detect these samples drawn far away from training distribution based on the security considerations of artificial intelligence. Many current methods based on neural networks mainly rely on complex processing strategies, such as temperature scaling and input preprocessing, to obtain satisfactory results. In this paper, we propose an effective algorithm for detecting out-of-distribution examples utilizing PEDCC-Loss. We mathematically analyze the nature of the confidence score output by the PEDCC (Predefined Evenly-Distribution Class Centroids) classifier, and then construct a more effective scoring function to distinguish in-distribution (ID) and out-of-distribution. In this method, there is no need to preprocess the input samples and the computational burden of the algorithm is reduced. Experiments demonstrate that our method can achieve better OOD detection performance.


title: Energy-Sensitive Trajectory Design and Restoration Areas Allocation for UAV-Enabled Grassland Restoration

abstract: Grassland restoration is a critical means to safeguard grassland ecological degradation. To alleviate the extensive human labors and boost the restoration efficiency, UAV is promising for its fully automatic capability yet still waits to be exploited. This paper progresses this emerging technology by explicitly considering the realistic constraints of the UAV and the grassland degradation while planning the grassland restoration. To this end, the UAV-enabled restoration process is first mathematically modeled as the maximization of restoration areas of the UAV under the limited battery energy of UAV, the grass seeds weight, the number of restored areas, and the corresponding sizes. Then we analyze that, by considering these constraints, this original problem emerges two conflict objectives, namely the shortest flight path and the optimal areas allocation. As a result, the maximization of restoration areas turns out to be a composite of a trajectory design problem and an areas allocation problem that are highly coupled. From the perspective of optimization, this requires solving two NP-hard problems of both the traveling salesman problem (TSP) and the multidimensional knapsack problem (MKP) at the same time. To tackle this complex problem, we propose a cooperative optimization algorithm, called CHAPBILM, to solve those two problems interlacedly by utilizing the interdependencies between them. Multiple simulations verify the conflicts between the trajectory design and areas allocation. The effectiveness of the cooperative optimization algorithm is also supported by the comparisons with traditional optimization methods which do not utilize the interdependencies between the two problems. As a result, the proposed algorithm successfully solves the multiple simulation instances in a near-optimal way.


title: Linear Complexity Randomized Self-attention Mechanism

abstract: Recently, random feature attentions (RFAs) are proposed to approximate the softmax attention in linear time and space complexity by linearizing the exponential kernel. In this paper, we first propose a novel perspective to understand the bias in such approximation by recasting RFAs as self-normalized importance samplers. This perspective further sheds light on an \emph{unbiased} estimator for the whole softmax attention, called randomized attention (RA). RA constructs positive random features via query-specific distributions and enjoys greatly improved approximation fidelity, albeit exhibiting quadratic complexity. By combining the expressiveness in RA and the efficiency in RFA, we develop a novel linear complexity self-attention mechanism called linear randomized attention (LARA). Extensive experiments across various domains demonstrate that RA and LARA significantly improve the performance of RFAs by a substantial margin.


title: NAN: Noise-Aware NeRFs for Burst-Denoising

abstract: Burst denoising is now more relevant than ever, as computational photography helps overcome sensitivity issues inherent in mobile phones and small cameras. A major challenge in burst-denoising is in coping with pixel misalignment, which was so far handled with rather simplistic assumptions of simple motion, or the ability to align in pre-processing. Such assumptions are not realistic in the presence of large motion and high levels of noise. We show that Neural Radiance Fields (NeRFs), originally suggested for physics-based novel-view rendering, can serve as a powerful framework for burst denoising. NeRFs have an inherent capability of handling noise as they integrate information from multiple images, but they are limited in doing so, mainly since they build on pixel-wise operations which are suitable to ideal imaging conditions. Our approach, termed NAN, leverages inter-view and spatial information in NeRFs to better deal with noise. It achieves state-of-the-art results in burst denoising and is especially successful in coping with large movement and occlusions, under very high levels of noise. With the rapid advances in accelerating NeRFs, it could provide a powerful platform for denoising in challenging environments.


title: Generalized Calogero-Sutherland models for Kondo physics in the Luttinger liquid

abstract: We propose a series of models with inverse-square interactions, for which the ground states have an exact closed form, that describe one localized spin-$1/2$ Kondo impurity coupled to Luttinger liquids of itinerant bosons or fermions in the continuum or on a lattice. The model Hamiltonians contain two parts: a two-component Calogero-Sutherland model with open boundary condition in the continuum or a long-range $t \textendash J$-type model on the lattice, and long-range Kondo couplings between the impurity and the particles. The wave functions of the ground states in a certain basis have Jastrow product forms with powers depending on the particle statistics. It is shown that the wave functions can be expressed as chiral correlators of certain conformal field theories, which reveals that the particles are fractionalized to fully screen the Kondo impurity. This insight would be very useful in future studies on the very difficult problem of Kondo physics with interacting baths.


title: Active Learning with Label Comparisons

abstract: Supervised learning typically relies on manual annotation of the true labels. When there are many potential classes, searching for the best one can be prohibitive for a human annotator. On the other hand, comparing two candidate labels is often much easier. We focus on this type of pairwise supervision and ask how it can be used effectively in learning, and in particular in active learning. We obtain several insightful results in this context. In principle, finding the best of $k$ labels can be done with $k-1$ active queries. We show that there is a natural class where this approach is sub-optimal, and that there is a more comparison-efficient active learning scheme. A key element in our analysis is the "label neighborhood graph" of the true distribution, which has an edge between two classes if they share a decision boundary. We also show that in the PAC setting, pairwise comparisons cannot provide improved sample complexity in the worst case. We complement our theoretical results with experiments, clearly demonstrating the effect of the neighborhood graph on sample complexity.


title: Kripke Contexts, Double Boolean Algebras with Operators and Corresponding Modal Systems

abstract: The notion of a context in formal concept analysis and that of an approximation space in rough set theory are unified in this study to define a Kripke context. For any context (G,M,I), a relation on the set G of objects and a relation on the set M of properties are included, giving a structure of the form ((G,R), (M,S), I). A Kripke context gives rise to complex algebras based on the collections of protoconcepts and semiconcepts of the underlying context. On abstraction, double Boolean algebras (dBas) with operators and topological dBas are defined. Representation results for these algebras are established in terms of the complex algebras of an appropriate Kripke context. As a natural next step, logics corresponding to classes of these algebras are formulated. A sequent calculus is proposed for contextual dBas, modal extensions of which give logics for contextual dBas with operators and topological contextual dBas. The representation theorems for the algebras result in a protoconcept-based semantics for these logics.


title: Dynamical Minimal Flavour Violating Inverse Seesaw

abstract: The Inverse Seesaw mechanism is dynamically realised within the Minimal Lepton Flavour Violation context. Lepton number, whose breaking is spontaneously realised, is generalised to a global Abelian factor of the whole flavour symmetry, that also plays the role of the Peccei-Quinn symmetry. The associated Goldstone boson is a Majoraxion that solves the Strong CP problem and represents a Dark Matter candidate. Three distinct scenarios are identified in terms of flavour symmetry and transformation properties of the exotic neutral leptons that enrich the Standard Model spectrum. The associated phenomenology is studied, focusing on the deviations from unitarity of the PMNS mixing matrix. The strongest constraints arise from the determination of the number of active neutrinos through the invisible width of the $Z$, the comparison of the measured $W$ boson mass with its prediction in terms of the Fermi constant from muon decay, and the null searches for the radiative rare muon decay and $\mu\to e$ conversion in nuclei. The heavy neutral leptons may have masses of a few TeV, leaving open the possibility for a direct detection at future colliders. The impact of the recent measurement of the $W$ mass at the CDF II detector has also been considered, which, in one of the scenarios, points to a sharp prediction for the masses of the heavy neutral leptons at about $2-3$ TeV.


title: Optimal long-time decay rate of solutions of complete monotonicity-preserving schemes for nonlinear time-fractional evolutionary equations

abstract: The solution of the nonlinear initial-value problem $\mathcal{D}_{t}^{\alpha}y(t)=-\lambda y(t)^{\gamma}$ for $t>0$ with $y(0)>0$, where $\mathcal{D}_{t}^{\alpha}$ is a Caputo derivative of order $\alpha\in (0,1)$ and $\lambda, \gamma$ are positive parameters, is known to exhibit $O(t^{\alpha/\gamma})$ decay as $t\to\infty$. No corresponding result for any discretisation of this problem has previously been proved. In the present paper it is shown that for the class of complete monotonicity-preserving ($\mathcal{CM}$-preserving) schemes (which includes the L1 and Gr\"unwald-Letnikov schemes) on uniform meshes $\{t_n:=nh\}_{n=0}^\infty$, the discrete solution also has $O(t_{n}^{-\alpha/\gamma})$ decay as $t_{n}\to\infty$. This result is then extended to $\mathcal{CM}$-preserving discretisations of certain time-fractional nonlinear subdiffusion problems such as the time-fractional porous media and $p$-Laplace equations. For the L1 scheme, the $O(t_{n}^{-\alpha/\gamma})$ decay result is shown to remain valid on a very general class of nonuniform meshes. Our analysis uses a discrete comparison principle with discrete subsolutions and supersolutions that are carefully constructed to give tight bounds on the discrete solution. Numerical experiments are provided to confirm our theoretical analysis.


title: Is my Driver Observation Model Overconfident? Input-guided Calibration Networks for Reliable and Interpretable Confidence Estimates

abstract: Driver observation models are rarely deployed under perfect conditions. In practice, illumination, camera placement and type differ from the ones present during training and unforeseen behaviours may occur at any time. While observing the human behind the steering wheel leads to more intuitive human-vehicle-interaction and safer driving, it requires recognition algorithms which do not only predict the correct driver state, but also determine their prediction quality through realistic and interpretable confidence measures. Reliable uncertainty estimates are crucial for building trust and are a serious obstacle for deploying activity recognition networks in real driving systems. In this work, we for the first time examine how well the confidence values of modern driver observation models indeed match the probability of the correct outcome and show that raw neural network-based approaches tend to significantly overestimate their prediction quality. To correct this misalignment between the confidence values and the actual uncertainty, we consider two strategies. First, we enhance two activity recognition models often used for driver observation with temperature scaling-an off-the-shelf method for confidence calibration in image classification. Then, we introduce Calibrated Action Recognition with Input Guidance (CARING)-a novel approach leveraging an additional neural network to learn scaling the confidences depending on the video representation. Extensive experiments on the Drive&Act dataset demonstrate that both strategies drastically improve the quality of model confidences, while our CARING model out-performs both, the original architectures and their temperature scaling enhancement, leading to best uncertainty estimates.


title: Generalized Drazin-Riesz invertible elements in a semi-simple Banach algebra

abstract: We extend the notion of generalized Drazin-Riesz inverse introduced for bounded linear operators in \cite{Ziv} to elements in a complex unital semi-simple Banach algebra. Several characterizations and properties of generalized Drazin-Riesz invertible elements are given. In particular, we extend those of \cite{AbZg1,Djor,Ziv}.


title: Simple Baselines for Image Restoration

abstract: Although there have been significant advances in the field of image restoration recently, the system complexity of the state-of-the-art (SOTA) methods is increasing as well, which may hinder the convenient analysis and comparison of methods. In this paper, we propose a simple baseline that exceeds the SOTA methods and is computationally efficient. To further simplify the baseline, we reveal that the nonlinear activation functions, e.g. Sigmoid, ReLU, GELU, Softmax, etc. are not necessary: they could be replaced by multiplication or removed. Thus, we derive a Nonlinear Activation Free Network, namely NAFNet, from the baseline. SOTA results are achieved on various challenging benchmarks, e.g. 33.69 dB PSNR on GoPro (for image deblurring), exceeding the previous SOTA 0.38 dB with only 8.4% of its computational costs; 40.30 dB PSNR on SIDD (for image denoising), exceeding the previous SOTA 0.28 dB with less than half of its computational costs. The code and the pre-trained models are released at https://github.com/megvii-research/NAFNet.


title: FedCorr: Multi-Stage Federated Learning for Label Noise Correction

abstract: Federated learning (FL) is a privacy-preserving distributed learning paradigm that enables clients to jointly train a global model. In real-world FL implementations, client data could have label noise, and different clients could have vastly different label noise levels. Although there exist methods in centralized learning for tackling label noise, such methods do not perform well on heterogeneous label noise in FL settings, due to the typically smaller sizes of client datasets and data privacy requirements in FL. In this paper, we propose $\texttt{FedCorr}$, a general multi-stage framework to tackle heterogeneous label noise in FL, without making any assumptions on the noise models of local clients, while still maintaining client data privacy. In particular, (1) $\texttt{FedCorr}$ dynamically identifies noisy clients by exploiting the dimensionalities of the model prediction subspaces independently measured on all clients, and then identifies incorrect labels on noisy clients based on per-sample losses. To deal with data heterogeneity and to increase training stability, we propose an adaptive local proximal regularization term that is based on estimated local noise levels. (2) We further finetune the global model on identified clean clients and correct the noisy labels for the remaining noisy clients after finetuning. (3) Finally, we apply the usual training on all clients to make full use of all local data. Experiments conducted on CIFAR-10/100 with federated synthetic label noise, and on a real-world noisy dataset, Clothing1M, demonstrate that $\texttt{FedCorr}$ is robust to label noise and substantially outperforms the state-of-the-art methods at multiple noise levels.


title: Parallelized integrated nested Laplace approximations for fast Bayesian inference

abstract: There is a growing demand for performing larger-scale Bayesian inference tasks, arising from greater data availability and higher-dimensional model parameter spaces. In this work we present parallelization strategies for the methodology of integrated nested Laplace approximations (INLA), a popular framework for performing approximate Bayesian inference on the class of Latent Gaussian models. Our approach makes use of nested OpenMP parallelism, a parallel line search procedure using robust regression in INLA's optimization phase and the state-of-the-art sparse linear solver PARDISO. We leverage mutually independent function evaluations in the algorithm as well as advanced sparse linear algebra techniques. This way we can flexibly utilize the power of today's multi-core architectures. We demonstrate the performance of our new parallelization scheme on a number of different real-world applications. The introduction of parallelism leads to speedups of a factor 10 and more for all larger models. Our work is already integrated in the current version of the open-source R-INLA package, making its improved performance conveniently available to all users.


title: Scale Invariant Semantic Segmentation with RGB-D Fusion

abstract: In this paper, we propose a neural network architecture for scale-invariant semantic segmentation using RGB-D images. We utilize depth information as an additional modality apart from color images only. Especially in an outdoor scene which consists of different scale objects due to the distance of the objects from the camera. The near distance objects consist of significantly more pixels than the far ones. We propose to incorporate depth information to the RGB data for pixel-wise semantic segmentation to address the different scale objects in an outdoor scene. We adapt to a well-known DeepLab-v2(ResNet-101) model as our RGB baseline. Depth images are passed separately as an additional input with a distinct branch. The intermediate feature maps of both color and depth image branch are fused using a novel fusion block. Our model is compact and can be easily applied to the other RGB model. We perform extensive qualitative and quantitative evaluation on a challenging dataset Cityscapes. The results obtained are comparable to the state-of-the-art. Additionally, we evaluated our model on a self-recorded real dataset. For the shake of extended evaluation of a driving scene with ground truth we generated a synthetic dataset using popular vehicle simulation project CARLA. The results obtained from the real and synthetic dataset shows the effectiveness of our approach.


title: Reasoning with Multi-Structure Commonsense Knowledge in Visual Dialog

abstract: Visual Dialog requires an agent to engage in a conversation with humans grounded in an image. Many studies on Visual Dialog focus on the understanding of the dialog history or the content of an image, while a considerable amount of commonsense-required questions are ignored. Handling these scenarios depends on logical reasoning that requires commonsense priors. How to capture relevant commonsense knowledge complementary to the history and the image remains a key challenge. In this paper, we propose a novel model by Reasoning with Multi-structure Commonsense Knowledge (RMK). In our model, the external knowledge is represented with sentence-level facts and graph-level facts, to properly suit the scenario of the composite of dialog history and image. On top of these multi-structure representations, our model can capture relevant knowledge and incorporate them into the vision and semantic features, via graph-based interaction and transformer-based fusion. Experimental results and analysis on VisDial v1.0 and VisDialCK datasets show that our proposed model effectively outperforms comparative methods.


title: Enhancing the Robustness, Efficiency, and Diversity of Differentiable Architecture Search

abstract: Differentiable architecture search (DARTS) has attracted much attention due to its simplicity and significant improvement in efficiency. However, the excessive accumulation of the skip connection makes it suffer from long-term weak stability and low robustness. Many works attempt to restrict the accumulation of skip connections by indicators or manual design, however, these methods are susceptible to thresholds and human priors. In this work, we suggest a more subtle and direct approach that removes skip connections from the operation space. Then, by introducing an adaptive channel allocation strategy, we redesign the DARTS framework to automatically refill the skip connections in the evaluation stage, resolving the performance degradation caused by the absence of skip connections. Our method, dubbed Adaptive-Channel-Allocation-DARTS (ACA-DRATS), could eliminate the inconsistency in operation strength and significantly expand the architecture diversity. We continue to explore smaller search space under our framework, and offer a direct search on the entire ImageNet dataset. Experiments show that ACA-DRATS improves the search stability and significantly speeds up DARTS by more than ten times while yielding higher accuracy.


title: Chaotic Excitations of Rogue Waves in Stable Parametric Region for Highly-Energetic Pair Plasmas

abstract: We have studied the Rogue wave existence and propagation in Ion-acoustic mode for the highly energetic case using kappa distributed electrons in accordance with the Korteweg de Vries equation that is modified KdV and extended KdV equation. We have used reductive perturbation method. We first examined the linear dispersive behaviour in Ionacoustic mode. Obtaining the Nonlinear Schrodinger equation, we simulated Rogue wave and examined dynamics of it, and its response to small perturbations. We discussed the possibility of generation of Rogue wave as well as the stability of this against various parameters like wave number, spatial and time component. This study is quite helpful for understanding some prominent points of the nonlinearity of IA waves and Rogue wave generation of the highly energetic case in space plasma also in a laboratory plasma.


title: Nilpotent Symmetries of a Modified Massive Abelian 3-Form Theory: Augmented Superfield Approach

abstract: We derive the off-shell nilpotent and absolutely anticommuting (anti-)BRST symmetry transformations for any arbitrary D-dimensional St$\ddot u$ckelberg-modified massive Abelian 3-form theory within the framework of augmented version of superfield approach (AVSA) to Becchi-Rouet-Stora-Tyutin (BRST) formalism where, in addition to the horizontality condition (HC), we exploit the theoretical strength of the gauge invariant restriction (GIR) to deduce the proper transformations for the gauge, associated (anti-)ghost fields, auxiliary fields, St$\ddot u$ckelberg compensating field, etc. In fact, it is an elegant and delicate combination of HC and GIR (within the ambit of AVSA) that is crucial for all our discussions and derivations. One of the highlights of our present endeavor is the deduction of a new set of (anti-)BRST invariant Curci-Ferrari (CF)-type restrictions which are not found in the massless version of our present theory where only the HC plays an important role in the derivation of all the (anti-)BRST transformations and a very specific set of CF-type restrictions. The alternative ways of the derivation of the full set of the latter, from various theoretical considerations, are also interesting results of our present investigation.


title: Rates of mixing for the measure of maximal entropy of dispersing billiard maps

abstract: In a recent work, Baladi and Demers constructed a measure of maximal entropy for finite horizon dispersing billiard maps and proved that it is unique, mixing and moreover Bernoulli. We show that this measure enjoys natural probabilistic properties for H\"older continuous observables, such as at least polynomial decay of correlations and the Central Limit Theorem. The results of Baladi and Demers are subject to a condition of sparse recurrence to singularities. We use a similar and slightly stronger condition, and it has a direct effect on our rate of decay of correlations. For billiard tables with bounded complexity (a property conjectured to be generic), we show that the sparse recurrence condition is always satisfied and the correlations decay at a super-polynomial rate.


title: EPTAS for the dual of splittable bin packing with cardinality constraint

abstract: The problem considered is the splittable bin packing with cardinality constraint. It is a variant of the bin packing problem where items are allowed to be split into parts but the number of parts in each bin is at most a given upper bound. Two versions of the splittable bin packing with cardinality constraint have been studied in the literature. Among these variants we consider the dual one where the objective is to minimize the maximum bin size while packing (may be fractional) the items to a given set of bins. We exhibit an EPTAS for the dual problem when the cardinality upper bound is part of the input. This result answers an open question raised by Epstein, Levin, and van Stee.


title: DISK: Domain-constrained Instance Sketch for Math Word Problem Generation

abstract: A math word problem (MWP) is a coherent narrative which reflects the underlying logic of math equations. Successful MWP generation can automate the writing of mathematics questions. Previous methods mainly generate MWP text based on inflexible pre-defined templates. In this paper, we propose a neural model for generating MWP text from math equations. Firstly, we incorporate a matching model conditioned on the domain knowledge to retrieve a MWP instance which is most consistent with the ground-truth, where the domain is a latent variable extracted with a domain summarizer. Secondly, by constructing a Quantity Cell Graph (QCG) from the retrieved MWP instance and reasoning over it, we improve the model's comprehension of real-world scenarios and derive a domain-constrained instance sketch to guide the generation. Besides, the QCG also interacts with the equation encoder to enhance the alignment between math tokens (e.g., quantities and variables) and MWP text. Experiments and empirical analysis on educational MWP set show that our model achieves impressive performance in both automatic evaluation metrics and human evaluation metrics.


title: MA-Dreamer: Coordination and communication through shared imagination

abstract: Multi-agent RL is rendered difficult due to the non-stationary nature of environment perceived by individual agents. Theoretically sound methods using the REINFORCE estimator are impeded by its high-variance, whereas value-function based methods are affected by issues stemming from their ad-hoc handling of situations like inter-agent communication. Methods like MADDPG are further constrained due to their requirement of centralized critics etc. In order to address these issues, we present MA-Dreamer, a model-based method that uses both agent-centric and global differentiable models of the environment in order to train decentralized agents' policies and critics using model-rollouts a.k.a `imagination'. Since only the model-training is done off-policy, inter-agent communication/coordination and `language emergence' can be handled in a straight-forward manner. We compare the performance of MA-Dreamer with other methods on two soccer-based games. Our experiments show that in long-term speaker-listener tasks and in cooperative games with strong partial-observability, MA-Dreamer finds a solution that makes effective use of coordination, whereas competing methods obtain marginal scores and fail outright, respectively. By effectively achieving coordination and communication under more relaxed and general conditions, out method opens the door to the study of more complex problems and population-based training.


title: Using $\gamma$-ray observations of dwarf spheroidal galaxies to test the possible common origin of the W-boson mass anomaly and the GeV $\gamma$-ray/antiproton excesses

abstract: A recent result from Fermilab suggests that the measured W-boson mass deviates from the prediction of the Standard Model (SM) with a significance of $>7\sigma$, and there may exist new physics beyond the SM. It is proposed that the inert two Higgs doublet model (i2HDM) can well explain the new W-boson mass. Meanwhile, the lightest neutral scalar $S$ in the i2HDM can be stable and play the role of dark matter with a preferred dark matter mass of $\sim 54-74$ GeV. It is also found that part of the parameter space of this model can explain both the Galactic center GeV gamma-ray excess detected by $Fermi$-LAT and the GeV antiproton excess detected by AMS-02 through a $SS\rightarrow WW^*$ annihilation. In this paper, we aim to test the possible common i2HDM origin of the three anomaly/excesses using the $Fermi$-LAT observations of Milky Way dwarf spheroidal (dSph) galaxies. We perform single and stacking analyses on 19 dSphs that have J-factor measurements. We find that our upper limits are below the favored parameters and seems to be able to exclude the possibility of a common origin of the three anomaly/excesses. However, because the J-factor measurements include relatively large uncertainties, which come from the measurements of stellar kinematics, whether this model could be reliably excluded needs to be further confirmed by future observations.


title: Impacts of gravitational-wave standard siren observations from Einstein Telescope and Cosmic Explorer on weighing neutrinos in interacting dark energy models

abstract: The multi-messenger gravitational-wave (GW) observation for binary neutron star merger events could provide a rather useful tool to explore the evolution of the universe. In particular, for the third-generation GW detectors, i.e., the Einstein Telescope (ET) and the Cosmic Explorer (CE), proposed to be built in Europe and the U.S., respectively, lots of GW standard sirens with known redshifts could be obtained, which would exert great impacts on the cosmological parameter estimation. The total neutrino mass could be measured by cosmological observations, but such a measurement is model-dependent and currently only gives an upper limit. In this work, we wish to investigate whether the GW standard sirens observed by ET and CE could help improve the constraint on the neutrino mass, in particular in the interacting dark energy (IDE) models. We find that the GW standard siren observations from ET and CE can only slightly improve the constraint on the neutrino mass in the IDE models, compared to the current limit. The improvements in the IDE models are weaker than in the standard cosmological model. Although the limit on neutrino mass can only be slightly updated, the constraints on other cosmological parameters can be significantly improved by using the GW observations.