title: Efficient high-dimensional variational data assimilation with machine-learned reduced-order models

abstract: Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has allowed dramatic improvements in weather forecasting over the past few decades. DA is commonly framed in a variational setting, where one solves an optimization problem within a Bayesian formulation using raw model forecasts as a prior, and observations as likelihood. This leads to a DA objective function that needs to be minimized, where the decision variables are the initial conditions specified to the model. In traditional DA, the forward model is numerically and computationally expensive. Here we replace the forward model with a low-dimensional, data-driven, and differentiable emulator. Consequently, gradients of our DA objective function with respect to the decision variables are obtained rapidly via automatic differentiation. We demonstrate our approach by performing an emulator-assisted DA forecast of geopotential height. Our results indicate that emulator-assisted DA is faster than traditional equation-based DA forecasts by four orders of magnitude, allowing computations to be performed on a workstation rather than a dedicated high-performance computer. In addition, we describe accuracy benefits of emulator-assisted DA when compared to simply using the emulator for forecasting (i.e., without DA).


title: Observational Signatures of Tearing Instability in the Current Sheet of a Solar Flare

abstract: Magnetic reconnection is a fundamental physical process converting magnetic energy into not only plasma energy but also particle energy in various astrophysical phenomena. In this letter, we show a unique dataset of a solar flare where various plasmoids were formed by a continually stretched current sheet. EUV images captured reconnection inflows, outflows, and particularly the recurring plasma blobs (plasmoids). X-ray images reveal nonthermal emission sources at the lower end of the current sheet, presumably as large plasmoids with a sufficiently amount of energetic electrons trapped in. In the radio domain, an upward slowly drifting pulsation structure, followed by a rare pair of oppositely drifting structures, was observed. These structures are supposed to map the evolution of the primary and the secondary plasmoids formed in the current sheet. Our results on plasmoids at different locations and scales shed important light on the dynamics, plasma heating, particle acceleration, and transport processes in the turbulent current sheet and provide observational evidence for the cascading magnetic reconnection process.


title: EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendation

abstract: Using computational notebooks (e.g., Jupyter Notebook), data scientists rationalize their exploratory data analysis (EDA) based on their prior experience and external knowledge such as online examples. For novices or data scientists who lack specific knowledge about the dataset or problem to investigate, effectively obtaining and understanding the external information is critical to carry out EDA. This paper presents EDAssistant, a JupyterLab extension that supports EDA with in-situ search of example notebooks and recommendation of useful APIs, powered by novel interactive visualization of search results. The code search and recommendation are enabled by state-of-the-art machine learning models, trained on a large corpus of EDA notebooks collected online. A user study is conducted to investigate both EDAssistant and data scientists' current practice (i.e., using external search engines). The results demonstrate the effectiveness and usefulness of EDAssistant, and participants appreciated its smooth and in-context support of EDA. We also report several design implications regarding code recommendation tools.


title: Finite-Sample Analysis of Decentralized Q-Learning for Stochastic Games

abstract: Learning in stochastic games is arguably the most standard and fundamental setting in multi-agent reinforcement learning (MARL). In this paper, we consider decentralized MARL in stochastic games in the non-asymptotic regime. In particular, we establish the finite-sample complexity of fully decentralized Q-learning algorithms in a significant class of general-sum stochastic games (SGs) - weakly acyclic SGs, which includes the common cooperative MARL setting with an identical reward to all agents (a Markov team problem) as a special case. We focus on the practical while challenging setting of fully decentralized MARL, where neither the rewards nor the actions of other agents can be observed by each agent. In fact, each agent is completely oblivious to the presence of other decision makers. Both the tabular and the linear function approximation cases have been considered. In the tabular setting, we analyze the sample complexity for the decentralized Q-learning algorithm to converge to a Markov perfect equilibrium (Nash equilibrium). With linear function approximation, the results are for convergence to a linear approximated equilibrium - a new notion of equilibrium that we propose - which describes that each agent's policy is a best reply (to other agents) within a linear space. Numerical experiments are also provided for both settings to demonstrate the results.


title: Operational models of temperature superpositions

abstract: A quantum system and a thermal bath can reach thermal equilibrium through an interaction, whereupon the system acquires the same temperature as the bath. But how does a delocalised quantum system thermalise with a bath whose local temperature varies, as, for example, in the Tolman effect? Here we formulate two scenarios in which the notion of a ``superposition of temperatures'' may arise. First: a probe interacting with two different baths dependent on the state of another quantum system (control). Second: a probe interacting with a single bath whose purified state is a superposition of states corresponding to different temperatures. We show that the two scenarios are fundamentally different and can be operationally distinguished. Moreover, we show that the probe does not in general thermalise even when the involved temperatures are equal, and that the final probe state is sensitive to the specific realisation of the thermalising channels. Our models may be applied to scenarios involving joint quantum, gravitational, and thermodynamic phenomena, and explain some recent results found in quantum intereference of relativistic probes thermalising with Unruh or Hawking radiation. Finally, we show that our results are reproduced in partial and pre-thermalisation processes, and thus our approach and conclusions hold beyond the idealised scenarios, where thermalisation is incomplete.


title: Spatiotemporal ETAS model with a renewal main-shock arrival process

abstract: This article proposes a spatiotemporal point process model that enhances the classical Epidemic-Type Aftershock Sequence (ETAS) model by incorporating a renewal main-shock arrival process, which we term the renewal ETAS (RETAS) model. This modification is similar in spirit to the renewal Hawkes (RHawkes) process but the conditional intensity process supports a spatial domain. It empowers the main-shock intensity with the capability to reset upon the arrival of main-shocks and therefore allows for heavier clustering of earthquakes than the spatiotemporal ETAS model introduced by Ogata (1998). We introduce a likelihood evaluation algorithm for parameter estimation and provide a novel procedure to evaluated the fitted model's goodness-of-fit based on a sequential application of the Rosenblatt transformation. A simulation algorithm for the RETAS model is developed and applied to validate the numerical performance of the likelihood evaluation algorithm and goodness of fit test procedure. We illustrate the proposed model and procedures on various earthquake catalogs around the world each with distinctly different seismic activity. These catalogs will demonstrate that the RETAS model affords additional flexibility in comparison to the classical spatiotemporal ETAS model and has the potential for superior modeling and forecasting of seismicity.


title: Fast Computation of Generalized Eigenvectors for Manifold Graph Embedding

abstract: Our goal is to efficiently compute low-dimensional latent coordinates for nodes in an input graph -- known as graph embedding -- for subsequent data processing such as clustering. Focusing on finite graphs that are interpreted as uniform samples on continuous manifolds (called manifold graphs), we leverage existing fast extreme eigenvector computation algorithms for speedy execution. We first pose a generalized eigenvalue problem for sparse matrix pair $(\A,\B)$, where $\A = \L - \mu \Q + \epsilon \I$ is a sum of graph Laplacian $\L$ and disconnected two-hop difference matrix $\Q$. Eigenvector $\v$ minimizing Rayleigh quotient $\frac{\v^{\top} \A \v}{\v^{\top} \v}$ thus minimizes $1$-hop neighbor distances while maximizing distances between disconnected $2$-hop neighbors, preserving graph structure. Matrix $\B = \text{diag}(\{\b_i\})$ that defines eigenvector orthogonality is then chosen so that boundary / interior nodes in the sampling domain have the same generalized degrees. $K$-dimensional latent vectors for the $N$ graph nodes are the first $K$ generalized eigenvectors for $(\A,\B)$, computed in $\cO(N)$ using LOBPCG, where $K \ll N$. Experiments show that our embedding is among the fastest in the literature, while producing the best clustering performance for manifold graphs.


title: Geometric-Arithmetic Master Equation in Large and Fast Open Quantum Systems

abstract: Understanding nonsecular dynamics in open quantum systems is addressed here, with emphasis on systems with large numbers of Bohr frequencies, zero temperature, and fast driving. We employ the master equation, which replaces arithmetic averages of the decay rates in the open system, with their geometric averages, and find that it can improve the second order perturbation theory, known as the Redfield equation, while enforcing complete positivity on quantum dynamics. The characteristic frequency scale that governs the approximation is the minimax frequency: the minimum of the maximum system oscillation frequency and the bath relaxation rate; this needs to be larger than the dissipation rate for it to be valid. The concepts are illustrated on the Heisenberg ferromagnetic spin-chain model. To study the accuracy of the approximation, a Hamiltonian is drawn from the Gaussian unitary ensemble, for which we calculate the fourth order time convolutionless master equation, in the Ohmic bath at zero temperature. Enforcing the geometric average, decreases the trace distance to the exact solution. Dynamical decoupling of a qubit is examined by applying the Redfield and the geometric-arithmetic master equations, in the interaction picture of the time dependent system Hamiltonian, and the results are compared to the exact path integral solution. The geometric-arithmetic approach is significantly simpler and can be super-exponentially faster compared to the Redfield approach.


title: 4$\alpha$ linear-chain state produced by $^{9}$Be+$^{9}$Be collision

abstract: Extreme nuclear deformations provide great insight into the geometric formation of quantum many-body systems. In this work, the $4\alpha+2n$ linear chain is assessed in $^{18}$O. We predict excitation energies, moment-of-inertia, $\alpha$-, and $^{9}$Be-decay widths by using the antisymmetrized molecular dynamics. We show that the $K^\pi=3^-$ linear-chain states may be verified by the head-on $^{9}{\rm Be}+{}^{9}{\rm Be}$ collision experiments.


title: Applying machine learning methods to prediction problems of lattice observables

abstract: We discuss the prediction of critical behavior of lattice observables in SU(2) and SU(3) gauge theories. We show that feed-forward neural network, trained on the lattice configurations of gauge fields as input data, finds correlations with the target observable, which is also true in the critical region where the neural network has not been trained. We have verified that the neural network constructs a gauge-invariant function and this property does not change over the entire range of the parameter space.


title: Unusual Resistive Transitions in the Nodal-Line Semimetallic Superconductor NaAlSi

abstract: NaAlSi is a quasi-two-dimensional semimetal with superconductivity below Tc = 6.8 K and a band structure characterized by nodal lines near the Fermi level and potential topological surface states. Electrical resistivity measurements on its superconducting transitions in magnetic fields were made using plate-like single crystals. In the magnetic field-temperature phase diagram, we observed a substantial reduction in resistivity in a pre-transitional zone above the bulk superconducting regime only when the magnetic fields were perpendicular to the plane, rather than parallel to it. Significant sample (thickness) dependence, reentrant behavior, and sensitivity to electrode configurations all indicate that a portion of the crystal has an upper critical field greater than the bulk superconductivity in the pre-transitional region. This fractional superconductivity may occur on the side surface of the crystal.


title: Interscript: A dataset for interactive learning of scripts through error feedback

abstract: How can an end-user provide feedback if a deployed structured prediction model generates inconsistent output, ignoring the structural complexity of human language? This is an emerging topic with recent progress in synthetic or constrained settings, and the next big leap would require testing and tuning models in real-world settings. We present a new dataset, Interscript, containing user feedback on a deployed model that generates complex everyday tasks. Interscript contains 8,466 data points -- the input is a possibly erroneous script and a user feedback, and the output is a modified script. We posit two use-cases of \ours that might significantly advance the state-of-the-art in interactive learning. The dataset is available at: https://github.com/allenai/interscript.


title: Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases

abstract: Detecting social bias in text is challenging due to nuance, subjectivity, and difficulty in obtaining good quality labeled datasets at scale, especially given the evolving nature of social biases and society. To address these challenges, we propose a few-shot instruction-based method for prompting pre-trained language models (LMs). We select a few class-balanced exemplars from a small support repository that are closest to the query to be labeled in the embedding space. We then provide the LM with instruction that consists of this subset of labeled exemplars, the query text to be classified, a definition of bias, and prompt it to make a decision. We demonstrate that large LMs used in a few-shot context can detect different types of fine-grained biases with similar and sometimes superior accuracy to fine-tuned models. We observe that the largest 530B parameter model is significantly more effective in detecting social bias compared to smaller models (achieving at least 13% improvement in AUC metric compared to other models). It also maintains a high AUC (dropping less than 2%) when the labeled repository is reduced to as few as $100$ samples. Large pretrained language models thus make it easier and quicker to build new bias detectors.


title: Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing

abstract: Motivation: A perennial challenge for biomedical researchers and clinical practitioners is to stay abreast with the rapid growth of publications and medical notes. Natural language processing (NLP) has emerged as a promising direction for taming information overload. In particular, large neural language models facilitate transfer learning by pretraining on unlabeled text, as exemplified by the successes of BERT models in various NLP applications. However, fine-tuning such models for an end task remains challenging, especially with small labeled datasets, which are common in biomedical NLP. Results: We conduct a systematic study on fine-tuning stability in biomedical NLP. We show that finetuning performance may be sensitive to pretraining settings, especially in low-resource domains. Large models have potential to attain better performance, but increasing model size also exacerbates finetuning instability. We thus conduct a comprehensive exploration of techniques for addressing fine-tuning instability. We show that these techniques can substantially improve fine-tuning performance for lowresource biomedical NLP applications. Specifically, freezing lower layers is helpful for standard BERT-BASE models, while layerwise decay is more effective for BERT-LARGE and ELECTRA models. For low-resource text similarity tasks such as BIOSSES, reinitializing the top layer is the optimal strategy. Overall, domainspecific vocabulary and pretraining facilitate more robust models for fine-tuning. Based on these findings, we establish new state of the art on a wide range of biomedical NLP applications. Availability and implementation: To facilitate progress in biomedical NLP, we release our state-of-the-art pretrained and fine-tuned models: https://aka.ms/BLURB.


title: Cross-Domain Generalization and Knowledge Transfer in Transformers Trained on Legal Data

abstract: We analyze the ability of pre-trained language models to transfer knowledge among datasets annotated with different type systems and to generalize beyond the domain and dataset they were trained on. We create a meta task, over multiple datasets focused on the prediction of rhetorical roles. Prediction of the rhetorical role a sentence plays in a case decision is an important and often studied task in AI & Law. Typically, it requires the annotation of a large number of sentences to train a model, which can be time-consuming and expensive. Further, the application of the models is restrained to the same dataset it was trained on. We fine-tune language models and evaluate their performance across datasets, to investigate the models' ability to generalize across domains. Our results suggest that the approach could be helpful in overcoming the cold-start problem in active or interactvie learning, and shows the ability of the models to generalize across datasets and domains.


title: The Compactness of Galaxy Groups in the Sloan Digital Sky Survey

abstract: We use an updated version of the halo-based galaxy group catalog of Yang et al., and take the surface brightness of the galaxy group ($\mu_{\rm lim}$) based on projected positions and luminosities of galaxy members as a compactness proxy to divide groups into sub-systems with different compactness. By comparing various properties, including galaxy conditional luminosity function, stellar population, active galactic nuclei (AGN) activity, and X-ray luminosity of the intra-cluster medium of carefully controlled high (HC) and low compactness (LC) group samples, we find that the group compactness plays an essential role in characterizing the detailed physical properties of the group themselves and their group members, especially for low mass groups with $M_h \lesssim 10^{13.5}h^{-1}M_{\odot}$. We find that the low-mass HC groups have a systematically lower magnitude gap $\Delta m_{12}$ and X-ray luminosity than their LC counterparts, indicating that the HC groups are probably in the early stage of group merging. On the other hand, a higher fraction of passive galaxies is found in the HC group, which however is a result of systematically smaller halo-centric distance distribution of their satellite population. After controlling of both $M_h$ and halo-centric distance, we do not find any differences for both the quenching faction and AGN activity of the member galaxies between the HC and LC groups. Therefore, we conclude that the halo quenching effect, which result in the halo-centric dependence of galaxy population, is a faster process compared to the dynamical relaxed time-scale of galaxy groups.


title: A Comparison of Robust Kalman Filters for Improving Wheel-Inertial Odometry in Planetary Rovers

abstract: This paper compares the performance of adaptive and robust Kalman filter algorithms in improving wheel-inertial odometry on low featured rough terrain. Approaches include classical adaptive and robust methods as well as variational methods, which are evaluated experimentally on a wheeled rover in terrain similar to what would be encountered in planetary exploration. Variational filters show improved solution accuracy compared to the classical adaptive filters and are able to handle erroneous wheel odometry measurements and keep good localization for longer distances without significant drift. We also show how varying the parameters affects localization performance.


title: Tracing Text Provenance via Context-Aware Lexical Substitution

abstract: Text content created by humans or language models is often stolen or misused by adversaries. Tracing text provenance can help claim the ownership of text content or identify the malicious users who distribute misleading content like machine-generated fake news. There have been some attempts to achieve this, mainly based on watermarking techniques. Specifically, traditional text watermarking methods embed watermarks by slightly altering text format like line spacing and font, which, however, are fragile to cross-media transmissions like OCR. Considering this, natural language watermarking methods represent watermarks by replacing words in original sentences with synonyms from handcrafted lexical resources (e.g., WordNet), but they do not consider the substitution's impact on the overall sentence's meaning. Recently, a transformer-based network was proposed to embed watermarks by modifying the unobtrusive words (e.g., function words), which also impair the sentence's logical and semantic coherence. Besides, one well-trained network fails on other different types of text content. To address the limitations mentioned above, we propose a natural language watermarking scheme based on context-aware lexical substitution (LS). Specifically, we employ BERT to suggest LS candidates by inferring the semantic relatedness between the candidates and the original sentence. Based on this, a selection strategy in terms of synchronicity and substitutability is further designed to test whether a word is exactly suitable for carrying the watermark signal. Extensive experiments demonstrate that, under both objective and subjective metrics, our watermarking scheme can well preserve the semantic integrity of original sentences and has a better transferability than existing methods. Besides, the proposed LS approach outperforms the state-of-the-art approach on the Stanford Word Substitution Benchmark.


title: Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling

abstract: We examine the extent to which, in principle, linguistic graph representations can complement and improve neural language modeling. With an ensemble setup consisting of a pretrained Transformer and ground-truth graphs from one of 7 different formalisms, we find that, overall, semantic constituency structures are most useful to language modeling performance -- outpacing syntactic constituency structures as well as syntactic and semantic dependency structures. Further, effects vary greatly depending on part-of-speech class. In sum, our findings point to promising tendencies in neuro-symbolic language modeling and invite future research quantifying the design choices made by different formalisms.


title: Novelty-Driven Binary Particle Swarm Optimisation for Truss Optimisation Problems

abstract: Topology optimisation of trusses can be formulated as a combinatorial and multi-modal problem in which locating distinct optimal designs allows practitioners to choose the best design based on their preferences. Bilevel optimisation has been successfully applied to truss optimisation to consider topology and sizing in upper and lower levels, respectively. We introduce exact enumeration to rigorously analyse the topology search space and remove randomness for small problems. We also propose novelty-driven binary particle swarm optimisation for bigger problems to discover new designs at the upper level by maximising novelty. For the lower level, we employ a reliable evolutionary optimiser to tackle the layout configuration aspect of the problem. We consider truss optimisation problem instances where designers need to select the size of bars from a discrete set with respect to practice code constraints. Our experimental investigations show that our approach outperforms the current state-of-the-art methods and it obtains multiple high-quality solutions.


title: Atmosphere Loss by Aerial Bursts

abstract: We present a simple analytic description of atmospheric mass loss by aerial bursts and demonstrate that mass loss from aerial bursts becomes significant when the maximum impactor size that leads to an aerial burst rather than a ground explosion, $r_o$, is larger than the minimum impactor size needed to achieve atmospheric loss, $r_{min}$. For vertical trajectories, which give the most stringent limit, this condition is approximately satisfied when $\rho_o/\rho_i \gtrsim 0.4 v_e/v_\infty$, which implies atmospheric densities need to be comparable to impactor densities for impactor velocities that are a few times the escape velocity of the planet. The range of impactor radii resulting in aerial burst-induced mass loss, $r_o-r_{min}$, increases with the ratio of the atmosphere to the impactor density and with the trajectory angle of the impactor. The range of impactor radii that result in aerial burst-induced mass loss and the atmospheric mass lost is larger in adiabatic atmospheres than isothermal atmospheres of equivalent total mass, scale height, and atmospheric surface density. Our results imply that aerial bursts are not expected to significantly contribute to the atmospheric mass-loss history of Earth, but are expected to play an important role for planets and exoplanets similar to Neptune with significant atmospheres. For Neptune-like atmospheres, the atmospheric mass ejected per impactor mass by aerial bursts is comparable to that lost by ground explosions, which implies that, for impactors following a Dohnanyi size distribution, overall loss by aerial busts is expected to exceed that by ground explosions by a factor of $(r_{ground}/r_{aerial})^{0.5}$.


title: Learning to Transpile AMR into SPARQL

abstract: We propose a transition-based system to transpile Abstract Meaning Representation (AMR) into SPARQL for Knowledge Base Question Answering (KBQA). This allows us to delegate part of the semantic representation to a strongly pre-trained semantic parser, while learning transpiling with small amount of paired data. We depart from recent work relating AMR and SPARQL constructs, but rather than applying a set of rules, we teach a BART model to selectively use these relations. Further, we avoid explicitly encoding AMR but rather encode the parser state in the attention mechanism of BART, following recent semantic parsing works. The resulting model is simple, provides supporting text for its decisions, and outperforms recent approaches in KBQA across two knowledge bases: DBPedia (LC-QuAD 1.0, QALD-9) and Wikidata (WebQSP, SWQ-WD).


title: Gaze Estimation with Eye Region Segmentation and Self-Supervised Multistream Learning

abstract: We present a novel multistream network that learns robust eye representations for gaze estimation. We first create a synthetic dataset containing eye region masks detailing the visible eyeball and iris using a simulator. We then perform eye region segmentation with a U-Net type model which we later use to generate eye region masks for real-world eye images. Next, we pretrain an eye image encoder in the real domain with self-supervised contrastive learning to learn generalized eye representations. Finally, this pretrained eye encoder, along with two additional encoders for visible eyeball region and iris, are used in parallel in our multistream framework to extract salient features for gaze estimation from real-world images. We demonstrate the performance of our method on the EYEDIAP dataset in two different evaluation settings and achieve state-of-the-art results, outperforming all the existing benchmarks on this dataset. We also conduct additional experiments to validate the robustness of our self-supervised network with respect to different amounts of labeled data used for training.


title: Does a Face Mask Protect my Privacy?: Deep Learning to Predict Protected Attributes from Masked Face Images

abstract: Contactless and efficient systems are implemented rapidly to advocate preventive methods in the fight against the COVID-19 pandemic. Despite the positive benefits of such systems, there is potential for exploitation by invading user privacy. In this work, we analyse the privacy invasiveness of face biometric systems by predicting privacy-sensitive soft-biometrics using masked face images. We train and apply a CNN based on the ResNet-50 architecture with 20,003 synthetic masked images and measure the privacy invasiveness. Despite the popular belief of the privacy benefits of wearing a mask among people, we show that there is no significant difference to privacy invasiveness when a mask is worn. In our experiments we were able to accurately predict sex (94.7%),race (83.1%) and age (MAE 6.21 and RMSE 8.33) from masked face images. Our proposed approach can serve as a baseline utility to evaluate the privacy-invasiveness of artificial intelligence systems that make use of privacy-sensitive information. We open-source all contributions for re-producibility and broader use by the research community.


title: Distilling the Real Cost of Production Garbage Collectors

abstract: Abridged abstract: despite the long history of garbage collection (GC) and its prevalence in modern programming languages, there is surprisingly little clarity about its true cost. Without understanding their cost, crucial tradeoffs made by garbage collectors (GCs) go unnoticed. This can lead to misguided design constraints and evaluation criteria used by GC researchers and users, hindering the development of high-performance, low-cost GCs. In this paper, we develop a methodology that allows us to empirically estimate the cost of GC for any given set of metrics. By distilling out the explicitly identifiable GC cost, we estimate the intrinsic application execution cost using different GCs. The minimum distilled cost forms a baseline. Subtracting this baseline from the total execution costs, we can then place an empirical lower bound on the absolute costs of different GCs. Using this methodology, we study five production GCs in OpenJDK 17, a high-performance Java runtime. We measure the cost of these collectors, and expose their respective key performance tradeoffs. We find that with a modestly sized heap, production GCs incur substantial overheads across a diverse suite of modern benchmarks, spending at least 7-82% more wall-clock time and 6-92% more CPU cycles relative to the baseline cost. We show that these costs can be masked by concurrency and generous provisioning of memory/compute. In addition, we find that newer low-pause GCs are significantly more expensive than older GCs, and, surprisingly, sometimes deliver worse application latency than stop-the-world GCs. Our findings reaffirm that GC is by no means a solved problem and that a low-cost, low-latency GC remains elusive. We recommend adopting the distillation methodology together with a wider range of cost metrics for future GC evaluations.


title: Schr\"odinger-Heisenberg Variational Quantum Algorithms

abstract: Recent breakthroughs have opened the possibility to intermediate-scale quantum computing with tens to hundreds of qubits, and shown the potential for solving classical challenging problems, such as in chemistry and condensed matter physics. However, the extremely high accuracy needed to surpass classical computers poses a critical demand to the circuit depth, which is severely limited by the non-negligible gate infidelity, currently around 0.1-1%. Here, by incorporating a virtual Heisenberg circuit, which acts effectively on the measurement observables, to a real shallow Schr\"odinger circuit, which is implemented realistically on the quantum hardware, we propose a paradigm of Schr\"odinger-Heisenberg variational quantum algorithms to resolve this problem. We choose a Clifford virtual circuit, whose effect on the Hamiltonian can be efficiently and classically implemented according to the Gottesman-Knill theorem. Yet, it greatly enlarges the state expressivity, realizing much larger unitary t-designs. Our method enables accurate quantum simulation and computation that otherwise is only achievable with much deeper and more accurate circuits conventionally. This has been verified in our numerical experiments for a better approximation of random states and a higher-fidelity solution to the ground state energy of the XXZ model. Together with effective quantum error mitigation, our work paves the way for realizing accurate quantum computing algorithms with near-term quantum devices.


title: Lex Rosetta: Transfer of Predictive Models Across Languages, Jurisdictions, and Legal Domains

abstract: In this paper, we examine the use of multi-lingual sentence embeddings to transfer predictive models for functional segmentation of adjudicatory decisions across jurisdictions, legal systems (common and civil law), languages, and domains (i.e. contexts). Mechanisms for utilizing linguistic resources outside of their original context have significant potential benefits in AI & Law because differences between legal systems, languages, or traditions often block wider adoption of research outcomes. We analyze the use of Language-Agnostic Sentence Representations in sequence labeling models using Gated Recurrent Units (GRUs) that are transferable across languages. To investigate transfer between different contexts we developed an annotation scheme for functional segmentation of adjudicatory decisions. We found that models generalize beyond the contexts on which they were trained (e.g., a model trained on administrative decisions from the US can be applied to criminal law decisions from Italy). Further, we found that training the models on multiple contexts increases robustness and improves overall performance when evaluating on previously unseen contexts. Finally, we found that pooling the training data from all the contexts enhances the models' in-context performance.


title: Generalized Fock space and fractional derivatives with Applications to Uniqueness of Sampling and Interpolation Sets

abstract: In this paper we introduce a Fock space related to derivatives of Gelfond-Leontiev type, a class of derivatives which includes many classic examples like fractional derivatives or Dunkl operators. For this space we establish a modified Bargmann transform as well as density theorems for sampling and interpolation. These density theorems allow us to establish lattice conditions for the construction of frames arising from integral transforms which are linked by the modified Bargmann transform with the Fock space.


title: Experimental quantum advantage with quantum coupon collector

abstract: An increasing number of communication and computational schemes with quantum advantages have recently been proposed, which implies that quantum technology has fertile application prospects. However, demonstrating these schemes experimentally continues to be a central challenge because of the difficulty in preparing high-dimensional states or highly entangled states. In this study, we introduce and analyse a quantum coupon collector protocol by employing coherent states and simple linear optical elements, which was successfully demonstrated using realistic experimental equipment. We showed that our protocol can significantly reduce the number of samples needed to learn a specific set compared with the classical limit of the coupon collector problem. We also discuss the potential values and expansions of the quantum coupon collector by constructing a quantum blind box game. The information transmitted by the proposed game also broke the classical limit. These results strongly prove the advantages of quantum mechanics in machine learning and communication complexity.


title: The band structure of the whole spectrum of an N-body cold system containing atoms with arbitrary integer spin and dominated by singlet pairing force

abstract: The spectra of $N$-boson systems with arbitrary nonzero spin $\mathfrak{f}$ have been studied. Firstly, only the singlet pairing interaction is considered, a set of eigenstates together with the eigenenergies are analytically obtained. The completeness of this set is proved. The analytical expression allows us to see clearly the spin structures of various states different in $N$ and/or $\mathfrak{f}$, and to find out the similarity and relationship lying among them. Secondly, the effect of other interactions is evaluated via exact numerical calculations on the systems with a smaller $N$. Some features and notable phenomena that might emerge in high-$\mathfrak{f}$ systems, say, the ground band might have extremely high level density, have been discussed.


title: The role of solute concentration in interface instability during alloy solidification: A viewpoint from the free energy

abstract: Solidification structures are determined by the interaction between the interfacial processes and transport processes of heat and solute. In this paper, we investigate planar instability in directional solidification. Firstly, the interfacial evolution at the initial growth stage is simulated, indicating the planar instability is represented by the transition from the planar to the cellular. Secondly, to represent the history-dependence of solidification, constant thermal gradient G and varying pulling speed VP are used in the simulations. The results indicate the cooling rate R ( = G*VP) dominates the overall propagation speed of the interface, to maintain the local thermodynamic equilibrium. The solute segregation determines the stability of the interface, by changing the excess free energy at the interface and corresponding interface energy. Finally, the simulations of the grains with different preferred crystallographic orientations are performed, indicating the surface energy and its anisotropy do not affect the solute diffusion and planar growth. The results also verify the conclusion that solute segregation influences the interface energy and results in interface instability. On the other hand, for the planar-cellular transition, the minimum surface stiffness rule is more suitable than the maximum surface energy rule. The influence of the solute concentration on the excess free energy and interface energy can be applied to other solidification patterns induced by the interface instability, which will be studied in the future.


title: Knowledge-Rich Self-Supervision for Biomedical Entity Linking

abstract: Entity linking faces significant challenges such as prolific variations and prevalent ambiguities, especially in high-value domains with myriad entities. Standard classification approaches suffer from the annotation bottleneck and cannot effectively handle unseen entities. Zero-shot entity linking has emerged as a promising direction for generalizing to new entities, but it still requires example gold entity mentions during training and canonical descriptions for all entities, both of which are rarely available outside of Wikipedia. In this paper, we explore Knowledge-RIch Self-Supervision ($\tt KRISS$) for biomedical entity linking, by leveraging readily available domain knowledge. In training, it generates self-supervised mention examples on unlabeled text using a domain ontology and trains a contextual encoder using contrastive learning. For inference, it samples self-supervised mentions as prototypes for each entity and conducts linking by mapping the test mention to the most similar prototype. Our approach can easily incorporate entity descriptions and gold mention labels if available. We conducted extensive experiments on seven standard datasets spanning biomedical literature and clinical notes. Without using any labeled information, our method produces $\tt KRISSBERT$, a universal entity linker for four million UMLS entities that attains new state of the art, outperforming prior self-supervised methods by as much as 20 absolute points in accuracy.


title: Event Linking: Grounding Event Mentions to Wikipedia

abstract: Comprehending an article requires understanding its constituent events. However, the context where an event is mentioned often lacks the details of this event. A question arises: how can the reader obtain more knowledge about this particular event in addition to what is provided by the local context in the article? This work defines Event Linking, a new natural language understanding task at the event level. Event linking tries to link an event mention appearing in an article to the most appropriate Wikipedia page. This page is expected to provide rich knowledge about what the event mention refers to. To standardize the research in this new direction, we contribute in four-fold. First, this is the first work in the community that formally defines Event Linking task. Second, we collect a dataset for this new task. Specifically, we automatically gather training set from Wikipedia, and then create two evaluation sets: one from the Wikipedia domain, reporting the in-domain performance, and a second from the real-world news domain, to evaluate out-of-domain performance. Third, we retrain and evaluate two state-of-the-art (SOTA) entity linking models, showing the challenges of event linking, and we propose an event-specific linking system EVELINK to set a competitive result for the new task. Fourth, we conduct a detailed and insightful analysis to help understand the task and the limitation of the current model. Overall, as our analysis shows, Event Linking is a considerably challenging and essential task requiring more effort from the community. Data and code are available here: https://github.com/CogComp/event-linking.


title: Defect patterns of two-dimensional nematic liquid crystals in confinement

abstract: A two-dimensional or quasi-two-dimensional nematic liquid crystal refers to a surface confined system. When such a system is further confined by external line boundaries or excluded from internal line boundaries, the nematic directors form a deformed texture that may display defect points or defect lines, for which winding numbers can be clearly defined. Here, a particular attention is paid to the case when the liquid crystal molecules prefer to form a boundary nematic texture in parallel to the wall surface (i.e., following the homogeneous boundary condition). A general theory, based on geometric argument, is presented for the relationship between the sum of all winding numbers in the system (the total winding number) and the type of confinement angles and curved segments. The conclusion is validated by comparing the theoretical defect rule with existing nematic textures observed experimentally and theoretically in recent years.


title: Investigating myocardial infarction and its effects in patients with urgent medical problems using advanced data mining tools

abstract: In medical science, it is very important to gather multiple data on different diseases and one of the most important objectives of the data is to investigate the diseases. Myocardial infarction is a serious risk factor in mortality and in previous studies, the main emphasis has been on people with heart disease and measuring the likelihood of myocardial infarction in them through demographic features, echocardiography, and electrocardiogram. In contrast, the purpose of the present study is to utilize data analysis algorithms and compare their accuracy in patients with a heart attack in order to identify the heart muscle strength during myocardial infarction by taking into account emergency operations and consequently predict myocardial infarction. For this purpose, 105 medical records of myocardial infarction patients with fourteen features including age, the time of emergency operation, Creatine Phosphokinase (CPK) test, heart rate, blood sugar, and vein are gathered and investigated through classification techniques of data analysis including random decision forests, decision tree, support vector machine (SVM), k-nearest neighbor, and ordinal logistic regression. Finally, the model of random decision forests with an accuracy of 76% is selected as the best model in terms of the mean evaluation indicator. Also, seven features of the creatine Phosphokinase test, urea, white and red blood cell count, blood sugar, time, and hemoglobin are identified as the most effective features of the ejection fraction variable.


title: Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data

abstract: Deep learning techniques for separating audio into different sound sources face several challenges. Standard architectures require training separate models for different types of audio sources. Although some universal separators employ a single model to target multiple sources, they have difficulty generalizing to unseen sources. In this paper, we propose a three-component pipeline to train a universal audio source separator from a large, but weakly-labeled dataset: AudioSet. First, we propose a transformer-based sound event detection system for processing weakly-labeled training data. Second, we devise a query-based audio separation model that leverages this data for model training. Third, we design a latent embedding processor to encode queries that specify audio targets for separation, allowing for zero-shot generalization. Our approach uses a single model for source separation of multiple sound types, and relies solely on weakly-labeled data for training. In addition, the proposed audio separator can be used in a zero-shot setting, learning to separate types of audio sources that were never seen in training. To evaluate the separation performance, we test our model on MUSDB18, while training on the disjoint AudioSet. We further verify the zero-shot performance by conducting another experiment on audio source types that are held-out from training. The model achieves comparable Source-to-Distortion Ratio (SDR) performance to current supervised models in both cases.


title: Likelihood-based inference for partially observed stochastic epidemics with individual heterogeneity

abstract: We develop a stochastic epidemic model progressing over dynamic networks, where infection rates are heterogeneous and may vary with individual-level covariates. The joint dynamics are modeled as a continuous-time Markov chain such that disease transmission is constrained by the contact network structure, and network evolution is in turn influenced by individual disease statuses. To accommodate partial epidemic observations commonly seen in real-world data, we propose a likelihood-based inference method based on the stochastic EM algorithm, introducing key innovations that include efficient conditional samplers for imputing missing infection and recovery times which respect the dynamic contact network. Experiments on both synthetic and real datasets demonstrate that our inference method can accurately and efficiently recover model parameters and provide valuable insight at the presence of unobserved disease episodes in epidemic data.


title: Graph-based Ensemble Machine Learning for Student Performance Prediction

abstract: Student performance prediction is a critical research problem to understand the students' needs, present proper learning opportunities/resources, and develop the teaching quality. However, traditional machine learning methods fail to produce stable and accurate prediction results. In this paper, we propose a graph-based ensemble machine learning method that aims to improve the stability of single machine learning methods via the consensus of multiple methods. To be specific, we leverage both supervised prediction methods and unsupervised clustering methods, build an iterative approach that propagates in a bipartite graph as well as converges to more stable and accurate prediction results. Extensive experiments demonstrate the effectiveness of our proposed method in predicting more accurate student performance. Specifically, our model outperforms the best traditional machine learning algorithms by up to 14.8% in prediction accuracy.


title: Forgiveness is an Adaptation in Iterated Prisoner's Dilemma with Memory

abstract: The Prisoner's Dilemma is used to represent many real life phenomena whether from the civilized world of humans or from the wild life of the other living. Researchers working on iterated prisoner's dilemma (IPD) with limited memory inspected the outcome of different forgetting strategies in homogeneous environment, within which all agents adopt the same forgetting strategy at a time. In this work, with the intention to represent real life more realistically, we improve existing forgetting strategies, offer new ones, and conduct experiments in heterogeneous environment that contains mixed agents and compare the results with previous research as well as homogeneous environment. Our findings show that the outcome depends on the type of the environment, and is just the opposite for homogeneous and heterogeneous ones, opposing the existing literature in IPD. Consequently, forgetting and forgiving defectors is the supreme memory management strategy in a competitive, heterogeneous environment. Therefore, forgiveness is an adaptation.


title: Robust Depth Completion with Uncertainty-Driven Loss Functions

abstract: Recovering a dense depth image from sparse LiDAR scans is a challenging task. Despite the popularity of color-guided methods for sparse-to-dense depth completion, they treated pixels equally during optimization, ignoring the uneven distribution characteristics in the sparse depth map and the accumulated outliers in the synthesized ground truth. In this work, we introduce uncertainty-driven loss functions to improve the robustness of depth completion and handle the uncertainty in depth completion. Specifically, we propose an explicit uncertainty formulation for robust depth completion with Jeffrey's prior. A parametric uncertain-driven loss is introduced and translated to new loss functions that are robust to noisy or missing data. Meanwhile, we propose a multiscale joint prediction model that can simultaneously predict depth and uncertainty maps. The estimated uncertainty map is also used to perform adaptive prediction on the pixels with high uncertainty, leading to a residual map for refining the completion results. Our method has been tested on KITTI Depth Completion Benchmark and achieved the state-of-the-art robustness performance in terms of MAE, IMAE, and IRMSE metrics.


title: Invisibility enables super-visibility in electromagnetic imaging

abstract: This paper is concerned with the inverse electromagnetic scattering problem for anisotropic media. We use the interior resonant modes to develop an inverse scattering scheme for imaging the scatterer. The whole procedure consists of three phases. First, we determine the interior Maxwell transmission eigenvalues of the scatterer from a family of far-field data by the mechanism of the linear sampling method. Next, we determine the corresponding transmission eigenfunctions by solving a constrained optimization problem. Finally, based on both global and local geometric properties of the transmission eigenfunctions, we design an imaging functional which can be used to determine the shape of the medium scatterer. We provide rigorous theoretical basis for our method. Numerical experiments verify the effectiveness, better accuracy and super-resolution results of the proposed scheme.


title: Tight query complexity bounds for learning graph partitions

abstract: Given a partition of a graph into connected components, the membership oracle asserts whether any two vertices of the graph lie in the same component or not. We prove that for $n\ge k\ge 2$, learning the components of an $n$-vertex hidden graph with $k$ components requires at least $(k-1)n-\binom k2$ membership queries. Our result improves on the best known information-theoretic bound of $\Omega(n\log k)$ queries, and exactly matches the query complexity of the algorithm introduced by [Reyzin and Srivastava, 2007] for this problem. Additionally, we introduce an oracle, with access to which one can learn the number of components of $G$ in asymptotically fewer queries than learning the full partition, thus answering another question posed by the same authors. Lastly, we introduce a more applicable version of this oracle, and prove asymptotically tight bounds of $\widetilde\Theta(m)$ queries for both learning and verifying an $m$-edge hidden graph $G$ using it.


title: Lifting homeomorphisms and finite abelian branched covers of the 2-sphere

abstract: We completely determine finite abelian regular branched covers of the 2-sphere $S^2$ with the property that each homeomorphism of $S^2$ preserving the branching set can be lifted.


title: Large Dual Encoders Are Generalizable Retrievers

abstract: It has been shown that dual encoders trained on one domain often fail to generalize to other domains for retrieval tasks. One widespread belief is that the bottleneck layer of a dual encoder, where the final score is simply a dot-product between a query vector and a passage vector, is too limited to make dual encoders an effective retrieval model for out-of-domain generalization. In this paper, we challenge this belief by scaling up the size of the dual encoder model {\em while keeping the bottleneck embedding size fixed.} With multi-stage training, surprisingly, scaling up the model size brings significant improvement on a variety of retrieval tasks, especially for out-of-domain generalization. Experimental results show that our dual encoders, \textbf{G}eneralizable \textbf{T}5-based dense \textbf{R}etrievers (GTR), outperform %ColBERT~\cite{khattab2020colbert} and existing sparse and dense retrievers on the BEIR dataset~\cite{thakur2021beir} significantly. Most surprisingly, our ablation study finds that GTR is very data efficient, as it only needs 10\% of MS Marco supervised data to achieve the best out-of-domain performance. All the GTR models are released at https://tfhub.dev/google/collections/gtr/1.


title: Environmental force sensing helps robots traverse cluttered large obstacles using physical interaction

abstract: Many applications require robots to move through complex 3-D terrain with large obstacles, such as self-driving, search and rescue, and extraterrestrial exploration. Although robots are already excellent at avoiding sparse obstacles, they still struggle in traversing cluttered large obstacles. To make progress, we need to better understand how to use and control the physical interaction with obstacles to traverse them. Forest floor-dwelling cockroaches can use physical interaction to transition between different locomotor modes to traverse flexible, grass-like beams of a large range of stiffness. Inspired by this, here we studied whether and how environmental force sensing helps robots make active adjustments to traverse cluttered large obstacles. We developed a physics model and a simulation of a minimalistic robot capable of sensing environmental forces during traversal of beam obstacles. Then, we developed a force-feedback control strategy, which estimated beam stiffness from the sensed contact force using the physics model. Then in simulation we used the estimated stiffness to control the robot to either stay in or transition to the more favorable locomotor modes to traverse. When beams were stiff, force sensing induced the robot to transition from a more costly pitch mode to a less costly roll mode, which helped the robot traverse with a higher success rate and less energy consumed. By contrast, if the robot simply pushed forward or always avoided obstacles, it would consume more energy, become stuck in front of beams, or even flip over. When the beams were flimsy, force sensing guided the robot to simply push across the beams. In addition, we demonstrated the robustness of beam stiffness estimation against body oscillations, randomness in oscillation, and uncertainty in position sensing. We also found that a shorter sensorimotor delay reduced energy cost of traversal.


title: Energy-Efficient Real-Time Heart Monitoring on Edge-Fog-Cloud Internet-of-Medical-Things

abstract: The recent developments in wearable devices and the Internet of Medical Things (IoMT) allow real-time monitoring and recording of electrocardiogram (ECG) signals. However, continuous monitoring of ECG signals is challenging in low-power wearable devices due to energy and memory constraints. Therefore, in this paper, we present a novel and energy-efficient methodology for continuously monitoring the heart for low-power wearable devices. The proposed methodology is composed of three different layers: 1) a Noise/Artifact detection layer to grade the quality of the ECG signals; 2) a Normal/Abnormal beat classification layer to detect the anomalies in the ECG signals, and 3) an Abnormal beat classification layer to detect diseases from ECG signals. Moreover, a distributed multi-output Convolutional Neural Network (CNN) architecture is used to decrease the energy consumption and latency between the edge-fog/cloud. Our methodology reaches an accuracy of 99.2% on the well-known MIT-BIH Arrhythmia dataset. Evaluation on real hardware shows that our methodology is suitable for devices having a minimum RAM of 32KB. Moreover, the proposed methodology achieves $7\times$ more energy efficiency compared to state-of-the-art works.


title: Factorizable Lie bialgebras, quadratic Rota-Baxter Lie algebras and Rota-Baxter Lie bialgebras

abstract: In this paper, first we introduce the notion of quadratic Rota-Baxter Lie algebras of arbitrary weight, and show that there is a one-to-one correspondence between factorizable Lie bialgebras and quadratic Rota-Baxter Lie algebras of nonzero weight. Then we introduce the notions of matched pairs, bialgebras and Manin triples of Rota-Baxter Lie algebras of arbitrary weight, and show that Rota-Baxter Lie bialgebras, Manin triples of Rota-Baxter Lie algebras and certain matched pairs of Rota-Baxter Lie algebras are equivalent. The coadjoint representations and quadratic Rota-Baxter Lie algebras play important roles in the whole study. Finally we generalize some results to the Lie group context. In particular, we show that there is a one-to-one correspondence between factorizable Poisson Lie groups and quadratic Rota-Baxter Lie groups.


title: Optimal Combinatorial Neural Codes with Matched Metric $\delta_{r}$: Characterization and Constructions

abstract: Based on the theoretical neuroscience, G. Cotardo and A. Ravagnavi in \cite{CR} introduced a kind of asymmetric binary codes called combinatorial neural codes (CN codes for short), with a "matched metric" $\delta_{r}$ called asymmetric discrepancy, instead of the Hamming distance $d_{H}$ for usual error-correcting codes. They also presented the Hamming, Singleton and Plotkin bounds for CN codes with respect to $\delta_{r}$ and asked how to construct the CN codes $\cC$ with large size $|\cC|$ and $\delta_{r}(\cC).$ In this paper we firstly show that a binary code $\cC$ reaches one of the above bounds for $\delta_{r}(\cC)$ if and only if $\cC$ reaches the corresponding bounds for $d_H$ and $r$ is sufficiently closed to 1. This means that all optimal CN codes come from the usual optimal codes. %(perfect codes, MDS codes or the codes meet the usual Plotkin bound). Secondly we present several constructions of CN codes with nice and flexible parameters $(n,K, \delta_r(\cC))$ by using bent functions.


title: Visualization for Petrov's Odd Unitary Group

abstract: In this article we define a set of matrices analogous to Vaserstein-type matrices which was introduced in the paper `Serre's problem on projective modules over polynomial rings and algebraic K-theory' by Suslin-Vaserstein in 1976. We prove that these are elementary linear matrices. Also, under some conditions, these matrices belong to Petrov's odd unitary group which is a generalization of all classical groups. We also prove that the group generated by these matrices is a conjugate of the Petrov's odd elementary hyperbolic unitary group when the ring is commutative.


title: Infinite not contact isotopic embeddings in $(S^{2n-1},\xi_{\mathrm{std}})$ for $n\ge 4$

abstract: For $n\ge 4$, we show that there are infinitely many formally contact isotopic embeddings of $(ST^*S^{n-1},\xi_{\mathrm{std}})$ to $(S^{2n-1},\xi_{\mathrm{std}})$ that are not contact isotopic. This resolves a conjecture of Casals and Etnyre except for the $n=3$ case. The argument does not appeal to the surgery formula of critical handle attachment for Floer theory/SFT.


title: Modulation property of flexural-gravity waves on a water surface covered by a compressed ice sheet

abstract: We study the nonlinear modulation property of flexural-gravity waves on a water surface covered by a compressed ice sheet of given thickness and density in a basin of a constant depth. For weakly nonlinear perturbations, we derive the nonlinear Schr\"odinger equation and investigate the conditions when a quasi-sinusoidal wave becomes unstable with respect to amplitude modulation. The domains of instability are presented in the planes of governing physical parameters; the shapes of the domains exhibit fairly complicated patterns. It is shown that under certain conditions the modulational instability can develop from shorter groups and for fewer wave periods than in the situation of deep-water gravity waves on a free water surface. The modulational instability can occur at the conditions shallower than that known for the free water surface kh = 1.363, where k is the wavenumber and h is the water depth. Estimates of parameters of modulated waves are given for the typical physical conditions of an ice-covered sea.


title: On a transversal theorem of Montejano and Karasev

abstract: We give a new proof of a theorem of Montejano and Karasev regarding $k$-dimensional transversals to small families of convex sets. While their proof uses technical algebraic and topological tools, our proof is a simple application of the Borsuk-Ulam theorem. Additionally, in certain cases our result is stronger than the Montejano-Karasev theorem.


title: $HW^{2,2}_{\rm loc}$-regularity for $p$-harmonic functions in Heisenberg groups

abstract: Let $1<p\le4$ when $n=1$ and $1<p< 3+\frac{1}{n-1} $ when $n\ge2$. We obtain the second-order horizontal Sobolev $HW^{2,2}_{\rm loc} $-regularity of $p$-harmonic functions in the Heisenberg group $\mathbb H^n$. This improves the known range of $p$ obtained by Domokos and Manfredi in 2005.


title: Homography Decomposition Networks for Planar Object Tracking

abstract: Planar object tracking plays an important role in AI applications, such as robotics, visual servoing, and visual SLAM. Although the previous planar trackers work well in most scenarios, it is still a challenging task due to the rapid motion and large transformation between two consecutive frames. The essential reason behind this problem is that the condition number of such a non-linear system changes unstably when the searching range of the homography parameter space becomes larger. To this end, we propose a novel Homography Decomposition Networks(HDN) approach that drastically reduces and stabilizes the condition number by decomposing the homography transformation into two groups. Specifically, a similarity transformation estimator is designed to predict the first group robustly by a deep convolution equivariant network. By taking advantage of the scale and rotation estimation with high confidence, a residual transformation is estimated by a simple regression model. Furthermore, the proposed end-to-end network is trained in a semi-supervised fashion. Extensive experiments show that our proposed approach outperforms the state-of-the-art planar tracking methods at a large margin on the challenging POT, UCSB and POIC datasets.


title: Decoupling Zero-Shot Semantic Segmentation

abstract: Zero-shot semantic segmentation (ZS3) aims to segment the novel categories that have not been seen in the training. Existing works formulate ZS3 as a pixel-level zeroshot classification problem, and transfer semantic knowledge from seen classes to unseen ones with the help of language models pre-trained only with texts. While simple, the pixel-level ZS3 formulation shows the limited capability to integrate vision-language models that are often pre-trained with image-text pairs and currently demonstrate great potential for vision tasks. Inspired by the observation that humans often perform segment-level semantic labeling, we propose to decouple the ZS3 into two sub-tasks: 1) a classagnostic grouping task to group the pixels into segments. 2) a zero-shot classification task on segments. The former task does not involve category information and can be directly transferred to group pixels for unseen classes. The latter task performs at segment-level and provides a natural way to leverage large-scale vision-language models pre-trained with image-text pairs (e.g. CLIP) for ZS3. Based on the decoupling formulation, we propose a simple and effective zero-shot semantic segmentation model, called ZegFormer, which outperforms the previous methods on ZS3 standard benchmarks by large margins, e.g., 22 points on the PASCAL VOC and 3 points on the COCO-Stuff in terms of mIoU for unseen classes. Code will be released at https://github.com/dingjiansw101/ZegFormer.


title: Extensive study of radiation dose on human body at aviation altitude through Monte Carlo simulation

abstract: The diverse near-Earth radiation environment due to cosmic rays and solar radiation has direct impact on human civilization. In the present and upcoming era of increasing air transfer, it is important to have precise idea of radiation dose effects on human body during air travel. Here, we calculate the radiation dose on the human body at the aviation altitude, also considering the shielding effect of the aircraft structure, using Monte Carlo simulation technique based on Geant4 toolkit. We consider proper 3D mathematical model of the atmosphere and geomagnetic field, updated profile of the incoming particle flux due to cosmic rays and appropriate physics processes. We use quasi-realistic computational phantoms to replicate the human body (male/female) for the effective dose calculation and develop a simplified mathematical model of the aircraft (taking Boeing 777--200LR as reference) for the shielding study. We simulate the radiation environment at the flying altitude (considering geomagnetic latitude in the range of 45-50$^{\circ}$), as well as at various locations inside the fuselage of the aircraft. Then, we calculate the dose rates in the different organs for both male and female phantoms, based on latest recommendations of International Commission on Radio logical Protection. This calculation shows that the sex-averaged effective dose rate in human phantom is 5.46 $\mu$Sv/h, whereas, if we calculate weighted sum of equivalent dose contributions separately in female and male body: total weighted sum of equivalent dose rate received by the female phantom is 5.72 $\mu$Sv/h and that by the male phantom is 5.20 $\mu$Sv/h. From the simulation, we also calculate the numerous cosmogenic radionuclides produced inside the phantoms through activation or spallation processes which may induce long-term biological effects.


title: Stability conditions and Teichm\"uller space

abstract: We consider a 3-Calabi-Yau triangulated category associated to an ideal triangulation of a marked bordered surface. Using the theory of harmonic maps between Riemann surfaces, we construct a natural map from a component of the space of Bridgeland stability conditions on this category to the enhanced Teichm\"uller space of the surface. We describe a relationship between the central charges of objects in the category and shear coordinates on the Teichm\"uller space.


title: A Comparative Analysis of Machine Learning Approaches for Automated Face Mask Detection During COVID-19

abstract: The World Health Organization (WHO) has recommended wearing face masks as one of the most effective measures to prevent COVID-19 transmission. In many countries, it is now mandatory to wear face masks, specially in public places. Since manual monitoring of face masks is often infeasible in the middle of the crowd, automatic detection can be beneficial. To facilitate that, we explored a number of deep learning models (i.e., VGG1, VGG19, ResNet50) for face-mask detection and evaluated them on two benchmark datasets. We also evaluated transfer learning (i.e., VGG19, ResNet50 pre-trained on ImageNet) in this context. We find that while the performances of all the models are quite good, transfer learning models achieve the best performance. Transfer learning improves the performance by 0.10\%--0.40\% with 30\% less training time. Our experiment also shows these high-performing models are not quite robust for real-world cases where the test dataset comes from a different distribution. Without any fine-tuning, the performance of these models drops by 47\% in cross-domain settings.


title: ZHED is NP-complete

abstract: We prove that the 2017 puzzle game ZHED is NP-complete, even with just 1 tiles. Such a puzzle is defined by a set of unit-square 1 tiles in a square grid, and a target square of the grid. A move consists of selecting an unselected 1 tile and then filling the next unfilled square in a chosen direction from that tile (similar to Tipover and Cross Purposes). We prove NP-completeness of deciding whether the target square can be filled, by a reduction from rectilinear planar monotone 3SAT.


title: Spin Waves and Dirac Magnons in a Honeycomb Lattice Zig-zag Antiferromagnet BaNi2(AsO4)2

abstract: The topological properties of massive and massless fermionic quasiparticles have been intensively investigated over the past decade in topological materials without magnetism. Recently, the bosonic analogs of such quasiparticles arising from spin waves have been reported in the two-dimensional (2D) honeycomb lattice ferromagnet/antiferromagnet and the 3D antiferromagnet. Here we use time-of-flight inelastic neutron scattering to study spin waves of the S = 1 honeycomb lattice antiferromagnet BaNi2(AsO4)2, which has a zig-zag antiferromagnetic (AF) ground state identical to that of the Kitaev quantum spin liquid candidate alpha-RuCl3. We determine the magnetic exchange interactions in the zig-zag AF ordered phase, and show that spin waves in BaNi2(AsO4)2 have symmetry-protected Dirac points inside the Brillouin zone boundary. These results provide a microscopic understanding of the zig-zag AF order and associated Dirac magnons in honeycomb lattice magnets, and are also important for establishing the magnetic interactions in Kitaev quantum spin liquid candidates.


title: LongT5: Efficient Text-To-Text Transformer for Long Sequences

abstract: Recent work has shown that either (1) increasing the input length or (2) increasing model size can improve the performance of Transformer-based neural models. In this paper, we present a new model, called LongT5, with which we explore the effects of scaling both the input length and model size at the same time. Specifically, we integrated attention ideas from long-input transformers (ETC), and adopted pre-training strategies from summarization pre-training (PEGASUS) into the scalable T5 architecture. The result is a new attention mechanism we call {\em Transient Global} (TGlobal), which mimics ETC's local/global attention mechanism, but without requiring additional side-inputs. We are able to achieve state-of-the-art results on several summarization tasks and outperform the original T5 models on question answering tasks.


title: SPTS: Single-Point Text Spotting

abstract: Existing scene text spotting (i.e., end-to-end text detection and recognition) methods rely on costly bounding box annotations (e.g., text-line, word-level, or character-level bounding boxes). For the first time, we demonstrate that training scene text spotting models can be achieved with an extremely low-cost annotation of a single-point for each instance. We propose an end-to-end scene text spotting method that tackles scene text spotting as a sequence prediction task. Given an image as input, we formulate the desired detection and recognition results as a sequence of discrete tokens and use an auto-regressive Transformer to predict the sequence. The proposed method is simple yet effective, which can achieve state-of-the-art results on widely used benchmarks. Most significantly, we show that the performance is not very sensitive to the positions of the point annotation, meaning that it can be much easier to be annotated or even be automatically generated than the bounding box that requires precise positions. We believe that such a pioneer attempt indicates a significant opportunity for scene text spotting applications of a much larger scale than previously possible. The code is available at https://github.com/shannanyinxiang/SPTS.


title: M-FasterSeg: An Efficient Semantic Segmentation Network Based on Neural Architecture Search

abstract: Image semantic segmentation technology is one of the key technologies for intelligent systems to understand natural scenes. As one of the important research directions in the field of visual intelligence, this technology has broad application scenarios in the fields of mobile robots, drones, smart driving, and smart security. However, in the actual application of mobile robots, problems such as inaccurate segmentation semantic label prediction and loss of edge information of segmented objects and background may occur. This paper proposes an improved structure of a semantic segmentation network based on a deep learning network that combines self-attention neural network and neural network architecture search methods. First, a neural network search method NAS (Neural Architecture Search) is used to find a semantic segmentation network with multiple resolution branches. In the search process, combine the self-attention network structure module to adjust the searched neural network structure, and then combine the semantic segmentation network searched by different branches to form a fast semantic segmentation network structure, and input the picture into the network structure to get the final forecast result. The experimental results on the Cityscapes dataset show that the accuracy of the algorithm is 69.8%, and the segmentation speed is 48/s. It achieves a good balance between real-time and accuracy, can optimize edge segmentation, and has a better performance in complex scenes. Good robustness is suitable for practical application.


title: Sample-Efficient Sparse Phase Retrieval via Stochastic Alternating Minimization

abstract: In this work we propose a nonconvex two-stage \underline{s}tochastic \underline{a}lternating \underline{m}inimizing (SAM) method for sparse phase retrieval. The proposed algorithm is guaranteed to have an exact recovery from $O(s\log n)$ samples if provided the initial guess is in a local neighbour of the ground truth. Thus, the proposed algorithm is two-stage, first we estimate a desired initial guess (e.g. via a spectral method), and then we introduce a randomized alternating minimization strategy for local refinement. Also, the hard-thresholding pursuit algorithm is employed to solve the sparse constraint least square subproblems. We give the theoretical justifications that SAM find the underlying signal exactly in a finite number of iterations (no more than $O(\log m)$ steps) with high probability. Further, numerical experiments illustrates that SAM requires less measurements than state-of-the-art algorithms for sparse phase retrieval problem.


title: Global existence theorem for the three-dimensional isentropic compressible Navier-Stokes flow in the exterior of a rotating obstacle

abstract: In this paper, we consider the initial-boundary value problem of three-dimensional isentropic compressible Navier-Stokes equations with rotating effect terms in an exterior domain with Navier-slip boundary condition and with far-field vacuum. This problem is related to the motion of the compressible viscous flow past a rotating obstacle. We establish the global existence and uniqueness of classical solutions, provided that the initial mass is small. The initial data and the angular velocity of the obstacle are allowed to have large oscillations.


title: Temporal Shuffling for Defending Deep Action Recognition Models against Adversarial Attacks

abstract: Recently, video-based action recognition methods using convolutional neural networks (CNNs) achieve remarkable recognition performance. However, there is still lack of understanding about the generalization mechanism of action recognition models. In this paper, we suggest that action recognition models rely on the motion information less than expected, and thus they are robust to randomization of frame orders. Furthermore, we find that motion monotonicity remaining after randomization also contributes to such robustness. Based on this observation, we develop a novel defense method using temporal shuffling of input videos against adversarial attacks for action recognition models. Another observation enabling our defense method is that adversarial perturbations on videos are sensitive to temporal destruction. To the best of our knowledge, this is the first attempt to design a defense method without additional training for 3D CNN-based video action recognition models.


title: Ten years of image analysis and machine learning competitions in dementia

abstract: Machine learning methods exploiting multi-parametric biomarkers, especially based on neuroimaging, have huge potential to improve early diagnosis of dementia and to predict which individuals are at-risk of developing dementia. To benchmark algorithms in the field of machine learning and neuroimaging in dementia and assess their potential for use in clinical practice and clinical trials, seven grand challenges have been organized in the last decade. The seven grand challenges addressed questions related to screening, clinical status estimation, prediction and monitoring in (pre-clinical) dementia. There was little overlap in clinical questions, tasks and performance metrics. Whereas this aids providing insight on a broad range of questions, it also limits the validation of results across challenges. The validation process itself was mostly comparable between challenges, using similar methods for ensuring objective comparison, uncertainty estimation and statistical testing. In general, winning algorithms performed rigorous data preprocessing and combined a wide range of input features. Despite high state-of-the-art performances, most of the methods evaluated by the challenges are not clinically used. To increase impact, future challenges could pay more attention to statistical analysis of which factors relate to higher performance, to clinical questions beyond Alzheimer's disease, and to using testing data beyond the Alzheimer's Disease Neuroimaging Initiative. Grand challenges would be an ideal venue for assessing the generalizability of algorithm performance to unseen data of other cohorts. Key for increasing impact in this way are larger testing data sizes, which could be reached by sharing algorithms rather than data to exploit data that cannot be shared.


title: Effects of bond-randomness and Dzyaloshinskii-Moriya interactions on the specific heat at low temperatures of a spherical kagom\'{e} cluster in {W$_{72}$V$_{30}$}

abstract: For the spin-1/2 spherical kagom\'{e} cluster, as well as for the 2D kagom\'{e} lattice, many low-energy singlet excitations have been expected to exist in the energy region below the spin gap, which has been actually confirmed by Kihara $et \ al.$ in their specific heat measurements up to 10K in {W$_{72}$V$_{30}$}, for which the exchange interaction was estimated as $J=115$K. However, the experimental result of the specific heat can not be reproduced by the theoretical result in the Heisenberg model. Although the theoretical result has a peak around 2 K, the experimental one does not. To elucidate this difference, we incorporate Dzyaloshinskii-Moriya (DM) interactions and bond-randomness into the model Hamiltonian for {W$_{72}$V$_{30}$} and calculate density of states, entropy, and specific heat at low temperatures by using the Lanczos method. We find that DM interactions do not significantly affect the energy distribution of about ten singlet states above the ground state, which are involved in the peak structure of the specific heat around 2K, while even 10% bond-randomness disperses this distribution to collapse the 2K peak. Kihara $et \ al.$ also reported experimental specific heats under magnetic fields up to 15T $(=0.17J)$, and found that the specific heats show almost no magnetic-field dependence, which strongly suggests that the bond randomness is much stronger than the magnetic fields. For example, our calculated specific heats with 50% randomness reproduce the experimental ones up to about 5K.


title: Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation

abstract: Knowledge-grounded dialogue systems are challenging to build due to the lack of training data and heterogeneous knowledge sources. Existing systems perform poorly on unseen topics due to limited topics covered in the training data. In addition, heterogeneous knowledge sources make it challenging for systems to generalize to other tasks because knowledge sources in different knowledge representations require different knowledge encoders. To address these challenges, we present PLUG, a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. PLUG is pre-trained on a dialogue generation task conditioned on a unified essential knowledge representation. It can generalize to different downstream knowledge-grounded dialogue generation tasks with a few training examples. The empirical evaluation on two benchmarks shows that our model generalizes well across different knowledge-grounded tasks. It can achieve comparable performance with state-of-the-art methods under a fully-supervised setting and significantly outperforms other methods in zero-shot and few-shot settings.


title: Versatile fidelity estimation with confidence

abstract: As quantum devices become more complex and the requirements on these devices become more demanding, it is crucial to be able to verify the performance of such devices in a scalable and reliable fashion. A cornerstone task in this challenge is quantifying how close an experimentally prepared quantum state is to the desired one. Here we present a method to construct an estimator for the quantum state fidelity that is compatible with any measurement protocol. Our method provides a confidence interval on this estimator that is guaranteed to be nearly minimax optimal for the specified measurement protocol. For a well-chosen measurement scheme, our method is competitive in the number of measurement outcomes required for estimation. We demonstrate our method using simulations and experimental data from a trapped-ion quantum computer and compare the results to state-of-the-art techniques. Our method can be easily extended to estimate the expectation value of any observable, such as entanglement witnesses.


title: Bridging three-dimensional coupled-wire models and cellular topological states: Solvable models for topological and fracton orders

abstract: Three-dimensional (3D) gapped topological phases with fractional excitations are divided into two subclasses: one has topological order with point-like and loop-like excitations fully mobile in the 3D space, and the other has fracton order with point-like excitations constrained in lower-dimensional subspaces. These exotic phases are often studied by exactly solvable Hamiltonians made of commuting projectors, which, however, are not capable of describing those exhibiting surface states with gapless chiral dispersion. Here we introduce a systematic way, based on cellular construction recently proposed for 3D topological phases, to construct another type of exactly solvable models in terms of coupled quantum wires with given inputs of cellular structure, two-dimensional Abelian topological order, and their gapped interfaces. We show that our models can describe both 3D topological and fracton orders (and even their hybrid) and study their universal properties such as quasiparticle statistics and topological ground-state degeneracy. We also apply this construction to two-dimensional coupled-wire models with ordinary topological orders and translation-symmetry-enriched topological orders. Our results pave the way for effective quantum field theory descriptions or microscopic model realizations of fracton orders with chiral gapless surface states.


title: A complete answer to the Gaveau--Brockett problem

abstract: The note is dedicated to provide a satisfying and complete answer to the long-standing Gaveau--Brockett open problem. More precisely, we determine the exact formula of the Carnot--Carath\'eodory distance on arbitrary step-two groups. The basic idea of the proof is combining Varadhan's formulas with the explicit expression for the associated heat kernel $p_h$ and the method of stationary phase. However, we have to introduce a number of original new methods, especially the usage of the concept of "Operator convexity". Next, new integral expressions for $p_h$ by means of properties of Bessel functions will be presented. An unexpected direct proof for the well-known positivity of $p_h$ via its original integral formula, will play an important role. Furthermore, all normal geodesics joining the identity element $o$ to any given $g$ as well as the cut locus can be characterized on every step-two groups. Finally, the corresponding results in Riemannian geometry on step-two groups will be briefly presented as well.


title: Imagine by Reasoning: A Reasoning-Based Implicit Semantic Data Augmentation for Long-Tailed Classification

abstract: Real-world data often follows a long-tailed distribution, which makes the performance of existing classification algorithms degrade heavily. A key issue is that samples in tail categories fail to depict their intra-class diversity. Humans can imagine a sample in new poses, scenes, and view angles with their prior knowledge even if it is the first time to see this category. Inspired by this, we propose a novel reasoning-based implicit semantic data augmentation method to borrow transformation directions from other classes. Since the covariance matrix of each category represents the feature transformation directions, we can sample new directions from similar categories to generate definitely different instances. Specifically, the long-tailed distributed data is first adopted to train a backbone and a classifier. Then, a covariance matrix for each category is estimated, and a knowledge graph is constructed to store the relations of any two categories. Finally, tail samples are adaptively enhanced via propagating information from all the similar categories in the knowledge graph. Experimental results on CIFAR-100-LT, ImageNet-LT, and iNaturalist 2018 have demonstrated the effectiveness of our proposed method compared with the state-of-the-art methods.


title: Authenticated Multiparty Quantum Key Agreement for Optical-Ring Quantum Communication Networks

abstract: Quantum communication networks are connected by various devices to achieve communication or distributed computing for users in remote locations. In order to solve the problem of generating temporary session key for secure communication in optical-ring quantum networks, a quantum key agreement protocol is proposed. In the key agreement protocols, an attacker can impersonate a legal user to participate in the negotiation process and eavesdrop the agreement key easily. This is often overlooked in most quantum key agreement protocols, which makes them insecure in practical implementation. Considering this problem, the function of authenticating the user's identity is added in the proposed protocol. Combining classical hash function with identity information, we design the authentication operation conforming to the characteristics of quantum search algorithm. In the security analysis of the proposed protocol, quantum state discrimination is utilized to show that the protocol is secure against common attacks and impersonation attack. In addition, only single photons need to be prepared and measured, which makes our protocol feasible with existing technology.


title: The secretary problem with non-uniform arrivals via a left-to-right-minimum exponentially tilted distribution

abstract: We solve the secretary problem in the case that the ranked items arrive in a statistically biased order rather than in uniformly random order. The bias is given by the left-to-right-minimum exponentially tilted distribution with parameter $q\in(0,\infty)$. That is, for $\sigma\in S_n$, $P_n(\sigma)$ is proportional to $q^{\text{LR}^{-}_n(\sigma)}$, where the left-to-right minimum statistic $\text{LR}^-_n$ is defined by $$ \text{LR}^{-}_n(\sigma)=|\{j\in[n]: \sigma_j=\min\{\sigma_i:1\le i\le j\}\}|,\ \sigma\in S_n. $$ For $q\in(0,1)$, higher ranked items tend to arrive earlier than in the case of the uniform distribution, and for $q\in(1,\infty)$, they tend to arrive later. In the classical problem, the asymptotically optimal strategy is to reject the first $M_n^*$ items, where $M_n^*\sim\frac ne$, and then to select the first item ranked higher than any of the first $M_n^*$ items (if such an item exists). This yields $e^{-1}$ as the limiting probability of success. With the above bias on arrivals, we calculate the asymptotic behavior of the optimal strategy $M_n^*$ and the corresponding limiting probability of success, for all regimes of $\{q_n\}_{n=1}^\infty$. In particular, if the leading order asymptotic behavior of $\{q_n\}_{n=1}^\infty$ is at least $\frac1{\log n}$, and if also its order is no more than $o(n)$, then the limiting probability of success when using an asymptotically optimal strategy is $e^{-1}$; otherwise, this limiting probability of success is greater than $e^{-1}$. Also, the limiting fraction of numbers, $\lim_{n\to\infty}\frac{M^*_n}n$, that are summarily rejected by an asymptotically optimal strategy lies in $(0,1)$ if and only if $\lim_{n\to\infty}q_n\in(0,\infty)$.


title: From Noise to Feature: Exploiting Intensity Distribution as a Novel Soft Biometric Trait for Finger Vein Recognition

abstract: Most finger vein feature extraction algorithms achieve satisfactory performance due to their texture representation abilities, despite simultaneously ignoring the intensity distribution that is formed by the finger tissue, and in some cases, processing it as background noise. In this paper, we exploit this kind of noise as a novel soft biometric trait for achieving better finger vein recognition performance. First, a detailed analysis of the finger vein imaging principle and the characteristics of the image are presented to show that the intensity distribution that is formed by the finger tissue in the background can be extracted as a soft biometric trait for recognition. Then, two finger vein background layer extraction algorithms and three soft biometric trait extraction algorithms are proposed for intensity distribution feature extraction. Finally, a hybrid matching strategy is proposed to solve the issue of dimension difference between the primary and soft biometric traits on the score level. A series of rigorous contrast experiments on three open-access databases demonstrates that our proposed method is feasible and effective for finger vein recognition.


title: Round-Core-Radius-Dependent Electromagnetic Coupling of Multifilament Helical Superconducting Tapes in a Swept Magnetic Field

abstract: With the excitation and demagnetization of a magnet for magnetic resonance imaging in mind, we theoretically and numerically investigated electromagnetic coupling--especially its dependence on the round core radius $R$--of multifilament helically wound superconducting tapes under steady-state conditions in a constantly ramped magnetic field. We found that even in a rapidly ramped magnetic field, the electromagnetic coupling can be suppressed by reducing $R$ to close to the tape width. We also clarified that the coupling sweep rate at which the electromagnetic coupling starts scales as $R^{-2}$, showing that the dependence on $R$ reflects the penetration of magnetic flux from the edges of the tape. Even when the round core is as narrow as the tape width, the behavior is considered to be similar to the electromagnetic response of a flat tape rather than that of a tubular wire.


title: Characteristic polynomials and finitely dimensional representations of $\mathfrak{sl}(2, \mathbb{C})$

abstract: In this paper, we obtain a general formula for the characteristic polynomial of a finitely dimensional representation of Lie algebra $\mathfrak{sl}(2, \C )$ and the form for these characteristic polynomials, and prove there is one to one correspondence between representations and their characteristic polynomials. We define a product on these characteristic polynomials, endowing them with a monoid structure.


title: Graph Representation Learning via Contrasting Cluster Assignments

abstract: With the rise of contrastive learning, unsupervised graph representation learning has been booming recently, even surpassing the supervised counterparts in some machine learning tasks. Most of existing contrastive models for graph representation learning either focus on maximizing mutual information between local and global embeddings, or primarily depend on contrasting embeddings at node level. However, they are still not exquisite enough to comprehensively explore the local and global views of network topology. Although the former considers local-global relationship, its coarse global information leads to grudging cooperation between local and global views. The latter pays attention to node-level feature alignment, so that the role of global view appears inconspicuous. To avoid falling into these two extreme cases, we propose a novel unsupervised graph representation model by contrasting cluster assignments, called as GRCCA. It is motivated to make good use of local and global information synthetically through combining clustering algorithms and contrastive learning. This not only facilitates the contrastive effect, but also provides the more high-quality graph information. Meanwhile, GRCCA further excavates cluster-level information, which make it get insight to the elusive association between nodes beyond graph topology. Specifically, we first generate two augmented graphs with distinct graph augmentation strategies, then employ clustering algorithms to obtain their cluster assignments and prototypes respectively. The proposed GRCCA further compels the identical nodes from different augmented graphs to recognize their cluster assignments mutually by minimizing a cross entropy loss. To demonstrate its effectiveness, we compare with the state-of-the-art models in three different downstream tasks. The experimental results show that GRCCA has strong competitiveness in most tasks.


title: RawNeXt: Speaker verification system for variable-duration utterances with deep layer aggregation and extended dynamic scaling policies

abstract: Despite achieving satisfactory performance in speaker verification using deep neural networks, variable-duration utterances remain a challenge that threatens the robustness of systems. To deal with this issue, we propose a speaker verification system called RawNeXt that can handle input raw waveforms of arbitrary length by employing the following two components: (1) A deep layer aggregation strategy enhances speaker information by iteratively and hierarchically aggregating features of various time scales and spectral channels output from blocks. (2) An extended dynamic scaling policy flexibly processes features according to the length of the utterance by selectively merging the activations of different resolution branches in each block. Owing to these two components, our proposed model can extract speaker embeddings rich in time-spectral information and operate dynamically on length variations. Experimental results on the VoxCeleb1 test set consisting of various duration utterances demonstrate that RawNeXt achieves state-of-the-art performance compared to the recently proposed systems. Our code and trained model weights are available at https://github.com/wngh1187/RawNeXt.


title: Nondegeneracy of the positive solutions for critical nonlinear Hartree equation in $\R^6$

abstract: We prove that any positive solution for the critical nonlinear Hartree equation $$-\Laplacian\fct{u}{x} -\int_{\R^6} \frac{\abs{\fct{u}{y}}^2 }{ \abs{x-y}^4 }\odif{y} \,\fct{u}{x}=0,\qtq{} x\in\R^6.$$ is nondegenerate. Firstly, in terms of spherical harmonics, we show that the corresponding linear operator can be decomposed into a series of one dimensional linear operators. Secondly, by making use of the Perron-Frobenius property, we show that the kernel of each one dimensional linear operator is finite. Finally, we show that the kernel of the corresponding linear operator is the direct sum of the kernel of all one dimensional linear operators.


title: The theorems on freedom for relatively free groups with a relations

abstract: In this paper we prove the theorem on freedom for relatively free groups with a single relation (analogous with the well-known result of Magnus) and a generalized Freiheitssatz for relatively free groups (analogous with the well-known result of Romanovski)