title: Language model acceptability judgements are not always robust to context

abstract: Targeted syntactic evaluations of language models ask whether models show stable preferences for syntactically acceptable content over minimal-pair unacceptable inputs. Most targeted syntactic evaluation datasets ask models to make these judgements with just a single context-free sentence as input. This does not match language models' training regime, in which input sentences are always highly contextualized by the surrounding corpus. This mismatch raises an important question: how robust are models' syntactic judgements in different contexts? In this paper, we investigate the stability of language models' performance on targeted syntactic evaluations as we vary properties of the input context: the length of the context, the types of syntactic phenomena it contains, and whether or not there are violations of grammaticality. We find that model judgements are generally robust when placed in randomly sampled linguistic contexts. However, they are substantially unstable for contexts containing syntactic structures matching those in the critical test content. Among all tested models (GPT-2 and five variants of OPT), we significantly improve models' judgements by providing contexts with matching syntactic structures, and conversely significantly worsen them using unacceptable contexts with matching but violated syntactic structures. This effect is amplified by the length of the context, except for unrelated inputs. We show that these changes in model performance are not explainable by simple features matching the context and the test inputs, such as lexical overlap and dependency overlap. This sensitivity to highly specific syntactic features of the context can only be explained by the models' implicit in-context learning abilities.


title: Nucleon resonances and transition form factors

abstract: This is a contribution to the review 50 Years of Quantum Chromodynamics edited by F. Gross and E. Klempt, to be published in Journal EPJC. This contribution reviews the nucleon resonance transition form factors determined from meson electro-production experiments at electron accelerator facilities, i.e. this contribution focuses on space-like transition form factors and amplitudes. Comparisons are made when available to LQCD and to approaches with traceable links to strong QCD and to advanced quark model calculations


title: A Layered Architecture for Universal Causality

abstract: We propose a layered hierarchical architecture called UCLA (Universal Causality Layered Architecture), which combines multiple levels of categorical abstraction for causal inference. At the top-most level, causal interventions are modeled combinatorially using a simplicial category of ordinal numbers. At the second layer, causal models are defined by a graph-type category. The non-random ``surgical" operations on causal structures, such as edge deletion, are captured using degeneracy and face operators from the simplicial layer above. The third categorical abstraction layer corresponds to the data layer in causal inference. The fourth homotopy layer comprises of additional structure imposed on the instance layer above, such as a topological space, which enables evaluating causal models on datasets. Functors map between every pair of layers in UCLA. Each functor between layers is characterized by a universal arrow, which defines an isomorphism between every pair of categorical layers. These universal arrows define universal elements and representations through the Yoneda Lemma, and in turn lead to a new category of elements based on a construction introduced by Grothendieck. Causal inference between each pair of layers is defined as a lifting problem, a commutative diagram whose objects are categories, and whose morphisms are functors that are characterized as different types of fibrations. We illustrate the UCLA architecture using a range of examples, including integer-valued multisets that represent a non-graphical framework for conditional independence, and causal models based on graphs and string diagrams using symmetric monoidal categories. We define causal effect in terms of the homotopy colimit of the nerve of the category of elements.


title: Exact relationships between the GW approximation and equation-of-motion coupled-cluster theories through the quasi-boson formalism

abstract: We describe the relationship between the GW approximation and various equation-of-motion (EOM) coupled-cluster (CC) theories. We demonstrate the exact equivalence of the G$_0$W$_0$ approximation and the propagator theory for an electron-boson problem in a particular excitation basis. From there, we establish equivalence within the quasi-boson picture to the IP+EA-EOM unitary coupled-cluster propagator. We analyze the incomplete description of screening provided by the standard similarity-transformed IP+EA-EOM-CC and the recently introduced G$_0$W$_0$ Tamm-Dancoff approximation. We further consider the approximate decoupling of IP and EA sectors in EOM-CC treatments and devise the analogous particle-hole decoupling approach for the G$_0$W$_0$ approximation. Finally, we numerically demonstrate the exact relationships and magnitude of the approximations in calculations of a set of molecular ionization potentials and electron affinities.


title: Adaptive Uncertainty Distribution in Deep Learning for Unsupervised Underwater Image Enhancement

abstract: One of the main challenges in deep learning-based underwater image enhancement is the limited availability of high-quality training data. Underwater images are difficult to capture and are often of poor quality due to the distortion and loss of colour and contrast in water. This makes it difficult to train supervised deep learning models on large and diverse datasets, which can limit the model's performance. In this paper, we explore an alternative approach to supervised underwater image enhancement. Specifically, we propose a novel unsupervised underwater image enhancement framework that employs a conditional variational autoencoder (cVAE) to train a deep learning model with probabilistic adaptive instance normalization (PAdaIN) and statistically guided multi-colour space stretch that produces realistic underwater images. The resulting framework is composed of a U-Net as a feature extractor and a PAdaIN to encode the uncertainty, which we call UDnet. To improve the visual quality of the images generated by UDnet, we use a statistically guided multi-colour space stretch module that ensures visual consistency with the input image and provides an alternative to training using a ground truth image. The proposed model does not need manual human annotation and can learn with a limited amount of data and achieves state-of-the-art results on underwater images. We evaluated our proposed framework on eight publicly-available datasets. The results show that our proposed framework yields competitive performance compared to other state-of-the-art approaches in quantitative as well as qualitative metrics. Code available at https://github.com/alzayats/UDnet .


title: Decentralized Control of Minimalistic Robotic Swarms For Guaranteed Target Encapsulation

abstract: We propose a decentralized control algorithm for a minimalistic robotic swarm with limited capabilities such that the desired global behavior emerges. We consider the problem of searching for and encapsulating various targets present in the environment while avoiding collisions with both static and dynamic obstacles. The novelty of this work is the guaranteed generation of desired complex swarm behavior with constrained individual robots which have no memory, no localization, and no knowledge of the exact relative locations of their neighbors. Moreover, we analyze how the emergent behavior changes with different parameters of the task, noise in the sensor reading, and asynchronous execution.


title: Efficient Image Captioning for Edge Devices

abstract: Recent years have witnessed the rapid progress of image captioning. However, the demands for large memory storage and heavy computational burden prevent these captioning models from being deployed on mobile devices. The main obstacles lie in the heavyweight visual feature extractors (i.e., object detectors) and complicated cross-modal fusion networks. To this end, we propose LightCap, a lightweight image captioner for resource-limited devices. The core design is built on the recent CLIP model for efficient image captioning. To be specific, on the one hand, we leverage the CLIP model to extract the compact grid features without relying on the time-consuming object detectors. On the other hand, we transfer the image-text retrieval design of CLIP to image captioning scenarios by devising a novel visual concept extractor and a cross-modal modulator. We further optimize the cross-modal fusion model and parallel prediction heads via sequential and ensemble distillations. With the carefully designed architecture, our model merely contains 40M parameters, saving the model size by more than 75% and the FLOPs by more than 98% in comparison with the current state-of-the-art methods. In spite of the low capacity, our model still exhibits state-of-the-art performance on prevalent datasets, e.g., 136.6 CIDEr on COCO Karpathy test split. Testing on the smartphone with only a single CPU, the proposed LightCap exhibits a fast inference speed of 188ms per image, which is ready for practical applications.


title: Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?

abstract: Authorship style transfer involves altering text to match the style of a target author whilst preserving the original meaning. Existing unsupervised approaches like STRAP have largely focused on style transfer to target authors with many examples of their writing style in books, speeches, or other published works. This high-resource training data requirement (often greater than 100,000 words) makes these approaches primarily useful for style transfer to published authors, politicians, or other well-known figures and authorship styles, while style transfer to non-famous authors has not been well-studied. We introduce the \textit{low-resource authorship style transfer} task, a more challenging class of authorship style transfer where only a limited amount of text in the target author's style may exist. In our experiments, we specifically choose source and target authors from Reddit and style transfer their Reddit posts, limiting ourselves to just 16 posts (on average ~500 words) of the target author's style. Style transfer accuracy is typically measured by how often a classifier or human judge will classify an output as written by the target author. Recent authorship representations models excel at authorship identification even with just a few writing samples, making automatic evaluation of this task possible for the first time through evaluation metrics we propose. Our results establish an in-context learning technique we develop as the strongest baseline, though we find current approaches do not yet achieve mastery of this challenging task. We release our data and implementations to encourage further investigation.


title: A Robust Semantic Frame Parsing Pipeline on a New Complex Twitter Dataset

abstract: Most recent semantic frame parsing systems for spoken language understanding (SLU) are designed based on recurrent neural networks. These systems display decent performance on benchmark SLU datasets such as ATIS or SNIPS, which contain short utterances with relatively simple patterns. However, the current semantic frame parsing models lack a mechanism to handle out-of-distribution (\emph{OOD}) patterns and out-of-vocabulary (\emph{OOV}) tokens. In this paper, we introduce a robust semantic frame parsing pipeline that can handle both \emph{OOD} patterns and \emph{OOV} tokens in conjunction with a new complex Twitter dataset that contains long tweets with more \emph{OOD} patterns and \emph{OOV} tokens. The new pipeline demonstrates much better results in comparison to state-of-the-art baseline SLU models on both the SNIPS dataset and the new Twitter dataset (Our new Twitter dataset can be downloaded from https://1drv.ms/u/s!AroHb-W6_OAlavK4begsDsMALfE?e=c8f2XX ). Finally, we also build an E2E application to demo the feasibility of our algorithm and show why it is useful in real application.


title: Open-loop and Closed-loop Local and Remote Stochastic Nonzero-sum Game with Inconsistent Information Structure

abstract: In this paper, the open-loop and closed-loop local and remote stochastic nonzero-sum game (LRSNG) problem is investigated. Different from previous works, the stochastic nonzero-sum game problem under consideration is essentially a special class of two-person nonzero-sum game problem, in which the information sets accessed by the two players are inconsistent. More specifically, both the local player and the remote player are involved in the system dynamics, and the information sets obtained by the two players are different, and each player is designed to minimize its own cost function. For the considered LRSNG problem, both the open-loop and closed-loop Nash equilibrium are derived. The contributions of this paper are given as follows. Firstly, the open-loop optimal Nash equilibrium is derived, which is determined in terms of the solution to the forward and backward stochastic difference equations (FBSDEs). Furthermore, by using the orthogonal decomposition method and the completing square method, the feedback representation of the optimal Nash equilibrium is derived for the first time. Finally, the effectiveness of our results is verified by a numerical example.


title: Deep learning applied to computational mechanics: A comprehensive review, state of the art, and the classics

abstract: Three recent breakthroughs due to AI in arts and science serve as motivation: An award winning digital image, protein folding, fast matrix multiplication. Many recent developments in artificial neural networks, particularly deep learning (DL), applied and relevant to computational mechanics (solid, fluids, finite-element technology) are reviewed in detail. Both hybrid and pure machine learning (ML) methods are discussed. Hybrid methods combine traditional PDE discretizations with ML methods either (1) to help model complex nonlinear constitutive relations, (2) to nonlinearly reduce the model order for efficient simulation (turbulence), or (3) to accelerate the simulation by predicting certain components in the traditional integration methods. Here, methods (1) and (2) relied on Long-Short-Term Memory (LSTM) architecture, with method (3) relying on convolutional neural networks. Pure ML methods to solve (nonlinear) PDEs are represented by Physics-Informed Neural network (PINN) methods, which could be combined with attention mechanism to address discontinuous solutions. Both LSTM and attention architectures, together with modern and generalized classic optimizers to include stochasticity for DL networks, are extensively reviewed. Kernel machines, including Gaussian processes, are provided to sufficient depth for more advanced works such as shallow networks with infinite width. Not only addressing experts, readers are assumed familiar with computational mechanics, but not with DL, whose concepts and applications are built up from the basics, aiming at bringing first-time learners quickly to the forefront of research. History and limitations of AI are recounted and discussed, with particular attention at pointing out misstatements or misconceptions of the classics, even in well-known references. Positioning and pointing control of a large-deformable beam is given as an example.


title: Plankton-FL: Exploration of Federated Learning for Privacy-Preserving Training of Deep Neural Networks for Phytoplankton Classification

abstract: Creating high-performance generalizable deep neural networks for phytoplankton monitoring requires utilizing large-scale data coming from diverse global water sources. A major challenge to training such networks lies in data privacy, where data collected at different facilities are often restricted from being transferred to a centralized location. A promising approach to overcome this challenge is federated learning, where training is done at site level on local data, and only the model parameters are exchanged over the network to generate a global model. In this study, we explore the feasibility of leveraging federated learning for privacy-preserving training of deep neural networks for phytoplankton classification. More specifically, we simulate two different federated learning frameworks, federated learning (FL) and mutually exclusive FL (ME-FL), and compare their performance to a traditional centralized learning (CL) framework. Experimental results from this study demonstrate the feasibility and potential of federated learning for phytoplankton monitoring.


title: Experimental observation of one-dimensional motion of interstitial skyrmion in FeGe

abstract: The interplay between dimensionality and topology manifests in magnetism via both exotic texture morphology and novel dynamics. A free magnetic skyrmion exhibits the skyrmion Hall effect under electric currents. Once it is confined in one-dimensional (1D) channels, the skyrmion Hall effect would be suppressed, and the current-driven skyrmion speed should be boosted by the non-adiabatic spin transfer torque \b{eta}. Here, we experimentally demonstrate that stripes of a spatially modulated spin helix serve as natural 1D channels to restrict skyrmion. Using FeGe as a benchmark, an interstitial skyrmion is created by geometry notch and further moves steadily without the skyrmion Hall effect. The slope of the current-velocity curve for 1D skyrmion is enhanced almost by an order of magnitude owing to a large \b{eta} in FeGe. This feature is also observed in other topological defects. Utilizing the 1D skyrmion dynamics would be a highly promising route to implement topological spintronic devices.


title: PoE: a Panel of Experts for Generalized Automatic Dialogue Assessment

abstract: Chatbots are expected to be knowledgeable across multiple domains, e.g. for daily chit-chat, exchange of information, and grounding in emotional situations. To effectively measure the quality of such conversational agents, a model-based automatic dialogue evaluation metric (ADEM) is expected to perform well across multiple domains. Despite significant progress, an ADEM that works well in one domain does not necessarily generalize to another. This calls for a dedicated network architecture for domain generalization. To tackle the multi-domain dialogue evaluation task, we propose a Panel of Experts (PoE), a multitask network that consists of a shared transformer encoder and a collection of lightweight adapters. The shared encoder captures the general knowledge of dialogues across domains, while each adapter specializes in one specific domain and serves as a domain expert. To validate the idea, we construct a high-quality multi-domain dialogue dataset leveraging data augmentation and pseudo-labeling. The PoE network is comprehensively assessed on 16 dialogue evaluation datasets spanning a wide range of dialogue domains. It achieves state-of-the-art performance in terms of mean Spearman correlation over all the evaluation datasets. It exhibits better zero-shot generalization than existing state-of-the-art ADEMs and the ability to easily adapt to new domains with few-shot transfer learning.


title: An Efficient NVM based Architecture for Intermittent Computing under Energy Constraints

abstract: Battery-less technology evolved to replace battery technology. Non-volatile memory (NVM) based processors were explored to store the program state during a power failure. The energy stored in a capacitor is used for a backup during a power failure. Since the size of a capacitor is fixed and limited, the available energy in a capacitor is also limited and fixed. Thus, the capacitor energy is insufficient to store the entire program state during frequent power failures. This paper proposes an architecture that assures safe backup of volatile contents during a power failure under energy constraints. Using a proposed dirty block table (DBT) and writeback queue (WBQ), this work limits the number of dirty blocks in the L1 cache at any given time. We further conducted a set of experiments by varying the parameter sizes to help the user make appropriate design decisions concerning their energy requirements. The proposed architecture decreases energy consumption by 17.56%, the number of writes to NVM by 18.97% at LLC, and 10.66% at a main-memory level compared to baseline architecture.


title: Applications of the source-frequency phase-referencing technique for ngEHT observations

abstract: The source-frequency phase-referencing (SFPR) technique has been demonstrated to have great advantages for mm-VLBI observations. By implementing simultaneous multi-frequency receiving systems on the next generation Event Horizon Telescope (ngEHT) antennas, it is feasible to carry out a frequency phase transfer (FPT) which could calibrate the non-dispersive propagation errors and significantly increase the phase coherence in the visibility data. Such increase offers an efficient approach for weak source or structure detection. SFPR also makes it possible for high precision astrometry, including the core-shift measurements up to sub-mm wavelengths for Sgr A* and M87* etc. We also briefly discuss the technical and scheduling considerations for future SFPR observations with the ngEHT.


title: Impact of Sentiment Analysis in Fake Review Detection

abstract: Fake review identification is an important topic and has gained the interest of experts all around the world. Identifying fake reviews is challenging for researchers, and there are several primary challenges to fake review detection. We propose developing an initial research paper for investigating fake reviews by using sentiment analysis. Ten research papers are identified that show fake reviews, and they discuss currently available solutions for predicting or detecting fake reviews. They also show the distribution of fake and truthful reviews through the analysis of sentiment. We summarize and compare previous studies related to fake reviews. We highlight the most significant challenges in the sentiment evaluation process and demonstrate that there is a significant impact on sentiment scores used to identify fake feedback.


title: Smart Face Shield: A Sensor-Based Wearable Face Shield Utilizing Computer Vision Algorithms

abstract: The study aims the development of a wearable device to combat the onslaught of covid-19. Likewise, to enhance the regular face shield available in the market. Furthermore, to raise awareness of the health and safety protocols initiated by the government and its affiliates in the enforcement of social distancing with the integration of computer vision algorithms. The wearable device was composed of various hardware and software components such as a transparent polycarbonate face shield, microprocessor, sensors, camera, thin-film transistor on-screen display, jumper wires, power bank, and python programming language. The algorithm incorporated in the study was object detection under computer vision machine learning. The front camera with OpenCV technology determines the distance of a person in front of the user. Utilizing TensorFlow, the target object identifies and detects the image or live feed to get its bounding boxes. The focal length lens requires the determination of the distance from the camera to the target object. To get the focal length, multiply the pixel width by the known distance and divide it by the known width (Rosebrock, 2020). The deployment of unit testing ensures that the parameters are valid in terms of design and specifications.


title: Multi-Instance Partial-Label Learning: Towards Exploiting Dual Inexact Supervision

abstract: Weakly supervised machine learning algorithms are able to learn from ambiguous samples or labels, e.g., multi-instance learning or partial-label learning. However, in some real-world tasks, each training sample is associated with not only multiple instances but also a candidate label set that contains one ground-truth label and some false positive labels. Specifically, at least one instance pertains to the ground-truth label while no instance belongs to the false positive labels. In this paper, we formalize such problems as multi-instance partial-label learning (MIPL). Existing multi-instance learning algorithms and partial-label learning algorithms are suboptimal for solving MIPL problems since the former fail to disambiguate a candidate label set, and the latter cannot handle a multi-instance bag. To address these issues, a tailored algorithm named MIPLGP, i.e., Multi-Instance Partial-Label learning with Gaussian Processes, is proposed. MIPLGP first assigns each instance with a candidate label set in an augmented label space, then transforms the candidate label set into a logarithmic space to yield the disambiguated and continuous labels via an exclusive disambiguation strategy, and last induces a model based on the Gaussian processes. Experimental results on various datasets validate that MIPLGP is superior to well-established multi-instance learning and partial-label learning algorithms for solving MIPL problems. Our code and datasets will be made publicly available.


title: Three-dimensional structural and compositional inhomogeneity in zeolites unraveled by low-dose electron ptychography

abstract: Structural and compositional inhomogeneity is common in zeolites and considerably affects their properties. Conventional transmission electron microscopy (TEM) cannot provide sufficient information on local structures in zeolites due to the thickness-limited lateral resolution, lack of depth resolution, and electron dose-constrained focusing. We demonstrate that a multislice ptychography method based on four-dimensional scanning TEM (4D-STEM) data can overcome these limitations. The 4D-STEM ptychography image obtained from a ~40-nm thick MFI zeolite exhibits an ultrahigh lateral resolution of ~0.85 {\AA}, enabling the unambiguous identification of individual framework oxygen (O) atoms and the precise determination of the orientations of adsorbed molecules. Furthermore, a depth resolution of ~6.6 nm is achieved, allowing the three-dimensional probing of O vacancies and phase boundaries in zeolites. The results of the 4D-STEM ptychography provide an unprecedented complete understanding of the intergrowth of MFI and MEL zeolites in three dimensions. The 4D-STEM ptychography can be generally applied to various zeolites and other materials with similar electron beam sensitivity.


title: Sentence-level Feedback Generation for English Language Learners: Does Data Augmentation Help?

abstract: In this paper, we present strong baselines for the task of Feedback Comment Generation for Writing Learning. Given a sentence and an error span, the task is to generate a feedback comment explaining the error. Sentences and feedback comments are both in English. We experiment with LLMs and also create multiple pseudo datasets for the task, investigating how it affects the performance of our system. We present our results for the task along with extensive analysis of the generated comments with the aim of aiding future studies in feedback comment generation for English language learners.


title: Confidence-aware Training of Smoothed Classifiers for Certified Robustness

abstract: Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the smoothed classifiers, the fundamental trade-off between accuracy and (adversarial) robustness has been well evidenced in the literature: i.e., increasing the robustness of a classifier for an input can be at the expense of decreased accuracy for some other inputs. In this paper, we propose a simple training method leveraging this trade-off to obtain robust smoothed classifiers, in particular, through a sample-wise control of robustness over the training samples. We make this control feasible by using "accuracy under Gaussian noise" as an easy-to-compute proxy of adversarial robustness for an input. Specifically, we differentiate the training objective depending on this proxy to filter out samples that are unlikely to benefit from the worst-case (adversarial) objective. Our experiments show that the proposed method, despite its simplicity, consistently exhibits improved certified robustness upon state-of-the-art training methods. Somewhat surprisingly, we find these improvements persist even for other notions of robustness, e.g., to various types of common corruptions.


title: Combustion and Evaporation of Deformable Fuel Droplets

abstract: \textit{This study focuses on combustion and evaporation of an isolated freely deforming fuel droplet under convective flow. The droplet shape is modified by varying Weber number at moderate Reynolds numbers. A simplified chemical reaction mechanism is used for combustion modelling.} \textit{The Direct Numerical Simulation (DNS) results show a net positive effect of Weber number on total evaporation rate ($\dot{m}$) for both pure evaporation and combustion cases. The enhancement in $\dot{m}$ for higher Weber number reaches upto $9 \%$ for combustion. A non-spherical envelope flame is observed which grows with time. The Damk\"{o}hler number is higher than 1 for this flame type which leads to faster reaction rates in comparison to evaporation. Hence, the combustion process is seen to be unaffected by droplet shape. An additional comparison between 3-D and 2-D combustion results is performed to understand if 2-D studies can reflect the right physical aspects of this problem. It is found that local evaporation flux in 2-D is $ 42.5 \%$ lower due to lower temperature gradients near the droplet surface for the same inflow velocity. The deformation of droplet is significantly different in 2-D which affects the boundary layer development and the wake flow. This is seen to affect the flame shape at the downstream of droplet. Hence, the 2-D simulations do not recover the correct behaviors.}


title: Ground-state cooling of a massive mechanical oscillator by feedback in cavity magnomechanics

abstract: Cooling the motion of a massive mechanical oscillator into its quantum ground state plays an essential role in observing macroscopic quantum effects in mechanical systems. Here we propose a measurement-based feedback cooling protocol in cavity magnomechanics that is able to cool the mechanical vibration mode of a macroscopic ferromagnet into its ground state. The mechanical mode couples to a magnon mode via a dispersive magnetostrictive interaction, and the latter further couples to a microwave cavity mode via the magnetic-dipole interaction. A feedback loop is introduced by measuring the amplitude of the microwave cavity output field and applying a force onto the mechanical oscillator that is proportional to the amplitude fluctuation of the output field. We show that by properly designing the feedback gain, the mechanical damping rate can be significantly enhanced while the mechanical frequency remains unaffected. Consequently, the vibration mode can be cooled into its quantum ground state in the unresolved-sideband regime at cryogenic temperatures. The protocol is designed for cavity magnomechanical systems using ferromagnetic materials which possess strong magnetostriction along with large magnon dissipation.


title: A novel method for searching the $\Xi_c^{0/+}$-$\Xi_c^{\prime 0/+}$ mixing effect in the angular distribution analysis of a four-body $\Xi_c^{0/+}$ decay

abstract: In this work, we raised a novel method for searching the $\Xi^{0+}_c$-$\Xi_c^{0+\prime}$ mixing effect in an angular distribution analysis of the $\Xi_c\to\Xi^{(\prime)}(\Lambda \pi)\ell^+\nu$ decay, where the mixing effect can be observed by the appearance of the $\Xi^{\prime}$ resonant. Armed with this angular distribution, the decay branching fraction and the forward-backward asymmetry are predicted. We pointed out that the forward-backward asymmetry, as a function of the invariant mass square of $\Xi^{(\prime)}$ and the $\Xi^{0+}_c$-$\Xi_c^{0+\prime}$ mixing angle $\theta_c$, can be used to distinguish the two resonants $\Xi^{(\prime)}$ and even provide a possibility to determine the exact mixing angle.


title: Rare-Seed Generation for Fuzzing

abstract: Starting with a random initial seed, fuzzers search for inputs that trigger bugs or vulnerabilities. However, fuzzers often fail to generate inputs for program paths guarded by restrictive branch conditions. In this paper, we show that by first identifying rare-paths in programs (i.e., program paths with path constraints that are unlikely to be satisfied by random input generation), and then, generating inputs/seeds that trigger rare-paths, one can improve the coverage of fuzzing tools. In particular, we present techniques 1) that identify rare paths using quantitative symbolic analysis, and 2) generate inputs that can explore these rare paths using path-guided concolic execution. We provide these inputs as initial seed sets to three state of the art fuzzers. Our experimental evaluation on a set of programs (that contain a lot of restrictive branch conditions) shows that the fuzzers achieve better coverage with the rare-path based seed set compared to a random initial seed.


title: High-Performance Filters For GPUs

abstract: Filters approximately store a set of items while trading off accuracy for space-efficiency and can address the limited memory on accelerators, such as GPUs. However, there is a lack of high-performance and feature-rich GPU filters as most advancements in filter research has focused on CPUs. In this paper, we explore the design space of filters with a goal to develop massively parallel, high performance, and feature rich filters for GPUs. We evaluate various filter designs in terms of performance, usability, and supported features and identify two filter designs that offer the right trade off in terms of performance, features, and usability. We present two new GPU-based filters, the TCF and GQF, that can be employed in various high performance data analytics applications. The TCF is a set membership filter and supports faster inserts and queries, whereas the GQF supports counting which comes at an additional performance cost. Both the GQF and TCF provide point and bulk insertion API and are designed to exploit the massive parallelism in the GPU without sacrificing usability and necessary features. The TCF and GQF are up to $4.4\times$ and $1.4\times$ faster than the previous GPU filters in our benchmarks and at the same time overcome the fundamental constraints in performance and usability in current GPU filters.


title: A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairness

abstract: Speech-centric machine learning systems have revolutionized many leading domains ranging from transportation and healthcare to education and defense, profoundly changing how people live, work, and interact with each other. However, recent studies have demonstrated that many speech-centric ML systems may need to be considered more trustworthy for broader deployment. Specifically, concerns over privacy breaches, discriminating performance, and vulnerability to adversarial attacks have all been discovered in ML research fields. In order to address the above challenges and risks, a significant number of efforts have been made to ensure these ML systems are trustworthy, especially private, safe, and fair. In this paper, we conduct the first comprehensive survey on speech-centric trustworthy ML topics related to privacy, safety, and fairness. In addition to serving as a summary report for the research community, we point out several promising future research directions to inspire the researchers who wish to explore further in this area.


title: PAC-Bayesian Treatment Allocation Under Budget Constraints

abstract: This paper considers the estimation of treatment assignment rules when the policy maker faces a general budget or resource constraint. Utilizing the PAC-Bayesian framework, we propose new treatment assignment rules that allow for flexible notions of treatment outcome, treatment cost, and a budget constraint. For example, the constraint setting allows for cost-savings, when the costs of non-treatment exceed those of treatment for a subpopulation, to be factored into the budget. It also accommodates simpler settings, such as quantity constraints, and doesn't require outcome responses and costs to have the same unit of measurement. Importantly, the approach accounts for settings where budget or resource limitations may preclude treating all that can benefit, where costs may vary with individual characteristics, and where there may be uncertainty regarding the cost of treatment rules of interest. Despite the nomenclature, our theoretical analysis examines frequentist properties of the proposed rules. For stochastic rules that typically approach budget-penalized empirical welfare maximizing policies in larger samples, we derive non-asymptotic generalization bounds for the target population costs and sharp oracle-type inequalities that compare the rules' welfare regret to that of optimal policies in relevant budget categories. A closely related, non-stochastic, model aggregation treatment assignment rule is shown to inherit desirable attributes.


title: Hidden State Approximation in Recurrent Neural Networks Using Continuous Particle Filtering

abstract: Using historical data to predict future events has many applications in the real world, such as stock price prediction; the robot localization. In the past decades, the Convolutional long short-term memory (LSTM) networks have achieved extraordinary success with sequential data in the related field. However, traditional recurrent neural networks (RNNs) keep the hidden states in a deterministic way. In this paper, we use the particles to approximate the distribution of the latent state and show how it can extend into a more complex form, i.e., the Encoder-Decoder mechanism. With the proposed continuous differentiable scheme, our model is capable of adaptively extracting valuable information and updating the latent state according to the Bayes rule. Our empirical studies demonstrate the effectiveness of our method in the prediction tasks.


title: Locally Simultaneous Inference

abstract: Selective inference is the problem of giving valid answers to statistical questions chosen in a data-driven manner. A standard solution to selective inference is simultaneous inference, which delivers valid answers to the set of all questions that could possibly have been asked. However, simultaneous inference can be unnecessarily conservative if this set includes many questions that were unlikely to be asked in the first place. We introduce a less conservative solution to selective inference that we call locally simultaneous inference, which only answers those questions that could plausibly have been asked in light of the observed data, all the while preserving rigorous type I error guarantees. For example, if the objective is to construct a confidence interval for the "winning" treatment effect in a clinical trial with multiple treatments, and it is obvious in hindsight that only one treatment had a chance to win, then our approach will return an interval that is nearly the same as the uncorrected, standard interval. Locally simultaneous inference is implemented by refining any method for simultaneous inference of interest. Under mild conditions satisfied by common confidence intervals, locally simultaneous inference strictly dominates its underlying simultaneous inference method, meaning it can never yield less statistical power but only more. Compared to conditional selective inference, which demands stronger guarantees, locally simultaneous inference is more easily applicable in nonparametric settings and is more numerically stable.


title: Risk-Sensitive Reinforcement Learning with Exponential Criteria

abstract: While reinforcement learning has shown experimental success in a number of applications, it is known to be sensitive to noise and perturbations in the parameters of the system, leading to high variance in the total reward amongst different episodes in slightly different environments. To introduce robustness, as well as sample efficiency, risk-sensitive reinforcement learning methods are being thoroughly studied. In this work, we provide a definition of robust reinforcement learning policies and formulate a risk-sensitive reinforcement learning problem to approximate them, by solving an optimization problem with respect to a modified objective based on exponential criteria. In particular, we study a model-free risk-sensitive variation of the widely-used Monte Carlo Policy Gradient algorithm and introduce a novel risk-sensitive online Actor-Critic algorithm based on solving a multiplicative Bellman equation using stochastic approximation updates. Analytical results suggest that the use of exponential criteria generalizes commonly used ad-hoc regularization approaches, improves sample efficiency, and introduces robustness with respect to perturbations in the model parameters and the environment. The implementation, performance, and robustness properties of the proposed methods are evaluated in simulated experiments.


title: Monodromy of the equivariant quantum differential equation of the cotangent bundle of a Grassmannian

abstract: We describe the monodromy of the equivariant quantum differential equation of the cotangent bundle of a Grassmannian in terms of the equivariant K-theory algebra of the cotangent bundle. This description is based on the hypergeometric integral representations for solutions of the equivariant quantum differential equation. We identify the space of solutions with the space of the equivariant K-theory algebra of the cotangent bundle. In particular, we show that for any element of the monodromy group, all entries of its matrix in the standard basis of the equivariant K-theory algebra of the cotangent bundle are Laurent polynomials with integer coefficients in the exponentiated equivariant parameters.


title: Electronic transport and thermoelectric properties of phosphorene nanodisk under an electric field

abstract: The Seebeck coefficient is an important quantity in determining the thermoelectric efficiency of a material. Phosphorene is a two-dimensional material with a puckered structure, which makes its properties anisotropic. In this work, a phosphorene nanodisk (PDisk) with a radius of 3.1 nm connected to two zigzag phosphorene nanoribbons is studied, numerically, by the tight-binding (TB) and non-equilibrium Greens function (NEGF) methods in the presence of transverse and perpendicular electric fields. Our results show that the change of the structure from a zigzag ribbon form to a disk one creates an energy gap in the structure, so that for a typical nanodisk with a radius of 3.1 nm, the size of the energy gap is 3.88 eV. Besides, with this change, the maximum Seebeck coefficient increases from 1.54 to 2.03 mV/K. Furthermore, we can control the electron transmission and Seebeck coefficients with the help of the electric fields. The numerical results show that with the increase of the electric field, the transmission coefficient decreases, and the Seebeck coefficient changes. The effect of a perpendicular electric field on the Seebeck coefficient is weaker than a transverse electric field. For an applied transverse electric field of 0.3 V/nm, the maximum Seebeck coefficient enhances to 2.09 mV/K.


title: Graph Neural Network based Child Activity Recognition

abstract: This paper presents an implementation on child activity recognition (CAR) with a graph convolution network (GCN) based deep learning model since prior implementations in this domain have been dominated by CNN, LSTM and other methods despite the superior performance of GCN. To the best of our knowledge, we are the first to use a GCN model in child activity recognition domain. In overcoming the challenges of having small size publicly available child action datasets, several learning methods such as feature extraction, fine-tuning and curriculum learning were implemented to improve the model performance. Inspired by the contradicting claims made on the use of transfer learning in CAR, we conducted a detailed implementation and analysis on transfer learning together with a study on negative transfer learning effect on CAR as it hasn't been addressed previously. As the principal contribution, we were able to develop a ST-GCN based CAR model which, despite the small size of the dataset, obtained around 50% accuracy on vanilla implementations. With feature extraction and fine-tuning methods, accuracy was improved by 20%-30% with the highest accuracy being 82.24%. Furthermore, the results provided on activity datasets empirically demonstrate that with careful selection of pre-train model datasets through methods such as curriculum learning could enhance the accuracy levels. Finally, we provide preliminary evidence on possible frame rate effect on the accuracy of CAR models, a direction future research can explore.


title: New sufficient degree conditions for an $r$-uniform hypergraph to be $k$-edge-connected

abstract: An $r$-uniform hypergraphic sequence (i.e., $r$-graphic sequence) $d=(d_1, d_2,\cdots,d_n)$ is said to be forcibly $k$-edge-connected if every realization of $d$ is $k$-edge-connected. In this paper, we obtain a strongest sufficient degree condition for $d$ to be $k$-edge-connected for all $k\ge 1$ and a strongest sufficient degree condition for $d$ to be super edge-connected. As a corollary, we give the minimum degree condition for $d$ to be maximally edge-connected. We also obtain another sufficient degree condition for $d$ to be $k$-edge-connected.


title: GAN-based Tabular Data Generator for Constructing Synopsis in Approximate Query Processing: Challenges and Solutions

abstract: In data-driven systems, data exploration is imperative for making real-time decisions. However, big data is stored in massive databases that are difficult to retrieve. Approximate Query Processing (AQP) is a technique for providing approximate answers to aggregate queries based on a summary of the data (synopsis) that closely replicates the behavior of the actual data, which can be useful where an approximate answer to the queries would be acceptable in a fraction of the real execution time. This study explores the novel utilization of Generative Adversarial Networks (GANs) in the generation of tabular data that can be employed in AQP for synopsis construction. We thoroughly investigate the unique challenges posed by the synopsis construction process, including maintaining data distribution characteristics, handling bounded continuous and categorical data, and preserving semantic relationships and then introduce the advancement of tabular GAN architectures that overcome these challenges. Furthermore, we propose and validate a suite of statistical metrics tailored for assessing the reliability of the GAN-generated synopses. Our findings demonstrate that advanced GAN variations exhibit a promising capacity to generate high-fidelity synopses, potentially transforming the efficiency and effectiveness of AQP in data-driven systems.


title: Multi-band Optical Variability of the TeV Blazar PG 1553+113 in 2019

abstract: We report the flux and spectral variability of PG 1553+113 on intra-night (IDV) to short-term timescales using BVRI data collected over 91 nights from 28 February to 8 November 2019 employing ten optical telescopes: three in Bulgaria, two each in India and Serbia, and one each in Greece, Georgia, and Latvia. We monitored the blazar quasi-simultaneously for 16 nights in the V and R bands and 8 nights in the V, R, I bands and examined the light curves (LCs) for intra-day flux and colour variations using two powerful tests: the power-enhanced F-test and the nested ANOVA test. The source was found to be significantly (> 99%) variable in 4 nights out of 27 in R-band, 1 out of 16 in V-band, and 1 out of 6 nights in I-band. No temporal variations in the colours were observed on IDV timescale. During the course of these observations the total variation in R-band was 0.89 mag observed. We also investigated the spectral energy distribution (SED) using B, V, R, and I band data. We found optical spectral indices in the range of 0.878+-0.029 to 1.106+-0.065 by fitting a power law to these SEDs of PG 1553+113. We found that the source follows a bluer-when-brighter trend on IDV timescales. We discuss possible physical causes of the observed spectral variability.


title: Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search

abstract: Medical systematic reviews typically require assessing all the documents retrieved by a search. The reason is two-fold: the task aims for ``total recall''; and documents retrieved using Boolean search are an unordered set, and thus it is unclear how an assessor could examine only a subset. Screening prioritisation is the process of ranking the (unordered) set of retrieved documents, allowing assessors to begin the downstream processes of the systematic review creation earlier, leading to earlier completion of the review, or even avoiding screening documents ranked least relevant. Screening prioritisation requires highly effective ranking methods. Pre-trained language models are state-of-the-art on many IR tasks but have yet to be applied to systematic review screening prioritisation. In this paper, we apply several pre-trained language models to the systematic review document ranking task, both directly and fine-tuned. An empirical analysis compares how effective neural methods compare to traditional methods for this task. We also investigate different types of document representations for neural methods and their impact on ranking performance. Our results show that BERT-based rankers outperform the current state-of-the-art screening prioritisation methods. However, BERT rankers and existing methods can actually be complementary, and thus, further improvements may be achieved if used in conjunction.


title: MeSH Suggester: A Library and System for MeSH Term Suggestion for Systematic Review Boolean Query Construction

abstract: Boolean query construction is often critical for medical systematic review literature search. To create an effective Boolean query, systematic review researchers typically spend weeks coming up with effective query terms and combinations. One challenge to creating an effective systematic review Boolean query is the selection of effective MeSH Terms to include in the query. In our previous work, we created neural MeSH term suggestion methods and compared them to state-of-the-art MeSH term suggestion methods. We found neural MeSH term suggestion methods to be highly effective. In this demonstration, we build upon our previous work by creating (1) a Web-based MeSH term suggestion prototype system that allows users to obtain suggestions from a number of underlying methods and (2) a Python library that implements ours and others' MeSH term suggestion methods and that is aimed at researchers who want to further investigate, create or deploy such type of methods. We describe the architecture of the web-based system and how to use it for the MeSH term suggestion task. For the Python library, we describe how the library can be used for advancing further research and experimentation, and we validate the results of the methods contained in the library on standard datasets. Our web-based prototype system is available at http://ielab-mesh-suggest.uqcloud.net, while our Python library is at https://github.com/ielab/meshsuggestlib.


title: Fast FullSubNet: Accelerate Full-band and Sub-band Fusion Model for Single-channel Speech Enhancement

abstract: FullSubNet is our recently proposed real-time single-channel speech enhancement network that achieves outstanding performance on the Deep Noise Suppression (DNS) Challenge dataset. A number of variants of FullSubNet have been proposed, but they all focus on the structure design towards better performance and are rarely concerned with computational efficiency. For many speech enhancement applications, a key feature is that system runs on a real-time, latency-sensitive, battery-powered platform, which strictly limits the algorithm latency and computational complexity. In this work, we propose a new architecture named Fast FullSubNet dedicated to accelerating the computation of FullSubNet. Specifically, Fast FullSubNet processes sub-band speech spectra in the mel-frequency domain by using cascaded linear-to-mel full-band, sub-band, and mel-to-linear full-band models such that frequencies involved in the sub-band computation are vastly reduced. After that, a down-sampling operation is proposed for the sub-band input sequence to further reduce the computational complexity along the time axis. Experimental results show that, compared to FullSubNet, Fast FullSubNet has only 13\% computational complexity and 16\% processing time, and achieves comparable or even better performance. Code and audio samples are available at https://github.com/Audio-WestlakeU/FullSubNet.


title: An Extension of Many-Interacting-Worlds Method on Non-Guassian Model

abstract: Discussions about whether quantum theory is determinism or indeterminism has lasted for a century. A new approach to standard quantum mechanics called many-interacting-worlds method based on many-worlds interpretation and de Broglie-Bohm mechanics provided the possibility to demonstrate probability from deterministic universe.The many-interacting-worlds method has been proved successful in the ground state of harmonic oscillator. In this article we extend this method to one dimensional Coulomb potential and construct a corresponding empirical density function. We also provide a theoretical proof of the convergence of density function. Our numerical simulation of one dimensional Coulomb potential in the first excited state obtains the consistent result with standard quantum mechanics and shows the applicability of many-interacting-worlds method. This research provides the possibility to extend many-interacting-worlds method to non-Gaussian quantum systems.


title: Landau-Bloch type theorem for elliptic and $K$-quasiregular harmonic mappings

abstract: In this paper, we establish an improved coefficient bounds for quasiregular and elliptic harmonic mappings and using these bounds we establish Landau-Bloch type theorem for $(K,K')$-elliptic and K-quasiregular harmonic mappings in plane. Furthermore, we prove the coefficient estimates for $K$-quasiconformal harmonic self maps defined on the unit disk $\mathbb{D}$.


title: Weyl's lemma on $RCD(K,N)$ metric measure spaces

abstract: In this paper, we extend the classical Weyl's lemma to $RCD(K,N)$ metric measure spaces. As its applications, we show the local regularity of solutions for Poisson equations and a Liouville-type result for $L^1$ very weak harmonic functions on $RCD(K,N)$ spaces. Meanwhile, a byproduct is that we obtain a gradient estimate for solutions to a class of elliptic equations with dis-continuous coefficients.


title: Glycolytic Wave Patterns in a Simple Reaction-diffusion System with Inhomogeneous Influx: Dynamic Transitions

abstract: An inhomogeneous profile of chemostatted species generates a rich variety of patterns in glycolytic waves depicted in a Selkov reaction-diffusion framework here. A key role played by diffusion amplitude and symmetry in the chemostatted species profile in dictating the fate of local spatial dynamics involving periodic, quasiperiodic, and chaotic patterns and transitions among them are investigated systematically. More importantly, various dynamic transitions, including wave propagation direction changes, are illustrated in interesting situations. Besides numerical results, our analytical formulation of the amplitude equation connecting complex Ginzburg-Landau and Lambda-omega representation shed light on the phase dynamics of the system. This systematic study of the glycolytic reaction-diffusion wave is in line with previous experimental results in the open spatial reactors and will provide knowledge about the dynamics that shape and control biological information processing and related phenomena.

categories: nlin.AO nlin.CD nlin.PS physics.bio-ph physics.chem-ph


title: Micromagnetic study of spin transport in easy-plane antiferromagnetic insulators

abstract: Magnon eigenmodes in easy-plane antiferromagnetic insulators are linearly polarized and are not expected to carry any net spin angular momentum. Motivated by recent nonlocal spin transport experiments in the easy-plane phase of hematite, we perform a series of micromagnetic simulations in a nonlocal geometry at finite temperatures. We show that by tuning an external magnetic field, we can control the magnon eigenmodes and the polarization of the spin transport signal in these systems. We argue that a coherent beating oscillation between two orthogonal linearly polarized magnon eigenmodes is the mechanism responsible for finite spin transport in easy-plane antiferromagnetic insulators. The sign of the detected spin signal is also naturally explained by the proposed coherent beating mechanism. Our finding opens a path for on-demand control of the spin signal in a large class of easy-plane antiferromagnetic insulators.


title: Vanishing of Tors of absolute integral closures in equicharacteristic zero

abstract: We show that a ring $R$ is regular if $Tor_{i}^{R}(R^{+},k) = 0$ for some $i\geq 1$ assuming further that $R$ is a $\mathbb{N}$-graded ring of dimension $2$ finitely generated over an equi-characteristic zero field $k$. This answers a question of Bhatt, Iyengar, and Ma. We use almost mathematics over $R^{+}$ to deduce properties of the noetherian ring $R$ and rational surface singularities. Moreover we show that $R^{+}$ in equi-characteristic zero is $m$-adically ideal(wise) separated, a condition which appears in the proof of local criterion for flatness. In dimension $2$ it is Ohm-Rush and intersection flat. As an application we show that the hypothesis can be astonishingly vacuous for $i \ll dim(R)$. We show that a positive answer to an old question of Aberbach and Hochster also answers this question. We use our techniques to make some remarks on a question of Andr\'e and Fiorot regarding `fpqc analgoues' of splinters.


title: Magnetic, transport and topological properties of Co-based shandite thin films

abstract: The kagome ferromagnet, Co-based shandite Co3Sn2S2, shows a large anomalous Hall effect (AHE) associated with the Weyl nodes. A thin film with a Co kagome monolayer was predicted to exhibit the quantum AHE, which awaits the experimental realisation. However, it is challenging to precisely predict how the Weyl nodes reside in thin films where the lattice and electronic structures are in general different from the bulk. Here we report comprehensive ab initio results for thin films of Co3Sn2S2 with one, two and three Co layers with Sn or S surface terminations. We find that all the Sn-end films stabilise a ferromagnetic state similar to the bulk, and retain the large AHE down to the monolayer limit where the AHE is quantised, while the magnetic and topological properties drastically change with the number of Co layers in the S-end films. Our results would stimulate further experimental exploration of thin Weyl materials.


title: 2D Pose Estimation based Child Action Recognition

abstract: We present a graph convolutional network with 2D pose estimation for the first time on child action recognition task achieving on par results with an RGB modality based model on a novel benchmark dataset containing unconstrained environment based videos.


title: Neural Coreference Resolution based on Reinforcement Learning

abstract: The target of a coreference resolution system is to cluster all mentions that refer to the same entity in a given context. All coreference resolution systems need to solve two subtasks; one task is to detect all of the potential mentions, and the other is to learn the linking of an antecedent for each possible mention. In this paper, we propose a reinforcement learning actor-critic-based neural coreference resolution system, which can achieve both mention detection and mention clustering by leveraging an actor-critic deep reinforcement learning technique and a joint training algorithm. We experiment on the BERT model to generate different input span representations. Our model with the BERT span representation achieves the state-of-the-art performance among the models on the CoNLL-2012 Shared Task English Test Set.


title: SurfaceVoronoi: Efficiently Computing Voronoi Diagrams over Mesh Surfaces with Arbitrary Distance Solvers

abstract: In this paper, we propose to compute Voronoi diagrams over mesh surfaces driven by an arbitrary geodesic distance solver, assuming that the input is a triangle mesh as well as a collection of sites $P=\{p_i\}_{i=1}^m$ on the surface. We propose two key techniques to solve this problem. First, as the partition is determined by minimizing the $m$ distance fields, each of which rooted at a source site, we suggest keeping one or more distance triples, for each triangle, that may help determine the Voronoi bisectors when one uses a mark-and-sweep geodesic algorithm to predict the multi-source distance field. Second, rather than keep the distance itself at a mesh vertex, we use the squared distance to characterize the linear change of distance field restricted in a triangle, which is proved to induce an exact VD when the base surface reduces to a planar triangle mesh. Specially, our algorithm also supports the Euclidean distance, which can handle thin-sheet models (e.g. leaf) and runs faster than the traditional restricted Voronoi diagram~(RVD) algorithm. It is very extensible to deal with various variants of surface-based Voronoi diagrams including (1)surface-based power diagram, (2)constrained Voronoi diagram with curve-type breaklines, and (3)curve-type generators. We conduct extensive experimental results to validate the ability to approximate the exact VD in different distance-driven scenarios.


title: Contextually Enhanced ES-dRNN with Dynamic Attention for Short-Term Load Forecasting

abstract: In this paper, we propose a new short-term load forecasting (STLF) model based on contextually enhanced hybrid and hierarchical architecture combining exponential smoothing (ES) and a recurrent neural network (RNN). The model is composed of two simultaneously trained tracks: the context track and the main track. The context track introduces additional information to the main track. It is extracted from representative series and dynamically modulated to adjust to the individual series forecasted by the main track. The RNN architecture consists of multiple recurrent layers stacked with hierarchical dilations and equipped with recently proposed attentive dilated recurrent cells. These cells enable the model to capture short-term, long-term and seasonal dependencies across time series as well as to weight dynamically the input information. The model produces both point forecasts and predictive intervals. The experimental part of the work performed on 35 forecasting problems shows that the proposed model outperforms in terms of accuracy its predecessor as well as standard statistical models and state-of-the-art machine learning models.


title: Marginal-Certainty-aware Fair Ranking Algorithm

abstract: Ranking systems are ubiquitous in modern Internet services, including online marketplaces, social media, and search engines. Traditionally, ranking systems only focus on how to get better relevance estimation. When relevance estimation is available, they usually adopt a user-centric optimization strategy where ranked lists are generated by sorting items according to their estimated relevance. However, such user-centric optimization ignores the fact that item providers also draw utility from ranking systems. It has been shown in existing research that such user-centric optimization will cause much unfairness to item providers, followed by unfair opportunities and unfair economic gains for item providers. To address ranking fairness, many fair ranking methods have been proposed. However, as we show in this paper, these methods could be suboptimal as they directly rely on the relevance estimation without being aware of the uncertainty (i.e., the variance of the estimated relevance). To address this uncertainty, we propose a novel Marginal-Certainty-aware Fair algorithm named MCFair. MCFair jointly optimizes fairness and user utility, while relevance estimation is constantly updated in an online manner. In MCFair, we first develop a ranking objective that includes uncertainty, fairness, and user utility. Then we directly use the gradient of the ranking objective as the ranking score. We theoretically prove that MCFair based on gradients is optimal for the aforementioned ranking objective. Empirically, we find that on semi-synthesized datasets, MCFair is effective and practical and can deliver superior performance compared to state-of-the-art fair ranking methods. To facilitate reproducibility, we release our code https://github.com/Taosheng-ty/WSDM22-MCFair.


title: AutoSlicer: Scalable Automated Data Slicing for ML Model Analysis

abstract: Automated slicing aims to identify subsets of evaluation data where a trained model performs anomalously. This is an important problem for machine learning pipelines in production since it plays a key role in model debugging and comparison, as well as the diagnosis of fairness issues. Scalability has become a critical requirement for any automated slicing system due to the large search space of possible slices and the growing scale of data. We present Autoslicer, a scalable system that searches for problematic slices through distributed metric computation and hypothesis testing. We develop an efficient strategy that reduces the search space through pruning and prioritization. In the experiments, we show that our search strategy finds most of the anomalous slices by inspecting a small portion of the search space.


title: Planning Immediate Landmarks of Targets for Model-Free Skill Transfer across Agents

abstract: In reinforcement learning applications like robotics, agents usually need to deal with various input/output features when specified with different state/action spaces by their developers or physical restrictions. This indicates unnecessary re-training from scratch and considerable sample inefficiency, especially when agents follow similar solution steps to achieve tasks. In this paper, we aim to transfer similar high-level goal-transition knowledge to alleviate the challenge. Specifically, we propose PILoT, i.e., Planning Immediate Landmarks of Targets. PILoT utilizes the universal decoupled policy optimization to learn a goal-conditioned state planner; then, distills a goal-planner to plan immediate landmarks in a model-free style that can be shared among different agents. In our experiments, we show the power of PILoT on various transferring challenges, including few-shot transferring across action spaces and dynamics, from low-dimensional vector states to image inputs, from simple robot to complicated morphology; and we also illustrate a zero-shot transfer solution from a simple 2D navigation task to the harder Ant-Maze task.


title: Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPs

abstract: Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes. While conventional wisdom commonly attributes the success of GNNs to their advanced expressivity, we conjecture that this is not the main cause of GNNs' superiority in node-level prediction tasks. This paper pinpoints the major source of GNNs' performance gain to their intrinsic generalization capability, by introducing an intermediate model class dubbed as P(ropagational)MLP, which is identical to standard MLP in training, but then adopts GNN's architecture in testing. Intriguingly, we observe that PMLPs consistently perform on par with (or even exceed) their GNN counterparts, while being much more efficient in training. This finding sheds new insights into understanding the learning behavior of GNNs, and can be used as an analytic tool for dissecting various GNN-related research problems. As an initial step to analyze the inherent generalizability of GNNs, we show the essential difference between MLP and PMLP at infinite-width limit lies in the NTK feature map in the post-training stage. Moreover, by examining their extrapolation behavior, we find that though many GNNs and their PMLP counterparts cannot extrapolate non-linear functions for extremely out-of-distribution samples, they have greater potential to generalize to testing samples near the training data range as natural advantages of GNN architectures.


title: Minimizing Maximum Model Discrepancy for Transferable Black-box Targeted Attacks

abstract: In this work, we study the black-box targeted attack problem from the model discrepancy perspective. On the theoretical side, we present a generalization error bound for black-box targeted attacks, which gives a rigorous theoretical analysis for guaranteeing the success of the attack. We reveal that the attack error on a target model mainly depends on empirical attack error on the substitute model and the maximum model discrepancy among substitute models. On the algorithmic side, we derive a new algorithm for black-box targeted attacks based on our theoretical analysis, in which we additionally minimize the maximum model discrepancy(M3D) of the substitute models when training the generator to generate adversarial examples. In this way, our model is capable of crafting highly transferable adversarial examples that are robust to the model variation, thus improving the success rate for attacking the black-box model. We conduct extensive experiments on the ImageNet dataset with different classification models, and our proposed approach outperforms existing state-of-the-art methods by a significant margin. Our codes will be released.


title: Type of local von Neumann algebras in abelian quantum double model

abstract: We show that the local von Neumann algebras on convex areas of the frustration-free ground state of abelian quantum double models are of type $II_\infty$.


title: Collinearity of points on Poincar\'e unit disk and Riemann sphere

abstract: We study certain points significant for the hyperbolic geometry of the unit disk. We give explicit formulas for the intersection points of the Euclidean lines and the stereographic projections of great circles of the Riemann sphere passing through these points. We prove several results related to collinearity of these intersection points, offer new ways to find the hyperbolic midpoint, and represent a formula for the chordal midpoint. The proofs utilize Gr\"obner bases from computer algebra for the solution of polynomial equations.


title: 2-d Fermionic SPT with CRT symmetry

abstract: An invariant of SPT-phases with on-site finite group $G$ symmetry for two-dimensional Fermion systems was derived in [O]. This invariant is doubled compared to the conjectured one from the invertible quantum field theory. We show that if we require CRT-symmetry (which holds automatically in quantum field theory) in addition, then our invariant reduces to the conjectured one.


title: Automated Optical Inspection of FAST's Reflector Surface using Drones and Computer Vision

abstract: The Five-hundred-meter Aperture Spherical radio Telescope (FAST) is the world's largest single-dish radio telescope. Its large reflecting surface achieves unprecedented sensitivity but is prone to damage, such as dents and holes, caused by naturally-occurring falling objects. Hence, the timely and accurate detection of surface defects is crucial for FAST's stable operation. Conventional manual inspection involves human inspectors climbing up and examining the large surface visually, a time-consuming and potentially unreliable process. To accelerate the inspection process and increase its accuracy, this work makes the first step towards automating the inspection of FAST by integrating deep-learning techniques with drone technology. First, a drone flies over the surface along a predetermined route. Since surface defects significantly vary in scale and show high inter-class similarity, directly applying existing deep detectors to detect defects on the drone imagery is highly prone to missing and misidentifying defects. As a remedy, we introduce cross-fusion, a dedicated plug-in operation for deep detectors that enables the adaptive fusion of multi-level features in a point-wise selective fashion, depending on local defect patterns. Consequently, strong semantics and fine-grained details are dynamically fused at different positions to support the accurate detection of defects of various scales and types. Our AI-powered drone-based automated inspection is time-efficient, reliable, and has good accessibility, which guarantees the long-term and stable operation of FAST.


title: The Underlying Correlated Dynamics in Neural Training

abstract: Training of neural networks is a computationally intensive task. The significance of understanding and modeling the training dynamics is growing as increasingly larger networks are being trained. We propose in this work a model based on the correlation of the parameters' dynamics, which dramatically reduces the dimensionality. We refer to our algorithm as \emph{correlation mode decomposition} (CMD). It splits the parameter space into groups of parameters (modes) which behave in a highly correlated manner through the epochs. We achieve a remarkable dimensionality reduction with this approach, where networks like ResNet-18, transformers and GANs, containing millions of parameters, can be modeled well using just a few modes. We observe each typical time profile of a mode is spread throughout the network in all layers. Moreover, our model induces regularization which yields better generalization capacity on the test set. This representation enhances the understanding of the underlying training dynamics and can pave the way for designing better acceleration techniques.


title: Configurational temperature in active matter. II. Quantifying the deviation from thermal equilibrium

abstract: This paper suggests using the configurational temperature $\Tc$ for quantifying how far an active-matter system is from thermal equilibrium. We measure this ``distance'' by the ratio of the systemic temperature $\Ts$ to $\Tc$, where $\Ts$ is the canonical-ensemble temperature for which the average potential energy is equal to that of the active-matter system. $\Tc$ is ``local'' in the sense that it is the average of a function, which only depends on how the potential energy varies in the vicinity of a given configuration; in contrast $\Ts$ is a global quantity. The quantity $\Ts/\Tc$ is straightforward to evaluate in a computer simulation; equilibrium simulations in conjunction with a single steady-state active-matter configuration are enough to determine $\Ts/\Tc$. We validate the suggestion that $\Ts/\Tc$ quantifies the deviation from thermal equilibrium by data for the radial distribution function of 3d Kob-Andersen and 2d Yukawa active-matter models with active Ornstein-Uhlenbeck and active Brownian Particle dynamics. Moreover, we show that $\Ts/\Tc$, structure, and dynamics of the homogeneous phase are all approximately invariant along the motility-induced phase separation (MIPS) boundary in the phase diagram of the 2d Yukawa model. The measure $\Ts/\Tc$ is not limited to active matter; it can be used for quantifying how far any system involving a potential-energy function, e.g., a driven Hamiltonian system, is from thermal equilibrium.


title: Gait Recognition Using 3-D Human Body Shape Inference

abstract: Gait recognition, which identifies individuals based on their walking patterns, is an important biometric technique since it can be observed from a distance and does not require the subject's cooperation. Recognizing a person's gait is difficult because of the appearance variants in human silhouette sequences produced by varying viewing angles, carrying objects, and clothing. Recent research has produced a number of ways for coping with these variants. In this paper, we present the usage of inferring 3-D body shapes distilled from limited images, which are, in principle, invariant to the specified variants. Inference of 3-D shape is a difficult task, especially when only silhouettes are provided in a dataset. We provide a method for learning 3-D body inference from silhouettes by transferring knowledge from 3-D shape prior from RGB photos. We use our method on multiple existing state-of-the-art gait baselines and obtain consistent improvements for gait identification on two public datasets, CASIA-B and OUMVLP, on several variants and settings, including a new setting of novel views not seen during training.


title: Equation of state and speed of sound of (2+1)-flavor QCD in strangeness-neutral matter at non-vanishing net baryon-number density

abstract: We update results on the QCD equation of state in (2+1)-flavor QCD with non-zero conserved charge chemical potentials obtained from an eighth-order Taylor series. We present results for basic bulk thermodynamic observables of strangeness-neutral strong-interaction matter, i.e. pressure, number densities, energy and entropy density, and resum Taylor series results using Pad\'e approximants. Furthermore, we calculate the speed of sound as well as the adiabatic compression factor of strangeness-neutral matter on lines of constant entropy per net baryon number. We show that the equation of state ($P(n_B), \epsilon (n_B)$) is already well described by the $4^{\rm th}$-order Taylor series in almost the entire range of temperatures accessible with the beam energy scan in collider mode at the Relativistic Heavy Ion Collider.


title: Text2Struct: A Machine Learning Pipeline for Mining Structured Data from Text

abstract: Many analysis and prediction tasks require the extraction of structured data from unstructured texts. However, an annotation scheme and a training dataset have not been available for training machine learning models to mine structured data from text without special templates and patterns. To solve it, this paper presents an end-to-end machine learning pipeline, Text2Struct, including a text annotation scheme, training data processing, and machine learning implementation. We formulated the mining problem as the extraction of metrics and units associated with numerals in the text. Text2Struct was trained and evaluated using an annotated text dataset collected from abstracts of medical publications regarding thrombectomy. In terms of prediction performance, a dice coefficient of 0.82 was achieved on the test dataset. By random sampling, most predicted relations between numerals and entities were well matched to the ground-truth annotations. These results show that Text2Struct is viable for the mining of structured data from text without special templates or patterns. It is anticipated to further improve the pipeline by expanding the dataset and investigating other machine learning models. A code demonstration can be found at: https://github.com/zcc861007/CourseProject


title: Task Preferences across Languages on Community Question Answering Platforms

abstract: With the steady emergence of community question answering (CQA) platforms like Quora, StackExchange, and WikiHow, users now have an unprecedented access to information on various kind of queries and tasks. Moreover, the rapid proliferation and localization of these platforms spanning geographic and linguistic boundaries offer a unique opportunity to study the task requirements and preferences of users in different socio-linguistic groups. In this study, we implement an entity-embedding model trained on a large longitudinal dataset of multi-lingual and task-oriented question-answer pairs to uncover and quantify the (i) prevalence and distribution of various online tasks across linguistic communities, and (ii) emerging and receding trends in task popularity over time in these communities. Our results show that there exists substantial variance in task preference as well as popularity trends across linguistic communities on the platform. Findings from this study will help Q&A platforms better curate and personalize content for non-English users, while also offering valuable insights to businesses looking to target non-English speaking communities online.


title: Blow-up and lifespan estimate to a nonlinear wave equation in Schwarzschild spacetime

abstract: We study the semilinear wave equation with power type nonlinearity and small initial data in Schwarzschild spacetime. If the nonlinear exponent $p$ satisfies $2\le p<1+\sqrt 2$, we establish the sharp upper bound of lifespan estimate, while for the most delicate critical power $p=1+\sqrt2$, we show that the lifespan satisfies \[ T(\e)\le \exp\left(C\e^{-(2+\sqrt 2)}\right), \] the optimality of which remains to be proved. The key novelty is that the compact support of the initial data can be close to the event horizon. By combining the global existence result for $p>1+\sqrt 2$ obtained by Lindblad et al.(Math. Ann. 2014), we then give a positive answer to the interesting question posed by Dafermos and Rodnianski(J. Math. Pures Appl. 2005, the end of the first paragraph in page $1151$): $p=1+\sqrt 2$ is exactly the critical power of $p$ separating stability and blow-up.


title: Probing many-body correlations using quantum-cascade correlation spectroscopy

abstract: The radiative quantum cascade, i.e. the consecutive emission of photons from a ladder of energy levels, is of fundamental importance in quantum optics. For example, the two-photon cascaded emission from calcium atoms was used in pioneering experiments to test Bell inequalities. In solid-state quantum optics, the radiative biexciton-exciton cascade has proven useful to generate entangled-photon pairs. More recently, correlations and entanglement of microwave photons emitted from a two-photon cascaded process were measured using superconducting circuits. All these experiments rely on the highly non-linear nature of the underlying energy ladder, enabling direct excitation and probing of specific single-photon transitions. Here, we use exciton polaritons to explore the cascaded emission of photons in the regime where individual transitions of the ladder are not resolved, a regime that has not been addressed so far. We excite a polariton quantum cascade by off-resonant laser excitation and probe the emitted luminescence using a combination of spectral filtering and correlation spectroscopy. Remarkably, the measured photon-photon correlations exhibit a strong dependence on the polariton energy, and therefore on the underlying polaritonic interaction strength, with clear signatures from two- and three-body Feshbach resonances. Our experiment establishes photon-cascade correlation spectroscopy as a highly sensitive tool to provide valuable information about the underlying quantum properties of novel semiconductor materials and we predict its usefulness in view of studying many-body quantum phenomena.


title: Determination of U-spin breaking parameters with an amplitude analysis of the decay $D^0 \to K_{\rm L}^0\pi^+\pi^-$

abstract: We present a study of the resonant structure of the decay $D^0 \to K_{\rm L}^0\pi^+\pi^-$, using quantum-correlated $D^0\bar{D}^0$ data produced at $\sqrt{s}=3.773$ GeV. The data sample was collected by the BESIII experiment and corresponds to an integrated luminosity of $2.93$ fb$^{-1}$. This study is the first amplitude analysis of a decay mode involving a $K_{\rm L}^0$, which also results in the first measurement of the complex $\textit{U-spin breaking parameters}$ ($\hat{\rho}$) related to various $\mathit{CP}$-eigenstate resonant modes through which the three-body decay proceeds. The moduli of the $\hat{\rho}$ parameters have central values in a wide range from $0.4$ to $12.1$, which indicates substantial U-spin symmetry breaking. We present the fractional resonant contributions and average strong-phase parameters over regions of phase space for both $K_{\rm S}^0\pi^+\pi^-$ and $K_{\rm L}^0\pi^+\pi^-$ modes. We also report the ratio of the branching fractions between $K_{\rm L}^0\pi^+\pi^-$ and $K_{\rm S}^0\pi^+\pi^-$ decay modes and the $\mathit{CP}$-even fraction of the $K_{\rm L}^0\pi^+\pi^-$ state calculated using the U-spin breaking parameters.


title: Perfectly Covert Communication with a Reflective Panel

abstract: This work considers the problem of \emph{perfect} covert communication in wireless networks. Specifically, harnessing an Intelligent Reflecting Surface (IRS), we turn our attention to schemes that allow the transmitter to completely hide the communication, with \emph{zero energy} at the unwanted listener (Willie) and hence zero probability of detection. Applications of such schemes go beyond simple covertness, as we prevent detectability or decoding even when the codebook, timings, and channel characteristics are known to Willie. We define perfect covertness, give a necessary and sufficient condition for it in IRS-assisted communication, and define the optimization problem. For two IRS elements, we analyze the probability of finding a solution and derive its closed form. We then investigate the problem of more than two IRS elements by analyzing the probability of such a zero-detection solution. We prove that this probability converges to $1$ as the number of elements tends to infinity. We provide an iterative algorithm to find a perfectly covert solution and prove its convergence. The results are also supported by simulations, showing that a small amount of IRS elements allows for a positive rate at the legitimate user yet with zero probability of detection at an unwanted listener.


title: Determining Distributions of Security Means for WSNs based on the Model of a Neighbourhood Watch

abstract: Neighbourhood watch is a concept that allows a community to distribute a complex security task in between all members. Members of the community carry out individual security tasks to contribute to the overall security of it. It reduces the workload of a particular individual while securing all members and allowing them to carry out a multitude of security tasks. Wireless sensor networks (WSNs) are composed of resource-constraint independent battery driven computers as nodes communicating wirelessly. Security in WSNs is essential. Without sufficient security, an attacker is able to eavesdrop the communication, tamper monitoring results or deny critical nodes providing their service in a way to cut off larger network parts. The resource-constraint nature of sensor nodes prevents them from running full-fledged security protocols. Instead, it is necessary to assess the most significant security threats and implement specialised protocols. A neighbourhood-watch inspired distributed security scheme for WSNs has been introduced by Langend\"orfer. Its goal is to increase the variety of attacks a WSN can fend off. A framework of such complexity has to be designed in multiple steps. Here, we introduce an approach to determine distributions of security means on large-scale static homogeneous WSNs. Therefore, we model WSNs as undirected graphs in which two nodes connected iff they are in transmission range. The framework aims to partition the graph into $n$ distinct security means resulting in the targeted distribution. The underlying problems turn out to be NP hard and we attempt to solve them using linear programs (LPs). To evaluate the computability of the LPs, we generate large numbers of random {\lambda}-precision unit disk graphs (UDGs) as representation of WSNs. For this purpose, we introduce a novel {\lambda}-precision UDG generator to model WSNs with a minimal distance in between nodes.


title: Nonsmooth manifold decompositions

abstract: We study the structure induced on a smooth manifold by a continuous selection of smooth functions. In case such selection is suitably generic, it provides a stratification of the manifold, whose strata are algebraically defined smooth submanifolds. When the continuous selection has nondegenerate critical points, stratification descends to the local topological structure. We analyze this structure for the maximum of three smooth functions on a 4-manifold, which provides a new perspective on the theory of trisections.


title: A Better Choice: Entire-space Datasets for Aspect Sentiment Triplet Extraction

abstract: Aspect sentiment triplet extraction (ASTE) aims to extract aspect term, sentiment and opinion term triplets from sentences. Since the initial datasets used to evaluate models on ASTE had flaws, several studies later corrected the initial datasets and released new versions of the datasets independently. As a result, different studies select different versions of datasets to evaluate their methods, which makes ASTE-related works hard to follow. In this paper, we analyze the relation between different versions of datasets and suggest that the entire-space version should be used for ASTE. Besides the sentences containing triplets and the triplets in the sentences, the entire-space version additionally includes the sentences without triplets and the aspect terms which do not belong to any triplets. Hence, the entire-space version is consistent with real-world scenarios and evaluating models on the entire-space version can better reflect the models' performance in real-world scenarios. In addition, experimental results show that evaluating models on non-entire-space datasets inflates the performance of existing models and models trained on the entire-space version can obtain better performance.


title: Realization of a three-dimensional quantum Hall effect in a Zeeman-induced second order topological insulator on a torus

abstract: We propose a realization of a quantum Hall effect (QHE) in a second-order topological insulator (SOTI) in three dimensions (3D), which is mediated by hinge states on a torus surface. It results from the nontrivial interplay of the material structure, Zeeman effect, and the surface curvature. In contrast to the conventional 2D- and 3D-QHE, we show that the 3D-SOTI QHE is not affected by orbital effects of the applied magnetic field and exists in the presence of a Zeeman term only, induced e.g. by magnetic doping. To explain the 3D-SOTI QHE, we analyze the boundary charge for a 3D-SOTI and establish its universal dependence on the Aharonov-Bohm flux threading through the torus hole. Exploiting the fundamental relation between the boundary charge and the Hall conductance, we demonstrate the universal quantization of the latter, as well as its stability against random disorder potentials and continuous deformations of the torus surface.


title: Branching ratio and $CP$ violation of $B\to K\pi$ decays in a modified perturbative QCD approach

abstract: We calculate the branching ratio and $CP$ violations for $B\to K\pi$ decays in a modified perturbative QCD approach based on $k_{T}$ factorization. The resummation effect of the transverse momentum regulates the endpoint singularity. Using the $B$ meson wave function that is obtained in the relativistic potential model, soft contribution cannot be suppressed effectively by Sudakov factor. Soft scale cutoff and soft $BK$, $B\pi$ and $K\pi$ form factors have to be introduced. The most important next-to-leading-order contributions from the vertex corrections, the quark loops, and the magnetic penguins are also considered. In addition, the contribution of the color-octet hadronic matrix element is included which is essentially of long-distance dynamics. Our predictions for branching ratios and $CP$ violations are in good agreement with the experimental data. Especially the theoretical result of dramatic difference between the $CP$ violations of $B^+\to K^+\pi^0$ and $B^0\to K^+\pi^-$ is consistent with experimental measurement, therefore the $K\pi$ puzzle in $B$ decays can be resolved in our way of the modified perturbative QCD approach.


title: On a group-theoretical generalization of the Gauss formula

abstract: In this paper, we discuss a group-theoretical generalization of the well-known Gauss formula involving the functionthat counts the number of automorphisms of a finite group. This gives several characterizations of finite cyclic groups.


title: Beyond Digital "Echo Chambers": The Role of Viewpoint Diversity in Political Discussion

abstract: Increasingly taking place in online spaces, modern political conversations are typically perceived to be unproductively affirming -- siloed in so called ``echo chambers'' of exclusively like-minded discussants. Yet, to date we lack sufficient means to measure viewpoint diversity in conversations. To this end, in this paper, we operationalize two viewpoint metrics proposed for recommender systems and adapt them to the context of social media conversations. This is the first study to apply these two metrics (Representation and Fragmentation) to real world data and to consider the implications for online conversations specifically. We apply these measures to two topics -- daylight savings time (DST), which serves as a control, and the more politically polarized topic of immigration. We find that the diversity scores for both Fragmentation and Representation are lower for immigration than for DST. Further, we find that while pro-immigrant views receive consistent pushback on the platform, anti-immigrant views largely operate within echo chambers. We observe less severe yet similar patterns for DST. Taken together, Representation and Fragmentation paint a meaningful and important new picture of viewpoint diversity.


title: Intrinsic Magnetic Topological Materials

abstract: Topological states of matter possess bulk electronic structures categorized by topological invariants and edge/surface states due to the bulk-boundary correspondence. Topological materials hold great potential in the development of dissipationless spintronics, information storage, and quantum computation, particularly if combined with magnetic order intrinsically or extrinsically. Here, we review the recent progress in the exploration of intrinsic magnetic topological materials, including but not limited to magnetic topological insulators, magnetic topological metals, and magnetic Weyl semimetals. We pay special attention to their characteristic band features such as the gap of topological surface state, gapped Dirac cone induced by magnetization (either bulk or surface), Weyl nodal point/line, and Fermi arc, as well as the exotic transport responses resulting from such band features. We conclude with a brief envision for experimental explorations of new physics or effects by incorporating other orders in intrinsic magnetic topological materials.


title: BEATs: Audio Pre-Training with Acoustic Tokenizers

abstract: The massive growth of self-supervised learning (SSL) has been witnessed in language, vision, speech, and audio domains over the past few years. While discrete label prediction is widely adopted for other modalities, the state-of-the-art audio SSL models still employ reconstruction loss for pre-training. Compared with reconstruction loss, semantic-rich discrete label prediction encourages the SSL model to abstract the high-level audio semantics and discard the redundant details as in human perception. However, a semantic-rich acoustic tokenizer for general audio pre-training is usually not straightforward to obtain, due to the continuous property of audio and unavailable phoneme sequences like speech. To tackle this challenge, we propose BEATs, an iterative audio pre-training framework to learn Bidirectional Encoder representation from Audio Transformers, where an acoustic tokenizer and an audio SSL model are optimized by iterations. In the first iteration, we use random projection as the acoustic tokenizer to train an audio SSL model in a mask and label prediction manner. Then, we train an acoustic tokenizer for the next iteration by distilling the semantic knowledge from the pre-trained or fine-tuned audio SSL model. The iteration is repeated with the hope of mutual promotion of the acoustic tokenizer and audio SSL model. The experimental results demonstrate our acoustic tokenizers can generate discrete labels with rich audio semantics and our audio SSL models achieve state-of-the-art results across various audio classification benchmarks, even outperforming previous models that use more training data and model parameters significantly. Specifically, we set a new state-of-the-art mAP 50.6% on AudioSet-2M for audio-only models without using any external data, and 98.1% accuracy on ESC-50. The code and pre-trained models are available at https://aka.ms/beats.


title: Resonant contributions to oscillatory phenomena under conditions of magnetic breakdown during reconstructions of electron dynamics on the Fermi surface

abstract: We consider here special closed electron trajectories that arise during reconstructions of electron dynamics on the Fermi surface in the presence of strong magnetic fields, as well as the phenomenon of intraband magnetic breakdown that occurs on such trajectories. We consider cases where the electronic spectrum arising in such a situation corresponds to the resonant contribution to quantum oscillations. In the paper, all cases where this occurs are singled out, and the possible influence of the appearance of the Berry phase and other effects on the described phenomena is also considered.