title: An Artificial Bee Colony Based Algorithm for Continuous Distributed Constraint Optimization Problems

abstract: Distributed Constraint Optimization Problems (DCOPs) are a frequently used framework in which a set of independent agents choose values from their respective discrete domains to maximize their utility. Although this formulation is typically appropriate, there are a number of real-world applications in which the decision variables are continuous-valued and the constraints are represented in functional form. To address this, Continuous Distributed Constraint Optimization Problems (C-DCOPs), an extension of the DCOPs paradigm, have recently grown the interest of the multi-agent systems field. To date, among different approaches, population-based algorithms are shown to be most effective for solving C-DCOPs. Considering the potential of population-based approaches, we propose a new C-DCOPs solver inspired by a well-known population-based algorithm Artificial Bee Colony (ABC). Additionally, we provide a new exploration method that aids in the further improvement of the algorithm's solution quality. Finally, We theoretically prove that our approach is an anytime algorithm and empirically show it produces significantly better results than the state-of-the-art C-DCOPs algorithms.


title: New techniques for bounding stabilizer rank

abstract: In this work, we present number-theoretic and algebraic-geometric techniques for bounding the stabilizer rank of quantum states. First, we refine a number-theoretic theorem of Moulton to exhibit an explicit sequence of product states with exponential stabilizer rank but constant approximate stabilizer rank, and to provide alternate (and simplified) proofs of the best-known asymptotic lower bounds on stabilizer rank and approximate stabilizer rank, up to a log factor. Second, we find the first non-trivial examples of quantum states with multiplicative stabilizer rank under the tensor product. Third, we introduce and study the generic stabilizer rank using algebraic-geometric techniques.


title: Active Learning for Improved Semi-Supervised Semantic Segmentation in Satellite Images

abstract: Remote sensing data is crucial for applications ranging from monitoring forest fires and deforestation to tracking urbanization. Most of these tasks require dense pixel-level annotations for the model to parse visual information from limited labeled data available for these satellite images. Due to the dearth of high-quality labeled training data in this domain, there is a need to focus on semi-supervised techniques. These techniques generate pseudo-labels from a small set of labeled examples which are used to augment the labeled training set. This makes it necessary to have a highly representative and diverse labeled training set. Therefore, we propose to use an active learning-based sampling strategy to select a highly representative set of labeled training data. We demonstrate our proposed method's effectiveness on two existing semantic segmentation datasets containing satellite images: UC Merced Land Use Classification Dataset and DeepGlobe Land Cover Classification Dataset. We report a 27% improvement in mIoU with as little as 2% labeled data using active learning sampling strategies over randomly sampling the small set of labeled training data.


title: The Fine-Tuning of the Universe for Life

abstract: When a physicist says that a theory is fine-tuned, they mean that it must make a suspiciously precise assumption in order to explain a certain observation. This is evidence that the theory is deficient or incomplete. One particular case of fine-tuning is particularly striking. The data in question are not the precise measurements of cosmology or particle physics, but a more general feature of our universe: it supports the existence of life. This chapter reviews this Fine-Tuning of the Universe for Life.


title: Subregularity in infinitely labeled generating trees of restricted permutations

abstract: In this paper, we revisit the application of generating trees to the pattern avoidance problem for permutations. In particular, we study this problem for certain general sets of patterns and propose a new procedure leveraging the FinLabel algorithm and exploiting the subregularities in the associated generating trees. We consider some general kinds of generating trees for which the FinLabel algorithm fails to determine in a finite number of iterations the generating function that enumerates the underlying class of permutations. Our procedure provides a unified approach in these cases leading to a system of equations satisfied by a certain finite set of generating functions which can be readily solved with the aid of programming.


title: Scalable Causal Structure Learning: Scoping Review of Traditional and Deep Learning Algorithms and New Opportunities in Biomedicine

abstract: Causal structure learning refers to a process of identifying causal structures from observational data, and it can have multiple applications in biomedicine and health care. This paper provides a practical review and tutorial on scalable causal structure learning models with examples of real-world data to help health care audiences understand and apply them. We reviewed traditional (combinatorial and score-based methods) for causal structure discovery and machine learning-based schemes. We also highlighted recent developments in biomedicine where causal structure learning can be applied to discover structures such as gene networks, brain connectivity networks, and those in cancer epidemiology. We also compared the performance of traditional and machine learning-based algorithms for causal discovery over some benchmark data sets. Machine learning-based approaches, including deep learning, have many advantages over traditional approaches, such as scalability, including a greater number of variables, and potentially being applied in a wide range of biomedical applications, such as genetics, if sufficient data are available. Furthermore, these models are more flexible than traditional models and are poised to positively affect many applications in the future.


title: Learning the Koopman Eigendecomposition: A Diffeomorphic Approach

abstract: We present a novel data-driven approach for learning linear representations of a class of stable nonlinear systems using Koopman eigenfunctions. By learning the conjugacy map between a nonlinear system and its Jacobian linearization through a Normalizing Flow one can guarantee the learned function is a diffeomorphism. Using this diffeomorphism, we construct eigenfunctions of the nonlinear system via the spectral equivalence of conjugate systems - allowing the construction of linear predictors for nonlinear systems. The universality of the diffeomorphism learner leads to the universal approximation of the nonlinear system's Koopman eigenfunctions. The developed method is also safe as it guarantees the model is asymptotically stable regardless of the representation accuracy. To our best knowledge, this is the first work to close the gap between the operator, system and learning theories. The efficacy of our approach is shown through simulation examples.


title: Analysis and visualization of spatial transcriptomic data

abstract: Human and animal tissues consist of heterogeneous cell types that organize and interact in highly structured manners. Bulk and single-cell sequencing technologies remove cells from their original microenvironments, resulting in a loss of spatial information. Spatial transcriptomics is a recent technological innovation that measures transcriptomic information while preserving spatial information. Spatial transcriptomic data can be generated in several ways. RNA molecules are measured by in situ sequencing, in situ hybridization, or spatial barcoding to recover original spatial coordinates. The inclusion of spatial information expands the range of possibilities for analysis and visualization, and spurred the development of numerous novel methods. In this review, we summarize the core concepts of spatial genomics technology and provide a comprehensive review of current analysis and visualization methods for spatial transcriptomics.


title: Gaussian Process Bandit Optimization with Few Batches

abstract: In this paper, we consider the problem of black-box optimization using Gaussian Process (GP) bandit optimization with a small number of batches. Assuming the unknown function has a low norm in the Reproducing Kernel Hilbert Space (RKHS), we introduce a batch algorithm inspired by batched finite-arm bandit algorithms, and show that it achieves the cumulative regret upper bound $O^\ast(\sqrt{T\gamma_T})$ using $O(\log\log T)$ batches within time horizon $T$, where the $O^\ast(\cdot)$ notation hides dimension-independent logarithmic factors and $\gamma_T$ is the maximum information gain associated with the kernel. This bound is near-optimal for several kernels of interest and improves on the typical $O^\ast(\sqrt{T}\gamma_T)$ bound, and our approach is arguably the simplest among algorithms attaining this improvement. In addition, in the case of a constant number of batches (not depending on $T$), we propose a modified version of our algorithm, and characterize how the regret is impacted by the number of batches, focusing on the squared exponential and Mat\'ern kernels. The algorithmic upper bounds are shown to be nearly minimax optimal via analogous algorithm-independent lower bounds.


title: Toward Learning Context-Dependent Tasks from Demonstration for Tendon-Driven Surgical Robots

abstract: Tendon-driven robots, a type of continuum robot, have the potential to reduce the invasiveness of surgery by enabling access to difficult-to-reach anatomical targets. In the future, the automation of surgical tasks for these robots may help reduce surgeon strain in the face of a rapidly growing population. However, directly encoding surgical tasks and their associated context for these robots is infeasible. In this work we take steps toward a system that is able to learn to successfully perform context-dependent surgical tasks by learning directly from a set of expert demonstrations. We present three models trained on the demonstrations conditioned on a vector encoding the context of the demonstration. We then use these models to plan and execute motions for the tendon-driven robot similar to the demonstrations for novel context not seen in the training set. We demonstrate the efficacy of our method on three surgery-inspired tasks.


title: DG-Labeler and DGL-MOTS Dataset: Boost the Autonomous Driving Perception

abstract: Multi-object tracking and segmentation (MOTS) is a critical task for autonomous driving applications. The existing MOTS studies face two critical challenges: 1) the published datasets inadequately capture the real-world complexity for network training to address various driving settings; 2) the working pipeline annotation tool is under-studied in the literature to improve the quality of MOTS learning examples. In this work, we introduce the DG-Labeler and DGL-MOTS dataset to facilitate the training data annotation for the MOTS task and accordingly improve network training accuracy and efficiency. DG-Labeler uses the novel Depth-Granularity Module to depict the instance spatial relations and produce fine-grained instance masks. Annotated by DG-Labeler, our DGL-MOTS dataset exceeds the prior effort (i.e., KITTI MOTS and BDD100K) in data diversity, annotation quality, and temporal representations. Results on extensive cross-dataset evaluations indicate significant performance improvements for several state-of-the-art methods trained on our DGL-MOTS dataset. We believe our DGL-MOTS Dataset and DG-Labeler hold the valuable potential to boost the visual perception of future transportation.


title: Overall Spectral Properties of Prompt Emissions with Diverse Segments in Swift/BAT Short Gamma-ray Bursts

abstract: Owing to lack of multiple components of prompt $\gamma$-ray emissions in short gamma-ray bursts (sGRBs), how these distinct components are correlated still keeps unclear. In this paper, we investigate the spectral and temporal properties of precursors, main peaks and extended emissions in 26 sGRBs including GRB 170817A. It is found that peak energies ($E_p$) in each pulse are uncorrelated with the pulse duration ($t_{dur}$). Meanwhile, we find that there is no obvious correlation between peak energy and energy fluence. Interestingly, there is no obvious spectral evolution from earlier precursors to later extended emissions in view of the correlations of $t_{dur}$ with either the $E_p$ or the low energy spectrum index, $\alpha$. A power-law correlation between the average flux ($F_{p}$) and the energy fluence ($S_\gamma$), $log F_p=(0.62\pm0.07) log S_\gamma + (0.27\pm0.07)$, is found to exist in the individual segments instead of mean peaks previously. Furthermore, we also find that the main peaks are on average brighter than the precursors or the extend emissions about one order of magnitude. On the basis of all the above analyses, one can conclude that three emissive components would share the same radiation mechanisms but they might be dominated by diverse physical processes.


title: A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification

abstract: We present a multilingual bag-of-entities model that effectively boosts the performance of zero-shot cross-lingual text classification by extending a multilingual pre-trained language model (e.g., M-BERT). It leverages the multilingual nature of Wikidata: entities in multiple languages representing the same concept are defined with a unique identifier. This enables entities described in multiple languages to be represented using shared embeddings. A model trained on entity features in a resource-rich language can thus be directly applied to other languages. Our experimental results on cross-lingual topic classification (using the MLDoc and TED-CLDC datasets) and entity typing (using the SHINRA2020-ML dataset) show that the proposed model consistently outperforms state-of-the-art models.


title: Methods for Creation and Linear Elastic Response Analysis of Packings of Semi-flexible Soft Polymer Chains

abstract: From understanding the sand on the beach to the foam on your beer, soft sphere simulations have been crucial to the study of the amorphous world around us. However, many of the materials we interact with on a daily basis aren't comprised of individual grains, but complex molecules and chains of polymers. By extending the soft sphere model to a model of linked spheres, we can learn more about the materials we interact with on a daily basis. In this methods paper, I show how one can find and study the physical properties of packings of flexible chains, rigid molecules, and everything in between. In addition to describing the energy landscape of these materials, these methods describe how to shear stabilize polymer packings, classify them in the jamming hierarchy, describe their elastic properties, and much more. This simple modification to soft sphere simulations has the potential to yield new discoveries surrounding glasses.


title: Carrollian and Galilean conformal higher-spin algebras in any dimensions

abstract: We present higher-spin algebras containing a Poincar\'e subalgebra and with the same set of generators as the Lie algebras that are relevant to Vasiliev's equations in any space-time dimension $D \geq 3$. Given these properties, they can be considered either as candidate rigid symmetries for higher-spin gauge theories in Minkowski space or as Carrollian conformal higher-spin symmetries in one less dimension. We build these Lie algebras as quotients of the universal enveloping algebra of $iso(1,D-1)$ and we show how to recover them as In\"on\"u-Wigner contractions of the rigid symmetries of higher-spin gauge theories in Anti de Sitter space or, equivalently, of relativistic conformal higher-spin symmetries. We use the same techniques to also define higher-spin algebras with the same set of generators and containing a Galilean conformal subalgebra, to be interpreted as non-relativistic limits of the conformal symmetries of a free scalar field. We begin by showing that the known flat-space higher-spin algebras in three dimensions can be obtained as quotients of the universal enveloping algebra of $iso(1,2)$ and then we extend the analysis along the same lines to a generic number of space-time dimensions. We also discuss the peculiarities that emerge for $D=5$.


title: Sharp $L^\infty$ estimates of HDG methods for Poisson equation II: 3D

abstract: In [SIAM J. Numer. Anal., 59 (2), 720-745], we proved quasi-optimal $L^\infty$ estimates (up to logarithmic factors) for the solution of Poisson's equation by a hybridizable discontinuous Galerkin (HDG) method. However, the estimates only work in 2D. In this paper, we obtain sharp (without logarithmic factors) $L^\infty$ estimates for the HDG method in both 2D and 3D. Numerical experiments are presented to confirm our theoretical result.


title: Occupancy Estimation from Thermal Images

abstract: We propose a non-intrusive, and privacy-preserving occupancy estimation system for smart environments. The proposed scheme uses thermal images to detect the number of people in a given area. The occupancy estimation model is designed using the concepts of intensity-based and motion-based human segmentation. The notion of difference catcher, connected component labeling, noise filter, and memory propagation are utilized to estimate the occupancy number. We use a real dataset to demonstrate the effectiveness of the proposed system.


title: EFENet: Reference-based Video Super-Resolution with Enhanced Flow Estimation

abstract: In this paper, we consider the problem of reference-based video super-resolution(RefVSR), i.e., how to utilize a high-resolution (HR) reference frame to super-resolve a low-resolution (LR) video sequence. The existing approaches to RefVSR essentially attempt to align the reference and the input sequence, in the presence of resolution gap and long temporal range. However, they either ignore temporal structure within the input sequence, or suffer accumulative alignment errors. To address these issues, we propose EFENet to exploit simultaneously the visual cues contained in the HR reference and the temporal information contained in the LR sequence. EFENet first globally estimates cross-scale flow between the reference and each LR frame. Then our novel flow refinement module of EFENet refines the flow regarding the furthest frame using all the estimated flows, which leverages the global temporal information within the sequence and therefore effectively reduces the alignment errors. We provide comprehensive evaluations to validate the strengths of our approach, and to demonstrate that the proposed framework outperforms the state-of-the-art methods. Code is available at https://github.com/IndigoPurple/EFENet.


title: Dynamics of Cross-Platform Attention to Retracted Papers

abstract: Retracted papers often circulate widely on social media, digital news and other websites before their official retraction. The spread of potentially inaccurate or misleading results from retracted papers can harm the scientific community and the public. Here we quantify the amount and type of attention 3,851 retracted papers received over time in different online platforms. Comparing to a set of non-retracted control papers from the same journals, with similar publication year, number of co-authors and author impact, we show that retracted papers receive more attention after publication not only on social media, but also on heavily curated platforms, such as news outlets and knowledge repositories, amplifying the negative impact on the public. At the same time, we find that posts on Twitter tend to express more criticism about retracted than about control papers, suggesting that criticism-expressing tweets could contain factual information about problematic papers. Most importantly, around the time they are retracted, papers generate discussions that are primarily about the retraction incident rather than about research findings, showing that by this point papers have exhausted attention to their results and highlighting the limited effect of retractions. Our findings reveal the extent to which retracted papers are discussed on different online platforms and identify at scale audience criticism towards them. In this context, we show that retraction is not an effective tool to reduce online attention to problematic papers.


title: A new family of bioSFQ logic/memory cells

abstract: Superconductor electronics (SCE) is competing to become a platform for efficient implementations of neuromorphic computing and deep learning algorithms (DLAs) with projects mostly concentrating on searching for gates that would better mimic behavior of real neurons. In contrast, we believe that most of the required components have already been demonstrated during the long history of SCE, whereas the missing part is how to organize these components to efficiently implement DLAs. We propose a family of logic/memory cells in which stored multi-bit data are encoded by quasi-analog currents or magnetic flux in superconductor loops while transmitted data are encoded as the rate of SFQ pulses. We designed, fabricated, and tested some of the basic cells to demonstrate a proof of concept, e.g., a unipolar and bipolar multipliers based on Josephson junction comparators. We coined the term bioSFQ to clearly connote close but distinguishable relations between the conventional SFQ electronics and its new neuromorphic paradigm.


title: Localized states with non-trivial symmetries: localized labyrinthine patterns

abstract: The formation of self-organized patterns and localized states are ubiquitous in Nature. Localized states containing trivial symmetries such as stripes, hexagons, or squares have been profusely studied. Disordered patterns with non-trivial symmetries such as labyrinthine patterns are observed in different physical contexts. Here we report stable localized disordered patterns in spatially extended dissipative systems. These 2D and 3D localized structures consist of an isolated labyrinth embedded in a homogeneous steady state. Their partial bifurcation diagram allows us to explain this phenomenon as a manifestation of a pinning-depinning transition. We illustrate our findings on Swift-Hohenberg type of equations and other well-established models for plant ecology, nonlinear optics, and reaction-diffusion systems.


title: Adversarial Purification through Representation Disentanglement

abstract: Deep learning models are vulnerable to adversarial examples and make incomprehensible mistakes, which puts a threat on their real-world deployment. Combined with the idea of adversarial training, preprocessing-based defenses are popular and convenient to use because of their task independence and good generalizability. Current defense methods, especially purification, tend to remove ``noise" by learning and recovering the natural images. However, different from random noise, the adversarial patterns are much easier to be overfitted during model training due to their strong correlation to the images. In this work, we propose a novel adversarial purification scheme by presenting disentanglement of natural images and adversarial perturbations as a preprocessing defense. With extensive experiments, our defense is shown to be generalizable and make significant protection against unseen strong adversarial attacks. It reduces the success rates of state-of-the-art \textbf{ensemble} attacks from \textbf{61.7\%} to \textbf{14.9\%} on average, superior to a number of existing methods. Notably, our defense restores the perturbed images perfectly and does not hurt the clean accuracy of backbone models, which is highly desirable in practice.


title: VLBI properties of compact interplanetary scintillators detected by the Murchison Widefield Array

abstract: Interplanetary scintillation (IPS) provides an approach for identifying the presence of sub-arcsec structures in radio sources, and very long baseline interferometry (VLBI) technique can help verify whether the IPS sources have fine structures on milli-arcsec (mas) scales. We searched the available VLBI archive for the 244 IPS sources detected by the Murchison Widefield Array at 162~MHz and found 63 cross-matches. We analysed the VLBI data of the 63 sources and characterised the compactness index in terms of the ratio $R$ of the VLBI-measured flux density at 4.3~GHz to the flux density estimated using the Very Large Array Sky Survey (VLASS) at 3~GHz and NRAO VLA Sky Survey (NVSS) at 1.4~GHz ($S_{\rm VLBI}/S_{\rm SA}$). Eleven sources are identified as blazars according to their flat spectra and strong variability. They show high compactness indices with $R>0.4$, compact core-jet structure, and a broad distribution of normalised scintillation index (NSI). Other sources show diverse morphologies (compact core, core and one-sided jet, core and two-sided jets), but there is a correlation between $R$ and NSI with a correlation coefficient $r=0.47$. A similar $R$--NSI correlation is found in sources showing single steep power-law or convex spectra. After excluding blazars (which are already known to be compact sources) from the VLBI-detected IPS sources, a strong correlation is found between the compactness and scintillation index of the remaining samples, indicating that stronger scintillating sources are more compact. This pilot study shows that IPS offers a convenient method to identify compact radio sources without the need to invoke high-resolution imaging observations, which often require significant observational time.


title: Attacking Open-domain Question Answering by Injecting Misinformation

abstract: With a rise in false, inaccurate, and misleading information in propaganda, news, and social media, real-world Question Answering (QA) systems face the challenges of synthesizing and reasoning over misinformation-polluted contexts to derive correct answers. This urgency gives rise to the need to make QA systems robust to misinformation, a topic previously unexplored. We study the risk of misinformation to QA models by investigating the sensitivity of open-domain QA models to corpus pollution with misinformation documents. We curate both human-written and model-generated false documents that we inject into the evidence corpus of QA models and assess the impact on the performance of these systems. Experiments show that QA models are vulnerable to even small amounts of evidence contamination brought by misinformation, with large absolute performance drops on all models. Misinformation attack brings more threat when fake documents are produced at scale by neural models or the attacker targets hacking specific questions of interest. To defend against such a threat, we discuss the necessity of building a misinformation-aware QA system that integrates question-answering and misinformation detection in a joint fashion.


title: Alternative Input Signals Ease Transfer in Multilingual Machine Translation

abstract: Recent work in multilingual machine translation (MMT) has focused on the potential of positive transfer between languages, particularly cases where higher-resourced languages can benefit lower-resourced ones. While training an MMT model, the supervision signals learned from one language pair can be transferred to the other via the tokens shared by multiple source languages. However, the transfer is inhibited when the token overlap among source languages is small, which manifests naturally when languages use different writing systems. In this paper, we tackle inhibited transfer by augmenting the training data with alternative signals that unify different writing systems, such as phonetic, romanized, and transliterated input. We test these signals on Indic and Turkic languages, two language families where the writing systems differ but languages still share common features. Our results indicate that a straightforward multi-source self-ensemble -- training a model on a mixture of various signals and ensembling the outputs of the same model fed with different signals during inference, outperforms strong ensemble baselines by 1.3 BLEU points on both language families. Further, we find that incorporating alternative inputs via self-ensemble can be particularly effective when training set is small, leading to +5 BLEU when only 5% of the total training data is accessible. Finally, our analysis demonstrates that including alternative signals yields more consistency and translates named entities more accurately, which is crucial for increased factuality of automated systems.


title: Quantum Fisher Information Perspective on Sensing in Anti-PT Symmetric Systems

abstract: The efficient sensing of weak environmental perturbations via special degeneracies called exceptional points in non-Hermitian systems has gained enormous traction in the last few decades. However, in contrast to the extensive literature on parity-time (PT) symmetric systems, the exotic hallmarks of anti-PT symmetric systems are only beginning to be realized now. Very recently, a characteristic resonance of vanishing linewidth in anti-PT symmetric systems was shown to exhibit tremendous sensitivity to intrinsic nonlinearities. Given the primacy of sensing in non-Hermitian systems, in general, and the immense topicality of anti-PT symmetry, we investigate the statistical bound to the measurement sensitivity for any arbitrary perturbation in a dissipatively coupled, anti-PT symmetric system. Using the framework of quantum Fisher information and the long-time solution to the full master equation, we analytically compute the Cramer-Rao bound for the system properties like the detunings and the couplings. As an illustrative example of this formulation, we inspect and reaffirm the role of a long-lived resonance in dissipatively interacting systems for sensing applications. \end{abstract}


title: Communicating Patient Health Data: A Wicked Problem

abstract: Designing patient-collected health data visualizations to support discussing patient data during clinical visits is a challenging problem due to the heterogeneity of the parties involved: patients, healthcare providers, and healthcare systems. Designers must ensure that all parties' needs are met. This complexity makes it challenging to find a definitive solution that can work for every individual. We have approached this research problem -- communicating patient data during clinical visits -- as a wicked problem. In this article, we outline how wicked problem characteristics apply to our research problem. We then describe the research methodologies we employed to explore the design space of individualized patient data visualization solutions. Last, we reflect on the insights and experiences we gained through this exploratory design process. We conclude with a call to action for researchers and visualization designers to consider patients' and healthcare providers' individualities when designing patient data visualizations.


title: Provable Regret Bounds for Deep Online Learning and Control

abstract: The theory of deep learning focuses almost exclusively on supervised learning, non-convex optimization using stochastic gradient descent, and overparametrized neural networks. It is common belief that the optimizer dynamics, network architecture, initialization procedure, and other factors tie together and are all components of its success. This presents theoretical challenges for analyzing state-based and/or online deep learning. Motivated by applications in control, we give a general black-box reduction from deep learning to online convex optimization. This allows us to decouple optimization, regret, expressiveness, and derive agnostic online learning guarantees for fully-connected deep neural networks with ReLU activations. We quantify convergence and regret guarantees for any range of parameters and allow any optimization procedure, such as adaptive gradient methods and second order methods. As an application, we derive provable algorithms for deep control in the online episodic setting.


title: Mobility Aware Edge Computing Segmentation Towards Localized Orchestration

abstract: The current trend in end-user devices' advancements in computing and communication capabilities makes edge computing an attractive solution to pave the way for the coveted ultra-low latency services. The success of the edge computing networking paradigm depends on the proper orchestration of the edge servers. Several Edge applications and services are intolerant to latency, especially in 5G and beyond networks, such as intelligent video surveillance, E-health, Internet of Vehicles, and augmented reality applications. The edge devices underwent rapid growth in both capabilities and size to cope with the service demands. Orchestrating it on the cloud was a prominent trend during the past decade. However, the increasing number of edge devices poses a significant burden on the orchestration delay. In addition to the growth in edge devices, the high mobility of users renders traditional orchestration schemes impractical for contemporary edge networks. Proper segmentation of the edge space becomes necessary to adapt these schemes to address these challenges. In this paper, we introduce a segmentation technique employing lax clustering and segregated mobility-based clustering. We then apply latency mapping to these clusters. The proposed scheme's main objective is to create subspaces (segments) that enable light and efficient edge orchestration by reducing the processing time and the core cloud communication overhead. A bench-marking simulation is conducted with the results showing decreased mobility-related failures and reduced orchestration delay.


title: PTQ-SL: Exploring the Sub-layerwise Post-training Quantization

abstract: Network quantization is a powerful technique to compress convolutional neural networks. The quantization granularity determines how to share the scaling factors in weights, which affects the performance of network quantization. Most existing approaches share the scaling factors layerwisely or channelwisely for quantization of convolutional layers. Channelwise quantization and layerwise quantization have been widely used in various applications. However, other quantization granularities are rarely explored. In this paper, we will explore the sub-layerwise granularity that shares the scaling factor across multiple input and output channels. We propose an efficient post-training quantization method in sub-layerwise granularity (PTQ-SL). Then we systematically experiment on various granularities and observe that the prediction accuracy of the quantized neural network has a strong correlation with the granularity. Moreover, we find that adjusting the position of the channels can improve the performance of sub-layerwise quantization. Therefore, we propose a method to reorder the channels for sub-layerwise quantization. The experiments demonstrate that the sub-layerwise quantization with appropriate channel reordering can outperform the channelwise quantization.


title: Towards Statistical and Computational Complexities of Polyak Step Size Gradient Descent

abstract: We study the statistical and computational complexities of the Polyak step size gradient descent algorithm under generalized smoothness and Lojasiewicz conditions of the population loss function, namely, the limit of the empirical loss function when the sample size goes to infinity, and the stability between the gradients of the empirical and population loss functions, namely, the polynomial growth on the concentration bound between the gradients of sample and population loss functions. We demonstrate that the Polyak step size gradient descent iterates reach a final statistical radius of convergence around the true parameter after logarithmic number of iterations in terms of the sample size. It is computationally cheaper than the polynomial number of iterations on the sample size of the fixed-step size gradient descent algorithm to reach the same final statistical radius when the population loss function is not locally strongly convex. Finally, we illustrate our general theory under three statistical examples: generalized linear model, mixture model, and mixed linear regression model.


title: Cascaded Fast and Slow Models for Efficient Semantic Code Search

abstract: The goal of natural language semantic code search is to retrieve a semantically relevant code snippet from a fixed set of candidates using a natural language query. Existing approaches are neither effective nor efficient enough towards a practical semantic code search system. In this paper, we propose an efficient and accurate semantic code search framework with cascaded fast and slow models, in which a fast transformer encoder model is learned to optimize a scalable index for fast retrieval followed by learning a slow classification-based re-ranking model to improve the performance of the top K results from the fast retrieval. To further reduce the high memory cost of deploying two separate models in practice, we propose to jointly train the fast and slow model based on a single transformer encoder with shared parameters. The proposed cascaded approach is not only efficient and scalable, but also achieves state-of-the-art results with an average mean reciprocal ranking (MRR) score of 0.7795 (across 6 programming languages) as opposed to the previous state-of-the-art result of 0.713 MRR on the CodeSearchNet benchmark.


title: Towards fast weak adversarial training to solve high dimensional parabolic partial differential equations using XNODE-WAN

abstract: Due to the curse of dimensionality, solving high dimensional parabolic partial differential equations (PDEs) has been a challenging problem for decades. Recently, a weak adversarial network (WAN) proposed in (Y.Zang et al., 2020) offered a flexible and computationally efficient approach to tackle this problem defined on arbitrary domains by leveraging the weak solution. WAN reformulates the PDE problem as a generative adversarial network, where the weak solution (primal network) and the test function (adversarial network) are parameterized by the multi-layer deep neural networks (DNNs). However, it is not yet clear whether DNNs are the most effective model for the parabolic PDE solutions as they do not take into account the fundamentally different roles played by time and spatial variables in the solution. To reinforce the difference, we design a novel so-called XNODE model for the primal network, which is built on the neural ODE (NODE) model with additional spatial dependency to incorporate the a priori information of the PDEs and serve as a universal and effective approximation to the solution. The proposed hybrid method (XNODE-WAN), by integrating the XNODE model within the WAN framework, leads to significant improvement in the performance and efficiency of training. Numerical results show that our method can reduce the training time to a fraction of that of the WAN model.


title: Chirality locking charge density waves in a chiral crystal

abstract: In Weyl semimetals, charge density wave (CDW) order can spontaneously break the chiral symmetry, gap out the Weyl nodes, and drive the material into the axion insulating phase. Investigations have however been limited since CDWs are rarely seen in Weyl semimetals. Here, using scanning tunneling microscopy/spectroscopy, we report the discovery of a novel unidirectional CDW order on the (001) surface of chiral crystal CoSi - a unique Weyl semimetal with unconventional chiral fermions. The CDW is incommensurate with both lattice momentum and crystalline symmetry directions, and exhibits an intra unit cell {\pi} phase shift in the layer stacking direction. The tunneling spectrum shows a particle-hole asymmetric V-shaped energy gap around the Fermi level that modulates spatially with the CDW wave vector. Combined with first-principle calculations, we identify that the CDW is locked to the crystal chirality and is related by a mirror reflection between the two enantiomers of the chiral crystal. Our findings reveal a novel correlated topological quantum state in chiral CoSi crystals and raise the potential for realizing an axion insulator and exploring the unprecedented physical behaviors of unconventional chiral fermions.


title: Meta-learning via Language Model In-context Tuning

abstract: The goal of meta-learning is to learn to adapt to a new task with only a few labeled examples. To tackle this problem in NLP, we propose $\textit{in-context tuning}$, which recasts adaptation and prediction as a simple sequence prediction problem: to form the input sequence, we concatenate the task instruction, the labeled examples, and the target input to predict; to meta-train the model to learn from in-context examples, we fine-tune a pre-trained language model (LM) to predict the target label from the input sequences on a collection of tasks. We benchmark our method on two collections of text classification tasks: LAMA and BinaryClfs. Compared to first-order MAML which adapts the model with gradient descent, our method better leverages the inductive bias of LMs to perform pattern matching, and outperforms MAML by an absolute $6\%$ AUC ROC score on BinaryClfs, with increasing advantage w.r.t. model size. Compared to non-fine-tuned in-context learning (i.e. prompting a raw LM), in-context tuning directly learns to learn from in-context examples. On BinaryClfs, in-context tuning improves the average AUC-ROC score by an absolute $10\%$, and reduces the variance with respect to example ordering by 6x and example choices by 2x.


title: Charge instability of topological Fermi arcs in chiral crystal CoSi

abstract: Topological boundary states, emerged at the spatial boundary between topological non-trivial and trivial phases, are usually gapless, or commonly referred as metallic states. For example, the surface state of a topological insulator is a gapless Dirac state. These metallic topological boundary states are typically well described by non-interacting fermions. However, the behavior of topological boundary states with significant electron-electron interactions, which could turn the gapless boundary states into gapped ordered states, e.g., density wave states or superconducting states, is of great interest theoretically, but is still lacking evidence experimentally. Here, we report the observation of incommensurable charge density wave (CDW) formed on the topological boundary states driven by the electron-electron interactions on the (001) surface of CoSi. The wavevector of CDW varies as the temperature changes, which coincides with the evolution of topological surface Fermi arcs with temperature. The orientation of CDW phase is determined by the chirality of the Fermi arcs, which indicates direct association between CDW and Fermi arcs. Our finding will stimulate the search of more interactions-driven ordered states, such as superconductivity and magnetism, on the boundaries of topological materials.


title: Multilingual Neural Machine Translation:Can Linguistic Hierarchies Help?

abstract: Multilingual Neural Machine Translation (MNMT) trains a single NMT model that supports translation between multiple languages, rather than training separate models for different languages. Learning a single model can enhance the low-resource translation by leveraging data from multiple languages. However, the performance of an MNMT model is highly dependent on the type of languages used in training, as transferring knowledge from a diverse set of languages degrades the translation performance due to negative transfer. In this paper, we propose a Hierarchical Knowledge Distillation (HKD) approach for MNMT which capitalises on language groups generated according to typological features and phylogeny of languages to overcome the issue of negative transfer. HKD generates a set of multilingual teacher-assistant models via a selective knowledge distillation mechanism based on the language groups, and then distils the ultimate multilingual model from those assistants in an adaptive way. Experimental results derived from the TED dataset with 53 languages demonstrate the effectiveness of our approach in avoiding the negative transfer effect in MNMT, leading to an improved translation performance (about 1 BLEU score on average) compared to strong baselines.


title: On the Theory of Uniform Satellite Constellation Reconfiguration

abstract: This work focuses on the study of the reconfiguration strategies available for uniformly distributed satellite constellations and slotting architectures. Particularly, this manuscript deals with the cases of reducing, maintaining, and also increasing the number of available positions for satellites in the space structure, and takes into account the potential minimum distances between spacecraft in the configuration to assure the safety of the system. To that end, several approaches to solve the reconfiguration problem are presented based on the properties of Flower Constellations, and more particularly, on the properties of uniformity and symmetries present in these uniform distributions.


title: A novel framework to quantify uncertainty in peptide-tandem mass spectrum matches with application to nanobody peptide identification

abstract: Nanobodies are small antibody fragments derived from camelids that selectively bind to antigens. These proteins have marked physicochemical properties that support advanced therapeutics, including treatments for SARS-CoV-2. To realize their potential, bottom-up proteomics via liquid chromatography-tandem mass spectrometry (LC-MS/MS) has been proposed to identify antigen-specific nanobodies at the proteome scale, where a critical component of this pipeline is matching nanobody peptides to their begotten tandem mass spectra. While peptide-spectrum matching is a well-studied problem, we show the sequence similarity between nanobody peptides violates key assumptions necessary to infer nanobody peptide-spectrum matches (PSMs) with the standard target-decoy paradigm, and prove these violations beget inflated error rates. To address these issues, we then develop a novel framework and method that treats peptide-spectrum matching as a Bayesian model selection problem with an incomplete model space, which are, to our knowledge, the first to account for all sources of PSM error without relying on the aforementioned assumptions. In addition to illustrating our method's improved performance on simulated and real nanobody data, our work demonstrates how to leverage novel retention time and spectrum prediction tools to develop accurate and discriminating data-generating models, and, to our knowledge, provides the first rigorous description of MS/MS spectrum noise.


title: Torsion for CM elliptic curves defined over number fields of degree 2p

abstract: For a prime number p, we characterize the groups that may arise as torsion subgroups of an elliptic curve with complex multiplication defined over a number field of degree 2p. In particular, our work shows that a classification in the strongest sense is tied to determining whether there exist infinitely many Sophie Germain primes.


title: Non-Markovian temperature sensing

abstract: We investigate the sensing performance of a single-qubit quantum thermometer within a non-Markovian dynamical framework. By employing an exactly numerical hierarchical equations of the motion method, we go beyond traditional paradigms of the Born-Markov theory, the pure dephasing mechanism, and the weak-coupling approximation, which were commonly used in many previous studies of quantum thermometry. We find (i) the non-Markovian characteristics may boost the estimation efficiency, (ii) the sensitivity of quantum thermometry can be effectively optimized by engineering the proportions of different coupling operators in the whole sensor-reservoir interaction Hamiltonian, and (iii) a threshold, above which the strong sensor-reservoir coupling can significantly enhance the sensing precision in the long-encoding-time regime. Our results may have certain applications for high-resolution quantum thermometry.


title: Gait-based Frailty Assessment using Image Representation of IMU Signals and Deep CNN

abstract: Frailty is a common and critical condition in elderly adults, which may lead to further deterioration of health. However, difficulties and complexities exist in traditional frailty assessments based on activity-related questionnaires. These can be overcome by monitoring the effects of frailty on the gait. In this paper, it is shown that by encoding gait signals as images, deep learning-based models can be utilized for the classification of gait type. Two deep learning models (a) SS-CNN, based on single stride input images, and (b) MS-CNN, based on 3 consecutive strides were proposed. It was shown that MS-CNN performs best with an accuracy of 85.1\%, while SS-CNN achieved an accuracy of 77.3\%. This is because MS-CNN can observe more features corresponding to stride-to-stride variations which is one of the key symptoms of frailty. Gait signals were encoded as images using STFT, CWT, and GAF. While the MS-CNN model using GAF images achieved the best overall accuracy and precision, CWT has a slightly better recall. This study demonstrates how image encoded gait data can be used to exploit the full potential of deep learning CNN models for the assessment of frailty.


title: On Extending Amdahl's law to Learn Computer Performance

abstract: The problem of learning parallel computer performance is investigated in the context of multicore processors. Given a fixed workload, the effect of varying system configuration on performance is sought. Conventionally, the performance speedup due to a single resource enhancement is formulated using Amdahl's law. However, in case of multiple configurable resources the conventional formulation results in several disconnected speedup equations that cannot be combined together to determine the overall speedup. To solve this problem, we propose to (1) extend Amdahl's law to accommodate multiple configurable resources into the overall speedup equation, and (2) transform the speedup equation into a multivariable regression problem suitable for machine learning. Using experimental data from fifty-eight tests spanning two benchmarks (SPECCPU 2017 and PCMark 10) and four hardware platforms (Intel Xeon 8180M, AMD EPYC 7702P, Intel CoffeeLake 8700K, and AMD Ryzen 3900X), analytical models are developed and cross-validated. Findings indicate that in most cases, the models result in an average cross-validated accuracy higher than 95%, thereby validating the proposed extension of Amdahl's law. The proposed methodology enables rapid generation of multivariable analytical models to support future industrial development, optimization, and simulation needs.


title: Non-self-intersecting trajectories and their applications to satellite constellation design and orbital capacity

abstract: This work focuses on the generation of non-self-intersecting relative trajectories, and their applications to satellite constellation design, slotting architectures, and Space Traffic Management. To that end, this paper introduces two theorems to determine when two spacecrafts share the same relative trajectory, and to identify the only conditions that allow the existence of non-self-intersecting relative trajectories. Then, these results are applied first to the estimation of the limits of the orbital capacity at a given altitude, and second, to the design of satellite constellations and slotting architectures that present no conjunctions between any element compliant with these space structures.


title: Criticality-enhanced quantum sensor at finite temperature

abstract: Conventional criticality-based quantum metrological schemes work only at zero or very low temperature because the quantum uncertainty around the quantum phase-transition point is generally erased by thermal fluctuations with the increase of temperature. Such an ultralow-temperature requirement severely restricts the development of quantum critical metrology. In this paper, we propose a thermodynamic-criticality-enhanced quantum sensing scenario at finite temperature. In our scheme, a qubit is employed as a quantum sensor to estimate parameters of interest in the Dicke model which experiences a thermodynamic phase transition. It is revealed that the thermodynamic criticality of the Dicke model can significantly improve the sensing precision. Enriching the scope of quantum critical metrology, our finding provides a possibility to realize highly sensitive quantum sensing without cooling.


title: Quantum parameter estimation in a dissipative environment

abstract: We investigate the performance of quantum parameter estimation based on a qubit probe in a dissipative bosonic environment beyond the traditional paradigm of weak-coupling and rotating-wave approximations. By making use of an exactly numerical hierarchical equations of motion method, we analyze the influences of the non-Markovian memory effect induced by the environment and the form of probe-environment interaction on the estimation precision. It is found that (i) the non-Markovianity can effectively boost the estimation performance and (ii) the estimation precision can be improved by introducing a perpendicular probe-environment interaction. Our results indicate the scheme of parameter estimation in a noisy environment can be optimized via engineering the decoherence mechanism.


title: Machine Learning Algorithms In User Authentication Schemes

abstract: In the past two decades, the number of mobile products being created by companies has grown exponentially. However, although these devices are constantly being upgraded with the newest features, the security measures used to protect these devices has stayed relatively the same over the past two decades. The vast difference in growth patterns between devices and their security is opening up the risk for more and more devices to easily become infiltrated by nefarious users. Working off of previous work in the field, this study looks at the different Machine Learning algorithms used in user authentication schemes involving touch dynamics and device movement. This study aims to give a comprehensive overview of the current uses of different machine learning algorithms that are frequently used in user authentication schemas involving touch dynamics and device movement. The benefits, limitations, and suggestions for future work will be thoroughly discussed throughout this paper.


title: DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articles

abstract: Quotation extraction and attribution are challenging tasks, aiming at determining the spans containing quotations and attributing each quotation to the original speaker. Applying this task to news data is highly related to fact-checking, media monitoring and news tracking. Direct quotations are more traceable and informative, and therefore of great significance among different types of quotations. Therefore, this paper introduces DirectQuote, a corpus containing 19,760 paragraphs and 10,279 direct quotations manually annotated from online news media. To the best of our knowledge, this is the largest and most complete corpus that focuses on direct quotations in news texts. We ensure that each speaker in the annotation can be linked to a specific named entity on Wikidata, benefiting various downstream tasks. In addition, for the first time, we propose several sequence labeling models as baseline methods to extract and attribute quotations simultaneously in an end-to-end manner.


title: Designing a Streaming Data Coalescing Architecture for Scientific Detector ASICs with Variable Data Velocity

abstract: Scientific detectors are a key technological enabler for many disciplines. Application-specific integrated circuits (ASICs) are used for many of these scientific detectors. Until recently, pixel detector ASICs have been used mainly for analog signal processing of the charge from the sensor layer and the transmission of raw pixel data off the detector ASIC. However, with the availability of more advanced ASIC technology nodes for scientific application, more digital functionality from the computing domains (e.g., compression) can be integrated directly into the detector ASIC to increase data velocity. However, these computing functionalities often have high and variable latency, whereas scientific detectors must operate in real-time (i.e., stall-free) to support continuous streaming of sampled data. This paper presents an example from the domain of pixel detectors with on-chip data compression for X-ray science applications. To address the challenges of variable-sized data from a parallel stream of compressors, we present an ASIC design architecture to coalesce variable-length data for transmission over a fixed bit-width network interface.


title: FedSEAL: Semi-Supervised Federated Learning with Self-Ensemble Learning and Negative Learning

abstract: Federated learning (FL), a popular decentralized and privacy-preserving machine learning (FL) framework, has received extensive research attention in recent years. The majority of existing works focus on supervised learning (SL) problems where it is assumed that clients carry labeled datasets while the server has no data. However, in realistic scenarios, clients are often unable to label their data due to the lack of expertise and motivation while the server may host a small amount of labeled data. How to reasonably utilize the server labeled data and the clients' unlabeled data is thus of paramount practical importance. In this paper, we propose a new FL algorithm, called FedSEAL, to solve this Semi-Supervised Federated Learning (SSFL) problem. Our algorithm utilizes self-ensemble learning and complementary negative learning to enhance both the accuracy and the efficiency of clients' unsupervised learning on unlabeled data, and orchestrates the model training on both the server side and the clients' side. Our experimental results on Fashion-MNIST and CIFAR10 datasets in the SSFL setting validate the effectiveness of our method, which outperforms the state-of-the-art SSFL methods by a large margin.


title: Wave turbulence and collective behavior models for wave equations with short- and long-range interactions

abstract: In this work, we discuss a situation which could lead to both wave turbulence and collective behavior kinetic equations. The wave turbulence kinetic models appear in the kinetic limit when the wave equations have local differential operators. Viewing wave equations on the lattice as chains of anharmonic oscillators and replacing the local differential operators (short-range interactions) by non-local ones (long-range interactions), we arrive at a new Vlasov-type kinetic model in the mean field limit under the molecular chaos assumption reminiscent of models for collective behavior in which anharmonic oscillators replace individual particles.


title: RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models

abstract: Backdoor attacks, which maliciously control a well-trained model's outputs of the instances with specific triggers, are recently shown to be serious threats to the safety of reusing deep neural networks (DNNs). In this work, we propose an efficient online defense mechanism based on robustness-aware perturbations. Specifically, by analyzing the backdoor training process, we point out that there exists a big gap of robustness between poisoned and clean samples. Motivated by this observation, we construct a word-based robustness-aware perturbation to distinguish poisoned samples from clean samples to defend against the backdoor attacks on natural language processing (NLP) models. Moreover, we give a theoretical analysis about the feasibility of our robustness-aware perturbation-based defense method. Experimental results on sentiment analysis and toxic detection tasks show that our method achieves better defending performance and much lower computational costs than existing online defense methods. Our code is available at https://github.com/lancopku/RAP.


title: A Modern Analysis of Aging Machine Learning Based IoT Cybersecurity Methods

abstract: Modern scientific advancements often contribute to the introduction and refinement of never-before-seen technologies. This can be quite the task for humans to maintain and monitor and as a result, our society has become reliant on machine learning to assist in this task. With new technology comes new methods and thus new ways to circumvent existing cyber security measures. This study examines the effectiveness of three distinct Internet of Things cyber security algorithms currently used in industry today for malware and intrusion detection: Random Forest (RF), Support-Vector Machine (SVM), and K-Nearest Neighbor (KNN). Each algorithm was trained and tested on the Aposemat IoT-23 dataset which was published in January 2020 with the earliest of captures from 2018 and latest from 2019. The RF, SVM, and KNN reached peak accuracies of 92.96%, 86.23%, and 91.48%, respectively, in intrusion detection and 92.27%, 83.52%, and 89.80% in malware detection. It was found all three algorithms are capable of being effectively utilized for the current landscape of IoT cyber security in 2021.


title: Span Detection for Aspect-Based Sentiment Analysis in Vietnamese

abstract: Aspect-based sentiment analysis plays an essential role in natural language processing and artificial intelligence. Recently, researchers only focused on aspect detection and sentiment classification but ignoring the sub-task of detecting user opinion span, which has enormous potential in practical applications. In this paper, we present a new Vietnamese dataset (UIT-ViSD4SA) consisting of 35,396 human-annotated spans on 11,122 feedback comments for evaluating the span detection in aspect-based sentiment analysis. Besides, we also propose a novel system using Bidirectional Long Short-Term Memory (BiLSTM) with a Conditional Random Field (CRF) layer (BiLSTM-CRF) for the span detection task in Vietnamese aspect-based sentiment analysis. The best result is a 62.76% F1 score (macro) for span detection using BiLSTM-CRF with embedding fusion of syllable embedding, character embedding, and contextual embedding from XLM-RoBERTa. In future work, span detection will be extended in many NLP tasks such as constructive detection, emotion recognition, complaint analysis, and opinion mining. Our dataset is freely available at https://github.com/kimkim00/UIT-ViSD4SA for research purposes.


title: Minimal mass blow-up solutions for the $L^2$-critical NLS with the Delta potential for radial data in one dimension

abstract: We consider the $L^2$-critical nonlinear Schr\"odinger equation (NLS) with the delta potential $$i\partial_tu +\partial^2_x u + \mu \delta u +|u|^{4}u=0, \, \, t\in \R, \, x\in \R , $$ where $ \mu \in \R$, and $\delta$ is the Dirac delta distribution at $x=0$. Local well-posedness theory together with sharp Gagliardo-Nirenberg inequality and the conservation laws of mass and energy implies that the solution with mass less than $\|Q\|_{2}$ is global existence in $H^1(\R)$, where $Q$ is the ground state of the $L^2$-critical NLS without the delta potential (i.e. $\mu=0$). We are interested in the dynamics of the solution with threshold mass $\|u_0\|_{2}=\|Q\|_{2}$ in $H^1(\R)$. First, for the case $\mu=0$, such blow-up solution exists due to the pseudo-conformal symmetry of the equation, and is unique up to the symmetries of the equation in $H^1(\R)$ from \cite{Me93:NLS:mini sol} (see also \cite{HmKe05:NLS:mini blp}), and recently in $L^2(\R)$ from \cite{Dod:NLS:L2thrh1}. Second, for the case $\mu<0$, simple variational argument with the conservation laws of mass and energy implies that radial solutions with threshold mass exist globally in $H^1(\R)$. Last, for the case $\mu>0$, we show the existence of radial threshold solutions with blow-up speed determined by the sign (i.e. $\mu>0$) of the delta potential perturbation since the refined blow-up profile to the rescaled equation is stable in a precise sense. The key ingredients here including the Energy-Morawetz argument and compactness method as well as the modulation analysis are close to the original one in \cite{RaS11:NLS:mini sol} (see also \cite{KrLR13:HalfW:nondis, LeMR:CNLS:blp, Mart05:Kdv:N sol, MaP17:BO:mini sol, MeRS14:NLS:blp}).


title: Observing hyperfine interactions of NV centers in diamond in an advanced quantum teaching lab

abstract: The negatively charged nitrogen-vacancy (NV$^-$) center in diamond is a model quantum system for university teaching labs due to its room-temperature compatibility and cost-effective operation. Based on the low-cost experimental setup that we have developed and described for the coherent control of the electronic spin (Sewani et al.), we introduce and explain here a number of more advanced experiments that probe the electron-nuclear interaction between the \nv electronic and the \NN~and \CC~nuclear spins. Optically-detected magnetic resonance (ODMR), Rabi oscillations, Ramsey fringe experiments, and Hahn echo sequences are implemented to demonstrate how the nuclear spins interact with the electron spins. Most experiments only require 15 minutes of measurement time and can, therefore, be completed within one teaching lab.


title: Star-forming Dwarf Galaxies in Filamentary Structures around the Virgo Cluster: Probing Chemical Pre-processing in Filament Environments

abstract: It has been proposed that the filament environment is closely connected to the pre-processing of galaxies, where their properties may have been changed by environmental effects in the filament before they fell into the galaxy cluster. We present the chemical properties of star-forming dwarf galaxies (SFDGs) in five filamentary structures (Virgo III, Leo Minor, Leo II A, Leo II B, and Canes Venatici) around the Virgo cluster using the Sloan Digital Sky Survey optical spectroscopic data and Galaxy Evolution Explorer ultraviolet photometric data. We investigate the relationship between stellar mass, gas-phase metallicity, and specific star formation rate (sSFR) of SFDGs in the Virgo filaments in comparison to those in the Virgo cluster and field. We find that, at a given stellar mass, SFDGs in the Virgo filaments show lower metallicity and higher sSFR than those in the Virgo cluster on average. We observe that SFDGs in the Virgo III filament show enhanced metallicities and suppressed star formation activities comparable to those in the Virgo cluster, whereas SFDGs in the other four filaments exhibit similar properties to the field counterparts. Moreover, about half of the galaxies in the Virgo III filament are found to be morphologically transitional dwarf galaxies that are supposed to be on the way to transforming into quiescent dwarf early-type galaxies. Based on the analysis of the galaxy perturbation parameter, we propose that the local environment represented by the galaxy interactions might be responsible for the contrasting features in "chemical pre-processing" found in the Virgo filaments.


title: Cross-Lingual Fine-Grained Entity Typing

abstract: The growth of cross-lingual pre-trained models has enabled NLP tools to rapidly generalize to new languages. While these models have been applied to tasks involving entities, their ability to explicitly predict typological features of these entities across languages has not been established. In this paper, we present a unified cross-lingual fine-grained entity typing model capable of handling over 100 languages and analyze this model's ability to generalize to languages and entities unseen during training. We train this model on cross-lingual training data collected from Wikipedia hyperlinks in multiple languages (training languages). During inference, our model takes an entity mention and context in a particular language (test language, possibly not in the training languages) and predicts fine-grained types for that entity. Generalizing to new languages and unseen entities are the fundamental challenges of this entity typing setup, so we focus our evaluation on these settings and compare against simple yet powerful string match baselines. Experimental results show that our approach outperforms the baselines on unseen languages such as Japanese, Tamil, Arabic, Serbian, and Persian. In addition, our approach substantially improves performance on unseen entities (even in unseen languages) over the baselines, and human evaluation shows a strong ability to predict relevant types in these settings.


title: A revisit of the density gradient theory and the mean field theory for the vapor-liquid interface system

abstract: In this work we define a mean-field crossover generated by the Maxwell construction as the dividing interface for the vapor-liquid interface area. A highly accurate density-profile equation is thus derived, which is physically favorable and leads to reliable predictions of interfacial properties. By using the density gradient theory and a mean-field equation of sate for the Lennard-Jones fluid, we are able to extensively explore the interface system in terms of the Gibbs free energy, the Helmholtz free energy and heat capacity. The results show that the mean-field dividing interface is the natural extension of the Widom line into the coexistence region. Hence the entire phase space is coherently divided into liquid-like and gas-like regions in all three (temperature-pressure-volume) planes. Some unconventional behaviors are observed for the intrinsic heat capacity, being positive in low temperature region while negative in high temperature region. Finally, a complete picture of the mean-field equation of state is unfolded: all three solutions to a vapor-liquid equilibrium problem have their respective significances.


title: Normal subgroups of big mapping class groups

abstract: Let S be a surface and let Mod(S,K) be the mapping class group of S permuting a Cantor subset K of S. We prove two structure theorems for normal subgroups of Mod(S,K). (Purity:) if S has finite type, every normal subgroup of Mod(S,K) either contains the kernel of the forgetful map to the mapping class group of S, or it is `pure', i.e. it fixes the Cantor set pointwise. (Inertia:) for any n element subset Q of the Cantor set, there is a forgetful map from the pure subgroup PMod(S,K) of Mod(S,K) to the mapping class group of (S,Q) fixing Q pointwise. If N is a normal subgroup of Mod(S,K) contained in PMod(S,K), its image N_Q is likewise normal. We characterize exactly which finite-type normal subgroups N_Q arise this way. Several applications and numerous examples are also given.


title: ESPnet2-TTS: Extending the Edge of TTS Research

abstract: This paper describes ESPnet2-TTS, an end-to-end text-to-speech (E2E-TTS) toolkit. ESPnet2-TTS extends our earlier version, ESPnet-TTS, by adding many new features, including: on-the-fly flexible pre-processing, joint training with neural vocoders, and state-of-the-art TTS models with extensions like full-band E2E text-to-waveform modeling, which simplify the training pipeline and further enhance TTS performance. The unified design of our recipes enables users to quickly reproduce state-of-the-art E2E-TTS results. We also provide many pre-trained models in a unified Python interface for inference, offering a quick means for users to generate baseline samples and build demos. Experimental evaluations with English and Japanese corpora demonstrate that our provided models synthesize utterances comparable to ground-truth ones, achieving state-of-the-art TTS performance. The toolkit is available online at https://github.com/espnet/espnet.


title: Optimal Needle Placement for Prostate Rotating-Shield Brachytherapy (RSBT)

abstract: Purpose: To present an efficient NEEdle Position Optimization (NEEPO) algorithm for prostate rotating shield brachytherapy (RSBT). With RSBT, the increased flexibility beyond conventional high-dose-rate brachytherapy (HDR-BT) due to the partially shielded radiation source has been shown by Adams et al. in 2020 to enable improved urethra sparing (23.1%), enhanced dose escalation (29.9%), or both, with 20 needles without NEEPO-optimized positions. Within this regime of improved dosimetry, we propose in this work that the benefits of RSBT can be maintained while also reducing the number of needles needed for the delivery. The goal of NEEPO is to provide the capability to further increase the dosimetric benefit of RSBT and to minimize the number of needles needed to satisfy a dosimetric goal. Methods: The NEEPO algorithm generates a needle pool for a given patient and then iteratively constructs a subset of needles from the pool based on relative needle importance as determined by total dwell times within needles. The NEEPO algorithm is based on a convex optimization formulation using a quadratic dosimetric penalty function, dwell time regularization by total variation, and a block sparsity regularization term to enable iterative removal of low-importance needles. RSBT treatment plans for 26 patients were generated using single fraction prescriptions with both dose escalation and urethra sparing goals, and compared to baseline HDR-BT treatment plans.


title: Atomic and electronic structure of defects in hBN: enhancing single-defect functionalities

abstract: Defect centers in insulators play a critical role in creating important functionalities in materials: prototype qubits, single-photon sources, magnetic field probes, and pressure sensors. These functionalities are highly dependent on their mid-gap electronic structure and orbital/spin wave-function contributions. However, in most cases, these fundamental properties remain unknown or speculative due to the defects being deeply embedded beneath the surface of highly resistive host crystals, thus impeding access through surface probes. Here, we directly inspected the atomic and electronic structures of defects in thin carbon-doped hexagonal boron nitride (hBN:C) using scanning tunneling microscopy (STM) and scanning tunneling spectroscopy (STS). Such investigation adds direct information about the electronic mid-gap states to the well-established photoluminescence response (including single photon emission) of intentionally created carbon defects in the most commonly investigated van der Waals insulator. Our joint atomic-scale experimental and theoretical investigations reveal two main categories of defects: 1) single-site defects manifesting as donor-like states with atomically resolved structures observable via STM, and 2) multi-site defect complexes exhibiting a ladder of empty and occupied mid-gap states characterized by distinct spatial geometries. Combining direct probing of mid-gap states through tunneling spectroscopy with the inspection of the optical response of insulators hosting specific defect structures holds promise for creating and enhancing functionalities realized with individual defects in the quantum limit. These findings underscore not only the versatility of hBN:C as a platform for quantum defect engineering but also its potential to drive advancements in atomic-scale optoelectronics.


title: FOLD-R++: A Scalable Toolset for Automated Inductive Learning of Default Theories from Mixed Data

abstract: FOLD-R is an automated inductive learning algorithm for learning default rules for mixed (numerical and categorical) data. It generates an (explainable) answer set programming (ASP) rule set for classification tasks. We present an improved FOLD-R algorithm, called FOLD-R++, that significantly increases the efficiency and scalability of FOLD-R by orders of magnitude. FOLD-R++ improves upon FOLD-R without compromising or losing information in the input training data during the encoding or feature selection phase. The FOLD-R++ algorithm is competitive in performance with the widely-used XGBoost algorithm, however, unlike XGBoost, the FOLD-R++ algorithm produces an explainable model. FOLD-R++ is also competitive in performance with the RIPPER system, however, on large datasets FOLD-R++ outperforms RIPPER. We also create a powerful tool-set by combining FOLD-R++ with s(CASP)-a goal-directed ASP execution engine-to make predictions on new data samples using the answer set program generated by FOLD-R++. The s(CASP) system also produces a justification for the prediction. Experiments presented in this paper show that our improved FOLD-R++ algorithm is a significant improvement over the original design and that the s(CASP) system can make predictions in an efficient manner as well.


title: Modeling Endorsement for Multi-Document Abstractive Summarization

abstract: A crucial difference between single- and multi-document summarization is how salient content manifests itself in the document(s). While such content may appear at the beginning of a single document, essential information is frequently reiterated in a set of documents related to a particular topic, resulting in an endorsement effect that increases information salience. In this paper, we model the cross-document endorsement effect and its utilization in multiple document summarization. Our method generates a synopsis from each document, which serves as an endorser to identify salient content from other documents. Strongly endorsed text segments are used to enrich a neural encoder-decoder model to consolidate them into an abstractive summary. The method has a great potential to learn from fewer examples to identify salient content, which alleviates the need for costly retraining when the set of documents is dynamically adjusted. Through extensive experiments on benchmark multi-document summarization datasets, we demonstrate the effectiveness of our proposed method over strong published baselines. Finally, we shed light on future research directions and discuss broader challenges of this task using a case study.


title: Empirical LiK excited state potentials: connecting short range and near dissociation expansions

abstract: We report on a high-resolution spectroscopic survey of ${}^{6}\textrm{Li}{}^{40}\textrm{K}$ molecules near the $2\textrm{S}+4\textrm{P}$ dissociation threshold and produce a fully empirical representation for the $\textrm{B}^{1}\Pi$ potential by connecting available short- and long-range data. The purpose is to identify a suitable intermediate state for a coherent Raman transfer to the absolute ground state, and the creation of a molecular gas with dipolar interactions. Starting from weakly bound ultracold Feshbach molecules, the transition frequencies to twenty-six vibrational states are determined. Our data are combined with long-range measurements [Ridinger et al., EPL, 2011, 96, 33001], and near-dissociation expansions for the spin-orbit coupled potentials are fitted to extract the $C_6$ dispersion coefficients. A suitable vibrational level is identified by resolving its Zeeman structure and by comparing the experimentally attained g-factor to our theoretical prediction. Using mass-scaling of the short-range data for the $\textrm{B}^{1}\Pi$ [Pashov et al., Chem. Phys. Lett., 1998, 292, 615-620] and an updated value for its depth, we model the short- and the long-range data simultaneously and produce a Rydberg-Klein-Rees curve covering the entire range.


title: The early evolution of solar flaring plasma loops

abstract: Plasma loops are the elementary structures of solar flaring active regions which dominate the whole processes of flaring eruptions. The standard flare models are well explained the evolution and eruption after magnetic reconnection around the hot cusp-structure above the top of plasma loops, however, the early evolution of the plasma loops before the onset of magnetic reconnection has been poorly understood. Considering that magnetic-gradients are ubiquitous in solar plasma loops, this work applies the magnetic-gradient pumping (MGP) mechanism to study the early evolution of flaring plasma loops. The results indicate that the early evolution depend on the magnetic field distribution and the geometry of the plasma loops which dominates the balance between the accumulation and dissipation of energy around loop-tops. Driven by MGP process, both of the density and temperature as well as the plasma beta value around the looptop will increase in the early phase of the plasma loops evolution. In fact, the solar plasma loops will have two distinct evolutionary results: the low, initial dense plasma loops with relatively strong magnetic fields tend to be stable for their maximum beta value always smaller than the critical value, while the higher, initial dilute solar plasma loops with relatively weak magnetic fields tend to be unstable for their beta values exceeding the critical value at a time of about one hour after the formation of the solar magnetized plasma loop. The latter may produce ballooning instability and finally trigger the following magnetic reconnection and eruptions. These physical scenarios may provide us a new viewpoint to understand the nature and origin of solar flares.


title: Tight Lipschitz Hardness for Optimizing Mean Field Spin Glasses

abstract: We study the problem of algorithmically optimizing the Hamiltonian $H_N$ of a spherical or Ising mixed $p$-spin glass. The maximum asymptotic value $\mathsf{OPT}$ of $H_N/N$ is characterized by a variational principle known as the Parisi formula, proved first by Talagrand and in more generality by Panchenko. Recently developed approximate message passing algorithms efficiently optimize $H_N/N$ up to a value $\mathsf{ALG}$ given by an extended Parisi formula, which minimizes over a larger space of functional order parameters. These two objectives are equal for spin glasses exhibiting a no overlap gap property. However, $\mathsf{ALG} < \mathsf{OPT}$ can also occur, and no efficient algorithm producing an objective value exceeding $\mathsf{ALG}$ is known. We prove that for mixed even $p$-spin models, no algorithm satisfying an overlap concentration property can produce an objective larger than $\mathsf{ALG}$ with non-negligible probability. This property holds for all algorithms with suitably Lipschitz dependence on the disorder coefficients of $H_N$. It encompasses natural formulations of gradient descent, approximate message passing, and Langevin dynamics run for bounded time and in particular includes the algorithms achieving $\mathsf{ALG}$ mentioned above. To prove this result, we substantially generalize the overlap gap property framework introduced by Gamarnik and Sudan to arbitrary ultrametric forbidden structures of solutions.

categories: math.PR cond-mat.dis-nn cs.CC math-ph math.MP math.OC


title: Individual versus Social Benefit on the Heterogeneous Networks

abstract: The focus of structural balance theory is dedicated to social benefits, while in a real network individual benefits sometimes get the importance as well. In Strauss's model, the local minima are modeled by considering an individual term besides a social one and the assumption is based on equal strength of individual benefits. The results show that the competition between two terms leads to a phase transition between individual and social benefits and there is a critical point, $CP$, that represents a first-order phase transition in the network. Concerning a real network of relations, individuals adjust the strength of their relationships based on the benefits they acquire from. Therefore, addressing heterogeneity in the individual interactions, we study a modified version of Strauss's model in which the first term represents the heterogeneous individual benefit by $\theta_{ij}$, and the coefficient of the second term, $\alpha$, measures the strength of social benefit. Our studies show that there is a region where the triangles are in a crumpled state rather than being dispersed in the network and increasing the heterogeneity of individual benefits results in the narrower region of crumpled state. Out of this region, the network is a mixture of links and triangles and the value of $\alpha$ determines whether the individual benefit or social benefit overcomes. For the small value of $\alpha$ the individual benefit dominates whereas in the large value of $\alpha$ the social benefit overcomes.


title: Density-corrected DFT explained: Questions and answers

abstract: HF-DFT, the practice of evaluating approximate density functionals on Hartree-Fock densities, has long been used in testing density functional approximations. Density-corrected DFT (DC-DFT) is a general theoretical framework for identifying failures of density functional approximations by separating errors in a functional from errors in its self-consistent (SC) density. Most modern DFT calculations yield highly accurate densities, but important characteristic classes of calculation have large density-driven errors, including reaction barrier heights, electron affinities, radicals and anions in solution, dissociation of heterodimers, and even some torsional barriers. Here, the HF density (if not spin-contaminated) usually yields more accurate and consistent energies than those of the SC density. We use the term DC(HF)-DFT to indicate DC-DFT using HF densities only in such cases. A recent comprehensive study (J. Chem. Theory Comput. 2021, 17, 1368$-$1379) of HF-DFT led to many unfavorable conclusions. A re-analysis using DC-DFT shows that DC(HF)-DFT substantially improves DFT results precisely when SC densities are flawed.


title: End-to-End Segmentation-based News Summarization

abstract: In this paper, we bring a new way of digesting news content by introducing the task of segmenting a news article into multiple sections and generating the corresponding summary to each section. We make two contributions towards this new task. First, we create and make available a dataset, SegNews, consisting of 27k news articles with sections and aligned heading-style section summaries. Second, we propose a novel segmentation-based language generation model adapted from pre-trained language models that can jointly segment a document and produce the summary for each section. Experimental results on SegNews demonstrate that our model can outperform several state-of-the-art sequence-to-sequence generation models for this new task.


title: Multiple Observers Ranked Set Samples for Shrinkage Estimators

abstract: Ranked set sampling (RSS) is used as a powerful data collection technique for situations where measuring the study variable requires a costly and/or tedious process while the sampling units can be ranked easily (e.g., osteoporosis research). In this paper, we develop ridge and Liu-type shrinkage estimators under RSS data from multiple observers to handle the collinearity problem in estimating coefficients of linear regression, stochastic restricted regression and logistic regression. Through extensive numerical studies, we show that shrinkage methods with the multi-observer RSS result in more efficient coefficient estimates. The developed methods are finally applied to bone mineral data for analysis of bone disorder status of women aged 50 and older.


title: Global large solution for the tropical climate model with diffusion

abstract: This paper studies the d-dimensional (d=2,3) tropical climate model with only the dissipation of the first baroclinic model of the velocity ($-\eta\Delta v$). By choosing a class of special initial data $(u_0,v_0,\theta_0)$ whose $H^s(\mathbb{R}^d)$ norm can be arbitrarily large, we obtain the global smooth solution of d-dimensional tropical climate model.


title: Isovariant homotopy theory and fixed point invariants

abstract: An isovariant map is an equivariant map between $G$-spaces which strictly preserves isotropy groups. We consider an isovariant analogue of Klein--Williams equivariant intersection theory for a finite group $G$. We prove that under certain reasonable dimension and codimension conditions on $H$-fixed subspaces (for $H\leq G$), the fixed points of a self-map of a compact smooth $G$-manifold can be removed isovariantly if and only if the equivariant Reidemeister trace of the map vanishes. In doing so, we study isovariant maps between manifolds up to isovariant homotopy, yielding an isovariant Whitehead's theorem. In addition, we speculate on the role of isovariant homotopy theory in distinguishing manifolds up to homeomorphism.


title: Log-Coulomb gases in the projective line of a $p$-field

abstract: This article extends recent results on log-Coulomb gases in a $p$-field $K$ (i.e., a nonarchimedean local field) to those in its projective line $\mathbb{P}^1(K)$, where the latter is endowed with the $PGL_2$-invariant Borel probability measure and spherical metric. Our first main result is an explicit combinatorial formula for the canonical partition function of log-Coulomb gases in $\mathbb{P}^1(K)$ with arbitrary charge values. Our second main result is called the "$(q+1)$th Power Law", which relates the grand canonical partition functions for one-component gases in $\mathbb{P}^1(K)$ (where all particles have charge 1) to those in the open and closed unit balls of $K$ in a simple way. The final result is a quadratic recurrence for the canonical partition functions for one-component gases in both unit balls of $K$ and in $\mathbb{P}^1(K)$. In addition to efficient computation of the canonical partition functions, the recurrence provides their "$q\to 1$" limits and "$q\mapsto q^{-1}$" functional equations.


title: Hierarchical Curriculum Learning for AMR Parsing

abstract: Abstract Meaning Representation (AMR) parsing aims to translate sentences to semantic representation with a hierarchical structure, and is recently empowered by pretrained sequence-to-sequence models. However, there exists a gap between their flat training objective (i.e., equally treats all output tokens) and the hierarchical AMR structure, which limits the model generalization. To bridge this gap, we propose a Hierarchical Curriculum Learning (HCL) framework with Structure-level (SC) and Instance-level Curricula (IC). SC switches progressively from core to detail AMR semantic elements while IC transits from structure-simple to -complex AMR instances during training. Through these two warming-up processes, HCL reduces the difficulty of learning complex structures, thus the flat model can better adapt to the AMR hierarchy. Extensive experiments on AMR2.0, AMR3.0, structure-complex and out-of-distribution situations verify the effectiveness of HCL.


title: pimeta: an R package of prediction intervals for random-effects meta-analysis

abstract: The prediction interval is gaining prominence in meta-analysis as it enables the assessment of uncertainties in treatment effects and heterogeneity between studies. However, coverage probabilities of the current standard method for constructing prediction intervals cannot retain their nominal levels in general, particularly when the number of synthesized studies is moderate or small, because their validities depend on large sample approximations. Recently, several methods have developed been to address this issue. This paper briefly summarizes the recent developments in methods of prediction intervals and provides readable examples using R for multiple types of data with simple code. The pimeta package is an R package that provides these improved methods to calculate accurate prediction intervals and graphical tools to illustrate these results. The pimeta package is listed in ``CRAN Task View: Meta-Analysis.'' The analysis is easily performed in R using a series of R packages.


title: Distributed Reconstruction Algorithm for Electron Tomography with Multiple-scattering Samples

abstract: Three-dimensional electron tomography is used to understand the structure and properties of samples in chemistry, materials science, geoscience, and biology. With the recent development of high-resolution detectors and algorithms that can account for multiple-scattering events, thicker samples can be examined at finer resolution, resulting in larger reconstruction volumes than previously possible. In this work, we propose a distributed computing framework that reconstructs large volumes by decomposing a projected tilt-series into smaller datasets such that sub-volumes can be simultaneously reconstructed on separate compute nodes using a cluster. We demonstrate our method by reconstructing a multiple-scattering layered clay (montmorillonite) sample at high resolution from a large field-of-view tilt-series phase contrast transmission electron microscopty dataset.


title: Understanding and Improving Robustness of Vision Transformers through Patch-based Negative Augmentation

abstract: We investigate the robustness of vision transformers (ViTs) through the lens of their special patch-based architectural structure, i.e., they process an image as a sequence of image patches. We find that ViTs are surprisingly insensitive to patch-based transformations, even when the transformation largely destroys the original semantics and makes the image unrecognizable by humans. This indicates that ViTs heavily use features that survived such transformations but are generally not indicative of the semantic class to humans. Further investigations show that these features are useful but non-robust, as ViTs trained on them can achieve high in-distribution accuracy, but break down under distribution shifts. From this understanding, we ask: can training the model to rely less on these features improve ViT robustness and out-of-distribution performance? We use the images transformed with our patch-based operations as negatively augmented views and offer losses to regularize the training away from using non-robust features. This is a complementary view to existing research that mostly focuses on augmenting inputs with semantic-preserving transformations to enforce models' invariance. We show that patch-based negative augmentation consistently improves robustness of ViTs across a wide set of ImageNet based robustness benchmarks. Furthermore, we find our patch-based negative augmentation are complementary to traditional (positive) data augmentation, and together boost the performance further.


title: Receptive Field Broadening and Boosting for Salient Object Detection

abstract: Salient object detection requires a comprehensive and scalable receptive field to locate the visually significant objects in the image. Recently, the emergence of visual transformers and multi-branch modules has significantly enhanced the ability of neural networks to perceive objects at different scales. However, compared to the traditional backbone, the calculation process of transformers is time-consuming. Moreover, different branches of the multi-branch modules could cause the same error back propagation in each training iteration, which is not conducive to extracting discriminative features. To solve these problems, we propose a bilateral network based on transformer and CNN to efficiently broaden local details and global semantic information simultaneously. Besides, a Multi-Head Boosting (MHB) strategy is proposed to enhance the specificity of different network branches. By calculating the errors of different prediction heads, each branch can separately pay more attention to the pixels that other branches predict incorrectly. Moreover, Unlike multi-path parallel training, MHB randomly selects one branch each time for gradient back propagation in a boosting way. Additionally, an Attention Feature Fusion Module (AF) is proposed to fuse two types of features according to respective characteristics. Comprehensive experiments on five benchmark datasets demonstrate that the proposed method can achieve a significant performance improvement compared with the state-of-the-art methods.


title: Charged domain boundaries stabilized by translational symmetry breaking in the hybrid improper ferroelectric Ca$_{3-x}$Sr$_x$Ti$_2$O$_7$

abstract: Charged domain walls and boundaries in ferroelectric materials display distinct phenomena, such as an increased conductivity due to the accumulation of bound charges. Here, we report the electron microscopy observations of atomic-scale arrangements at charged domain boundaries in the hybrid improper ferroelectric Ca$_{2.46}$Sr$_{0.54}$Ti$_2$O$_7$. Like in the prototype improper ferroelectric YMnO$_3$, we find that charged domain boundaries in Ca$_{2.46}$Sr$_{0.54}$Ti$_2$O$_7$ correspond to out-of-phase boundaries, which separate adjacent domains with a fractional translational shift of the unit cell. In addition, our results show that strontium ions are located at charged domain boundaries. The out-of-phase boundary structure may decrease the polarization charge at the boundary because of the ferrielectric nature of Ca$_{2.46}$Sr$_{0.54}$Ti$_2$O$_7$, thereby promoting the stabilization of the charged state. By combining atomic-resolution imaging and density-functional theory calculations, this study proposes an unexplored stabilization mechanism of charged domain boundaries and structural defects accompanying out-of-phase translational shifts.