title: Align, Write, Re-order: Explainable End-to-End Speech Translation via Operation Sequence Generation

abstract: The black-box nature of end-to-end speech translation (E2E ST) systems makes it difficult to understand how source language inputs are being mapped to the target language. To solve this problem, we would like to simultaneously generate automatic speech recognition (ASR) and ST predictions such that each source language word is explicitly mapped to a target language word. A major challenge arises from the fact that translation is a non-monotonic sequence transduction task due to word ordering differences between languages -- this clashes with the monotonic nature of ASR. Therefore, we propose to generate ST tokens out-of-order while remembering how to re-order them later. We achieve this by predicting a sequence of tuples consisting of a source word, the corresponding target words, and post-editing operations dictating the correct insertion points for the target word. We examine two variants of such operation sequences which enable generation of monotonic transcriptions and non-monotonic translations from the same speech input simultaneously. We apply our approach to offline and real-time streaming models, demonstrating that we can provide explainable translations without sacrificing quality or latency. In fact, the delayed re-ordering ability of our approach improves performance during streaming. As an added benefit, our method performs ASR and ST simultaneously, making it faster than using two separate systems to perform these tasks.


title: Peeling Sequences

abstract: Given a set of $n$ labeled points in general position in the plane, we remove all of its points one by one. At each step, one point from the convex hull of the remaining set is erased. In how many ways can the process be carried out? The answer obviously depends on the point set. If the points are in convex position, there are exactly $n!$ ways, which is the maximum number of ways for $n$ points. But what is the minimum number? It is shown that this number is (roughly) at least $3^n$ and at most $12.29^n$.


title: A telecom O-band emitter in diamond

abstract: Color centers in diamond are promising platforms for quantum technologies. Most color centers in diamond discovered thus far emit in the visible or near-infrared wavelength range, which are incompatible with long-distance fiber communication and unfavorable for imaging in biological tissues. Here, we report the experimental observation of a new color center that emits in the telecom O-band, which we observe in silicon-doped bulk single crystal diamonds and microdiamonds. Combining absorption and photoluminescence measurements, we identify a zero-phonon line at 1221 nm and phonon replicas separated by 42 meV. Using transient absorption spectroscopy, we measure an excited state lifetime of around 270 ps and observe a long-lived baseline that may arise from intersystem crossing to another spin manifold.


title: Palm Vein Recognition via Multi-task Loss Function and Attention Layer

abstract: With the improvement of arithmetic power and algorithm accuracy of personal devices, biological features are increasingly widely used in personal identification, and palm vein recognition has rich extractable features and has been widely studied in recent years. However, traditional recognition methods are poorly robust and susceptible to environmental influences such as reflections and noise. In this paper, a convolutional neural network based on VGG-16 transfer learning fused attention mechanism is used as the feature extraction network on the infrared palm vein dataset. The palm vein classification task is first trained using palmprint classification methods, followed by matching using a similarity function, in which we propose the multi-task loss function to improve the accuracy of the matching task. In order to verify the robustness of the model, some experiments were carried out on datasets from different sources. Then, we used K-means clustering to determine the adaptive matching threshold and finally achieved an accuracy rate of 98.89% on prediction set. At the same time, the matching is with high efficiency which takes an average of 0.13 seconds per palm vein pair, and that means our method can be adopted in practice.


title: Insonification Angle-based Ultrasound Volume Reconstruction for Spine Intervention

abstract: Ultrasound-guided spine interventions, such as lumbar-puncture procedures, often suffer from the reduced visibility of key anatomical features such as the inter-spinous process space, due to the complex shape of the self-shadowing vertebra. Therefore, we propose to design a wearable 3D ultrasound device capable of imaging the vertebra from multiple insonification angles to improve the 3D bone surface visualization for interventional guidance. In this work, we aim to equip the imaging platform with a reconstruction algorithm taking advantage of the redundant ultrasound beam angles. Specifically, we try to weight each beam's contribution for the same reconstructed voxel during the reconstruction process based on its incidence angle to the estimated bone surface. To validate our approach, we acquired multi-angle ultrasound image data on a spine phantom with a tracked phased array transducer. The results show that with the proposed method the bone surface contrast can be significantly enhanced, providing clearer visual guidance for the clinician to perform spine intervention.


title: Detection of Strongly Lensed Arcs in Galaxy Clusters with Transformers

abstract: Strong lensing in galaxy clusters probes properties of dense cores of dark matter halos in mass, studies the distant universe at flux levels and spatial resolutions otherwise unavailable, and constrains cosmological models independently. The next-generation large scale sky imaging surveys are expected to discover thousands of cluster-scale strong lenses, which would lead to unprecedented opportunities for applying cluster-scale strong lenses to solve astrophysical and cosmological problems. However, the large dataset challenges astronomers to identify and extract strong lensing signals, particularly strongly lensed arcs, because of their complexity and variety. Hence, we propose a framework to detect cluster-scale strongly lensed arcs, which contains a transformer-based detection algorithm and an image simulation algorithm. We embed prior information of strongly lensed arcs at cluster-scale into the training data through simulation and then train the detection algorithm with simulated images. We use the trained transformer to detect strongly lensed arcs from simulated and real data. Results show that our approach could achieve 99.63 % accuracy rate, 90.32 % recall rate, 85.37 % precision rate and 0.23 % false positive rate in detection of strongly lensed arcs from simulated images and could detect almost all strongly lensed arcs in real observation images. Besides, with an interpretation method, we have shown that our method could identify important information embedded in simulated data. Next step, to test the reliability and usability of our approach, we will apply it to available observations (e.g., DESI Legacy Imaging Surveys) and simulated data of upcoming large-scale sky surveys, such as the Euclid and the CSST.

categories: astro-ph.IM astro-ph.CO astro-ph.GA cs.CV


title: On the Gauduchon Curvature of Hermitian Manifolds

abstract: It is shown that many results, previously believed to be properties of the Lichnerowicz Ricci curvature, hold for the Ricci curvature of all Gauduchon connections. We prove the existence of $t$--Gauduchon Ricci-flat metrics on the suspension of a compact Sasaki--Einstein manifold, for all $t \in (-\infty,1)$; in particular, for the Bismut, Minimal, and Hermitian conformal connection. A monotonicity theorem is obtained for the Gauduchon holomorphic sectional curvature, illustrating a maximality property for the Chern connection and furnishing insight into known phenomena concerning hyperbolicity and the existence of rational curves. Moreover, we show a rigidity result for Hermitian metrics which have a pair of Gauduchon holomorphic sectional curvatures that are equal, elucidating a duality implicit in the recent work of Chen--Nie.


title: Proposal for valleytronic materials: ferrovalley metal and valley gapless semiconductor

abstract: Valleytronic materials can provide new degrees of freedom to future electronic devices. In this work, the concepts of the ferrovalley metal (FVM) and valley gapless semiconductor (VGS) are proposed, which can be achieved in valleytronic bilayer systems by electric-field tuning, where the interaction between out-of-plane ferroelectricity and A-type antiferromagnetism can induce layer-polarized anomalous valley Hall (LP-AVH) effect. The K and -K valleys of FVM are both metallic, and electron and hole carriers simultaneously exist. In the extreme case, the FVM can become VGS by analogizing spin gapless semiconductor (SGS). Moreover, it is proposed that the valley splitting enhancement and valley polarization reversal can be achieved by electric field in valleytronic bilayer systems. Taking the bilayer $\mathrm{RuBr_2}$ as an example, our proposal is confirmed by the first-principle calculations. The FVM and VGS can be achieved in bilayer $\mathrm{RuBr_2}$ by applying electric field. With appropriate electric field range, increasing electric field can enhance valley splitting, and the valley polarization can be reversed by flipping electric field direction. To effectively tune valley properties by electric field in bilayer systems, the parent monolayer should possess out-of-plane magnetization, and have large valley splitting. Our results shed light on the possible role of electric field in tuning valleytronic bilayer systems, and provide a way to design the ferrovalley-related material by electric field.


title: From RDMA to RDCA: Toward High-Speed Last Mile of Data Center Networks Using Remote Direct Cache Access

abstract: In this paper, we conduct systematic measurement studies to show that the high memory bandwidth consumption of modern distributed applications can lead to a significant drop of network throughput and a large increase of tail latency in high-speed RDMA networks.We identify its root cause as the high contention of memory bandwidth between application processes and network processes. This contention leads to frequent packet drops at the NIC of receiving hosts, which triggers the congestion control mechanism of the network and eventually results in network performance degradation. To tackle this problem, we make a key observation that given the distributed storage service, the vast majority of data it receives from the network will be eventually written to high-speed storage media (e.g., SSD) by CPU. As such, we propose to bypass host memory when processing received data to completely circumvent this performance bottleneck. In particular, we design Lamda, a novel receiver cache processing system that consumes a small amount of CPU cache to process received data from the network at line rate. We implement a prototype of Lamda and evaluate its performance extensively in a Clos-based testbed. Results show that for distributed storage applications, Lamda improves network throughput by 4.7% with zero memory bandwidth consumption on storage nodes, and improves network throughput by up 17% and 45% for large block size and small size under the memory bandwidth pressure, respectively. Lamda can also be applied to latency-sensitive HPC applications, which reduces their communication latency by 35.1%.


title: Codebook-Based Solutions for Reconfigurable Intelligent Surfaces and Their Open Challenges

abstract: Reconfigurable intelligent surfaces (RIS) is a revolutionary technology to cost-effectively improve the performance of wireless networks. We first review the existing framework of channel estimation and passive beamforming (CE & PBF) in RIS-assisted communication systems. To reduce the excessive pilot signaling overhead and implementation complexity of the CE & PBF framework, we conceive a codebook-based framework to strike flexible tradeoffs between communication performance and signaling overhead. Moreover, we provide useful insights into the codebook design and learning mechanisms of the RIS reflection pattern. Finally, we analyze the scalability of the proposed framework by flexibly adapting the training overhead to the specified quality-of-service requirements and then elaborate on its appealing advantages over the existing CE & PBF approaches. It is shown that our novel codebook-based framework can be beneficially applied to all RIS-assisted scenarios and avoids the curse of model dependency faced by its existing counterparts, thus constituting a competitive solution for practical RIS-assisted communication systems.


title: Bayesian Detection of a Sinusoidal Signal with Randomly Varying Frequency

abstract: The problem of detecting a sinusoidal signal with randomly varying frequency has a long history. It is one of the core problems in signal processing, arising in many applications including, for example, underwater acoustic frequency line tracking, demodulation of FM radio communications, laser phase drift in optical communications and, recently, continuous gravitational wave astronomy. In this paper we describe a Markov Chain Monte Carlo based procedure to compute a specific detection posterior density. We demonstrate via simulation that our approach results in an up to $25$ percent higher detection rate than Hidden Markov Model based solutions, which are generally considered to be the leading techniques for these problems.


title: Orbital Origin of Intrinsic Planar Hall Effect

abstract: Recent experiments reported an antisymmetric planar Hall effect, where the Hall current is odd in the in-plane magnetic field and scales linearly with both electric and magnetic fields applied. Existing theories rely exclusively on a spin origin, which requires spin-orbit coupling to take effect. Here, we develop a general theory for the intrinsic planar Hall effect (IPHE), highlighting a previously unknown orbital mechanism and connecting it to a band geometric quantity -- the anomalous orbital polarizability (AOP). Importantly, the orbital mechanism does not request spin-orbit coupling, so sizable IPHE can occur and is dominated by orbital contribution in systems with weak spin-orbit coupling. Combined with first-principles calculations, we demonstrate our theory with quantitative evaluation for bulk materials $\mathrm{TaSb_{2}}$, $\mathrm{NbAs_{2}}$, and $\mathrm{SrAs_{3}}$. We further show that AOP and its associated orbital IPHE can be greatly enhanced at topological band crossings, offering a new way to probe topological materials.


title: Semi-supervised Variational Autoencoder for Regression: Application on Soft Sensors

abstract: We present the development of a semi-supervised regression method using variational autoencoders (VAE), which is customized for use in soft sensing applications. We motivate the use of semi-supervised learning considering the fact that process quality variables are not collected at the same frequency as other process variables leading to many unlabelled records in operational datasets. These unlabelled records are not possible to use for training quality variable predictions based on supervised learning methods. Use of VAEs for unsupervised learning is well established and recently they were used for regression applications based on variational inference procedures. We extend this approach of supervised VAEs for regression (SVAER) to make it learn from unlabelled data leading to semi-supervised VAEs for regression (SSVAER), then we make further modifications to their architecture using additional regularization components to make SSVAER well suited for learning from both labelled and unlabelled process data. The probabilistic regressor resulting from the variational approach makes it possible to estimate the variance of the predictions simultaneously, which provides an uncertainty quantification along with the generated predictions. We provide an extensive comparative study of SSVAER with other publicly available semi-supervised and supervised learning methods on two benchmark problems using fixed-size datasets, where we vary the percentage of labelled data available for training. In these experiments, SSVAER achieves the lowest test errors in 11 of the 20 studied cases, compared to other methods where the second best gets 4 lowest test errors out of the 20.


title: Hardness-guided domain adaptation to recognise biomedical named entities under low-resource scenarios

abstract: Domain adaptation is an effective solution to data scarcity in low-resource scenarios. However, when applied to token-level tasks such as bioNER, domain adaptation methods often suffer from the challenging linguistic characteristics that clinical narratives possess, which leads to unsatisfactory performance. In this paper, we present a simple yet effective hardness-guided domain adaptation (HGDA) framework for bioNER tasks that can effectively leverage the domain hardness information to improve the adaptability of the learnt model in low-resource scenarios. Experimental results on biomedical datasets show that our model can achieve significant performance improvement over the recently published state-of-the-art (SOTA) MetaNER model


title: Multiparameter persistence modules in the large scale

abstract: A persistence module with $m$ discrete parameters is a diagram of vector spaces indexed by the poset $\mathbb{N}^m$. If we are only interested in the large scale behavior of such a diagram, then we can consider two diagrams equivalent if they agree outside of a ``negligeable'' region. In the $2$-dimensional case, we classify the indecomposable diagrams up to finitely supported diagrams. In higher dimension, we partially classify the indecomposable diagrams up to suitably finite diagrams, and show that the full classification problem is wild.


title: Multi-domain Cooperative SLAM: The Enabler for Integrated Sensing and Communications

abstract: Simultaneous localization and mapping (SLAM) provides user tracking and environmental mapping capabilities, enabling communication systems to gain situational awareness. Advanced communication networks with ultra-wideband, multiple antennas, and a large number of connections present opportunities for deep integration of sensing and communications. First, the development of integrated sensing and communications (ISAC) is reviewed in this study, and the differences between ISAC and traditional communication are revealed. Then, efficient mechanisms for multi-domain collaborative SLAM are presented. In particular, research opportunities and challenges for cross-sensing, cross-user, cross-frequency, and cross-device SLAM mechanisms are proposed. In addition, SLAM-aided communication strategies are explicitly discussed. We prove that the multi-domain cooperative SLAM mechanisms based on hybrid sensing and crowdsourcing can considerably improve the accuracy of localization and mapping in complex multipath propagation environments through numerical analysis. Furthermore, we conduct testbed experiments to show that the proposed SLAM mechanisms can achieve decimeter-level localization and mapping accuracy in practical scenarios, thereby proving the application prospect of multi-domain collaborative SLAM in ISAC.


title: Acoustic Pornography Recognition Using Convolutional Neural Networks and Bag of Refinements

abstract: A large number of pornographic audios publicly available on the Internet seriously threaten the mental and physical health of children, but these audios are rarely detected and filtered. In this paper, we firstly propose a convolutional neural networks (CNN) based model for acoustic pornography recognition. Then, we research a collection of refinements and verify their effectiveness through ablation studies. Finally, we stack all refinements together to verify whether they can further improve the accuracy of the model. Experimental results on our newly-collected large dataset consisting of 224127 pornographic audios and 274206 normal samples demonstrate the effectiveness of our proposed model and these refinements. Specifically, the proposed model achieves an accuracy of 92.46% and the accuracy is further improved to 97.19% when all refinements are combined.


title: Getting the Most out of Simile Recognition

abstract: Simile recognition involves two subtasks: simile sentence classification that discriminates whether a sentence contains simile, and simile component extraction that locates the corresponding objects (i.e., tenors and vehicles). Recent work ignores features other than surface strings. In this paper, we explore expressive features for this task to achieve more effective data utilization. Particularly, we study two types of features: 1) input-side features that include POS tags, dependency trees and word definitions, and 2) decoding features that capture the interdependence among various decoding decisions. We further construct a model named HGSR, which merges the input-side features as a heterogeneous graph and leverages decoding features via distillation. Experiments show that HGSR significantly outperforms the current state-of-the-art systems and carefully designed baselines, verifying the effectiveness of introduced features. Our code is available at https://github.com/DeepLearnXMU/HGSR.


title: Using Persuasive Writing Strategies to Explain and Detect Health Misinformation

abstract: Nowadays, the spread of misinformation is a prominent problem in society. Our research focuses on aiding the automatic identification of misinformation by analyzing the persuasive strategies employed in textual documents. We introduce a novel annotation scheme encompassing common persuasive writing tactics to achieve our objective. Additionally, we provide a dataset on health misinformation, thoroughly annotated by experts utilizing our proposed scheme. Our contribution includes proposing a new task of annotating pieces of text with their persuasive writing strategy types. We evaluate fine-tuning and prompt-engineering techniques with pre-trained language models of the BERT family and the generative large language models of the GPT family using persuasive strategies as an additional source of information. We evaluate the effects of employing persuasive strategies as intermediate labels in the context of misinformation detection. Our results show that those strategies enhance accuracy and improve the explainability of misinformation detection models. The persuasive strategies can serve as valuable insights and explanations, enabling other models or even humans to make more informed decisions regarding the trustworthiness of the information.


title: DeepG2P: Fusing Multi-Modal Data to Improve Crop Production

abstract: Agriculture is at the heart of the solution to achieve sustainability in feeding the world population, but advancing our understanding on how agricultural output responds to climatic variability is still needed. Precision Agriculture (PA), which is a management strategy that uses technology such as remote sensing, Geographical Information System (GIS), and machine learning for decision making in the field, has emerged as a promising approach to enhance crop production, increase yield, and reduce water and nutrient losses and environmental impacts. In this context, multiple models to predict agricultural phenotypes, such as crop yield, from genomics (G), environment (E), weather and soil, and field management practices (M) have been developed. These models have traditionally been based on mechanistic or statistical approaches. However, AI approaches are intrinsically well-suited to model complex interactions and have more recently been developed, outperforming classical methods. Here, we present a Natural Language Processing (NLP)-based neural network architecture to process the G, E and M inputs and their interactions. We show that by modeling DNA as natural language, our approach performs better than previous approaches when tested for new environments and similarly to other approaches for unseen seed varieties.


title: CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification

abstract: Recently, prefix-tuning was proposed to efficiently adapt pre-trained language models to a broad spectrum of natural language classification tasks. It leverages soft prefix as task-specific indicators and language verbalizers as categorical-label mentions to narrow the formulation gap from pre-training language models. However, when the label space increases considerably (i.e., many-class classification), such a tuning technique suffers from a verbalizer ambiguity problem since the many-class labels are represented by semantic-similar verbalizers in short language phrases. To overcome this, inspired by the human-decision process that the most ambiguous classes would be mulled over for each instance, we propose a brand-new prefix-tuning method, Counterfactual Contrastive Prefix-tuning (CCPrefix), for many-class classification. Basically, an instance-dependent soft prefix, derived from fact-counterfactual pairs in the label space, is leveraged to complement the language verbalizers in many-class classification. We conduct experiments on many-class benchmark datasets in both the fully supervised setting and the few-shot setting, which indicates that our model outperforms former baselines.


title: A Multi-Qubit Quantum Gate Using the Zeno Effect

abstract: The Zeno effect, in which repeated observation freezes the dynamics of a quantum system, stands as an iconic oddity of quantum mechanics. When a measurement is unable to distinguish between states in a subspace, the dynamics within that subspace can be profoundly altered, leading to non-trivial behavior. Here we show that such a measurement can turn a non-interacting system with only single-qubit control into a two- or multi-qubit entangling gate, which we call a Zeno gate. The gate works by imparting a geometric phase on the system, conditioned on it lying within a particular nonlocal subspace. We derive simple closed-form expressions for the gate fidelity under a number of non-idealities and show that the gate is viable for implementation in circuit and cavity QED systems. More specifically, we illustrate the functioning of the gate via dispersive readout in both the Markovian and non-Markovian readout regimes, and derive conditions for longitudinal readout to ideally realize the gate.


title: Thermodynamics of Black Holes with R\'enyi Entropy from Classical Gravity

abstract: The nonextensive nature of black holes is one of the most intriguing discoveries. In fact, the black hole entropy is a nonextensive quantity that scales by its surface area at the event horizon. In our work, we extend the thermodynamic phase space of black holes by treating the nonextensive parameter of the R\'enyi entropy as the thermodynamic variable. Using Euler's theorem for a homogeneous function of the black holes' mass, the compatible Smarr formula and the first law of black hole thermodynamics can be obtained. It is also demonstrated that, by keeping the same form of the black hole mass, the R\'enyi temperature is straightforwardly defined as proposed in the literature. Since many different types of black holes can indeed be successfully treated with such a procedure, our consideration is fairly general. It is worthwhile to argue that the black hole thermodynamics in R\'enyi statistics is rooted from the relation among geometric quantities in the same way as the standard approach corresponding to the Gibbs-Boltzmann statistics. Even though our results are based on classical gravity, they may pave the way to derive the R\'enyi temperature using the notion of quantum field in curved spacetime.


title: Reverse Doping Asymmetry in Semiconductor Thin Films Using External Voltage

abstract: Doping asymmetry is a notable phenomenon with semiconductors and a particularly longstanding challenge limiting the applications of most wide-band-gap semiconductors, which are inherent of spontaneous heavy n- or p-type doping because of their extreme band edges. This study theoretically shows that by applying a proper external voltage on materials during their growth or doping processes, we can largely tune the band edges and consequently reverse the doping asymmetry in semiconductor thin films. We take zinc oxide as a touchstone and computationally demonstrate that this voltage-assisted-doping approach efficiently suppresses the spontaneous n-type defects by around four orders under three distinct growth conditions and successfully generates p-type zinc oxide up to the lowest acceptor levels. The proposed approach is insensitive to materials, growth conditions, or defects origins, and thus offers a general solution to the doping asymmetry in semiconductor thin films.


title: MF2-MVQA: A Multi-stage Feature Fusion method for Medical Visual Question Answering

abstract: There is a key problem in the medical visual question answering task that how to effectively realize the feature fusion of language and medical images with limited datasets. In order to better utilize multi-scale information of medical images, previous methods directly embed the multi-stage visual feature maps as tokens of same size respectively and fuse them with text representation. However, this will cause the confusion of visual features at different stages. To this end, we propose a simple but powerful multi-stage feature fusion method, MF2-MVQA, which stage-wise fuses multi-level visual features with textual semantics. MF2-MVQA achieves the State-Of-The-Art performance on VQA-Med 2019 and VQA-RAD dataset. The results of visualization also verify that our model outperforms previous work.


title: Delay Embedded Echo-State Network: A Predictor for Partially Observed Systems

abstract: This paper considers the problem of data-driven prediction of partially observed systems using a recurrent neural network. While neural network based dynamic predictors perform well with full-state training data, prediction with partial observation during training phase poses a significant challenge. Here a predictor for partial observations is developed using an echo-state network (ESN) and time delay embedding of the partially observed state. The proposed method is theoretically justified with Taken's embedding theorem and strong observability of a nonlinear system. The efficacy of the proposed method is demonstrated on three systems: two synthetic datasets from chaotic dynamical systems and a set of real-time traffic data.


title: Testing the galaxy collision induced formation scenario for the trail of dark matter deficient galaxies with the susceptibility of globular clusters to the tidal force

abstract: It has been suggested that a trail of diffuse galaxies, including two dark matter deficient galaxies (DMDGs), in the vicinity of NGC1052 formed because of a high-speed collision between two gas-rich dwarf galaxies, one bound to NGC1052 and the other one on an unbound orbit. The collision compresses the gas reservoirs of the colliding galaxies, which in turn triggers a burst of star formation. In contrast, the dark matter and pre-existing stars in the progenitor galaxies pass through it. Since the high pressures in the compressed gas are conducive to the formation of massive globular clusters (GCs), this scenario can explain the formation of DMDGs with large populations of massive GCs, consistent with the observations of NGC1052-DF2 (DF2) and NGC1052-DF4. A potential difficulty with this `mini bullet cluster' scenario is that the observed spatial distributions of GCs in DMDGs are extended. GCs experience dynamical friction causing their orbits to decay with time. Consequently, their distribution at formation should have been even more extended than that observed at present. Using a semi-analytic model, we show that the observed positions and velocities of the GCs in DF2 imply that they must have formed at a radial distance of 5-10kpc from the center of DF2. However, as we demonstrate, the scenario is difficult to reconcile with the fact that the strong tidal forces from NGC1052 strip the extendedly distributed GCs from DF2, requiring 33-59 massive GCs to form at the collision to explain observations.


title: A Survey of Knowledge Enhanced Pre-trained Language Models

abstract: Pre-trained Language Models (PLMs) which are trained on large text corpus via self-supervised learning method, have yielded promising performance on various tasks in Natural Language Processing (NLP). However, though PLMs with huge parameters can effectively possess rich knowledge learned from massive training text and benefit downstream tasks at the fine-tuning stage, they still have some limitations such as poor reasoning ability due to the lack of external knowledge. Research has been dedicated to incorporating knowledge into PLMs to tackle these issues. In this paper, we present a comprehensive review of Knowledge Enhanced Pre-trained Language Models (KE-PLMs) to provide a clear insight into this thriving field. We introduce appropriate taxonomies respectively for Natural Language Understanding (NLU) and Natural Language Generation (NLG) to highlight these two main tasks of NLP. For NLU, we divide the types of knowledge into four categories: linguistic knowledge, text knowledge, knowledge graph (KG), and rule knowledge. The KE-PLMs for NLG are categorized into KG-based and retrieval-based methods. Finally, we point out some promising future directions of KE-PLMs.


title: In-game Toxic Language Detection: Shared Task and Attention Residuals

abstract: In-game toxic language becomes the hot potato in the gaming industry and community. There have been several online game toxicity analysis frameworks and models proposed. However, it is still challenging to detect toxicity due to the nature of in-game chat, which has extremely short length. In this paper, we describe how the in-game toxic language shared task has been established using the real-world in-game chat data. In addition, we propose and introduce the model/framework for toxic language token tagging (slot filling) from the in-game chat. The data and code will be released.


title: Sterile Neutrinos from Dark Matter: A $\nu$ Nightmare?

abstract: We provide a comprehensive study of observable spectra from dark matter pair-annihilation or decay into sterile (right-handed) neutrinos. This occurs, for instance, in neutrino portal dark matter models, where a sterile neutrino acts as the portal between dark matter and the Standard Model sector. The subsequent decays of right-handed neutrinos produce detectable Standard Model particles, notably photons, positrons, and neutrinos. We study the phenomenology of models where the right-handed neutrino masses are below the GeV scale, as well as models where they are at, or significantly heavier than, the TeV scale. In both instances, and for different reasons, the standard tools, including Monte Carlo simulations, are both inadequate and inaccurate. We present the complete framework to compute the relevant branching ratios for right-handed neutrino decays and the spectra of secondary photons, positrons, and neutrinos for a broad range of dark matter and right-handed neutrino masses. We discuss the general features of such signals, and compare the spectra to standard signals from dark matter annihilation/decay into bottom quarks. Additionally, we provide open source code1 that can be used to compute such spectra. The code is available at https://github.com/LoganAMorrison/blackthorn.


title: LiDAL: Inter-frame Uncertainty Based Active Learning for 3D LiDAR Semantic Segmentation

abstract: We propose LiDAL, a novel active learning method for 3D LiDAR semantic segmentation by exploiting inter-frame uncertainty among LiDAR frames. Our core idea is that a well-trained model should generate robust results irrespective of viewpoints for scene scanning and thus the inconsistencies in model predictions across frames provide a very reliable measure of uncertainty for active sample selection. To implement this uncertainty measure, we introduce new inter-frame divergence and entropy formulations, which serve as the metrics for active selection. Moreover, we demonstrate additional performance gains by predicting and incorporating pseudo-labels, which are also selected using the proposed inter-frame uncertainty measure. Experimental results validate the effectiveness of LiDAL: we achieve 95% of the performance of fully supervised learning with less than 5% of annotations on the SemanticKITTI and nuScenes datasets, outperforming state-of-the-art active learning methods. Code release: https://github.com/hzykent/LiDAL.


title: Carnegie Supernova Project-II: Near-infrared spectral diversity and template of Type Ia Supernovae

abstract: We present the largest and most homogeneous collection of near-infrared (NIR) spectra of Type Ia supernovae (SNe Ia): 339 spectra of 98 individual SNe obtained as part of the Carnegie Supernova Project-II. These spectra, obtained with the FIRE spectrograph on the 6.5 m Magellan Baade telescope, have a spectral range of 0.8--2.5 $\mu$m. Using this sample, we explore the NIR spectral diversity of SNe Ia and construct a template of spectral time series as a function of the light-curve-shape parameter, color stretch $s_{BV}$. Principal component analysis is applied to characterize the diversity of the spectral features and reduce data dimensionality to a smaller subspace. Gaussian process regression is then used to model the subspace dependence on phase and light-curve shape and the associated uncertainty. Our template is able to predict spectral variations that are correlated with $s_{BV}$, such as the hallmark NIR features: Mg II at early times and the $H$-band break after peak. Using this template reduces the systematic uncertainties in K-corrections by ~90% compared to those from the Hsiao template. These uncertainties, defined as the mean K-correction differences computed with the color-matched template and observed spectra, are on the level of $4\times10^{-4}$ mag on average. This template can serve as the baseline spectral energy distribution for light-curve fitters and can identify peculiar spectral features that might point to compelling physics. The results presented here will substantially improve future SN~Ia cosmological experiments, for both nearby and distant samples.


title: BattX: An Equivalent Circuit Model for Lithium-Ion Batteries Over Broad Current Ranges

abstract: Advanced battery management is to lithium-ion battery systems as the brain is to the human body. Its performance rests on the use of battery models that are both fast and accurate. However, mainstream equivalent circuit models and electrochemical models have yet to meet this need well, due to struggle with either predictive accuracy or computational complexity. This problem has acquired urgency as some emerging battery applications running across broad current ranges, e.g., electric vertical take-off and landing aircraft, can hardly find usable models from the literature. Motivated to address the problem, we develop an innovative model in this study. Called BattX, the model is an equivalent circuit model but draws comparisons to a single particle model with electrolyte and thermal dynamics, thus combining their respective merits to be computationally efficient, accurate, and physically interpretable. The model design pivots on leveraging multiple circuits to approximate major electrochemical and physical processes in charging/discharging. Given the model, we develop a multipronged approach to design experiments and identify its parameters in groups from experimental data. Experimental validation proves that the BattX model is capable of accurate voltage prediction for charging/discharging across low to high C-rates.


title: Direction-dependent coupling between a nanofiber-guided light field and a two-level atom with an electric quadrupole transition

abstract: We study the directional dependence of the coupling between a nanofiber-guided light field and a two-level atom with an electric quadrupole transition. We examine the situation where the atom lies on the fiber transverse axis $x$, the quantization axis for the atomic internal states is the other orthogonal transverse axis $y$, the atomic upper and lower levels are the magnetic sublevels $M'$ and $M$ of hyperfine-structure levels of an alkali-metal atom, and the field is in a quasilinearly polarized fundamental guided mode HE$_{11}$ with the polarization $\xi=x$ or $y$. We find that the absolute value of the quadrupole Rabi frequency depends on the propagation direction of the light field in the cases of ($M'-M=\pm1$, $\xi=y$) and ($M'-M=\pm2$, $\xi=x$). We show that the directional dependence of the coupling leads to the directional dependence of spontaneous emission into guided modes. We find that the directional dependence of the atom-field coupling in the case of quadrupole transitions is not entirely due to spin-orbit coupling of light: there are some other contributions resulting from the gradient of the spatial phase factor of the field.


title: An Improved End-to-End Multi-Target Tracking Method Based on Transformer Self-Attention

abstract: This study proposes an improved end-to-end multi-target tracking algorithm that adapts to multi-view multi-scale scenes based on the self-attentive mechanism of the transformer's encoder-decoder structure. A multi-dimensional feature extraction backbone network is combined with a self-built semantic raster map, which is stored in the encoder for correlation and generates target position encoding and multi-dimensional feature vectors. The decoder incorporates four methods: spatial clustering and semantic filtering of multi-view targets, dynamic matching of multi-dimensional features, space-time logic-based multi-target tracking, and space-time convergence network (STCN)-based parameter passing. Through the fusion of multiple decoding methods, muti-camera targets are tracked in three dimensions: temporal logic, spatial logic, and feature matching. For the MOT17 dataset, this study's method significantly outperforms the current state-of-the-art method MiniTrackV2 [49] by 2.2% to 0.836 on Multiple Object Tracking Accuracy(MOTA) metric. Furthermore, this study proposes a retrospective mechanism for the first time, and adopts a reverse-order processing method to optimise the historical mislabeled targets for improving the Identification F1-score(IDF1). For the self-built dataset OVIT-MOT01, the IDF1 improves from 0.948 to 0.967, and the Multi-camera Tracking Accuracy(MCTA) improves from 0.878 to 0.909, which significantly improves the continuous tracking accuracy and scene adaptation. This research method introduces a new attentional tracking paradigm which is able to achieve state-of-the-art performance on multi-target tracking (MOT17 and OVIT-MOT01) tasks.


title: Hierarchical Clustering in Astronomy

abstract: Hierarchical clustering is a common algorithm in data analysis. It is unique among many clustering algorithms in that it draws dendrograms based on the distance of data under a certain metric, and group them. It is widely used in all areas of astronomical research, covering various scales from asteroids and molecular clouds, to galaxies and galaxy cluster. This paper systematically reviews the history and current status of the development of hierarchical clustering methods in various branches of astronomy. These applications can be grouped into two broad categories, one revealing the intrinsic hierarchical structure of celestial systems and the other classifying large samples of celestial objects automatically. By reviewing these applications, we can clarify the conditions and limitations of the hierarchical clustering algorithm, and make more reasonable and reliable astronomical discoveries.


title: Coherent Equalization of Linear Quantum Systems

abstract: This paper introduces a $H_\infty$-like methodology of coherent filtering for equalization of passive linear quantum systems to help mitigate degrading effects of quantum communication channels. For such systems, which include a wide range of linear quantum optical devices and signals, we seek to find a near optimal equalizing filter which is itself a passive quantum system. The problem amounts to solving an optimization problem subject to constraints dictated by the requirement for the equalizer to be physically realizable. By formulating these constraints in the frequency domain, we show that the problem admits a convex $H_\infty$-like formulation. This allows us to derive a set of suboptimal coherent equalizers using $J$-spectral factorization. An additional semidefinite relaxation combined with the Nevanlinna-Pick interpolation is shown to lead to a tractable algorithm for the design of a near optimal coherent equalizer.


title: A Comprehensive Survey of Transformers for Computer Vision

abstract: As a special type of transformer, Vision Transformers (ViTs) are used to various computer vision applications (CV), such as image recognition. There are several potential problems with convolutional neural networks (CNNs) that can be solved with ViTs. For image coding tasks like compression, super-resolution, segmentation, and denoising, different variants of the ViTs are used. The purpose of this survey is to present the first application of ViTs in CV. The survey is the first of its kind on ViTs for CVs to the best of our knowledge. In the first step, we classify different CV applications where ViTs are applicable. CV applications include image classification, object detection, image segmentation, image compression, image super-resolution, image denoising, and anomaly detection. Our next step is to review the state-of-the-art in each category and list the available models. Following that, we present a detailed analysis and comparison of each model and list its pros and cons. After that, we present our insights and lessons learned for each category. Moreover, we discuss several open research challenges and future research directions.


title: Wide Field Integral Spectroscopy in Nearby Galaxies with the TYPHOON Survey

abstract: The TYPHOON program is producing an atlas of spectroscopic data cubes of 44 large-angular-sized galaxies with complete spatial coverage from 3650-9000 A. This survey provides an unparalleled opportunity to study variations in the interstellar medium (ISM) properties within individual HII regions across the entire star-forming disks of nearby galaxies. This can provide key insights into the spatial distribution and resolved properties of the ISM to understand how efficiently metals are mixed and redistributed across spirals and dwarf galaxies. In this Proceeding, we present early science results from six nearby spiral galaxies as part of the TYPHOON program from Grasha et al. (2022). We use HIIPhot to identify the HII regions within the galaxy based on the surface brightness of the H-alpha emission line and measure variations of the HII region oxygen abundance. In this initial work, we find that while the spiral pattern plays a role in organizing the ISM, it alone does not establish the relatively uniform azimuthal variations we observe across all the galaxies. Differences in the metal abundances are more likely driven by the strong correlations with the local physical conditions. We find a strong and positive correlation between the ionization parameter and the local abundances as measured by the relative metallicity offset $\Delta$(O/H), indicating a tight relationship between local physical conditions and their localized enrichment of the ISM. These variations can be explained by a combination of localized, star formation-driven self-enrichment and large-scale mixing-driven dilution due to the passing of spiral density waves.


title: Small-angle neutron scattering of long-wavelength magnetic modulations in reduced sample dimensions

abstract: Magnetic small-angle neutron scattering (SANS) is ideally suited to provide direct, reciprocal-space information of long-wavelength magnetic modulations, such as helicoids, solitons, merons, or skyrmions. SANS of such structures in thin films or micro-structured bulk materials is strongly limited by the tiny scattering volume vis a vis the prohibitively large background scattering by the substrate and support structures. Considering near-surface scattering closely above the critical angle of reflection, where unwanted signal contributions due to substrate or support structures becomes very small, we establish equivalent scattering patterns of the helical, conical, skyrmion lattice, and fluctuation-disordered phases in a polished bulk sample of MnSi between conventional transmission and near-surface SANS geometries. This motivates the prediction of a complete repository of scattering patterns expected for thin films in the near-surface SANS geometry for each orientation of the magnetic order with respect to the scattering plane.


title: Continuous Soft Pseudo-Labeling in ASR

abstract: Continuous pseudo-labeling (PL) algorithms such as slimIPL have recently emerged as a powerful strategy for semi-supervised learning in speech recognition. In contrast with earlier strategies that alternated between training a model and generating pseudo-labels (PLs) with it, here PLs are generated in end-to-end manner as training proceeds, improving training speed and the accuracy of the final model. PL shares a common theme with teacher-student models such as distillation in that a teacher model generates targets that need to be mimicked by the student model being trained. However, interestingly, PL strategies in general use hard-labels, whereas distillation uses the distribution over labels as the target to mimic. Inspired by distillation we expect that specifying the whole distribution (aka soft-labels) over sequences as the target for unlabeled data, instead of a single best pass pseudo-labeled transcript (hard-labels) should improve PL performance and convergence. Surprisingly and unexpectedly, we find that soft-labels targets can lead to training divergence, with the model collapsing to a degenerate token distribution per frame. We hypothesize that the reason this does not happen with hard-labels is that training loss on hard-labels imposes sequence-level consistency that keeps the model from collapsing to the degenerate solution. In this paper, we show several experiments that support this hypothesis, and experiment with several regularization approaches that can ameliorate the degenerate collapse when using soft-labels. These approaches can bring the accuracy of soft-labels closer to that of hard-labels, and while they are unable to outperform them yet, they serve as a useful framework for further improvements.


title: Resonant $s$-channel dark matter annihilation at NLO

abstract: Studies of dark matter annihilation through an $s$-channel resonance are often based on recipes such as a narrow width approximation or real intermediate state subtraction. We review a recipe-free formalism that can be implemented at the NLO level in the full theory, and ensures the cancellation of mass singularities. Its basic ingredients can be formulated in the relativistic regime, but we show that the procedure simplifies if we go to the non-relativistic one and assume the presence of kinetic equilibrium. The latter case is illustrated for scalar singlet dark matter with $m_{\rm S}^{ } \simeq 60$ GeV, freezing out at $T \simeq (1-3)$ GeV, re-confirming the viability of this scenario with couplings tiny enough to evade experimental constraints.


title: What's the Situation with Intelligent Mesh Generation: A Survey and Perspectives

abstract: Intelligent Mesh Generation (IMG) represents a novel and promising field of research, utilizing machine learning techniques to generate meshes. Despite its relative infancy, IMG has significantly broadened the adaptability and practicality of mesh generation techniques, delivering numerous breakthroughs and unveiling potential future pathways. However, a noticeable void exists in the contemporary literature concerning comprehensive surveys of IMG methods. This paper endeavors to fill this gap by providing a systematic and thorough survey of the current IMG landscape. With a focus on 113 preliminary IMG methods, we undertake a meticulous analysis from various angles, encompassing core algorithm techniques and their application scope, agent learning objectives, data types, targeted challenges, as well as advantages and limitations. We have curated and categorized the literature, proposing three unique taxonomies based on key techniques, output mesh unit elements, and relevant input data types. This paper also underscores several promising future research directions and challenges in IMG. To augment reader accessibility, a dedicated IMG project page is available at \url{https://github.com/xzb030/IMG_Survey}.


title: Cosmic Hydrogen and Ice Loss Lines

abstract: We explain the overall equilibrium-temperature-dependent trend in the exoplanet mass-radius diagram, using the escape mechanisms of hydrogen and relevant volatiles, and the chemical equilibrium calculation of molecular hydrogen (H$_2$) break-up into atomic hydrogen (H). We identify two Cosmic Hydrogen and Ice Loss Lines (CHILLs) in the mass-radius diagram. Gas disks are well known to disperse in ten million years. However, gas-rich planets may lose some or almost all gas on a much longer timescale. We thus hypothesize that most planets that are born out of a hydrogen-gas-dominated nebular disk begin by possessing a primordial H$_2$-envelope. This envelope is gradually lost due to escape processes caused by host-stellar radiation.


title: GeoAI for Knowledge Graph Construction: Identifying Causality Between Cascading Events to Support Environmental Resilience Research

abstract: Knowledge graph technology is considered a powerful and semantically enabled solution to link entities, allowing users to derive new knowledge by reasoning data according to various types of reasoning rules. However, in building such a knowledge graph, events modeling, such as that of disasters, is often limited to single, isolated events. The linkages among cascading events are often missing in existing knowledge graphs. This paper introduces our GeoAI (Geospatial Artificial Intelligence) solutions to identify causality among events, in particular, disaster events, based on a set of spatially and temporally-enabled semantic rules. Through a use case of causal disaster events modeling, we demonstrated how these defined rules, including theme-based identification of correlated events, spatiotemporal co-occurrence constraint, and text mining of event metadata, enable the automatic extraction of causal relationships between different events. Our solution enriches the event knowledge base and allows for the exploration of linked cascading events in large knowledge graphs, therefore empowering knowledge query and discovery.


abstract: Masked image modelling (e.g., Masked AutoEncoder) and contrastive learning (e.g., Momentum Contrast) have shown impressive performance on unsupervised visual representation learning. This work presents Masked Contrastive Representation Learning (MACRL) for self-supervised visual pre-training. In particular, MACRL leverages the effectiveness of both masked image modelling and contrastive learning. We adopt an asymmetric setting for the siamese network (i.e., encoder-decoder structure in both branches), where one branch with higher mask ratio and stronger data augmentation, while the other adopts weaker data corruptions. We optimize a contrastive learning objective based on the learned features from the encoder in both branches. Furthermore, we minimize the $L_1$ reconstruction loss according to the decoders' outputs. In our experiments, MACRL presents superior results on various vision benchmarks, including CIFAR-10, CIFAR-100, Tiny-ImageNet, and two other ImageNet subsets. Our framework provides unified insights on self-supervised visual pre-training and future research.


title: Exploring Mental Health Communications among Instagram Coaches

abstract: There has been a significant expansion in the use of online social networks (OSNs) to support people experiencing mental health issues. This paper studies the role of Instagram influencers who specialize in coaching people with mental health issues. Using a dataset of 97k posts, we characterize such users' linguistic and behavioural features. We explore how these observations impact audience engagement (as measured by likes). We show that the support provided by these accounts varies based on their self-declared professional identities. For instance, Instagram accounts that declare themselves as Authors offer less support than accounts that label themselves as Coach. We show that increasing information support in general communication positively affects user engagement. However, the effect of vocabulary on engagement is not consistent across the Instagram account types. Our findings shed light on this understudied topic and guide how mental health practitioners can improve outreach.


title: Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction

abstract: Information Extraction (IE) aims to extract structured information from heterogeneous sources. IE from natural language texts include sub-tasks such as Named Entity Recognition (NER), Relation Extraction (RE), and Event Extraction (EE). Most IE systems require comprehensive understandings of sentence structure, implied semantics, and domain knowledge to perform well; thus, IE tasks always need adequate external resources and annotations. However, it takes time and effort to obtain more human annotations. Low-Resource Information Extraction (LRIE) strives to use unsupervised data, reducing the required resources and human annotation. In practice, existing systems either utilize self-training schemes to generate pseudo labels that will cause the gradual drift problem, or leverage consistency regularization methods which inevitably possess confirmation bias. To alleviate confirmation bias due to the lack of feedback loops in existing LRIE learning paradigms, we develop a Gradient Imitation Reinforcement Learning (GIRL) method to encourage pseudo-labeled data to imitate the gradient descent direction on labeled data, which can force pseudo-labeled data to achieve better optimization capabilities similar to labeled data. Based on how well the pseudo-labeled data imitates the instructive gradient descent direction obtained from labeled data, we design a reward to quantify the imitation process and bootstrap the optimization capability of pseudo-labeled data through trial and error. In addition to learning paradigms, GIRL is not limited to specific sub-tasks, and we leverage GIRL to solve all IE sub-tasks (named entity recognition, relation extraction, and event extraction) in low-resource settings (semi-supervised IE and few-shot IE).


title: Reducibility of the dispersive Camassa-Holm equation with unbounded perturbations

abstract: Considered herein is the reducibility of the quasi-periodically time dependent linear dynamical system with a diophantine frequency vector $\omega \in \mathcal{O}_0 \subset \mathbb{R}^{\nu}$. This system is derived from linearizing the dispersive Camassa-Holm equation with unbounded perturbations at a small amplitude quasi-periodic function. It is shown that there is a set $\mathcal{O}_{\infty} \subset \mathcal{O}_0$ of asymptotically full Lebesgue measure such that for any $\omega \in \mathcal{O}_{\infty}$, the system can be reduced to the one with constant coefficients by a quasi-periodic linear transformation. The strategy adopted in this paper consists of two steps: (a) A reduction based on the orders of the pseudo differential operators in the system which conjugates the linearized operator to a one with constant coefficients up to a small remainder; (b) A perturbative reducibility scheme which completely diagonalizes the remainder of the previous step. The main difficulties in the reducibility we need to tackle come from the operator $J=(1-\partial_{xx})^{-1}\partial_{x}$, which induces the symplectic structure of the dispersive Camassa-Holm equation.


title: How Population III Supernovae Determined the Properties of the First Galaxies

abstract: Massive Pop III stars can die as energetic supernovae that enrich the early universe with metals and determine the properties of the first galaxies. With masses of about $10^9$ Msun at $z \gtrsim 10$, these galaxies are believed to be the ancestors of the Milky Way. This paper investigates the impact of Pop III supernova remnants (SNRs) from both Salpeter-like and top-heavy initial mass functions (IMFs) on the formation of first galaxies with high-resolution radiation-hydrodynamical simulations with the ENZO code. Our findings indicate that SNRs from a top-heavy Pop III IMF produce more metals, leading to more efficient gas cooling and earlier Pop II star formation in the first galaxies. From a few hundred to a few thousand Pop II stars can form in the central regions of these galaxies. These stars have metallicities of $10^{-3}$ to $10^{-2}$, Zsun, greater than those of extremely metal-poor (EMP) stars. Their mass function follows a power-law distribution with $dN(M_*)/dM_* \propto M_*^{\alpha}$, where $M_*$ is stellar mass and $\alpha = 2.66 - 5.83$ and is steeper for a top-heavy IMF. We thus find that EMP stars were not typical of most primitive galaxies.

categories: astro-ph.GA astro-ph.CO astro-ph.HE astro-ph.SR


title: Joint Spatio-Temporal Precoding for Practical Non-Stationary Wireless Channels

abstract: The high mobility, density and multi-path evident in modern wireless systems makes the channel highly non-stationary. This causes temporal variation in the channel distribution that leads to the existence of time-varying joint interference across multiple degrees of freedom (DoF, e.g., users, antennas, frequency and symbols), which renders conventional precoding sub-optimal in practice. In this work, we derive a High-Order Generalization of Mercer's Theorem (HOGMT), which decomposes the multi-user non-stationary channel into two (dual) sets of jointly orthogonal subchannels (eigenfunctions), that result in the other set when one set is transmitted through the channel. This duality and joint orthogonality of eigenfuntions ensure transmission over independently flat-fading subchannels. Consequently, transmitting these eigenfunctions with optimally derived coefficients eventually mitigates any interference across its degrees of freedoms and forms the foundation of the proposed joint spatio-temporal precoding. The transferred dual eigenfuntions and coefficients directly reconstruct the data symbols at the receiver upon demodulation, thereby significantly reducing its computational burden, by alleviating the need for any complementary post-coding. Additionally, the eigenfunctions decomposed from the time-frequency delay-Doppler channel kernel are paramount to extracting the second-order channel statistics, and therefore completely characterize the underlying channel. We evaluate this using a realistic non-stationary channel framework built in Matlab and show that our precoding achieves ${\geqslant}$4 orders of reduction in BER at SNR${\geqslant}15$dB in OFDM systems for higher-order modulations and less complexity compared to the state-of-the-art precoding.


title: MDFlow: Unsupervised Optical Flow Learning by Reliable Mutual Knowledge Distillation

abstract: Recent works have shown that optical flow can be learned by deep networks from unlabelled image pairs based on brightness constancy assumption and smoothness prior. Current approaches additionally impose an augmentation regularization term for continual self-supervision, which has been proved to be effective on difficult matching regions. However, this method also amplify the inevitable mismatch in unsupervised setting, blocking the learning process towards optimal solution. To break the dilemma, we propose a novel mutual distillation framework to transfer reliable knowledge back and forth between the teacher and student networks for alternate improvement. Concretely, taking estimation of off-the-shelf unsupervised approach as pseudo labels, our insight locates at defining a confidence selection mechanism to extract relative good matches, and then add diverse data augmentation for distilling adequate and reliable knowledge from teacher to student. Thanks to the decouple nature of our method, we can choose a stronger student architecture for sufficient learning. Finally, better student prediction is adopted to transfer knowledge back to the efficient teacher without additional costs in real deployment. Rather than formulating it as a supervised task, we find that introducing an extra unsupervised term for multi-target learning achieves best final results. Extensive experiments show that our approach, termed MDFlow, achieves state-of-the-art real-time accuracy and generalization ability on challenging benchmarks. Code is available at https://github.com/ltkong218/MDFlow.


title: Explicit bounds on the coefficients of modular polynomials for the elliptic $j$-invariant

abstract: We obtain an explicit upper bound on the size of the coefficients of the elliptic modular polynomials $\Phi_N$ for any $N\geq1$. These polynomials vanish at pairs of $j$-invariants of elliptic curves linked by cyclic isogenies of degree $N$. The main term in the bound is asymptotically optimal as $N$ tends to infinity.


title: Current Topics, Methods, and Challenges in the Modelling of Intrinsically Disordered Protein Dynamics

abstract: The paradigm that the primary amino acid sequence prescribes structure and thus function has for a long time been central to the understanding of protein science. Though the theory is supported by the behaviour of most structured proteins, it loses much of its applicability when discussing intrinsically disordered proteins (IDPs). These peculiar proteins, whose tertiary structure constantly interconverts between a series of energetically favourable conformations, are the root of many current, pressing scientific mechanisms. Many biological processes that are still yet to be elucidated--the mechanisms of of protein folding, ligand binding, and general protein dynamics--involve IDPs. Because most dynamic protein events are on such short time scales, using experimental methods to observe their action often times doesn't yield useful data. As well, the data resulting from scientific techniques developed for structured, "static proteins" must be presented in conjunction with data from methods tailored specifically to IDPs in order to have significance. A method that models IDPs with shocking accuracy is computer simulation, particularly Molecular Dynamics (MD) simulations. With computational power only recently increasing enough to encompass the timescale needed for protein dynamics, MD simulations are still fairly novel in their implementations. This paper will discuss and consolidate the current methods, problems, and solutions of using MD simulation to model IDPs. Which simulation parameters can be altered to more precisely describe observed biological behaviour? How can one accurately use MD simulation to answer questions that, when using experimental methods, have no answer? How can the data resulting from MD simulation be analyzed and quantified to support the conclusions being drawn?


title: Spatially-resolved properties of the ionized gas in the HII galaxy J084220+115000

abstract: We present a spatially resolved spectroscopic study for the metal poor HII galaxy J084220+115000 using MEGARA Integral Field Unit observations at the Gran Telescopio Canarias. We estimated the gas metallicity using the direct method for oxygen, nitrogen and helium and found a mean value of 12+$\log$(O/H)=$8.03\pm$0.06, and integrated electron density and temperature of $\sim161$ cm$^{-3}$ and $\sim15400$ K, respectively. The metallicity distribution shows a large range of $\Delta$(O/H) = 0.72 dex between the minimum and maximum (7.69$\pm$0.06 and 8.42$\pm$0.05) values, unusual in a dwarf star-forming galaxy. We derived an integrated $\log$(N/O) ratio of $-1.51\pm0.05$ and found that both N/O and O/H correspond to a primary production of metals. Spatially resolved maps indicate that the gas appears to be photoionized by massive stars according to the diagnostic line ratios. Between the possible mechanisms to explain the starburst activity and the large variation of oxygen abundance in this galaxy, our data support a possible scenario where we are witnessing an ongoing interaction triggering multiple star-forming regions localized in two dominant clumps.


title: Curvature and quantized Arnold strangeness

abstract: By integrating curvatures multiplied non-trivial densities, we introduce an integral expression of the Arnold strangeness that is a celebrated plane curve invariant. The key is a partition function by Shumakovitch to reformulate Arnold strangeness. Our integrating curvatures suggests a quantized Arnold strangeness which Taylor expansion includes the rotation number and the original Arnold strangeness, and also higher terms are invariants of Tabachnikov. It is an analogue of the quantization by Viro for Arnold $J^-$ and by Lanzat-Polyak for $J^+$.


title: Soft-Landing Strategy for Alleviating the Task Discrepancy Problem in Temporal Action Localization Tasks

abstract: Temporal Action Localization (TAL) methods typically operate on top of feature sequences from a frozen snippet encoder that is pretrained with the Trimmed Action Classification (TAC) tasks, resulting in a task discrepancy problem. While existing TAL methods mitigate this issue either by retraining the encoder with a pretext task or by end-to-end fine-tuning, they commonly require an overload of high memory and computation. In this work, we introduce Soft-Landing (SoLa) strategy, an efficient yet effective framework to bridge the transferability gap between the pretrained encoder and the downstream tasks by incorporating a light-weight neural network, i.e., a SoLa module, on top of the frozen encoder. We also propose an unsupervised training scheme for the SoLa module; it learns with inter-frame Similarity Matching that uses the frame interval as its supervisory signal, eliminating the need for temporal annotations. Experimental evaluation on various benchmarks for downstream TAL tasks shows that our method effectively alleviates the task discrepancy problem with remarkable computational efficiency.


title: Progressive Motion Context Refine Network for Efficient Video Frame Interpolation

abstract: Recently, flow-based frame interpolation methods have achieved great success by first modeling optical flow between target and input frames, and then building synthesis network for target frame generation. However, above cascaded architecture can lead to large model size and inference delay, hindering them from mobile and real-time applications. To solve this problem, we propose a novel Progressive Motion Context Refine Network (PMCRNet) to predict motion fields and image context jointly for higher efficiency. Different from others that directly synthesize target frame from deep feature, we explore to simplify frame interpolation task by borrowing existing texture from adjacent input frames, which means that decoder in each pyramid level of our PMCRNet only needs to update easier intermediate optical flow, occlusion merge mask and image residual. Moreover, we introduce a new annealed multi-scale reconstruction loss to better guide the learning process of this efficient PMCRNet. Experiments on multiple benchmarks show that proposed approaches not only achieve favorable quantitative and qualitative results but also reduces current model size and running time significantly.


title: Tailoring the magnetic landscape in Al-doped LaMnO3: An experimental and computational perspective

abstract: We have presented the synthesis, structural, and magnetic properties from the experimental point of view. Then we verified our experimental observation by studying the electronic and magnetic properties of Al-doped LaMnO3 from the first principle density functional theory (DFT) and Monte-Carlo simulation. We have synthesized the LaAlxMn1-xO3 (x= 0.05, 0.15, 0.25) and performed the Rietveld refinement of XRD data to determine the lattice parameters. To see the mixed valance of Mn-ion, we performed the XPS of 25% Al-doped material. The magnetic study shows the ferromagnetic transition of these materials. Using XRD refinement values, we have completed the DFT calculations. The Monte Carlo simulation has been done through the anisotropic Ising model to analyze the origin of magnetic transition. We have determined the anisotropy and the interaction constants from the DFT calculations.


title: Existence and uniqueness of weighted generalized $\psi$-estimators

abstract: We introduce the notions of generalized and weighted generalized $\psi$-estimators as unique points of sign change of some appropriate functions, and we give necessary as well as sufficient conditions for their existence. We also derive a set of sufficient conditions under which the so-called $\psi$-expectation function has a unique point of sign change. We present several examples from statistical estimation theory, where our results are well-applicable. For example, we consider the cases of empirical quantiles, empirical expectiles, some $\psi$-estimators that are important in robust statistics, and some examples from maximum likelihood theory as well. Further, we introduce Bajraktarevi\'c-type (in particular, quasi-arithmetic-type) $\psi$-estimators. Our results specialized to $\psi$-estimators with a function $\psi$ being continuous in its second variable provide new results for (usual) $\psi$-estimators (also called Z-estimators).


title: Dance of SNN and ANN: Solving binding problem by combining spike timing and reconstructive attention

abstract: The binding problem is one of the fundamental challenges that prevent the artificial neural network (ANNs) from a compositional understanding of the world like human perception, because disentangled and distributed representations of generative factors can interfere and lead to ambiguity when complex data with multiple objects are presented. In this paper, we propose a brain-inspired hybrid neural network (HNN) that introduces temporal binding theory originated from neuroscience into ANNs by integrating spike timing dynamics (via spiking neural networks, SNNs) with reconstructive attention (by ANNs). Spike timing provides an additional dimension for grouping, while reconstructive feedback coordinates the spikes into temporal coherent states. Through iterative interaction of ANN and SNN, the model continuously binds multiple objects at alternative synchronous firing times in the SNN coding space. The effectiveness of the model is evaluated on synthetic datasets of binary images. By visualization and analysis, we demonstrate that the binding is explainable, soft, flexible, and hierarchical. Notably, the model is trained on single object datasets without explicit supervision on grouping, but successfully binds multiple objects on test datasets, showing its compositional generalization capability. Further results show its binding ability in dynamic situations.


title: Fair Curing and Network Design in SIS Epidemic Processes

abstract: This paper studies efficient algorithms for dynamic curing policies and the corresponding network design problems to guarantee the fast extinction of epidemic spread in a susceptible-infected-susceptible (SIS) model. We consider a Markov process-based SIS epidemic model. We call a curing policy fair if demographic groups are cured with comparable speeds. We propose a fair curing policy based on the curing policy of Drakopoulos et al. Since these optimization problems are NP-hard, finding optimal policies is intractable for large graphs. We provide approximation guarantees on both curing and fair curing policies. Moreover, when the total infection rate is large, the original curing policy includes a waiting period in which no measures are taken to mitigate the spread until the rate slows down. To avoid the waiting period, we study network design problems to reduce the total infection rate by deleting edges or reducing the weight of edges. Then the curing processes become continuous since the total infection rate is restricted by network design. We provide algorithms with provable guarantees for the considered network design problems. In summary, the proposed fair curing and network design algorithms together provide an effective, fair, and computationally efficient approach that mitigates SIS epidemic spread in networks.


title: Morphologies and Central Stars of Planetary Nebulae in the Galactic bulge from VLT, $\textit{HST}$ and Pan-STARRS imaging

abstract: This is the first in a series of papers that present sets of different results for 136 compact, known planetary nebulae within a 10 $\times$ 10 degree region of the Galactic bulge. We use a large, previously unpublished sample of our own extensive ESO 8 m VLT deep imaging and spectroscopic data. This is combined with archival deep $\textit{HST}$ imaging where available to provide a detailed morphological classification and study. The influence of angular resolution and sensitivity when assigning a morphology is discussed. A large fraction (68%) of the sample are shown to be bipolars and the implications for this in the context of planetary nebulae progenitors are explored. Four new planetary nebula central stars are also identified which are not in $\textit{Gaia}$. This is based on both VLT and deep archival Pan-STARRS broad-band imagery. Some 11 putative central stars previously reported, based on $\textit{Gaia}$ positions, are also not the true central star. In other cases the $\textit{Gaia}$ central stars reported in the literature are actually based on the overall centroid position of a very compact planetary nebula rather than the actual central star within it. $\textit{Gaia}$ parallax distances and kinematic ages for PNe in this sample are provided where possible based on fresh angular size measures from the new VLT imagery and $\textit{Gaia}$ distances and literature expansion velocities when available. All these results are discussed within the context of the overall characteristics of the Galactic bulge and its planetary nebula population.


title: Efficient Immediate-Access Dynamic Indexing

abstract: In a dynamic retrieval system, documents must be ingested as they arrive, and be immediately findable by queries. Our purpose in this paper is to describe an index structure and processing regime that accommodates that requirement for immediate access, seeking to make the ingestion process as streamlined as possible, while at the same time seeking to make the growing index as small as possible, and seeking to make term-based querying via the index as efficient as possible. We describe a new compression operation and a novel approach to extensible lists which together facilitate that triple goal. In particular, the structure we describe provides incremental document-level indexing using as little as two bytes per posting and only a small amount more for word-level indexing; provides fast document insertion; supports immediate and continuous queryability; provides support for fast conjunctive queries and similarity score-based ranked queries; and facilitates fast conversion of the dynamic index to a "normal" static compressed inverted index structure. Measurement of our new mechanism confirms that in-memory dynamic document-level indexes for collections into the gigabyte range can be constructed at a rate of two gigabytes/minute using a typical server architecture, that multi-term conjunctive Boolean queries can be resolved in just a few milliseconds each on average even while new documents are being concurrently ingested, and that the net memory space required for all of the required data structures amounts to an average of as little as two bytes per stored posting, less than half the space required by the best previous mechanism.


title: GET-DIPP: Graph-Embedded Transformer for Differentiable Integrated Prediction and Planning

abstract: Accurately predicting interactive road agents' future trajectories and planning a socially compliant and human-like trajectory accordingly are important for autonomous vehicles. In this paper, we propose a planning-centric prediction neural network, which takes surrounding agents' historical states and map context information as input, and outputs the joint multi-modal prediction trajectories for surrounding agents, as well as a sequence of control commands for the ego vehicle by imitation learning. An agent-agent interaction module along the time axis is proposed in our network architecture to better comprehend the relationship among all the other intelligent agents on the road. To incorporate the map's topological information, a Dynamic Graph Convolutional Neural Network (DGCNN) is employed to process the road network topology. Besides, the whole architecture can serve as a backbone for the Differentiable Integrated motion Prediction with Planning (DIPP) method by providing accurate prediction results and initial planning commands. Experiments are conducted on real-world datasets to demonstrate the improvements made by our proposed method in both planning and prediction accuracy compared to the previous state-of-the-art methods.


title: Design Selection for Two-Level Multi-Stratum Factorial Experiments Based on Swarm Intelligence Optimization

abstract: For unstructured experimental units, the minimum aberration due to Fries and Hunter (1980) is a popular criterion for choosing regular fractional factorial designs. Following which, many related studies have focused on multi-stratum factorial designs, in which multiple error terms arise from the complicated structures of experimental units. Chang and Cheng (2018) proposed a Bayesian-inspired aberration criterion for selecting multi-stratum factorial designs, which can be considered as a generalized version of that in Fries and Hunter (1980). However, they did not propose algorithms for searching for minimum aberration designs. The particle swarm optimization (PSO) algorithm is a popular optimization method that has been widely used in various applications. In this paper, we propose a new version of the PSO to select regular as well as nonregular multi-stratum designs. To select regular ones, we treat defining words as particles in the PSO and link the PSO with design key matrices. For nonregular multi-stratum designs, we treat treatment combinations as particles in the PSO. Several numerical illustrations are provided.


title: A Faster Small Treewidth SDP Solver

abstract: Semidefinite programming is a fundamental tool in optimization and theoretical computer science. It has been extensively used as a black-box for solving many problems, such as embedding, complexity, learning, and discrepancy. One natural setting of semidefinite programming is the small treewidth setting. The best previous SDP solver under small treewidth setting is due to Zhang-Lavaei '18, which takes $n^{1.5} \tau^{6.5}$ time. In this work, we show how to solve a semidefinite programming with $n \times n$ variables, $m$ constraints and $\tau$ treewidth in $n \tau^{2\omega+0.5}$ time, where $\omega < 2.373$ denotes the exponent of matrix multiplication. We give the first SDP solver that runs in time in linear in number of variables under this setting. In addition, we improve the running time that solves a linear programming with tau treewidth from $n \tau^2$ (Dong-Lee-Ye '21) to $n \tau^{(\omega+1)/2}$.


title: Does Deep Learning REALLY Outperform Non-deep Machine Learning for Clinical Prediction on Physiological Time Series?

abstract: Machine learning has been widely used in healthcare applications to approximate complex models, for clinical diagnosis, prognosis, and treatment. As deep learning has the outstanding ability to extract information from time series, its true capabilities on sparse, irregularly sampled, multivariate, and imbalanced physiological data are not yet fully explored. In this paper, we systematically examine the performance of machine learning models for the clinical prediction task based on the EHR, especially physiological time series. We choose Physionet 2019 challenge public dataset to predict Sepsis outcomes in ICU units. Ten baseline machine learning models are compared, including 3 deep learning methods and 7 non-deep learning methods, commonly used in the clinical prediction domain. Nine evaluation metrics with specific clinical implications are used to assess the performance of models. Besides, we sub-sample training dataset sizes and use learning curve fit to investigate the impact of the training dataset size on the performance of the machine learning models. We also propose the general pre-processing method for the physiology time-series data and use Dice Loss to deal with the dataset imbalanced problem. The results show that deep learning indeed outperforms non-deep learning, but with certain conditions: firstly, evaluating with some particular evaluation metrics (AUROC, AUPRC, Sensitivity, and FNR), but not others; secondly, the training dataset size is large enough (with an estimation of a magnitude of thousands).


title: Effective binding potential from Casimir interactions: the case of the Bose gas

abstract: We consider the thermal Casimir effect in ideal Bose gases, where the dispersion relation involves both terms quadratic and quartic in momentum. We demonstrate that if macroscopic objects are immersed in such a fluid in spatial dimensionality $d\in\{3,7, 11, \dots\}$ and at the critical temperature $T_c$, the Casimir force acting between them is characterized by a sign which depends on the separation $D$ between the bodies and changes from attractive at large distances to repulsive at smaller separations. In consequence, an effective potential which binds the two objects at a finite separation arises. We demonstrate that for odd integer dimensionality $d\in \{3, 5, 7, \dots\}$, the Casimir energy is a polynomial of degree $(d-1)$ in $D^{-2}$. We point out a very special role of dimensionality $d=3$, where we derive a strikingly simple form of the Casimir energy as a function of $D$ at Bose-Einstein condensation. We discuss crossover between monotonous and oscillatory decay of the Casimir interaction above the condensation temperature.


title: Dynamics of nanosecond laser pulse propagation and of associated instabilities in a magnetized underdense plasma

abstract: The propagation and energy coupling of intense laser beams in plasmas are critical issues in laser-driven inertial confinement fusion. Applying magnetic fields to such a setup has been evoked to enhance fuel confinement and heating, and mitigate laser energy losses. Here we report on experimental measurements demonstrating improved transmission and increased smoothing of a high-power laser beam propagating in an underdense magnetized plasma. We also measure enhanced backscattering, which our simulations show is due to hot electrons confinement, thus leading to reduced target preheating.


title: A fast-rotating pear-shaped nucleus

abstract: The spectroscopic studies have identified few Actinide and Lanthanide nuclei of the periodic table, which can assume the pear shape. The low frequency collective rotation of these nuclei has been established by determining the band structure of the excited levels and their gamma decay rates. In this article, we report the rotation of a pear-shaped nucleus in 100 Ru, which rotates nearly three times faster than the previously known cases. The three novel consequences of this fast rotation are: the realization of a pear-shape in an excited state, its moment of inertia becoming a constant of motion and its shape evolution. These inferences have been arrived at by comparing the characteristics of the rotational band of 100 Ru with three of the best-known examples of a rotating pear-shaped nucleus and through the theoretical interpretation of the data. The observation of a pear-shaped nucleus in the lighter mass region opens up the possibility of a systematic study of the effects of fast rotation on this shape.


title: A high-mass X-ray binary pulsar 4U 1907+09 with multiple absorption-line features in the spectrum

abstract: We report X-ray observations of the High Mass X-ray Binary (HMXB) pulsar 4U 1907+09. Spectral and Timing analysis of the source has been performed using NuSTAR observation. Timing analysis of the photon events revealed the coherent X-ray pulsation of the source with a pulse period of $442.92\;\pm\;0.03$ s. It is observed that the source is spinning down at a rate of $0.1971(4) s yr^{-1}$. The pulse profile is characterized by a decaying amplitude of the secondary peak and relative growth in the amplitude of the primary peak with an increase in energy. The broad-band spectral coverage of NuSTAR has been used to observe multiple absorption features in the X-ray continuum of the source. We confirm the presence of two prominent cyclotron absorption features at $\sim 17$ keV and $\sim 38$ keV respectively. In addition, we have detected an absorption-line feature at $\sim 8$ keV, with an equivalent width of $\sim 1.3$ keV. The variation of the spectral parameters with pulse phase has been observed using phase-resolved spectroscopy and the relevant variabilities of the parameters have been discussed with the underlying physical implications. The continuum evolution and variations in spectral parameters have also been studied by time-resolved spectroscopy.


title: Online Linearized LASSO

abstract: Sparse regression has been a popular approach to perform variable selection and enhance the prediction accuracy and interpretability of the resulting statistical model. Existing approaches focus on offline regularized regression, while the online scenario has rarely been studied. In this paper, we propose a novel online sparse linear regression framework for analyzing streaming data when data points arrive sequentially. Our proposed method is memory efficient and requires less stringent restricted strong convexity assumptions. Theoretically, we show that with a properly chosen regularization parameter, the $\ell_2$-norm statistical error of our estimator diminishes to zero in the optimal order of $\tilde{O}({\sqrt{s/t}})$, where $s$ is the sparsity level, $t$ is the streaming sample size, and $\tilde{O}(\cdot)$ hides logarithmic terms. Numerical experiments demonstrate the practical efficiency of our algorithm.


title: Sub-kHz-linewidth external-cavity laser (ECL) with Si$_{3}$N$_{4}$ resonator used as a tunable pump for a Kerr frequency comb

abstract: Combining optical gain in direct-bandgap III-V materials with tunable optical feedback offered by advanced photonic integrated circuits is key to chip-scale external-cavity lasers (ECL), offering wideband tunability along with low optical linewidths. External feedback circuits can be efficiently implemented using low-loss silicon nitride (Si$_{3}$N$_{4}$) waveguides, which do not suffer from two-photon absorption and can thus handle much higher power levels than conventional silicon photonics. However, co-integrating III-V-based gain elements with tunable external feedback circuits in chip-scale modules still represents a challenge, requiring either technologically demanding heterogeneous integration techniques or costly high-precision multi-chip assembly. In this work, we demonstrate Si$_{3}$N$_{4}$-based hybrid integrated ECL that exploit 3D-printed structures such as intra-cavity photonic wire bonds and facet-attached microlenses for low-loss optical coupling with relaxed alignment tolerances, thereby overcoming the need for active alignment while maintaining the full flexibility of multi-chip integration techniques. In a proof-of-concept experiment, we demonstrate an ECL offering a 90 nm tuning range (1480 nm - 1570 nm) with on-chip output powers above 12 dBm and side-mode suppression ratios of up to 59 dB. We achieve an intrinsic linewidth of 979 Hz, which is among the lowest values reported for comparable feedback architectures. The optical loss of the intra-cavity photonic wire bond between the III-V gain element and the Si$_{3}$N$_{4}$-based tunable feedback circuit amounts to approximately (1.6 $\pm$ 0.2) dB. We use the ECL as a tunable pump laser to generate a dissipative Kerr soliton frequency comb. To the best of our knowledge, our experiments represent the first demonstration of a single-soliton Kerr comb generated with a pump that is derived from a hybrid ECL.


title: An Adapter based Multi-label Pre-training for Speech Separation and Enhancement

abstract: In recent years, self-supervised learning (SSL) has achieved tremendous success in various speech tasks due to its power to extract representations from massive unlabeled data. However, compared with tasks such as speech recognition (ASR), the improvements from SSL representation in speech separation (SS) and enhancement (SE) are considerably smaller. Based on HuBERT, this work investigates improving the SSL model for SS and SE. We first update HuBERT's masked speech prediction (MSP) objective by integrating the separation and denoising terms, resulting in a multiple pseudo label pre-training scheme, which significantly improves HuBERT's performance on SS and SE but degrades the performance on ASR. To maintain its performance gain on ASR, we further propose an adapter-based architecture for HuBERT's Transformer encoder, where only a few parameters of each layer are adjusted to the multiple pseudo label MSP while other parameters remain frozen as default HuBERT. Experimental results show that our proposed adapter-based multiple pseudo label HuBERT yield consistent and significant performance improvements on SE, SS, and ASR tasks, with a faster pre-training speed, at only marginal parameters increase.


title: Separating Times for One-Dimensional Diffusions

abstract: The separating time for two probability measures on a filtered space is an extended stopping time which captures the phase transition between equivalence and singularity. More specifically, two probability measures are equivalent before their separating time and singular afterwards. In this paper, we investigate the separating time for two laws of general one-dimensional regular continuous strong Markov processes, so-called general diffusions, which are parameterized via scale functions and speed measures. Our main result is a representation of the corresponding separating time as (loosely speaking) a hitting time of a deterministic set which is characterized via speed and scale. As hitting times are fairly easy to understand, our result gives access to explicit and easy-to-check sufficient and necessary conditions for two laws of general diffusions to be (locally) absolutely continuous and/or singular. Most of the related literature treats the case of stochastic differential equations. In our setting we encounter several novel features, which are due to general speed and scale on the one hand, and to the fact that we do not exclude (instantaneous or sticky) reflection on the other hand. These new features are discussed in a variety of examples. As an application of our main theorem, we investigate the no arbitrage concept no free lunch with vanishing risk (NFLVR) for a single asset financial market whose (discounted) asset is modeled as a general diffusion which is bounded from below (e.g., non-negative). More precisely, we derive deterministic criteria for NFLVR and we identify the (unique) equivalent local martingale measure as the law of a certain general diffusion on natural scale.


title: Topologically bound states, non-Hermitian skin effect and flat bands, induced by two-particle interaction

abstract: We study theoretically quantum states of two repelling spinless particles in a one-dimensional tight-binding model with simple periodic lattice and open boundary conditions. We demonstrate, that when the particles are not identical, their interaction drives nontrivial correlated two-particle states, such as bound states, edge states as well as interaction-induced flat bands. Specifically, the center-of-mass and relative motions of two particles become coupled in a topologically nontrivial way. By virtue of the non-Hermitian skin effect the localization of the center of mass enforces the localization of the relative motion and formation of the bound states.


title: External-memory dictionaries with worst-case update cost

abstract: The $B^{\epsilon}$-tree [Brodal and Fagerberg 2003] is a simple I/O-efficient external-memory-model data structure that supports updates orders of magnitude faster than B-tree with a query performance comparable to the B-tree: for any positive constant $\epsilon<1$ insertions and deletions take $O(\frac{1}{B^{1-\epsilon}}\log_{B}N)$ time (rather than $O(\log_BN)$ time for the classic B-tree), queries take $O(\log_BN)$ time and range queries returning $k$ items take $O(\log_BN+\frac{k}{B})$ time. Although the $B^{\epsilon}$-tree has an optimal update/query tradeoff, the runtimes are amortized. Another structure, the write-optimized skip list, introduced by Bender et al. [PODS 2017], has the same performance as the $B^{\epsilon}$-tree but with runtimes that are randomized rather than amortized. In this paper, we present a variant of the $B^{\epsilon}$-tree with deterministic worst-case running times that are identical to the original's amortized running times.