title: Down-set thresholds

abstract: We elucidate the relationship between the threshold and the expectation-threshold of a down-set. Qualitatively, our main result demonstrates that there exist down-sets with polynomial gaps between their thresholds and expectation-thresholds; in particular, the logarithmic gap predictions of Kahn--Kalai and Talagrand (recently proved by Park--Pham and Frankston--Kahn--Narayanan--Park) about up-sets do not apply to down-sets. Quantitatively, we show that any collection $\mathcal{G}$ of graphs on $[n]$ that covers the family of all triangle-free graphs on $[n]$ satisfies the inequality $\sum_{G \in \mathcal{G}} \exp(-\delta e(G^c) / \sqrt{n}) < 1/2$ for some universal $\delta > 0$, and this is essentially best-possible.


title: Invariance Through Latent Alignment

abstract: A robot's deployment environment often involves perceptual changes that differ from what it has experienced during training. Standard practices such as data augmentation attempt to bridge this gap by augmenting source images in an effort to extend the support of the training distribution to better cover what the agent might experience at test time. In many cases, however, it is impossible to know test-time distribution-shift a priori, making these schemes infeasible. In this paper, we introduce a general approach, called Invariance Through Latent Alignment (ILA), that improves the test-time performance of a visuomotor control policy in deployment environments with unknown perceptual variations. ILA performs unsupervised adaptation at deployment-time by matching the distribution of latent features on the target domain to the agent's prior experience, without relying on paired data. Although simple, we show that this idea leads to surprising improvements on a variety of challenging adaptation scenarios, including changes in lighting conditions, the content in the scene, and camera poses. We present results on calibrated control benchmarks in simulation -- the distractor control suite -- and a physical robot under a sim-to-real setup.


title: Nearly-periodic maps and geometric integration of noncanonical Hamiltonian systems

abstract: M. Kruskal showed that each continuous-time nearly-periodic dynamical system admits a formal $U(1)$ symmetry, generated by the so-called roto-rate. When the nearly-periodic system is also Hamiltonian, Noether's theorem implies the existence of a corresponding adiabatic invariant. We develop a discrete-time analoue of Kruskal's theory. Nearly-periodic maps are defined as parameter-dependent diffeomorphisms that limit to rotations along a $U(1)$-action. When the limiting rotation is non-resonant, these maps admit formal $U(1)$ symmetries to all orders in perturbation theory. For Hamiltonian nearly-periodic maps on exact presymplectic manifolds, we prove that the formal $U(1)$ symmetry gives rise to a discrete-time adiabatic invariant using a discrete-time extension of Noether's theorem. When the unperturbed $U(1)$-orbits are contractible, we also find a discrete-time adiabatic invariant for mappings that are merely presymplectic, rather than Hamiltonian. As an application of the theory, we use it to develop a novel technique for geometric integration of non-canonical Hamiltonian systems on exact symplectic manifolds.


title: Studying the EPRL spinfoam self-energy

abstract: I present some recent progresses in the study of the EPRL self-energy amplitude. New numerical methods allow to analyze how the divergence scales, for which previous works provided very different lower and upper bounds. I show the role that the Immirzi parameter plays in the asymptotic behavior, and I discuss the dynamical expectation value of the dihedral angle boundary observable.


title: A Higher Order Resolvent-positive Finite Difference Approximation for Fractional Derivatives

abstract: We develop a finite difference approximation of order $\alpha$ for the $\alpha$-fractional derivative. The weights of the approximation scheme have the same rate-matrix type properties as the popular Gr\"unwald scheme. In particular, approximate solutions to fractional diffusion equations preserve positivity. Furthermore, for the approximation of the solution to the skewed fractional heat equation on a bounded domain the new approximation scheme keeps its order $\alpha$ whereas the order of the Gr\"unwald scheme reduces to order $\alpha-1$, contradicting the convergence rate results by Meerschaert and Tadjeran.


title: The Impact of TV Advertising on Website Traffic

abstract: We propose a modeling procedure for estimating immediate responses to TV ads and evaluating the factors influencing their size. First, we capture diurnal and seasonal patterns of website visits using the kernel smoothing method. Second, we estimate a gradual increase in website visits after an ad using the maximum likelihood method. Third, we analyze the non-linear dependence of the estimated increase in website visits on characteristics of the ads using the random forest method. The proposed methodology is applied to a dataset containing minute-by-minute organic website visits and detailed characteristics of TV ads for an e-commerce company in 2019. The results show that people are indeed willing to switch between screens and multitask. Moreover, the time of the day, the TV channel, and the advertising motive play a great role in the impact of the ads.


title: Four Attitudes Towards Singularities in the Search for a Theory of Quantum Gravity

abstract: Singularities in general relativity and quantum field theory are often taken not only to motivate the search for a more-fundamental theory (quantum gravity, QG), but also to characterise this new theory and shape expectations of what it is to achieve. Here, we first evaluate how particular types of singularities may suggest an incompleteness of current theories. We then classify four different `attitudes' towards singularities in the search for QG, and show, through examples in the physics literature, that these lead to different scenarios for the new theory. Two of the attitudes prompt singularity resolution, but only one suggests the need for a theory of QG. Rather than evaluate the different attitudes, we close with some suggestions of factors that influence the choice between them.


title: Penn-Helsinki Parsed Corpus of Early Modern English: First Parsing Results and Analysis

abstract: We present the first parsing results on the Penn-Helsinki Parsed Corpus of Early Modern English (PPCEME), a 1.9 million word treebank that is an important resource for research in syntactic change. We describe key features of PPCEME that make it challenging for parsing, including a larger and more varied set of function tags than in the Penn Treebank. We present results for this corpus using a modified version of the Berkeley Neural Parser and the approach to function tag recovery of Gabbard et al (2006). Despite its simplicity, this approach works surprisingly well, suggesting it is possible to recover the original structure with sufficient accuracy to support linguistic applications (e.g., searching for syntactic structures of interest). However, for a subset of function tags (e.g., the tag indicating direct speech), additional work is needed, and we discuss some further limits of this approach. The resulting parser will be used to parse Early English Books Online, a 1.1 billion word corpus whose utility for the study of syntactic change will be greatly increased with the addition of accurate parse trees.


title: Terahertz Field-Induced Reemergence of Quenched Photoluminescence in Quantum Dots

abstract: Continuous and concerted development of colloidal quantum-dot light-emitting diodes over the past two decades has established them as a bedrock technology for the next generation of displays. However, a fundamental issue that limits the performance of these devices is the quenching of photoluminescence due to excess charges from conductive charge transport layers. Although device designs have leveraged various workarounds, doing so often comes at the cost of limiting efficient charge injection. Here we demonstrate that high-field terahertz (THz) pulses can dramatically brighten quenched QDs on metallic surfaces, an effect which persists for minutes after THz irradiation. This phenomenon is attributed to the ability of the THz field to remove excess charges, thereby reducing trion and non-radiative Auger recombination. Our findings show that THz technologies can be used to suppress and control such undesired non-radiative decay, potentially in a variety of luminescent materials for future device applications.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph physics.optics


title: Trading with the Momentum Transformer: An Intelligent and Interpretable Architecture

abstract: We introduce the Momentum Transformer, an attention-based deep-learning architecture, which outperforms benchmark time-series momentum and mean-reversion trading strategies. Unlike state-of-the-art Long Short-Term Memory (LSTM) architectures, which are sequential in nature and tailored to local processing, an attention mechanism provides our architecture with a direct connection to all previous time-steps. Our architecture, an attention-LSTM hybrid, enables us to learn longer-term dependencies, improves performance when considering returns net of transaction costs and naturally adapts to new market regimes, such as during the SARS-CoV-2 crisis. Via the introduction of multiple attention heads, we can capture concurrent regimes, or temporal dynamics, which are occurring at different timescales. The Momentum Transformer is inherently interpretable, providing us with greater insights into our deep-learning momentum trading strategy, including the importance of different factors over time and the past time-steps which are of the greatest significance to the model.


title: Fractional cyber-neural systems -- a brief survey

abstract: Neurotechnology has made great strides in the last 20 years. However, we still have a long way to go to commercialize many of these technologies as we lack a unified framework to study cyber-neural systems (CNS) that bring the hardware, software, and the neural system together. Dynamical systems play a key role in developing these technologies as they capture different aspects of the brain and provide insight into their function. Converging evidence suggests that fractional-order dynamical systems are advantageous in modeling neural systems because of their compact representation and accuracy in capturing the long-range memory exhibited in neural behavior. In this brief survey, we provide an overview of fractional CNS that entails fractional-order systems in the context of CNS. In particular, we introduce basic definitions required for the analysis and synthesis of fractional CNS, encompassing system identification, state estimation, and closed-loop control. Additionally, we provide an illustration of some applications in the context of CNS and draw some possible future research directions. Ultimately, advancements in these three areas will be critical in developing the next generation of CNS, which will, ultimately, improve people's quality of life.


title: Decoupling of Spin Decoherence Paths near Zero Magnetic Field

abstract: We demonstrate a method to quantify and manipulate nuclear spin decoherence mechanisms that are active in zero to ultralow magnetic fields. These include: (i) non-adiabatic switching of spin quantization axis, due to residual background fields; (ii) scalar pathways due to through-bond couplings between $^1$H and heteronuclear spin species, such as $^2$H used partially as an isotopic substitute for $^1$H. Under conditions of free evolution, scalar relaxation due to $^2$H can significantly limit nuclear spin polarization lifetimes and thus the scope of magnetic resonance procedures near zero field. It is shown that robust trains of pulsed dc magnetic fields that apply $\pi$ flip angles to one or multiple spin species may switch effective symmetry of the nuclear spin Hamiltonian, imposing decoupled or coupled dynamic regimes on demand. The method should broaden the spectrum of hyperpolarized biomedical contrast-agent compounds and hyperpolarization procedures that are used near zero field.


title: Invariants and reduced Wigner coefficients for quasi-triangular Hopf superalgebras

abstract: We develop explicit formulae for the eigenvalues of various invariants for highest weight irreducible representations of the quantum supergroup $U_q[gl(m|n)]$. The techniques employed make use of modified characteristic identity methods and allow for the evaluation of generator matrix elements and reduced Wigner coefficients.


title: Visualizing the Loss Landscape of Winning Lottery Tickets

abstract: The underlying loss landscapes of deep neural networks have a great impact on their training, but they have mainly been studied theoretically due to computational constraints. This work vastly reduces the time required to compute such loss landscapes, and uses them to study winning lottery tickets found via iterative magnitude pruning. We also share results that contradict previously claimed correlations between certain loss landscape projection methods and model trainability and generalization error.


title: Implicit Neural Representations for Deconvolving SAS Images

abstract: Synthetic aperture sonar (SAS) image resolution is constrained by waveform bandwidth and array geometry. Specifically, the waveform bandwidth determines a point spread function (PSF) that blurs the locations of point scatterers in the scene. In theory, deconvolving the reconstructed SAS image with the scene PSF restores the original distribution of scatterers and yields sharper reconstructions. However, deconvolution is an ill-posed operation that is highly sensitive to noise. In this work, we leverage implicit neural representations (INRs), shown to be strong priors for the natural image space, to deconvolve SAS images. Importantly, our method does not require training data, as we perform our deconvolution through an analysis-bysynthesis optimization in a self-supervised fashion. We validate our method on simulated SAS data created with a point scattering model and real data captured with an in-air circular SAS. This work is an important first step towards applying neural networks for SAS image deconvolution.


title: Integrated Guidance and Control for Lunar Landing using a Stabilized Seeker

abstract: We develop an integrated guidance and control system that in conjunction with a stabilized seeker and landing site detection software can achieve precise and safe planetary landing. The seeker tracks the designated landing site by adjusting seeker elevation and azimuth angles to center the designated landing site in the sensor field of view. The seeker angles, closing speed, and range to the designated landing site are used to formulate a velocity field that is used by the guidance and control system to achieve a safe landing at the designated landing site. The guidance and control system maps this velocity field, attitude, and rotational velocity directly to a commanded thrust vector for the lander's four engines. The guidance and control system is implemented as a policy optimized using reinforcement meta learning. We demonstrate that the guidance and control system is compatible with multiple diverts during the powered descent phase, and is robust to seeker lag, actuator lag and degradation, and center of mass variation induced by fuel consumption. We outline several concepts of operations, including an approach using a preplaced landing beacon.


title: BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing

abstract: Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs) to non-Euclidean graph data, achieving ground-breaking performance on various tasks such as node classification and graph property prediction. Nonetheless, existing systems are inefficient to train large graphs with billions of nodes and edges with GPUs. The main bottlenecks are the process of preparing data for GPUs - subgraph sampling and feature retrieving. This paper proposes BGL, a distributed GNN training system designed to address the bottlenecks with a few key ideas. First, we propose a dynamic cache engine to minimize feature retrieving traffic. By a co-design of caching policy and the order of sampling, we find a sweet spot of low overhead and high cache hit ratio. Second, we improve the graph partition algorithm to reduce cross-partition communication during subgraph sampling. Finally, careful resource isolation reduces contention between different data preprocessing stages. Extensive experiments on various GNN models and large graph datasets show that BGL significantly outperforms existing GNN training systems by 20.68x on average.


title: QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization

abstract: Factual consistency is an essential quality of text summarization models in practical settings. Existing work in evaluating this dimension can be broadly categorized into two lines of research, entailment-based and question answering (QA)-based metrics, and different experimental setups often lead to contrasting conclusions as to which paradigm performs the best. In this work, we conduct an extensive comparison of entailment and QA-based metrics, demonstrating that carefully choosing the components of a QA-based metric, especially question generation and answerability classification, is critical to performance. Building on those insights, we propose an optimized metric, which we call QAFactEval, that leads to a 14% average improvement over previous QA-based metrics on the SummaC factual consistency benchmark, and also outperforms the best-performing entailment-based metric. Moreover, we find that QA-based and entailment-based metrics can offer complementary signals and be combined into a single metric for a further performance boost.


title: A framework for syntactic and semantic quality evaluation of ontologies

abstract: The increasing focus on Web 3.0 is leading to automated creation and enrichment of ontologies and other linked datasets. Alongside automation, quality evaluation of enriched ontologies can impact software reliability and reuse. Current quality evaluation approaches oftentimes seek to evaluate ontologies in either syntactic (degree of following ontology development guidelines) or semantic (degree of semantic validity of enriched concepts/relations) aspects. This paper proposes an ontology quality evaluation framework consisting of: (a) SynEvaluator and (b) SemValidator for evaluating syntactic and semantic aspects of ontologies respectively. SynEvaluator allows dynamic task-specific creation and updation of syntactic rules at run-time without any need for programming. SemValidator uses Twitter-based expertise of validators for semantic evaluation. The efficacy and validity of the framework is shown empirically on multiple ontologies.


title: NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge

abstract: Claim detection and verification are crucial for news understanding and have emerged as promising technologies for mitigating misinformation and disinformation in the news. However, most existing work has focused on claim sentence analysis while overlooking additional crucial attributes (e.g., the claimer and the main object associated with the claim). In this work, we present NewsClaims, a new benchmark for attribute-aware claim detection in the news domain. We extend the claim detection problem to include extraction of additional attributes related to each claim and release 889 claims annotated over 143 news articles. NewsClaims aims to benchmark claim detection systems in emerging scenarios, comprising unseen topics with little or no training data. To this end, we see that zero-shot and prompt-based baselines show promising performance on this benchmark, while still considerably behind human performance.


title: Simultaneous Sieve Inference for Time-Inhomogeneous Nonlinear Time Series Regression

abstract: In this paper, we consider the time-inhomogeneous nonlinear time series regression for a general class of locally stationary time series. On one hand, we propose sieve nonparametric estimators for the time-varying regression functions which can achieve the min-max optimal rate. On the other hand, we develop a unified simultaneous inferential theory which can be used to conduct both structural and exact form testings on the functions. Our proposed statistics are powerful even under locally weak alternatives. We also propose a multiplier bootstrapping procedure for practical implementation. Our methodology and theory do not require any structural assumptions on the regression functions and we also allow the functions to be supported in an unbounded domain. We also establish sieve approximation theory for 2-D functions in unbounded domain and a Gaussian approximation result for affine and quadratic forms for high dimensional locally stationary time series, which can be of independent interest. Numerical simulations and a real financial data analysis are provided to support our results.


title: Uniform Convergence Results for the Local Linear Regression Estimation of the Conditional Distribution

abstract: This paper examines the local linear regression (LLR) estimate of the conditional distribution function $F(y|x)$. We derive three uniform convergence results: the uniform bias expansion, the uniform convergence rate, and the uniform asymptotic linear representation. The uniformity in the above results is with respect to both $x$ and $y$ and therefore has not previously been addressed in the literature on local polynomial regression. Such uniform convergence results are especially useful when the conditional distribution estimator is the first stage of a semiparametric estimator. We demonstrate the usefulness of these uniform results with two examples: the stochastic equicontinuity condition in $y$, and the estimation of the integrated conditional distribution function.


title: Learning Rich Representation of Keyphrases from Text

abstract: In this work, we explore how to train task-specific language models aimed towards learning rich representation of keyphrases from text documents. We experiment with different masking strategies for pre-training transformer language models (LMs) in discriminative as well as generative settings. In the discriminative setting, we introduce a new pre-training objective - Keyphrase Boundary Infilling with Replacement (KBIR), showing large gains in performance (upto 8.16 points in F1) over SOTA, when the LM pre-trained using KBIR is fine-tuned for the task of keyphrase extraction. In the generative setting, we introduce a new pre-training setup for BART - KeyBART, that reproduces the keyphrases related to the input text in the CatSeq format, instead of the denoised original input. This also led to gains in performance (upto 4.33 points in F1@M) over SOTA for keyphrase generation. Additionally, we also fine-tune the pre-trained language models on named entity recognition (NER), question answering (QA), relation extraction (RE), abstractive summarization and achieve comparable performance with that of the SOTA, showing that learning rich representation of keyphrases is indeed beneficial for many other fundamental NLP tasks.


title: Isochrony-Aware Neural Machine Translation for Automatic Dubbing

abstract: We introduce the task of isochrony-aware machine translation which aims at generating translations suitable for dubbing. Dubbing of a spoken sentence requires transferring the content as well as the speech-pause structure of the source into the target language to achieve audiovisual coherence. Practically, this implies correctly projecting pauses from the source to the target and ensuring that target speech segments have roughly the same duration of the corresponding source speech segments. In this work, we propose implicit and explicit modeling approaches to integrate isochrony information into neural machine translation. Experiments on English-German/French language pairs with automatic metrics show that the simplest of the considered approaches works best. Results are confirmed by human evaluations of translations and dubbed videos.


title: A prediction-based approach for online dynamic patient scheduling: a case study in radiotherapy treatment

abstract: Patient scheduling is a difficult task involving stochastic factors such as the unknown arrival times of patients. Similarly, the scheduling of radiotherapy for cancer treatments needs to handle patients with different urgency levels when allocating resources. High priority patients may arrive at any time, and there must be resources available to accommodate them. A common solution is to reserve a flat percentage of treatment capacity for emergency patients. However, this solution can result in overdue treatments for urgent patients, a failure to fully exploit treatment capacity, and delayed treatments for low-priority patients. This problem is especially severe in large and crowded hospitals. In this paper, we propose a prediction-based approach for online dynamic radiotherapy scheduling that dynamically adapts the present scheduling decision based on each incoming patient and the current allocation of resources. Our approach is based on a regression model trained to recognize the links between patients' arrival patterns, and their ideal waiting time in optimal offline solutions where all future arrivals are known in advance. When our prediction-based approach is compared to flat-reservation policies, it does a better job of preventing overdue treatments for emergency patients, while also maintaining comparable waiting times for the other patients. We also demonstrate how our proposed approach supports explainability and interpretability in scheduling decisions using SHAP values.


title: Neural Content Extraction for Poster Generation of Scientific Papers

abstract: The problem of poster generation for scientific papers is under-investigated. Posters often present the most important information of papers, and the task can be considered as a special form of document summarization. Previous studies focus mainly on poster layout and panel composition, while neglecting the importance of content extraction. Besides, their datasets are not publicly available, which hinders further research. In this paper, we construct a benchmark dataset from scratch for this task. Then we propose a three-step framework to tackle this task and focus on the content extraction step in this study. To get both textual and visual elements of a poster panel, a neural extractive model is proposed to extract text, figures and tables of a paper section simultaneously. We conduct experiments on the dataset and also perform ablation study. Results demonstrate the efficacy of our proposed model. The dataset and code will be released.


title: Rigorous reconstruction of gluon propagator in the presence of complex singularities

abstract: It has been suggested that the Landau-gauge gluon propagator has complex singularities, which invalidates the K\"all\'en-Lehmann spectral representation. Since such singularities are beyond the standard formalism of quantum field theory, the reconstruction of Minkowski propagators from Euclidean propagators has to be carefully examined for their interpretation. In this talk, we present rigorous results on this reconstruction in the presence of complex singularities. As a result, the analytically continued Wightman function is holomorphic in the usual tube, and the Lorentz symmetry and locality are kept valid. On the other hand, the Wightman function on the Minkowski spacetime is a non-tempered distribution and violates the positivity condition. Finally, we discuss an interpretation and implications of complex singularities in quantum theories, arguing that complex singularities correspond to zero-norm confined states.


title: Orbital period of the IW And-type star ST Cha

abstract: We analyzed TESS data of the IW And-type dwarf nova ST Cha during ordinary dwarf nova states. We have identified an orbital period of 0.285360(1) d. The object was reported to be eclipsing in the past using the data obtained in the 1970s, which is not in agreement with the present data. Despite the constant mean brightness, the strength of the orbital signal varied significantly, suggesting that the strength of the orbital signal does not always reflect the mass-transfer rate. During an outburst with a shoulder, we did not find evidence of humps recurring with a period longer than the orbital period which were recorded in V363 Lyr. This finding strengthens the idea that V363 Lyr is an unusual object. We found that the strength of the orbital signal increased after an outburst with a shoulder. This outburst may have changed the state of the disk and the hot spot became more apparent. Such a change in the disk may have triggered a transition from an ordinary dwarf nova-type state to an IW And-type state and this possibility would require further examination.


title: UMAD: Universal Model Adaptation under Domain and Category Shift

abstract: Learning to reject unknown samples (not present in the source classes) in the target domain is fairly important for unsupervised domain adaptation (UDA). There exist two typical UDA scenarios, i.e., open-set, and open-partial-set, and the latter assumes that not all source classes appear in the target domain. However, most prior methods are designed for one UDA scenario and always perform badly on the other UDA scenario. Moreover, they also require the labeled source data during adaptation, limiting their usability in data privacy-sensitive applications. To address these issues, this paper proposes a Universal Model ADaptation (UMAD) framework which handles both UDA scenarios without access to the source data nor prior knowledge about the category shift between domains. Specifically, we aim to learn a source model with an elegantly designed two-head classifier and provide it to the target domain. During adaptation, we develop an informative consistency score to help distinguish unknown samples from known samples. To achieve bilateral adaptation in the target domain, we further maximize localized mutual information to align known samples with the source classifier and employ an entropic loss to push unknown samples far away from the source classification boundary, respectively. Experiments on open-set and open-partial-set UDA scenarios demonstrate that UMAD, as a unified approach without access to source data, exhibits comparable, if not superior, performance to state-of-the-art data-dependent methods.


title: A Deep Learning Approach for Ontology Enrichment from Unstructured Text

abstract: Information Security in the cyber world is a major cause for concern, with a significant increase in the number of attack surfaces. Existing information on vulnerabilities, attacks, controls, and advisories available on the web provides an opportunity to represent knowledge and perform security analytics to mitigate some of the concerns. Representing security knowledge in the form of ontology facilitates anomaly detection, threat intelligence, reasoning and relevance attribution of attacks, and many more. This necessitates dynamic and automated enrichment of information security ontologies. However, existing ontology enrichment algorithms based on natural language processing and ML models have issues with contextual extraction of concepts in words, phrases, and sentences. This motivates the need for sequential Deep Learning architectures that traverse through dependency paths in text and extract embedded vulnerabilities, threats, controls, products, and other security-related concepts and instances from learned path representations. In the proposed approach, Bidirectional LSTMs trained on a large DBpedia dataset and Wikipedia corpus of 2.8 GB along with Universal Sentence Encoder is deployed to enrich ISO 27001-based information security ontology. The model is trained and tested on a high-performance computing (HPC) environment to handle Wiki text dimensionality. The approach yielded a test accuracy of over 80% when tested with knocked-out concepts from ontology and web page instances to validate the robustness.


title: Massive Black Hole Mergers with Orbital Information: Predictions from the ASTRID Simulation

abstract: We examine massive black hole (MBH) mergers and their associated gravitational wave signals from the large-volume cosmological simulation Astrid. Astrid includes galaxy formation and black hole models recently updated with a MBH seed population between $3\times 10^4M_{\odot}/h$ and $3\times 10^5M_{\odot}/h$ and a sub-grid dynamical friction (DF) model to follow the MBH dynamics down to $1.5\;\text{ckpc}/h$. We calculate initial eccentricities of MBH orbits directly from the simulation at kpc-scales, and find orbital eccentricities above $0.7$ for most MBH pairs before the numerical merger. After approximating unresolved evolution on scales below ${\sim 200\,\text{pc}}$, we find that the in-simulation DF on large scales accounts for more than half of the total orbital decay time ($\sim 500\,\text{Myrs}$) due to DF. The binary hardening time is an order of magnitude longer than the DF time, especially for the seed-mass binaries ($M_\text{BH}<2M_\text{seed}$). As a result, only $\lesssim20\%$ of seed MBH pairs merge at $z>3$ after considering both unresolved DF evolution and binary hardening. These $z>3$ seed-mass mergers are hosted in a biased population of galaxies with the highest stellar masses of $>10^9\,M_\odot$. With the higher initial eccentricity prediction from Astrid, we estimate an expected merger rate of $0.3-0.7$ per year from the $z>3$ MBH population. This is a factor of $\sim 7$ higher than the prediction using the circular orbit assumption. The LISA events are expected at a similar rate, and comprise $\gtrsim 60\%$ seed-seed mergers, $\sim 30\%$ involving only one seed-mass MBH, and $\sim 10\%$ mergers of non-seed MBHs.


title: Highly precise AMCW time-of-flight scanning sensor based on digital-parallel demodulation

abstract: In this paper, a novel amplitude-modulated continuous wave (AMCW) time-of-flight (ToF) scanning sensor based on digital-parallel demodulation is proposed and demonstrated in the aspect of distance measurement precision. Since digital-parallel demodulation utilizes a high-amplitude demodulation signal with zero-offset, the proposed sensor platform can maintain extremely high demodulation contrast. Meanwhile, as all cross correlated samples are calculated in parallel and in extremely short integration time, the proposed sensor platform can utilize a 2D laser scanning structure with a single photo detector, maintaining a moderate frame rate. This optical structure can increase the received optical SNR and remove the crosstalk of image pixel array. Based on these measurement properties, the proposed AMCW ToF scanning sensor shows highly precise 3D depth measurement performance. In this study, this precise measurement performance is explained in detail. Additionally, the actual measurement performance of the proposed sensor platform is experimentally validated under various conditions.


title: Protograph Bit-Interleaved Coded Modulation: A Bandwidth-Efficient Design Paradigm for 6G Wireless Communications

abstract: Bit-interleaved coded modulation (BICM) has attracted considerable attention from the research community in the past three decades, because it can achieve desirable error performance with relatively low implementation complexity for a large number of communication and storage systems. By exploiting the iterative demapping and decoding (ID), the BICM is able to approach capacity limits of coded modulation over various channels. In recent years, protograph low-density parity-check (PLDPC) codes and their spatially-coupled (SC) variants have emerged to be a pragmatic forward-error-correction (FEC) solution for BICM systems due to their tremendous error-correction capability and simple structures, and found widespread applications such as deep-space communication, satellite communication, wireless communication, optical communication, and data storage. This article offers a comprehensive survey on the state-of-the-art development of PLDPC-BICM and its innovative SC variants over a variety of channel models, e.g., additive white Gaussian noise (AWGN) channels, fading channels, Poisson pulse position modulation (PPM) channels, and flash-memory channels. Of particular interest is code construction, constellation shaping, as well as bit-mapper design, where the receiver is formulated as a serially-concatenated decoding framework consisting of a soft-decision demapper and a belief-propagation decoder. Finally, several promising research directions are discussed, which have not been adequately addressed in the current literature.


title: CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning

abstract: Compared to standard retrieval tasks, passage retrieval for conversational question answering (CQA) poses new challenges in understanding the current user question, as each question needs to be interpreted within the dialogue context. Moreover, it can be expensive to re-train well-established retrievers such as search engines that are originally developed for non-conversational queries. To facilitate their use, we develop a query rewriting model CONQRR that rewrites a conversational question in the context into a standalone question. It is trained with a novel reward function to directly optimize towards retrieval using reinforcement learning and can be adapted to any off-the-shelf retriever. CONQRR achieves state-of-the-art results on a recent open-domain CQA dataset containing conversations from three different sources, and is effective for two different off-the-shelf retrievers. Our extensive analysis also shows the robustness of CONQRR to out-of-domain dialogues as well as to zero query rewriting supervision.


title: Magnetic properties of pressurized CsV$_{3}$Sb$_{5}$ calculated by using a hybrid functional

abstract: Based on the hybrid functional, we find that at 0 GPa, the pristine CsV$_{3}$Sb$_{5}$ has local magnetic moment of 0.85 $\mu_B$ /unit cell, which is suppressed at pressure of 2.5 GPa resulting in a spin-crossover. Since the ground sate of CsV$_{3}$Sb$_{5}$ with charge density wave (CDW) distortion is non-magnetic state, the local magnetic moment of pristine CsV$_{3}$Sb$_{5}$ will be suppressed by temperature-induced CDW transition at 94 K. The schematic evolution of magnetic moments as functions of pressure and temperature are presented. At low temperature, CsV$_{3}$Sb$_{5}$ is a rare example of materials hosting pressureinduced local magnetic moment, and we suggeste that the effects of local magnetic moments should be considered for understanding its properties.


title: Block-Skim: Efficient Question Answering for Transformer

abstract: Transformer models have achieved promising results on natural language processing (NLP) tasks including extractive question answering (QA). Common Transformer encoders used in NLP tasks process the hidden states of all input tokens in the context paragraph throughout all layers. However, different from other tasks such as sequence classification, answering the raised question does not necessarily need all the tokens in the context paragraph. Following this motivation, we propose Block-skim, which learns to skim unnecessary context in higher hidden layers to improve and accelerate the Transformer performance. The key idea of Block-Skim is to identify the context that must be further processed and those that could be safely discarded early on during inference. Critically, we find that such information could be sufficiently derived from the self-attention weights inside the Transformer model. We further prune the hidden states corresponding to the unnecessary positions early in lower layers, achieving significant inference-time speedup. To our surprise, we observe that models pruned in this way outperform their full-size counterparts. Block-Skim improves QA models' accuracy on different datasets and achieves 3 times speedup on BERT-base model.


title: EmotionBox: a music-element-driven emotional music generation system using Recurrent Neural Network

abstract: With the development of deep neural networks, automatic music composition has made great progress. Although emotional music can evoke listeners' different emotions and it is important for artistic expression, only few researches have focused on generating emotional music. This paper presents EmotionBox -an music-element-driven emotional music generator that is capable of composing music given a specific emotion, where this model does not require a music dataset labeled with emotions. Instead, pitch histogram and note density are extracted as features that represent mode and tempo respectively to control music emotions. The subjective listening tests show that the Emotionbox has a more competitive and balanced performance in arousing a specified emotion than the emotion-label-based method.


title: Enhanced phonon blockade in a weakly-coupled hybrid system via mechanical parametric amplification

abstract: We propose how to achieve strong phonon blockade (PB) in a hybrid spin-mechanical system in the weak-coupling regime. We demonstrate the implementation of magnetically-induced two-phonon interactions between a mechanical cantilever resonator and an embedded nitrogen-vacancy (NV) center, which, combined with parametric amplification of the mechanical motion, produces significantly enlarged anharmonicity in the eigenenergy spectrum. In the weak-driving regime, we show that strong PB appears in the hybrid system along with a large mean phonon number, even in the presence of strong mechanical dissipation. We also show flexible tunability of phonon statistics by controlling the strength of mechanical parametric amplification. Our work opens up prospects for the implementation of an efficient single-phonon source, with potential applications in quantum phononics and phononic quantum networks.


title: Rail Vehicle Localization and Mapping with LiDAR-Vision-Inertial-GNSS Fusion

abstract: In this paper, we present a global navigation satellite system (GNSS) aided LiDAR-visual-inertial scheme, RailLoMer-V, for accurate and robust rail vehicle localization and mapping. RailLoMer-V is formulated atop a factor graph and consists of two subsystems: an odometer assisted LiDAR-inertial system (OLIS) and an odometer integrated Visual-inertial system (OVIS). Both the subsystem exploits the typical geometry structure on the railroads. The plane constraints from extracted rail tracks are used to complement the rotation and vertical errors in OLIS. Besides, the line features and vanishing points are leveraged to constrain rotation drifts in OVIS. The proposed framework is extensively evaluated on datasets over 800 km, gathered for more than a year on both general-speed and high-speed railways, day and night. Taking advantage of the tightly-coupled integration of all measurements from individual sensors, our framework is accurate to long-during tasks and robust enough to grievously degenerated scenarios (railway tunnels). In addition, the real-time performance can be achieved with an onboard computer.


title: Optimal Fidelity Witnesses for Gravitational Entanglement

abstract: Optomechanical systems open new possibilities in fundamental research at the interface between quantum information and gravity. Recently, an ambitious experimental proposal was suggested by Bose et al. to measure the entanglement between two optomechanical systems generated by their gravitational interaction. The scheme relies on witnessing entanglement between the two systems. Here we develop a general framework to study the quality of bipartite entanglement witnesses using fidelity witnesses. We then apply this framework to the gravitational entanglement proposal, optimizing for the detection of entanglement. We construct a witness consisting of only 5 non-trivial spin measurements, which we compare with other proposed witnesses. With post-processing our witness can detect entanglement for any choice of phases in the setup, up to a set of measure zero.


title: An adaptive finite element method for two-dimensional elliptic equations with line Dirac sources

abstract: In this paper, we propose a novel adaptive finite element method for an elliptic equation with line Dirac delta functions as a source term. We first study the well-posedness and global regularity of the solution in the whole domain. Instead of regularizing the singular source term and using the classical residual-based a posteriori error estimator, we propose a novel a posteriori estimator based on an equivalent transmission problem with zero source term and nonzero flux jumps on line fractures. The transmission problem is defined in the same domain as the original problem excluding on line fractures, and the solution is therefore shown to be more regular. The estimator relies on meshes conforming to the line fractures and its edge jump residual essentially uses the flux jumps of the transmission problem on line fractures. The error estimator is proven to be both reliable and efficient, an adaptive finite element algorithm is proposed based on the error estimator and the bisection refinement method. Numerical tests show that quasi-optimal convergence rates are achieved even for high order approximations and the adaptive meshes are only locally refined at singular points.


title: Randomized regularized extended Kaczmarz algorithms for tensor recovery

abstract: Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with {\it consistent} linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm (which converges linearly in expectation to the unique minimum norm least squares solution of a linear system) for tensor recovery models with {\it inconsistent} linear measurements. We prove the linear convergence in expectation of our algorithm. Numerical experiments on a tensor least squares problem and a sparse tensor recovery problem are given to illustrate the theoretical results.


title: HampDTI: a heterogeneous graph automatic meta-path learning method for drug-target interaction prediction

abstract: Motivation: Identifying drug-target interactions (DTIs) is a key step in drug repositioning. In recent years, the accumulation of a large number of genomics and pharmacology data has formed mass drug and target related heterogeneous networks (HNs), which provides new opportunities of developing HN-based computational models to accurately predict DTIs. The HN implies lots of useful information about DTIs but also contains irrelevant data, and how to make the best of heterogeneous networks remains a challenge. Results: In this paper, we propose a heterogeneous graph automatic meta-path learning based DTI prediction method (HampDTI). HampDTI automatically learns the important meta-paths between drugs and targets from the HN, and generates meta-path graphs. For each meta-path graph, the features learned from drug molecule graphs and target protein sequences serve as the node attributes, and then a node-type specific graph convolutional network (NSGCN) which efficiently considers node type information (drugs or targets) is designed to learn embeddings of drugs and targets. Finally, the embeddings from multiple meta-path graphs are combined to predict novel DTIs. The experiments on benchmark datasets show that our proposed HampDTI achieves superior performance compared with state-of-the-art DTI prediction methods. More importantly, HampDTI identifies the important meta-paths for DTI prediction, which could explain how drugs connect with targets in HNs.


title: Spectral Moment Formulae for $GL(3)\times GL(2)$ $L$-functions I: The Cuspidal Case

abstract: Spectral moment formulae of various shapes have proven to be very successful in studying the statistics of central $L$-values. In this article, we establish, in a completely explicit fashion, such formulae for the family of $GL(3)\times GL(2)$ Rankin-Selberg $L$-functions using the period integral method. The Kuznetsov and the Voronoi formulae are not needed in our argument. We also prove the essential analytic properties and explicit formulae for the integral transform of our moment formulae. It is hoped that our method will provide insights into moments of $L$-functions for higher-rank groups.


title: Toward Imagined Speech based Smart Communication System: Potential Applications on Metaverse Conditions

abstract: Metaverse provides an alternative platform for human interaction in the virtual world. Since virtual platform holds few restrictions in changing the surrounding environments or the appearance of the avatars, it can serve as a platform that reflects human thoughts or even dreams at least in the metaverse world. When it is merged together with the current brain-computer interface (BCI) technology, which enables system control via brain signals, a new paradigm of human interaction through mind may be established in the metaverse conditions. Recent BCI systems are aiming to provide user-friendly and intuitive means of communication using brain signals. Imagined speech has become an alternative neuro-paradigm for communicative BCI since it relies directly on a person's speech production process, rather than using speech-unrelated neural activity as the means of communication. In this paper, we propose a brain-to-speech (BTS) system for real-world smart communication using brain signals. Also, we show a demonstration of imagined speech based smart home control through communication with a virtual assistant, which can be one of the future applications of brain-metaverse system. We performed pseudo-online analysis using imagined speech electroencephalography data of nine subjects to investigate the potential use of virtual BTS system in the real-world. Average accuracy of 46.54 % (chance level = 7.7 %) and 75.56 % (chance level = 50 %) was acquired in the thirteen-class and binary pseudo-online analysis, respectively. Our results support the potential of imagined speech based smart communication to be applied in the metaverse world.


title: Can Multilinguality benefit Non-autoregressive Machine Translation?

abstract: Non-autoregressive (NAR) machine translation has recently achieved significant improvements, and now outperforms autoregressive (AR) models on some benchmarks, providing an efficient alternative to AR inference. However, while AR translation is often implemented using multilingual models that benefit from transfer between languages and from improved serving efficiency, multilingual NAR models remain relatively unexplored. Taking Connectionist Temporal Classification (CTC) as an example NAR model and Imputer as a semi-NAR model, we present a comprehensive empirical study of multilingual NAR. We test its capabilities with respect to positive transfer between related languages and negative transfer under capacity constraints. As NAR models require distilled training sets, we carefully study the impact of bilingual versus multilingual teachers. Finally, we fit a scaling law for multilingual NAR, which quantifies its performance relative to the AR model as model scale increases.


title: Optimising Inflationary Features the Bayesian Way

abstract: Modern cosmological data demand modern data analysis techniques. We introduce BayOp, a new likelihood sampling and maximisation method which is based on the Bayesian Optimisation algorithm and learns a function instead of randomly sampling from it. We apply BayOp to analyse Planck data for traces of inflationary features models with global periodic modulations of the primordial power spectrum. While we do not find any new evidence for features, we demonstrate that BayOp provides an extremely efficient way of sampling likelihoods over low-to-moderate-dimensional parameter spaces, even for very complex likelihood landscapes.


title: Predictive Price-Performance Optimization for Serverless Query Processing

abstract: We present an efficient, parametric modeling framework for predictive resource allocations, focusing on the amount of computational resources, that can optimize for a range of price-performance objectives for data analytics in serverless query processing settings. We discuss and evaluate in depth how our system, AutoExecutor, can use this framework to automatically select near-optimal executor and core counts for Spark SQL queries running on Azure Synapse. Our techniques improve upon Spark's in-built, reactive, dynamic executor allocation capabilities by substantially reducing the total executors allocated and executor occupancy while running queries, thereby freeing up executors that can potentially be used by other concurrent queries or in reducing the overall cluster provisioning needs. In contrast with post-execution analysis tools such as Sparklens, we predict resource allocations for queries before executing them and can also account for changes in input data sizes for predicting the desired allocations.


title: A Series transformation formula and related degenerate polynomials

abstract: Recently, Bovadzhiev studied a power series whose coefficients are binomial expressions and extended some known formulas involving classical special functions and polynomials. The aim of this paper is to adopt his ideas to express several identities involving " degenerate formal power series" as those including degenerate stirling numbers of the second kind, degenerate Bell polynomials, degenerate Fubini polynomials and degenerate poly-Bernoulli polynomials.


title: Norming constants of embedded bound states and bounded positon solutions of the Korteweg-de Vries equation

abstract: In the context of the full line Schrodinger equation, we revisit the binary Darboux transformation (double commutation method) which inserts or removes any number of positive eigenvalues embedded into the absolutely continuous spectrum without altering the rest of scattering data. We then show that embedded eigenvalues produce an additional explicit term in the KdV solution. This term looks similar to multi-soliton solution and describes waves traveling in the direction opposite to solitons. It also resembles the known formula for (singular) multi-positon solutions but remains bounded, which answers in the affirmative Matveev's question about existence of bounded positons.


title: Axioms for Quantum Gauge Fields

abstract: The purpose of this paper is to extend the existing axiom scheme for quantum field theory to include most known examples of gauge theories. The axioms are formulated to be neutral relative to possible implementation strategies. They are developed in both the Euclidean and Minkowski metrics for spacetime. We demonstrate that the Euclidean axioms imply the Minkowski (Wightman) axioms. The reconstruction theorem for gauge fields as operator-valued tempered distributions with gauge transformation properties is proven as well.


title: Geometric continuous-stage exponential energy-preserving integrators for charged-particle dynamics in a magnetic field from normal to strong regimes

abstract: This paper is concerned with geometric exponential energy-preserving integrators for solving charged-particle dynamics in a magnetic field from normal to strong regimes. We firstly formulate the scheme of the methods for the system in a uniform magnetic field by using the idea of continuous-stage methods, and then discuss its energy-preserving property. Moreover, symmetric conditions and order conditions are analysed. Based on those conditions, we propose two practical symmetric continuous-stage exponential energy-preserving integrators of order up to four. Then we extend the obtained methods to the system in a nonuniform magnetic field and derive their properties including the symmetry, convergence and energy conservation. Numerical experiments demonstrate the efficiency of the proposed methods in comparison with some existing schemes in the literature.


title: Some identities on degenerate Bell polynomials and their related identities

abstract: Recently, several types of degenerate Bell polynomials have been introduced as degenerate versions of the ordinary Bell polynomials. The aim of this paper is to study some identities for the degenerate Bell polynomials and their related identities by making use of series transformation formula obtained by Boyadzhiev. In particular, this answers to the natural question about the relationship between two different types of degenerate Bell polynomials.


title: CLICKER: A Computational LInguistics Classification Scheme for Educational Resources

abstract: A classification scheme of a scientific subject gives an overview of its body of knowledge. It can also be used to facilitate access to research articles and other materials related to the subject. For example, the ACM Computing Classification System (CCS) is used in the ACM Digital Library search interface and also for indexing computer science papers. We observed that a comprehensive classification system like CCS or Mathematics Subject Classification (MSC) does not exist for Computational Linguistics (CL) and Natural Language Processing (NLP). We propose a classification scheme -- CLICKER for CL/NLP based on the analysis of online lectures from 77 university courses on this subject. The currently proposed taxonomy includes 334 topics and focuses on educational aspects of CL/NLP; it is based primarily, but not exclusively, on lecture notes from NLP courses. We discuss how such a taxonomy can help in various real-world applications, including tutoring platforms, resource retrieval, resource recommendation, prerequisite chain learning, and survey generation.


title: The Credibility Cryptocurrency Valuation: Statistical Learning Analysis for Influencer Tweets

abstract: Cryptocurrency has attracted significant attention. Considering the number of individuals investing in bitcoin, their motivations are comparatively less clear than traditional investment decisions. As of December 2020, the market has continuously increased in cryptocurrency. Especially, the spike of joke Dogecoin shows the weirdness of the modern meme economy with the support of Elon Musk, whom himself appointed as "Dogefather". In this paper, we analysis the impact of tweets by Elon musk and present some statistical analyze with event study.


title: Existence of Multi-dimensional Contact Discontinuities for the Ideal Compressible Magnetohydrodynamics

abstract: We establish the local existence and uniqueness of multi-dimensional contact discontinuities for the ideal compressible magnetohydrodynamics (MHD) in Sobolev spaces, which are most typical interfacial waves for astrophysical plasmas and prototypical fundamental waves for hyperbolic systems of conservation laws. Such waves are characteristic discontinuities for which there is no flow across the discontinuity surface while the magnetic field crosses transversely, which lead to a two-phase free boundary problem where the pressure, velocity and magnetic field are continuous across the interface whereas the entropy and density may have jumps. To overcome the difficulties of possible nonlinear Rayleigh--Taylor instability and loss of derivatives, here we use crucially the Lagrangian formulation and Cauchy's celebrated integral (1815) for the magnetic field. These motivate us to define two special good unknowns; one enables us to capture the boundary regularizing effect of the transversal magnetic field on the flow map, and the other one allows us to get around the troublesome boundary integrals due to the transversality of the magnetic field. In particular, our result removes the additional assumption of the Rayleigh--Taylor sign condition required by Morando, Trakhinin and Trebeschi (\emph{J. Differential Equations} \textbf{258} (2015), no. 7, 2531--2571; \emph{Arch. Ration. Mech. Anal.} \textbf{228} (2018), no. 2, 697--742) and holds for both 2D and 3D and hence gives a complete answer to the two open questions raised therein. Moreover, there is {\it no loss of derivatives} in our well-posedness theory. The solution is constructed as {\it the inviscid limit} of solutions to some suitably-chosen nonlinear approximate problems for the two-phase compressible viscous non-resistive MHD.


title: Mathematical Runtime Analysis for the Non-Dominated Sorting Genetic Algorithm II (NSGA-II)

abstract: The non-dominated sorting genetic algorithm II (NSGA-II) is the most intensively used multi-objective evolutionary algorithm (MOEA) in real-world applications. However, in contrast to several simple MOEAs analyzed also via mathematical means, no such study exists for the NSGA-II so far. In this work, we show that mathematical runtime analyses are feasible also for the NSGA-II. As particular results, we prove that with a population size four times larger than the size of the Pareto front, the NSGA-II with two classic mutation operators and four different ways to select the parents satisfies the same asymptotic runtime guarantees as the SEMO and GSEMO algorithms on the basic OneMinMax and LeadingOnesTrailingZeros benchmarks. However, if the population size is only equal to the size of the Pareto front, then the NSGA-II cannot efficiently compute the full Pareto front: for an exponential number of iterations, the population will always miss a constant fraction of the Pareto front. Our experiments confirm the above findings.


title: Ordered Ehresmann semigroups and categories

abstract: Ehresmann semigroups may be viewed as biunary semigroups equipped with domain and range operations satisfying some equational laws. Motivated by some of the main examples, we here define ordered Ehresmann semigroups, and consider their basic properties as well as special cases in which the order is algebraically definable. In particular, one and two-sided restriction semigroups equipped with their natural orders are characterised within the class of ordered Ehresmann semigroups. The main result is an ESN-style theorem for ordered Ehresmann semigroups with particular reference to the special cases.


title: Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge

abstract: Transformer models pre-trained with a masked-language-modeling objective (e.g., BERT) encode commonsense knowledge as evidenced by behavioral probes; however, the extent to which this knowledge is acquired by systematic inference over the semantics of the pre-training corpora is an open question. To answer this question, we selectively inject verbalized knowledge into the minibatches of a BERT model during pre-training and evaluate how well the model generalizes to supported inferences. We find generalization does not improve over the course of pre-training, suggesting that commonsense knowledge is acquired from surface-level, co-occurrence patterns rather than induced, systematic reasoning.


title: New puzzle in charmonium decays

abstract: By analyzing existing data on pseudoscalar charmonium decays, we obtain the ratio of the branching fractions of $\eta_c(2S)$ and $\eta_c$ decays into ten different final states with light hadrons. For the first time, we test the two existing theoretical predictions of these decays, and find that the experimental data are significantly different from both of them. The lack of observation of any decay mode with higher rate in $\eta_c(2S)$ than in $\eta_c$ decays suggests very unusual decay dynamics in pseudoscalar charmonium decays to be identified. We also report the first model-independent evaluation of the partial width of $\eta_c(2S)\to \gamma\gamma$ ($2.21_{-0.64}^{+0.88}$ keV) and improved determination of that of $\eta_c\to \gamma\gamma$ ($5.43_{-0.38}^{+0.41}$ keV). The latter shows a tension with the most recent lattice QCD calculation.


title: Some q-supercongruences on double and triple sums

abstract: In this paper, we investigate a number of $q$-supercongruences on double and triple sums. By means of a lemma devised by El Bachraoui and its generalization, we transform some $q$-supercongruences on double and triple sums into the $q$-supercongruences of the square and cube of truncated basic hypergeometric series.Our main tools still involve the `creative microscoping' method introduced by Guo and Zudilin, a lemma designed by Guo and Li and the Chinese remainder theorem.


title: Removal of 5 Terms from a Degree 21 Polynomial

abstract: In 1683 Tschirnhaus claimed to have developed an algebraic method to determine the roots of any degree $n$ polynomial. His argument was flawed, but it spurred a great deal of work by mathematicians including Bring, Jerrard, Hamilton, Sylvester, and Hilbert. Many of the problems they considered can be framed in terms of the geometric notion of resolvent degree, introduced by Farb and Wolfson. Roughly speaking, we have $RD(n) \leq n-k$ if a general degree $n$ polynomial can be put into an $(n-k)$-parameter form. In the present note we discuss a method introduced by Sylvester for solving systems of polynomial equations, and apply it to finding bounds on resolvent degree. In particular, we prove the bound $RD(21) \leq 15$. This bound has been independently established by Sutherland using the classical theory of polarity.


title: SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoning

abstract: Answering complex questions about images is an ambitious goal for machine intelligence, which requires a joint understanding of images, text, and commonsense knowledge, as well as a strong reasoning ability. Recently, multimodal Transformers have made great progress in the task of Visual Commonsense Reasoning (VCR), by jointly understanding visual objects and text tokens through layers of cross-modality attention. However, these approaches do not utilize the rich structure of the scene and the interactions between objects which are essential in answering complex commonsense questions. We propose a Scene Graph Enhanced Image-Text Learning (SGEITL) framework to incorporate visual scene graphs in commonsense reasoning. To exploit the scene graph structure, at the model structure level, we propose a multihop graph transformer for regularizing attention interaction among hops. As for pre-training, a scene-graph-aware pre-training method is proposed to leverage structure knowledge extracted in the visual scene graph. Moreover, we introduce a method to train and generate domain-relevant visual scene graphs using textual annotations in a weakly-supervised manner. Extensive experiments on VCR and other tasks show a significant performance boost compared with the state-of-the-art methods and prove the efficacy of each proposed component.


title: Learning to acquire novel cognitive tasks with evolution, plasticity and meta-meta-learning

abstract: A hallmark of intelligence is the ability to autonomously learn new flexible, cognitive behaviors - that is, behaviors where the appropriate action depends not just on immediate stimuli (as in simple reflexive stimulus-response associations), but on contextual information that must be adequately acquired, stored and processed. While many meta-learning algorithms can design agents that autonomously learn new tasks, cognitive tasks adds another level of learning and memory to typical ``learning-to-learn'' problems. Here we evolve neural networks, endowed with plastic connections and neuromodulation, over a sizable set of simple cognitive tasks adapted from a computational neuroscience framework. The resulting evolved networks can automatically modify their own connectivity to acquire a novel simple cognitive task, never seen during evolution, from stimuli and rewards alone, through the spontaneous operation of their evolved neural organization and plasticity system. Our results emphasize the importance of carefully considering the multiple learning loops involved in the emergence of intelligent behavior.


title: Knowledge Graph Embedding in E-commerce Applications: Attentive Reasoning, Explanations, and Transferable Rules

abstract: Knowledge Graphs (KGs), representing facts as triples, have been widely adopted in many applications. Reasoning tasks such as link prediction and rule induction are important for the development of KGs. Knowledge Graph Embeddings (KGEs) embedding entities and relations of a KG into continuous vector spaces, have been proposed for these reasoning tasks and proven to be efficient and robust. But the plausibility and feasibility of applying and deploying KGEs in real-work applications has not been well-explored. In this paper, we discuss and report our experiences of deploying KGEs in a real domain application: e-commerce. We first identity three important desiderata for e-commerce KG systems: 1) attentive reasoning, reasoning over a few target relations of more concerns instead of all; 2) explanation, providing explanations for a prediction to help both users and business operators understand why the prediction is made; 3) transferable rules, generating reusable rules to accelerate the deployment of a KG to new systems. While non existing KGE could meet all these desiderata, we propose a novel one, an explainable knowledge graph attention network that make prediction through modeling correlations between triples rather than purely relying on its head entity, relation and tail entity embeddings. It could automatically selects attentive triples for prediction and records the contribution of them at the same time, from which explanations could be easily provided and transferable rules could be efficiently produced. We empirically show that our method is capable of meeting all three desiderata in our e-commerce application and outperform typical baselines on datasets from real domain applications.


title: Federated 3GPP Mobile Edge Computing Systems: A Transparent Proxy for Third Party Authentication with Application Mobility Support

abstract: Multi-Access or Mobile Edge Computing (MEC) is being deployed by 4G/5G operators to provide computational services at lower latencies. Federating MECs across operators expands capability, capacity, and coverage but gives rise to two issues - third-party authentication and application mobility - for continuous service during roaming without re-authentication. In this work, we propose a Federated State transfer and 3rd-party Authentication (FS3A) mechanism that uses a transparent proxy to transfer the information of both authentication and application state across operators to resolve these issues. The FS3A proxy is kept transparent, with virtual counterparts, to avoid any changes to the existing MEC and cellular architectures. FS3A provides users with a token, when authenticated by an MEC, which can be reused across operators for faster authentication. Prefetching of subscription and state is also proposed to further reduce the authentication and application mobility latencies. We evaluated FS3A on an OpenAirInterface (OAI)-based testbed and the results show that token reuse and subscription prefetching reduce the authentication latency by 53-65%, compared to complete re-authentication, while state prefetching reduces application mobility latency by 51-91%, compared to no prefetching. Overall, FS3A reduces the service interruption time by 33%, compared to no token reuse and prefetching.


title: Dynamic Transport Characteristics of Side-Coupled Double Quantum-Impurity Systems

abstract: A systematic study is made on the time-dependent dynamic transport characteristics of the side-coupled double quantum-impurity system based on the hierarchical equations of motion. It is found that the transport current behaves like a single quantum dot when the coupling strength is low during tunneling or coulomb coupling. The dynamic current oscillates due to the temporal coherence of the electron tunneling device only when the tunneling transition is coupled. The oscillation frequency of the transport current is related to the step voltage applied by the lead, while the $T$, e-e interaction $U$ and the bandwidth $W$ have little influence. The amplitude of the current oscillation exists in positive correlation with $W$ and negative correlation with $U$. With the increase in coupling $t_{12}$ between impurities, the ground state of the system changes from a Kondo singlet of one impurity to a spin-singlet of two impurities. Moreover, lowering the temperature could promote the Kondo effect to intensify the oscillation of the dynamic current. When only the coulomb transition is coupled, it is found that the two split-off Hubbard peaks move upward and have different interference effects on the Kondo peak at the Fermi surface with the increase in $U_{12}$, from the dynamics point of view.


title: Idiomatic Expression Paraphrasing without Strong Supervision

abstract: Idiomatic expressions (IEs) play an essential role in natural language. In this paper, we study the task of idiomatic sentence paraphrasing (ISP), which aims to paraphrase a sentence with an IE by replacing the IE with its literal paraphrase. The lack of large-scale corpora with idiomatic-literal parallel sentences is a primary challenge for this task, for which we consider two separate solutions. First, we propose an unsupervised approach to ISP, which leverages an IE's contextual information and definition and does not require a parallel sentence training set. Second, we propose a weakly supervised approach using back-translation to jointly perform paraphrasing and generation of sentences with IEs to enlarge the small-scale parallel sentence training dataset. Other significant derivatives of the study include a model that replaces a literal phrase in a sentence with an IE to generate an idiomatic expression and a large scale parallel dataset with idiomatic/literal sentence pairs. The effectiveness of the proposed solutions compared to competitive baselines is seen in the relative gains of over 5.16 points in BLEU, over 8.75 points in METEOR, and over 19.57 points in SARI when the generated sentences are empirically validated on a parallel dataset using automatic and manual evaluations. We demonstrate the practical utility of ISP as a preprocessing step in En-De machine translation.


title: Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learning

abstract: The advent of large pre-trained generative language models has provided a common framework for AI story generation via sampling the model to create sequences that continue the story. However, sampling alone is insufficient for story generation. In particular, it is hard to direct a language model to create stories to reach a specific goal event. We present two automated techniques grounded in deep reinforcement learning and reward shaping to control the plot of computer-generated stories. The first utilizes proximal policy optimization to fine-tune an existing transformer-based language model to generate text continuations but also be goal-seeking. The second extracts a knowledge graph from the unfolding story, which is used by a policy network with graph attention to select a candidate continuation generated by a language model. We report on automated metrics pertaining to how often stories achieve a given goal event as well as human participant rankings of coherence and overall story quality compared to baselines and ablations.


title: Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformation

abstract: Detecting out-of-context media, such as "mis-captioned" images on Twitter, is a relevant problem, especially in domains of high public significance. In this work we aim to develop defenses against such misinformation for the topics of Climate Change, COVID-19, and Military Vehicles. We first present a large-scale multimodal dataset with over 884k tweets relevant to these topics. Next, we propose a detection method, based on the state-of-the-art CLIP model, that leverages automatically generated hard image-text mismatches. While this approach works well on our automatically constructed out-of-context tweets, we aim to validate its usefulness on data representative of the real world. Thus, we test it on a set of human-generated fakes created by mimicking in-the-wild misinformation. We achieve an 11% detection improvement in a high precision regime over a strong baseline. Finally, we share insights about our best model design and analyze the challenges of this emerging threat.


title: Accuracy Enhancing Interface Treatment Algorithm: the Back and Forth Error Compensation and Correction method

abstract: The accuracy of information transmission while solving domain decomposed problems is crucial to smooth transition of a solution around the interface/overlapping region. This paper describes a systematical study on an accuracy enhancing interface treatment algorithm based on the back and forth error compensation and correction method (BFECC). By repetitively employing a low order interpolation technique (normally local 2\ts{nd} order) 3 times, this algorithm achieves local 3\ts{rd} order accuracy. Analytical derivations for 1D \& 2D cases are made, and the "super convergence" phenomenon (4\ts{th} order accuracy) is found for specific positioning of the donor and target grids. A set of numerical experiments based on various relative displacements, relative rotations, mesh ratios, and meshes with perturbation have been tested, and the results match the derivations. Different interface treatments are compared with 3D examples: corner flow and cavity flow. The component convergence rate analysis shows that the BFECC method positively affects the accuracy of solutions.


title: Guiding Neural Story Generation with Reader Models

abstract: Automated storytelling has long captured the attention of researchers for the ubiquity of narratives in everyday life. However, it is challenging to maintain coherence and stay on-topic toward a specific ending when generating narratives with neural language models. In this paper, we introduce Story generation with Reader Models (StoRM), a framework in which a reader model is used to reason about the story should progress. A reader model infers what a human reader believes about the concepts, entities, and relations about the fictional story world. We show how an explicit reader model represented as a knowledge graph affords story coherence and provides controllability in the form of achieving a given story world state goal. Experiments show that our model produces significantly more coherent and on-topic stories, outperforming baselines in dimensions including plot plausibility and staying on topic.


title: Reprogrammable Surfaces Through Star Graph Metamaterials

abstract: The ability to change a surface's profile allows biological systems to effectively manipulate and blend into their surroundings. Current surface morphing techniques rely either on having a small number of fixed states or on directly driving the entire system. We discovered a subset of scale-independent auxetic metamaterials have a state trajectory with a star-graph structure. At the central node, small nudges can move the material between trajectories, allowing us to locally shift Poisson's ratio, causing the material to take on different shapes under loading. While the number of possible shapes grows exponentially with the size of the material, the probability of finding one at random is vanishingly small. By actively guiding the material through the node points, we produce a reprogrammable surface that does not require inputs to maintain shape and can display arbitrary 2D information and take on complex 3D shapes. Our work opens new opportunities in micro devices, tactile displays, manufacturing, and robotic systems.


title: FIgLib & SmokeyNet: Dataset and Deep Learning Model for Real-Time Wildland Fire Smoke Detection

abstract: The size and frequency of wildland fires in the western United States have dramatically increased in recent years. On high-fire-risk days, a small fire ignition can rapidly grow and become out of control. Early detection of fire ignitions from initial smoke can assist the response to such fires before they become difficult to manage. Past deep learning approaches for wildfire smoke detection have suffered from small or unreliable datasets that make it difficult to extrapolate performance to real-world scenarios. In this work, we present the Fire Ignition Library (FIgLib), a publicly available dataset of nearly 25,000 labeled wildfire smoke images as seen from fixed-view cameras deployed in Southern California. We also introduce SmokeyNet, a novel deep learning architecture using spatiotemporal information from camera imagery for real-time wildfire smoke detection. When trained on the FIgLib dataset, SmokeyNet outperforms comparable baselines and rivals human performance. We hope that the availability of the FIgLib dataset and the SmokeyNet architecture will inspire further research into deep learning methods for wildfire smoke detection, leading to automated notification systems that reduce the time to wildfire response.


title: Central X-ray point-sources found to be abundant in low-mass, late-type galaxies predicted to contain an intermediate-mass black hole

abstract: Building upon three late-type galaxies in the Virgo cluster with both a predicted black hole mass of less than $\sim$10$^5$ M$_{\odot}$ and a centrally-located X-ray point-source, we reveal 11 more such galaxies, more than tripling the number of active intermediate-mass black hole candidates among this population. Moreover, this amounts to a 36$\pm$8% X-ray detection rate (despite the sometimes high, X-ray-absorbing, HI column densities), compared to just 10$\pm$5% for (the largely HI-free) dwarf early-type galaxies in the Virgo cluster. The expected contribution of X-ray binaries from the galaxies' inner field stars is negligible. Moreover, given that both the spiral and dwarf galaxies contain nuclear star clusters, the above inequality appears to disfavor X-ray binaries in nuclear star clusters. The higher occupation, or rather detection, fraction among the spiral galaxies may instead reflect an enhanced cool gas/fuel supply and Eddington ratio. Indeed, four of the 11 new X-ray detections are associated with known LINERs or LINER/HII composites. For all (four) of the new detections for which the X-ray flux was strong enough to establish the spectral energy distribution in the Chandra band, it is consistent with power-law spectra. Furthermore, the X-ray emission from the source with the highest flux (NGC 4197: $L_X \approx 10^{40}$ erg s$^{-1}$) suggests a non-stellar-mass black hole if the X-ray spectrum corresponds to the `low/hard state'. Follow-up observations to further probe the black hole masses, and prospects for spatially resolving the gravitational spheres-of-influence around intermediate-mass black holes, are reviewed in some detail.


title: Isospin competitions and valley polarized correlated insulators in twisted double bilayer graphene

abstract: New phase of matter usually emerges when a given symmetry breaks spontaneously, which can involve charge, spin, and valley degree of freedoms. Here, we report an observation of new correlated insulators evolved from spin polarized states to valley polarized states in AB-BA stacked twisted double bilayer graphene (TDBG). The transition of the isospin polarization is a result of the competition between spin and valley, driven by the displacement field (D). At a high field |D| > 0.7 V/nm, we observe valley polarized correlated insulators with a big Zeeman g factor of ~10, both at v = 2 in the moir\'e conduction band and more surprisingly at v = -2 in the moir\'e valence band. At a medium field |D| < 0.6 V/nm, by contrast, it is a conventional spin polarized correlated insulator at v = 2 and a featureless metal at v = -2. Moreover, we observe a valley polarized Chern insulator with C = 2 emanating at v = 2 in the electron side and a valley polarized Fermi surface around v = -2 in the hole side. The valley Chern insulator with C = 2 is evident from a well quantized Hall conductance plateau at 2e^2/h and correspondingly a vanishing longitudinal component. The valley polarized Fermi surface is topologically trivial with C = 0, and it shows a series of quantized Landau levels with v_LL = 0, 1, 2, 3, 4 and others. These observations are in good agreements with our band and topology calculations. Our results demonstrate a feasible way to realize isospin control and to obtain new phases of matter in TDBG by the displacement field, and might benefit other twisted or non-twisted multilayer systems.


title: A New Model-free Prediction Method: GA-NoVaS

abstract: Volatility forecasting plays an important role in the financial econometrics. Previous works in this regime are mainly based on applying various GARCH-type models. However, it is hard for people to choose a specific GARCH model which works for general cases and such traditional methods are unstable for dealing with high-volatile period or using small sample size. The newly proposed normalizing and variance stabilizing (NoVaS) method is a more robust and accurate prediction technique. This Model-free method is built by taking advantage of an inverse transformation which is based on the ARCH model. Inspired by the historic development of the ARCH to GARCH model, we propose a novel NoVaS-type method which exploits the GARCH model structure. By performing extensive data analysis, we find our model has better time-aggregated prediction performance than the current state-of-the-art NoVaS method on forecasting short and volatile data. The victory of our new method corroborates that and also opens up avenues where one can explore other NoVaS structures to improve on the existing ones or solve specific prediction problems.


title: $n \times n \times n$ Rubik's Cubes and God's Number

abstract: The Rubik's Cube is the most popular puzzle in the world. Two of its studied aspects are God's Number, the minimum number of turns necessary to solve any state, and the first law of cubology, a solvability criterion. We modify previous statements of the first law of cubology for $n \times n \times n$ Rubik's Cubes, and prove necessary and sufficient solvability conditions. We compute the order of the Rubik's Cube group and the number of distinct configurations of the $n \times n \times n$ Rubik's Cube. Finally, we derive a lower bound for God's Number using the group theoretical results and a counting argument.


title: Self-trapped interlayer excitons in van der Waals heterostructures

abstract: The self-trapped state (STS) of interlayer exciton (IX) has been aroused enormous interesting owing to their significant impact on the fundamental properties of the van derWaals heterostructures (vdWHs). Nevertheless, the microscopic mechanisms of STS are still controversial. Herein, we study the corrections of the binding energies of the IXs due to the exciton-interface optical phonon coupling in four kinds of vdWHs and find that these IXs are in the STS for the appropriate ratio of the electron and hole effective masses. We show that these STSs could be classified into the type I with the increasing binding energy in the tens of meV range, which are very agreement with the red-shift of the IXs spectra in experiments, and the type II with the decreasing binding energy, which provides a possible explanation for the blue-shift and broad linewidth of the IXs spectra in the low temperature. Moreover, these two types of self-trapped IXs could be transformed into each other by adjusting the structural parameters of vdWHs. These results not only provide an in-depth understanding for the self-trapped mechanism of IX, but also shed light on the modulations of IXs in vdWHs.


title: Use Image Clustering to Facilitate Technology Assisted Review

abstract: During the past decade breakthroughs in GPU hardware and deep neural networks technologies have revolutionized the field of computer vision, making image analytical potentials accessible to a range of real-world applications. Technology Assisted Review (TAR) in electronic discovery though traditionally has dominantly dealt with textual content, is witnessing a rising need to incorporate multimedia content in the scope. We have developed innovative image analytics applications for TAR in the past years, such as image classification, image clustering, and object detection, etc. In this paper, we discuss the use of image clustering applications to facilitate TAR based on our experiences in serving clients. We describe our general workflow on leveraging image clustering in tasks and use statistics from real projects to showcase the effectiveness of using image clustering in TAR. We also summarize lessons learned and best practices on using image clustering in TAR.


title: Frequency Spectrum Augmentation Consistency for Domain Adaptive Object Detection

abstract: Domain adaptive object detection (DAOD) aims to improve the generalization ability of detectors when the training and test data are from different domains. Considering the significant domain gap, some typical methods, e.g., CycleGAN-based methods, adopt the intermediate domain to bridge the source and target domains progressively. However, the CycleGAN-based intermediate domain lacks the pix- or instance-level supervision for object detection, which leads to semantic differences. To address this problem, in this paper, we introduce a Frequency Spectrum Augmentation Consistency (FSAC) framework with four different low-frequency filter operations. In this way, we can obtain a series of augmented data as the intermediate domain. Concretely, we propose a two-stage optimization framework. In the first stage, we utilize all the original and augmented source data to train an object detector. In the second stage, augmented source and target data with pseudo labels are adopted to perform the self-training for prediction consistency. And a teacher model optimized using Mean Teacher is used to further revise the pseudo labels. In the experiment, we evaluate our method on the single- and compound- target DAOD separately, which demonstrate the effectiveness of our method.


title: An Empirical Study on Transfer Learning for Privilege Review

abstract: Protecting privileged communications and data from inadvertent disclosure is a paramount task in the US legal practice. Traditionally counsels rely on keyword searching and manual review to identify privileged documents in cases. As data volumes increase, this approach becomes less and less defensible in costs. Machine learning methods have been used in identifying privilege documents. Given the generalizable nature of privilege in legal cases, we hypothesize that transfer learning can capitalize knowledge learned from existing labeled data to identify privilege documents without requiring labeling new training data. In this paper, we study both traditional machine learning models and deep learning models based on BERT for privilege document classification tasks in legal document review, and we examine the effectiveness of transfer learning in privilege model on three real world datasets with privilege labels. Our results show that BERT model outperforms the industry standard logistic regression algorithm and transfer learning models can achieve decent performance on datasets in same or close domains.


title: Current-in-plane magnetoresistance in chiral-molecule/ferromagnetic metal bilayer due to thermally induced spin polarization

abstract: We report chirality-induced current-in-plane magnetoresistance (CIP-MR) in chiral molecule/ferromagnetic metal bilayer at room temperature. The previously reported chiralityinduced current-perpendicular-to-plane magnetoresistance (CPP-MR) originates from the chiral induced spin-selectivity (CISS) effect that needs charge-current passing through the molecule. In contrast, the observed CIP-MR in the present study requires no bias charge current through the molecule. The temperature dependence of CIP-MR suggests thermally induced spin-polarization in the chiral molecules is the key for the observed MR.


title: QuALITY: Question Answering with Long Input Texts, Yes!

abstract: To enable building and testing models on long-document comprehension, we introduce QuALITY, a multiple-choice QA dataset with context passages in English that have an average length of about 5,000 tokens, much longer than typical current models can process. Unlike in prior work with passages, our questions are written and validated by contributors who have read the entire passage, rather than relying on summaries or excerpts. In addition, only half of the questions are answerable by annotators working under tight time constraints, indicating that skimming and simple search are not enough to consistently perform well. Our baseline models perform poorly on this task (55.4%) and significantly lag behind human performance (93.5%).


title: DuQM: A Chinese Dataset of Linguistically Perturbed Natural Questions for Evaluating the Robustness of Question Matching Models

abstract: In this paper, we focus on studying robustness evaluation of Chinese question matching. Most of the previous work on analyzing robustness issue focus on just one or a few types of artificial adversarial examples. Instead, we argue that it is necessary to formulate a comprehensive evaluation about the linguistic capabilities of models on natural texts. For this purpose, we create a Chinese dataset namely DuQM which contains natural questions with linguistic perturbations to evaluate the robustness of question matching models. DuQM contains 3 categories and 13 subcategories with 32 linguistic perturbations. The extensive experiments demonstrate that DuQM has a better ability to distinguish different models. Importantly, the detailed breakdown of evaluation by linguistic phenomenon in DuQM helps us easily diagnose the strength and weakness of different models. Additionally, our experiment results show that the effect of artificial adversarial examples does not work on the natural texts.


title: Electromagnetic Effective Degree of Freedom of a MIMO System in Free Space

abstract: Effective degree of freedom (EDOF) of a multiple-input-multiple-output (MIMO) system represents its equivalent number of independent single-input-single-output (SISO) systems, which directly characterizes the communication performance. Traditional EDOF only considers single polarization, where the full polarized components degrade into two independent transverse components under the far-field approximation. However, the traditional model is not applicable to complex scenarios especially for the near-field region. Based on an electromagnetic (EM) channel model built from the dyadic Green's function, we first calculate the EM EDOF to estimate the performance of an arbitrary MIMO system with full polarizations in free space. Then, we clarify the relations between the limit of EDOF and the optimal number of sources/receivers. Finally, potential benefits of near-field MIMO communications are demonstrated with the EM EDOF, in which the contribution of the longitudinally polarized source is taken into account. This work establishes a fundamental EM framework for MIMO wireless communications.


title: Clickbait in YouTube Prevention, Detection and Analysis of the Bait using Ensemble Learning

abstract: Unscrupulous content creators on YouTube employ deceptive techniques such as spam and clickbait to reach a broad audience and trick users into clicking on their videos to increase their advertisement revenue. Clickbait detection on YouTube requires an in depth examination and analysis of the intricate relationship between the video content and video descriptors title and thumbnail. However, the current solutions are mostly centred around the study of video descriptors and other metadata such as likes, tags, comments, etc and fail to utilize the video content, both video and audio. Therefore, we introduce a novel model to detect clickbaits on YouTube that consider the relationship between video content and title or thumbnail. The proposed model consists of a stacking classifier framework composed of six base models (K Nearest Neighbours, Support Vector Machine, XGBoost, Naive Bayes, Logistic Regression, and Multilayer Perceptron) and a meta classifier. The developed clickbait detection model achieved a high accuracy of 92.89% for the novel BollyBAIT dataset and 95.38% for Misleading Video Dataset. Additionally, the stated classifier does not use meta features or other statistics dependent on user interaction with the video (the number of likes, followers, or comments) for classification, and thus, can be used to detect potential clickbait videos before they are uploaded, thereby preventing the nuisance of clickbaits altogether and improving the users streaming experience.


title: Pairing strength in the relativistic mean-field theory determined from fission barrier heights of actinide nuclei and verified by pairing rotation and binding energies

abstract: We have studied strength in the BCS pairing force, used as a residual interaction to the relativistic mean-field to reproduce the height of the inner fission barriers for actinide nuclei. It was found that increasing the pairing strength by about 13% makes reproduce the inner fission barriers better over a wide range of actinide nuclei. This result was verified by using the moment-of-inertia of pairing rotational energy, which was introduced to avoid mean-field and odd-mass effects in the pairing interaction to deduce purely the pairing strength. The pairing interaction thus determined could simultaneously improve the description of the binding energy of heavy nuclei as well. As a result, a consistent picture among inner fission barrier, binding energy, and pairing moment of inertia could be obtained in terms of the relativistic mean-field + BCS theory for a broad region of the actinide nuclei.