title: A New Data Integration Framework for Covid-19 Social Media Information

abstract: The Covid-19 pandemic presents a serious threat to people health, resulting in over 250 million confirmed cases and over 5 million deaths globally. To reduce the burden on national health care systems and to mitigate the effects of the outbreak, accurate modelling and forecasting methods for short- and long-term health demand are needed to inform government interventions aiming at curbing the pandemic. Current research on Covid-19 is typically based on a single source of information, specifically on structured historical pandemic data. Other studies are exclusively focused on unstructured online retrieved insights, such as data available from social media. However, the combined use of structured and unstructured information is still uncharted. This paper aims at filling this gap, by leveraging historical and social media information with a novel data integration methodology. The proposed approach is based on vine copulas, which allow us to exploit the dependencies between different sources of information. We apply the methodology to combine structured datasets retrieved from official sources and a big unstructured dataset of information collected from social media. The results show that the combined use of official and online generated information contributes to yield a more accurate assessment of the evolution of the Covid-19 pandemic, compared to the sole use of official data.


title: Inferring Spatial Source of Disease Outbreaks using Maximum Entropy

abstract: Mathematical modeling of disease outbreaks can infer the future trajectory of an epidemic, which can inform policy decisions. Another task is inferring the origin of a disease, which is relatively difficult with current mathematical models. Such frameworks -- across varying levels of complexity -- are typically sensitive to input data on epidemic parameters, case-counts and mortality rates, which are generally noisy and incomplete. To alleviate these limitations, we propose a maximum entropy framework that fits epidemiological models, provides a calibrated infection origin probabilities, and is robust to noise due to a prior belief model. Maximum entropy is agnostic to the parameters or model structure used and allows for flexible use when faced with sparse data conditions and incomplete knowledge in the dynamical phase of disease-spread, providing for more reliable modeling at early stages of outbreaks. We evaluate the performance of our model by predicting future disease trajectories in synthetic graph networks and the real mobility network of New York state. In addition, unlike existing approaches, we demonstrate that the method can be used to infer the origin of the outbreak with accurate confidence. Indeed, despite the prevalent belief on the feasibility of contact-tracing being limited to the initial stages of an outbreak, we report the possibility of reconstructing early disease dynamics, including the epidemic seed, at advanced stages.


title: Machine Translation Verbosity Control for Automatic Dubbing

abstract: Automatic dubbing aims at seamlessly replacing the speech in a video document with synthetic speech in a different language. The task implies many challenges, one of which is generating translations that not only convey the original content, but also match the duration of the corresponding utterances. In this paper, we focus on the problem of controlling the verbosity of machine translation output, so that subsequent steps of our automatic dubbing pipeline can generate dubs of better quality. We propose new methods to control the verbosity of MT output and compare them against the state of the art with both intrinsic and extrinsic evaluations. For our experiments we use a public data set to dub English speeches into French, Italian, German and Spanish. Finally, we report extensive subjective tests that measure the impact of MT verbosity control on the final quality of dubbed video clips.


title: Speeding up Deep Model Training by Sharing Weights and Then Unsharing

abstract: We propose a simple and efficient approach for training the BERT model. Our approach exploits the special structure of BERT that contains a stack of repeated modules (i.e., transformer encoders). Our proposed approach first trains BERT with the weights shared across all the repeated modules till some point. This is for learning the commonly shared component of weights across all repeated layers. We then stop weight sharing and continue training until convergence. We present theoretic insights for training by sharing weights then unsharing with analysis for simplified models. Empirical experiments on the BERT model show that our method yields better performance of trained models, and significantly reduces the number of training iterations.


title: Site characterization at Treasure Island and Delaney Park downhole arrays by heterogeneous data assimilation

abstract: This article extends a recently proposed heterogeneous data assimilation technique for site characterization to estimate compression and shear wave velocity (Vp and Vs, respectively) and damping at Treasure Island and Delaney Park downhole arrays. The adopted method is based on the joint inversion of earthquake acceleration time series and experimental surface wave dispersion data, and including physical constraints to improve the inverse problem's well-posedness. We first use synthetic data at these two sites to refine the proposed approach and then apply the refined algorithm to real data sets available at the Treasure Island and Delaney Park downhole arrays. The joint inversion results show that the estimated Vs and Vp profiles are in very good agreement with measured profiles at these two sites. Our synthetic and real data experiment results suggest that Vp estimation from inversion at downhole arrays can be improved by integrating the water table depth information or the higher modes of the Rayleigh wave dispersion data. Depending on the site complexity, water table information can also help reduce uncertainties associated with damping estimation. In the last part of this article, we compare the performance of the inverted profiles to other methods used to incorporate spatial variability and wave scattering effects in 1D ground response analysis (GRA). The comparisons show that the joint inversion-based Vs and Vp profiles and damping ratios estimated in this article can effectively integrate the effects of spatial variability and wave scattering into 1D GRAs, especially at the Delaney Park downhole array, which is classified as a poorly modeled site using traditional 1D GRA.


title: Full-frequency dynamical Bethe-Salpeter equation without frequency and a study of double excitations

abstract: The Bethe-Salpeter equation (BSE) that results from the GW approximation to the self-energy is a frequency-dependent (nonlinear) eigenvalue problem due to the dynamically screened Coulomb interaction between electrons and holes. The computational time required for a numerically exact treatment of this frequency dependence is $O(N^6)$, where $N$ is the system size. To avoid the common static screening approximation, we show that the full-frequency dynamical BSE can be exactly reformulated as a frequency-independent eigenvalue problem in an expanded space of single and double excitations. When combined with an iterative eigensolver and the density fitting approximation to the electron repulsion integrals, this reformulation yields a dynamical BSE algorithm whose computational time is $O(N^5)$, which we verify numerically. Furthermore, the reformulation provides direct access to excited states with dominant double excitation character, which are completely absent in the spectrum of the statically screened BSE. We study the $2^1A_\mathrm{g}$ state of butadiene, hexatriene, and octatetraene and find that GW/BSE overestimates the excitation energy by about 1.5-2 eV and significantly underestimates the double excitation character.


title: Automatic annotation of visual deep neural networks

abstract: Computer vision is widely used in the fields of driverless, face recognition and 3D reconstruction as a technology to help or replace human eye perception images or multidimensional data through computers. Nowadays, with the development and application of deep neural networks, the models of deep neural networks proposed for computer vision are becoming more and more abundant, and developers will use the already trained models on the way to solve problems, and need to consult the relevant documents to understand the use of the model. The class model, which creates the need to quickly and accurately find the relevant models that you need. The automatic annotation method of visual depth neural network proposed in this paper is based on natural language processing technology such as semantic analysis, which realizes automatic labeling of model application fields. In the three top international conferences on computer vision: ICCV, CVPR and ECCV, the average correct rate of application of the papers of 72 papers reached 90%, indicating the effectiveness of the automatic labeling system.


title: The characters of symmetric groups that depend only on length

abstract: The characters $\chi(\pi)$ of $S_n$ that depend only on the number of cycles of $\pi$ are completely determined.


title: A Physical Model for the Quasar Luminosity Function Evolution between Cosmic Dawn and High Noon

abstract: Modeling the evolution of the number density distribution of quasars through the Quasar Luminosity Function (QLF) is critical to improve our understanding of the connection between black holes, galaxies and their halos. Here we present a novel semi-empirical model for the evolution of the QLF that is fully defined after the specification of a free parameter, the internal duty cycle, $\varepsilon_{DC}$ along with minimal other assumptions. All remaining model parameters are fixed upon calibration against the QLF at two redshifts, $z=4$ and $z=5$. Our modeling shows that the evolution at the bright end results from the stochasticity in the median quasar luminosity versus halo mass relation, while the faint end shape is determined by the evolution of the Halo Mass Function (HMF) with redshift. Additionally, our model suggests the overall quasar density is determined by the evolution of the HMF, irrespective of the value of $\varepsilon_{DC}$. The $z\ge4$ QLFs from our model are in excellent agreement with current observations for all $\varepsilon_{DC}$, with model predictions suggesting that observations at $z\gtrsim7.5$ are needed to discriminate between different $\varepsilon_{DC}$. We further extend the model at $z\le4$, successfully describing the QLF between $1\le z\le4$, albeit with additional assumptions on $\Sigma$ and $\varepsilon_{DC}$. We use the existing measurements of quasar duty cycle from clustering to constrain $\varepsilon_{DC}$, finding $\varepsilon_{DC}\sim0.01$ or $\varepsilon_{DC}\gtrsim0.1$ dependent on observational datasets used for reference. Finally, we present forecasts for future wide-area surveys with promising expectations for the Nancy Grace Roman Telescope to discover $N\gtrsim10$, bright, $m_{UV}<26.5$ quasars at $z\sim8$.


title: Meta-Learning 3D Shape Segmentation Functions

abstract: Learning robust 3D shape segmentation functions with deep neural networks has emerged as a powerful paradigm, offering promising performance in producing a consistent part segmentation of each 3D shape. Generalizing across 3D shape segmentation functions requires robust learning of priors over the respective function space and enables consistent part segmentation of shapes in presence of significant 3D structure variations. Existing generalization methods rely on extensive training of 3D shape segmentation functions on large-scale labeled datasets. In this paper, we proposed to formalize the learning of a 3D shape segmentation function space as a meta-learning problem, aiming to predict a 3D segmentation model that can be quickly adapted to new shapes with no or limited training data. More specifically, we define each task as unsupervised learning of shape-conditioned 3D segmentation function which takes as input points in 3D space and predicts the part-segment labels. The 3D segmentation function is trained by a self-supervised 3D shape reconstruction loss without the need for part labels. Also, we introduce an auxiliary deep neural network as a meta-learner which takes as input a 3D shape and predicts the prior over the respective 3D segmentation function space. We show in experiments that our meta-learning approach, denoted as Meta-3DSeg, leads to improvements on unsupervised 3D shape segmentation over the conventional designs of deep neural networks for 3D shape segmentation functions.


title: Hardware Functional Obfuscation With Ferroelectric Active Interconnects

abstract: Camouflaging gate techniques are typically used in hardware security to prevent reverse engineering. Layout level camouflaging by adding dummy contacts ensures some level of protection against extracting the correct netlist. Threshold voltage manipulation for multi-functional logic with identical layouts has also been introduced for functional obfuscation. All these techniques are implemented at the expense of circuit-complexity and with significant area, energy, and delay penalty. In this paper, we propose an efficient hardware encryption technique with minimal complexity and overheads based on ferroelectric field-effect transistor (FeFET) active interconnects. The active interconnect provides run-time reconfigurable inverter-buffer logic by utilizing the threshold voltage programmability of the FeFETs. Our method utilizes only two FeFETs and an inverter to realize the masking function compared to recent reconfigurable logic gate implementations using several FeFETs and complex differential logic. We fabricate the proposed circuit and demonstrate the functionality. Judicious placement of the proposed logic in the IC makes it acts as a hardware encryption key and enables encoding and decoding of the functional output without affecting the critical path timing delay. Also, we achieve comparable encryption probability with a limited number of encryption units. In addition, we show a peripheral programming scheme for reconfigurable logic by reusing the existing scan chain logic, hence obviating the need for specialized programming logic and circuitry for keybit distribution. Our analysis shows an average encryption probability of 97.43% with an increase of 2.24%/ 3.67% delay for the most critical path/ sum of 100 critical paths delay for ISCAS85 benchmarks.


title: Using the EAGLE simulations to elucidate the origin of disc surface brightness profile breaks as a function of mass and environment

abstract: We analyse the surface brightness profiles of disc-type galaxies in the EAGLE simulations in order to investigate the effects of galaxy mass and environment on galaxy profile types. Following observational works, we classify the simulated galaxies by their disc surface brightness profiles into single exponential (Type I), truncated (Type II) and anti-truncated (Type III) profiles. In agreement with previous observation and theoretical work, we find that Type II discs result from truncated star-forming discs that drive radial gradients in the stellar populations. In contrast, Type III profiles result from galaxy mergers, extended star-forming discs or the late formation of a steeper, inner disc. We find that the EAGLE simulations qualitatively reproduce the observed trends found between profile type frequency and galaxy mass, morphology and environment, such as the fraction of Type III galaxies increasing with galaxy mass, and the the fraction of Type II galaxies increasing with Hubble type. We investigate the lower incidence of Type II galaxies in galaxy clusters, finding, in a striking similarity to observed galaxies, that almost no S0-like galaxies in clusters have Type II profiles. Similarly, the fraction of Type II profiles for disc-dominated galaxies in clusters is significantly decreased relative to field galaxies. This difference between field and cluster galaxies is driven by star formation quenching. Following the cessation of star formation upon entering a galaxy cluster, the young stellar populations of Type II galaxies simply fade, leaving behind Type I galaxies.


title: A study on the efficacy of model pre-training in developing neural text-to-speech system

abstract: In the development of neural text-to-speech systems, model pre-training with a large amount of non-target speakers' data is a common approach. However, in terms of ultimately achieved system performance for target speaker(s), the actual benefits of model pre-training are uncertain and unstable, depending very much on the quantity and text content of training data. This study aims to understand better why and how model pre-training can positively contribute to TTS system performance. It is postulated that the pre-training process plays a critical role in learning text-related variation in speech, while further training with the target speaker's data aims to capture the speaker-related variation. Different test sets are created with varying degrees of similarity to target speaker data in terms of text content. Experiments show that leveraging a speaker-independent TTS trained on speech data with diverse text content can improve the target speaker TTS on domain-mismatched text. We also attempt to reduce the amount of pre-training data for a new text domain and improve the data and computational efficiency. It is found that the TTS system could achieve comparable performance when the pre-training data is reduced to 1/8 of its original size.


title: ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search

abstract: Currently, an increasing number of model pruning methods are proposed to resolve the contradictions between the computer powers required by the deep learning models and the resource-constrained devices. However, most of the traditional rule-based network pruning methods can not reach a sufficient compression ratio with low accuracy loss and are time-consuming as well as laborious. In this paper, we propose Automatic Block-wise and Channel-wise Network Pruning (ABCP) to jointly search the block-wise and channel-wise pruning action with deep reinforcement learning. A joint sample algorithm is proposed to simultaneously generate the pruning choice of each residual block and the channel pruning ratio of each convolutional layer from the discrete and continuous search space respectively. The best pruning action taking both the accuracy and the complexity of the model into account is obtained finally. Compared with the traditional rule-based pruning method, this pipeline saves human labor and achieves a higher compression ratio with lower accuracy loss. Tested on the mobile robot detection dataset, the pruned YOLOv3 model saves 99.5% FLOPs, reduces 99.5% parameters, and achieves 37.3 times speed up with only 2.8% mAP loss. The results of the transfer task on the sim2real detection dataset also show that our pruned model has much better robustness performance.


title: Sharing quantum steering among multiple Alices and Bobs via a two-qubit Werner state

abstract: Quantum steering, a type of quantum correlation with unique asymmetry, has important applications in asymmetric quantum information tasks. We consider a new quantum steering scenario in which one half of a two-qubit Werner state is sequentially measured by multiple Alices and the other half by multiple Bobs. We find that the maximum number of Alices who can share steering with a single Bob increases from 2 to 5 when the number of measurement settings $N$ increases from 2 to 16. Furthermore, we find a counterintuitive phenomenon that for a fixed $N$, at most 2 Alices can share steering with 2 Bobs, while 4 or more Alices are allowed to share steering with a single Bob. We further analyze the robustness of the steering sharing by calculating the required purity of the initial Werner state, the lower bound of which varies from 0.503(1) to 0.979(5). Finally, we show that our both-sides sequential steering sharing scheme can be applied to control the steering ability, even the steering direction, if an initial asymmetric state or asymmetric measurement is adopted. Our work gives insights into the diversity of steering sharing and can be extended to study the problems such as genuine multipartite quantum steering when the sequential unsharp measurement is applied.


title: Token Pooling in Vision Transformers

abstract: Despite the recent success in many applications, the high computational requirements of vision transformers limit their use in resource-constrained settings. While many existing methods improve the quadratic complexity of attention, in most vision transformers, self-attention is not the major computation bottleneck, e.g., more than 80% of the computation is spent on fully-connected layers. To improve the computational complexity of all layers, we propose a novel token downsampling method, called Token Pooling, efficiently exploiting redundancies in the images and intermediate token representations. We show that, under mild assumptions, softmax-attention acts as a high-dimensional low-pass (smoothing) filter. Thus, its output contains redundancy that can be pruned to achieve a better trade-off between the computational cost and accuracy. Our new technique accurately approximates a set of tokens by minimizing the reconstruction error caused by downsampling. We solve this optimization problem via cost-efficient clustering. We rigorously analyze and compare to prior downsampling methods. Our experiments show that Token Pooling significantly improves the cost-accuracy trade-off over the state-of-the-art downsampling. Token Pooling is a simple and effective operator that can benefit many architectures. Applied to DeiT, it achieves the same ImageNet top-1 accuracy using 42% fewer computations.


title: QTN-VQC: An End-to-End Learning framework for Quantum Neural Networks

abstract: The advent of noisy intermediate-scale quantum (NISQ) computers raises a crucial challenge to design quantum neural networks for fully quantum learning tasks. To bridge the gap, this work proposes an end-to-end learning framework named QTN-VQC, by introducing a trainable quantum tensor network (QTN) for quantum embedding on a variational quantum circuit (VQC). The architecture of QTN is composed of a parametric tensor-train network for feature extraction and a tensor product encoding for quantum embedding. We highlight the QTN for quantum embedding in terms of two perspectives: (1) we theoretically characterize QTN by analyzing its representation power of input features; (2) QTN enables an end-to-end parametric model pipeline, namely QTN-VQC, from the generation of quantum embedding to the output measurement. Our experiments on the MNIST dataset demonstrate the advantages of QTN for quantum embedding over other quantum embedding approaches.


title: Monte Carlo simulation of COVID-19 pandemic using statistical physics-inspired probabilities

abstract: We present a Monte Carlo simulation model of an epidemic spread inspired on physics variables such as temperature, cross section and interaction range, which considers the Plank distribution of photons in the black body radiation to describe the mobility of individuals. The model consists of a lattice of cells that can be in four different states: susceptible, infected, recovered or death. An infected cell can transmit the disease to any other susceptible cell within some random range $R$. The transmission mechanism follows the physics laws for the interaction between a particle and a target. Each infected particle affects the interaction region a number $n$ of times, according to its energy. The number of interactions is proportional to the interaction cross section $\sigma$ and to the target surface density $\rho$. The discrete energy follows a Planck distribution law, which depends on the temperature $T$ of the system. For any interaction, infection, recovery and death probabilities are applied. We investigate the results of viral transmission for different sets of parameters and compare them with available COVID-19 data. The parameters of the model can be made time dependent in order to consider, for instance, the effects of lockdown in the middle of the pandemic.


title: Universal Non-Volatile Resistive Switching Behavior in 2D Metal Dichalcogenides Featuring Unique Conductive-Point Random Access Memory Effect

abstract: Two-dimensional materials have been discovered to exhibit non-volatile resistive switching (NVRS) phenomenon. In our work, we reported the universal NVRS behavior in a dozen metal dichalcogenides, featuring low switching voltage, large on/off ratio, fast switching speed and forming free characteristics. A unique conductive-point random access memory (CPRAM) effect is used to explain the switching mechanisms, supported by experimental results from current-sweep measurements.


title: Boundary-aware Transformers for Skin Lesion Segmentation

abstract: Skin lesion segmentation from dermoscopy images is of great importance for improving the quantitative analysis of skin cancer. However, the automatic segmentation of melanoma is a very challenging task owing to the large variation of melanoma and ambiguous boundaries of lesion areas. While convolutional neutral networks (CNNs) have achieved remarkable progress in this task, most of existing solutions are still incapable of effectively capturing global dependencies to counteract the inductive bias caused by limited receptive fields. Recently, transformers have been proposed as a promising tool for global context modeling by employing a powerful global attention mechanism, but one of their main shortcomings when applied to segmentation tasks is that they cannot effectively extract sufficient local details to tackle ambiguous boundaries. We propose a novel boundary-aware transformer (BAT) to comprehensively address the challenges of automatic skin lesion segmentation. Specifically, we integrate a new boundary-wise attention gate (BAG) into transformers to enable the whole network to not only effectively model global long-range dependencies via transformers but also, simultaneously, capture more local details by making full use of boundary-wise prior knowledge. Particularly, the auxiliary supervision of BAG is capable of assisting transformers to learn position embedding as it provides much spatial information. We conducted extensive experiments to evaluate the proposed BAT and experiments corroborate its effectiveness, consistently outperforming state-of-the-art methods in two famous datasets.


title: Stable Prediction on Graphs with Agnostic Distribution Shift

abstract: Graph is a flexible and effective tool to represent complex structures in practice and graph neural networks (GNNs) have been shown to be effective on various graph tasks with randomly separated training and testing data. In real applications, however, the distribution of training graph might be different from that of the test one (e.g., users' interactions on the user-item training graph and their actual preference on items, i.e., testing environment, are known to have inconsistencies in recommender systems). Moreover, the distribution of test data is always agnostic when GNNs are trained. Hence, we are facing the agnostic distribution shift between training and testing on graph learning, which would lead to unstable inference of traditional GNNs across different test environments. To address this problem, we propose a novel stable prediction framework for GNNs, which permits both locally and globally stable learning and prediction on graphs. In particular, since each node is partially represented by its neighbors in GNNs, we propose to capture the stable properties for each node (locally stable) by re-weighting the information propagation/aggregation processes. For global stability, we propose a stable regularizer that reduces the training losses on heterogeneous environments and thus warping the GNNs to generalize well. We conduct extensive experiments on several graph benchmarks and a noisy industrial recommendation dataset that is collected from 5 consecutive days during a product promotion festival. The results demonstrate that our method outperforms various SOTA GNNs for stable prediction on graphs with agnostic distribution shift, including shift caused by node labels and attributes.


title: Unsupervised Cross-Lingual Transfer of Structured Predictors without Source Data

abstract: Providing technologies to communities or domains where training data is scarce or protected e.g., for privacy reasons, is becoming increasingly important. To that end, we generalise methods for unsupervised transfer from multiple input models for structured prediction. We show that the means of aggregating over the input models is critical, and that multiplying marginal probabilities of substructures to obtain high-probability structures for distant supervision is substantially better than taking the union of such structures over the input models, as done in prior work. Testing on 18 languages, we demonstrate that the method works in a cross-lingual setting, considering both dependency parsing and part-of-speech structured prediction problems. Our analyses show that the proposed method produces less noisy labels for the distant supervision.


title: Spatially separated superconductivity and enhanced charge-density-wave ordering in IrTe2 nano-flake

abstract: The interplay among various collective electronic states such as superconductivity (SC) and charge density wave (CDW) is of tremendous significance in low-dimensional transition metal dichalcogenides. Thus far, a consensus on the relationship between SC and CDW has not been established in IrTe2, where either competing or collaboration pictures have been suggested in the bulk or thick flakes. Here, we use the state-of-art Au-assisted exfoliation method to overcome the obstacle of interlayer Te-Te bonding, cleaving the IrTe2 down to monolayer for the first time. A striking feature revealed by angle-resolved polarized Raman spectroscopy (ARPRS) and electrical transport measurements is the concurrence of phase separation in one single piece of nano-flake, i.e. the superconducting (P-3m1) and CDW (P-3) area. In the pure SC area, the dimensional fluctuations completely suppress the CDW ordering and induce SC at 3.5 K. Meanwhile, the pure CDW area with much enhanced TCDW at 605 K (compared to TCDW = 280 K in bulk) is always accompanied by a unique wrinkle pattern. Detailed analyses suggest the local strain-induced bond breaking of the Te-Te dimer facilitates the emergence of the CDW order. Our works provide compelling evidence of competition between SC and CDW, highlighting the importance of microstructure in determining the ground states of IrTe2.


title: Towards Learning (Dis)-Similarity of Source Code from Program Contrasts

abstract: Understanding the functional (dis)-similarity of source code is significant for code modeling tasks such as software vulnerability and code clone detection. We present DISCO(DIS-similarity of COde), a novel self-supervised model focusing on identifying (dis)similar functionalities of source code. Different from existing works, our approach does not require a huge amount of randomly collected datasets. Rather, we design structure-guided code transformation algorithms to generate synthetic code clones and inject real-world security bugs, augmenting the collected datasets in a targeted way. We propose to pre-train the Transformer model with such automatically generated program contrasts to better identify similar code in the wild and differentiate vulnerable programs from benign ones. To better capture the structural features of source code, we propose a new cloze objective to encode the local tree-based context (e.g., parents or sibling nodes). We pre-train our model with a much smaller dataset, the size of which is only 5% of the state-of-the-art models' training datasets, to illustrate the effectiveness of our data augmentation and the pre-training approach. The evaluation shows that, even with much less data, DISCO can still outperform the state-of-the-art models in vulnerability and code clone detection tasks.


title: Self-supervised Speaker Recognition with Loss-gated Learning

abstract: In self-supervised learning for speaker recognition, pseudo labels are useful as the supervision signals. It is a known fact that a speaker recognition model doesn't always benefit from pseudo labels due to their unreliability. In this work, we observe that a speaker recognition network tends to model the data with reliable labels faster than those with unreliable labels. This motivates us to study a loss-gated learning (LGL) strategy, which extracts the reliable labels through the fitting ability of the neural network during training. With the proposed LGL, our speaker recognition model obtains a $46.3\%$ performance gain over the system without it. Further, the proposed self-supervised speaker recognition with LGL trained on the VoxCeleb2 dataset without any labels achieves an equal error rate of $1.66\%$ on the VoxCeleb1 original test set. Code has been made available at: https://github.com/TaoRuijie/Loss-Gated-Learning.


title: Holomorphic integer graded vertex superalgebras

abstract: In this note we study holomorphic integer graded vertex superalgebras. We prove that all such vertex superalgebras of central charge 8 and 16 are purely even. For the case of central charge 24 we prove that the weight-one Lie superalgebra is either zero, of superdimension 24, or else is one of an explicit list of 1332 semisimple Lie superalgebras.


title: Search for the decay $B^{0}\rightarrow K^{\ast 0}\tau^{+}\tau^{-}$ at the Belle experiment

abstract: This letter presents a search for the rare flavor-changing neutral current process $B^{0}\rightarrow K^{\ast 0}\tau^{+}\tau^{-}$ using data taken with the Belle detector at the KEKB asymmetric energy $e^{+}e^{-}$ collider. The analysis is based on the entire $\Upsilon(4S)$ resonance data sample of 711 $\rm fb^{-1}$, corresponding to $772\times 10^{6} B \bar{B}$ pairs. In our search we fully reconstruct the companion $B$ meson produced in the process $e^{+}e^{-}\rightarrow\Upsilon(4S)\rightarrow B\bar{B}$ from its hadronic decay modes, and look for the decay $B^{0}\rightarrow K^{\ast 0}\tau^{+}\tau^{-}$ in the rest of the event. No evidence for a signal is found. We report an upper limit on the branching fraction $\mathcal{B}({B^{0}\rightarrow K^{\ast 0}\tau^{+}\tau^{-}})<3.1\times 10^{-3}$ at 90\% confidence level. This is the first direct limit on $\mathcal{B}({B^{0}\rightarrow K^{\ast 0}\tau^{+}\tau^{-}})$.


title: The similarity index of mathematical and other scientific publications with equations and formulas and the problem of self-plagiarism identification

abstract: The problems of estimating the similarity index of inhomogeneous scientific publications containing equations and formulas are discussed for the first time. It is shown that the presence of equations and formulas (as well as figures, drawings, and tables) is a complicating factor that significantly complicates the study of such texts. It has been proved that the method for determining the similarity index of publications, based on taking into account individual mathematical symbols and parts of equations and formulas, is ineffective and can lead to erroneous and even completely absurd conclusions. Possibilities of the most popular software systems Antiplagiat and iThenticate, currently used in scientific journals, are investigated for detecting plagiarism and self-plagiarism. The results of processing by the iThenticate system of specific examples and specific test problems containing equations and formulas are presented. It has been established that this software system, when analyzing heterogeneous texts, is often unable to distinguish self-plagiarism from pseudo-self-plagiarism, seeming real (but false and imaginary) self-plagiarism. A model complex situation is considered, in which the identification of self-plagiarism requires the involvement of highly qualified specialists of a narrow profile. Various ways to improve the work of software systems for comparing inhomogeneous texts are proposed. This article will be useful to researchers and university teachers in physics, mathematics, and engineering, programmers dealing with problems in image recognition and research topics of digital image processing, as well as a wide range of readers who are interested in issues of plagiarism and self-plagiarism.


title: Representation of professions in entertainment media: Insights into frequency and sentiment trends through computational text analysis

abstract: Societal ideas and trends dictate media narratives and cinematic depictions which in turn influences people's beliefs and perceptions of the real world. Media portrayal of culture, education, government, religion, and family affect their function and evolution over time as people interpret and perceive these representations and incorporate them into their beliefs and actions. It is important to study media depictions of these social structures so that they do not propagate or reinforce negative stereotypes, or discriminate against any demographic section. In this work, we examine media representation of professions and provide computational insights into their incidence, and sentiment expressed, in entertainment media content. We create a searchable taxonomy of professional groups and titles to facilitate their retrieval from speaker-agnostic text passages like movie and television (TV) show subtitles. We leverage this taxonomy and relevant natural language processing (NLP) models to create a corpus of professional mentions in media content, spanning more than 136,000 IMDb titles over seven decades (1950-2017). We analyze the frequency and sentiment trends of different occupations, study the effect of media attributes like genre, country of production, and title type on these trends, and investigate if the incidence of professions in media subtitles correlate with their real-world employment statistics. We observe increased media mentions of STEM, arts, sports, and entertainment occupations in the analyzed subtitles, and a decreased frequency of manual labor jobs and military occupations. The sentiment expressed toward lawyers, police, and doctors is becoming negative over time, whereas astronauts, musicians, singers, and engineers are mentioned favorably. Professions that employ more people have increased media frequency, supporting our hypothesis that media acts as a mirror to society.


title: Uncertainty quantification in the Bradley-Terry-Luce model

abstract: The Bradley-Terry-Luce (BTL) model is a benchmark model for pairwise comparisons between individuals. Despite recent progress on the first-order asymptotics of several popular procedures, the understanding of uncertainty quantification in the BTL model remains largely incomplete, especially when the underlying comparison graph is sparse. In this paper, we fill this gap by focusing on two estimators that have received much recent attention: the maximum likelihood estimator (MLE) and the spectral estimator. Using a unified proof strategy, we derive sharp and uniform non-asymptotic expansions for both estimators in the sparsest possible regime (up to some poly-logarithmic factors) of the underlying comparison graph. These expansions allow us to obtain: (i) finite-dimensional central limit theorems for both estimators; (ii) construction of confidence intervals for individual ranks; (iii) optimal constant of $\ell_2$ estimation, which is achieved by the MLE but not by the spectral estimator. Our proof is based on a self-consistent equation of the second-order remainder vector and a novel leave-two-out analysis.


title: Dyn-Backdoor: Backdoor Attack on Dynamic Link Prediction

abstract: Dynamic link prediction (DLP) makes graph prediction based on historical information. Since most DLP methods are highly dependent on the training data to achieve satisfying prediction performance, the quality of the training data is crucial. Backdoor attacks induce the DLP methods to make wrong prediction by the malicious training data, i.e., generating a subgraph sequence as the trigger and embedding it to the training data. However, the vulnerability of DLP toward backdoor attacks has not been studied yet. To address the issue, we propose a novel backdoor attack framework on DLP, denoted as Dyn-Backdoor. Specifically, Dyn-Backdoor generates diverse initial-triggers by a generative adversarial network (GAN). Then partial links of the initial-triggers are selected to form a trigger set, according to the gradient information of the attack discriminator in the GAN, so as to reduce the size of triggers and improve the concealment of the attack. Experimental results show that Dyn-Backdoor launches successful backdoor attacks on the state-of-the-art DLP models with success rate more than 90%. Additionally, we conduct a possible defense against Dyn-Backdoor to testify its resistance in defensive settings, highlighting the needs of defenses for backdoor attacks on DLP.


title: Phone-to-audio alignment without text: A Semi-supervised Approach

abstract: The task of phone-to-audio alignment has many applications in speech research. Here we introduce two Wav2Vec2-based models for both text-dependent and text-independent phone-to-audio alignment. The proposed Wav2Vec2-FS, a semi-supervised model, directly learns phone-to-audio alignment through contrastive learning and a forward sum loss, and can be coupled with a pretrained phone recognizer to achieve text-independent alignment. The other model, Wav2Vec2-FC, is a frame classification model trained on forced aligned labels that can both perform forced alignment and text-independent segmentation. Evaluation results suggest that both proposed methods, even when transcriptions are not available, generate highly close results to existing forced alignment tools. Our work presents a neural pipeline of fully automated phone-to-audio alignment. Code and pretrained models are available at https://github.com/lingjzhu/charsiu.


title: Designing the Architecture of a Convolutional Neural Network Automatically for Diabetic Retinopathy Diagnosis

abstract: The prevalence of diabetic retinopathy (DR) has reached 34.6% worldwide and is a major cause of blindness among middle-aged diabetic patients. Regular DR screening using fundus photography helps detect its complications and prevent its progression to advanced levels. As manual screening is time-consuming and subjective, machine learning (ML) and deep learning (DL) have been employed to aid graders. However, the existing CNN-based methods use either pre-trained CNN models or a brute force approach to design new CNN models, which are not customized to the complexity of fundus images. To overcome this issue, we introduce an approach for custom-design of CNN models, whose architectures are adapted to the structural patterns of fundus images and better represent the DR-relevant features. It takes the leverage of k-medoid clustering, principal component analysis (PCA), and inter-class and intra-class variations to automatically determine the depth and width of a CNN model. The designed models are lightweight, adapted to the internal structures of fundus images, and encode the discriminative patterns of DR lesions. The technique is validated on a local dataset from King Saud University Medical City, Saudi Arabia, and two challenging benchmark datasets from Kaggle: EyePACS and APTOS2019. The custom-designed models outperform the famous pre-trained CNN models like ResNet152, Densnet121, and ResNeSt50 with a significant decrease in the number of parameters and compete well with the state-of-the-art CNN-based DR screening methods. The proposed approach is helpful for DR screening under diverse clinical settings and referring the patients who may need further assessment and treatment to expert ophthalmologists.


title: GEO satellites on-orbit repairing mission planning with mission deadline constraint using a large neighborhood search-genetic algorithm

abstract: This paper proposed a novel large neighborhood search-adaptive genetic algorithm (LNS-AGA) for many-to-many on-orbit repairing mission planning of geosynchronous orbit (GEO) satellites with mission deadline constraint. In the many-to-many on-orbit repairing scenario, several servicing spacecrafts and target satellites are located in GEO orbits which have different inclination, RAAN and true anomaly. Each servicing spacecraft need to rendezvous with target satellites to perform repairing missions under limited fuel. The mission objective is to find the optimal servicing sequence and orbit rendezvous time of every servicing spacecraft to minimize total cost of all servicing spacecrafts with all target satellites repaired. Firstly, a time-dependent orbital rendezvous strategy is proposed, which can handle the mission deadline constraint. Besides, it is also cost-effective compared with the existing strategy. Based on this strategy, the many-to-many on-orbit repairing mission planning model can be simplified to an integer programming problem, which is established based on the vehicle routing problem with time windows (VRPTW) model. In order to efficiently find a feasible optimal solution under complicated constraints, a hybrid adaptive genetic algorithm combining the large neighborhood search procedure is designed. The operations of "destroy" and "repair" are used on the elite individuals in each generation of the genetic algorithm to enhance local search capabilities. Finally, the simulations under different scenarios are carried out to verify the effectiveness of the presented algorithm and orbital rendezvous strategy, which performs better than the traditional genetic algorithm.


title: Explaining the Attention Mechanism of End-to-End Speech Recognition Using Decision Trees

abstract: The attention mechanism has largely improved the performance of end-to-end speech recognition systems. However, the underlying behaviours of attention is not yet clearer. In this study, we use decision trees to explain how the attention mechanism impact itself in speech recognition. The results indicate that attention levels are largely impacted by their previous states rather than the encoder and decoder patterns. Additionally, the default attention mechanism seems to put more weights on closer states, but behaves poorly on modelling long-term dependencies of attention states.


title: Joint Scatterer Localization and Material Identification Using Radio Access Technology

abstract: Cellular network technologies and radar sensing technologies have been developing in parallel for decades. Instead of developing two individual technologies, the 6G cellular network is expected to naturally support both communication and radar functionalities with shared hardware and carrier frequencies. In this regard, radio access technology (RAT)-based scatterer localization system is one of the important aspects of joint communication and sensing system (JCAS) that uses communication signals between transceivers to determine the location of scatterers in and around the propagation paths. In this article, we first identify the challenges of RAT-based scatterer localization system, then present single- and multiple-bounce reflection loss (RL) simulation results for three common building materials in indoor environments. We also propose two novel methods to jointly localize and identify the type of the scatterers in a rich scattering environment.


title: An infinite family of antiprimitive cyclic codes supporting Steiner systems $S(3,8, 7^m+1)$

abstract: Coding theory and combinatorial $t$-designs have close connections and interesting interplay. One of the major approaches to the construction of combinatorial t-designs is the employment of error-correcting codes. As we all known, some $t$-designs have been constructed with this approach by using certain linear codes in recent years. However, only a few infinite families of cyclic codes holding an infinite family of $3$-designs are reported in the literature. The objective of this paper is to study an infinite family of cyclic codes and determine their parameters. By the parameters of these codes and their dual, some infinite family of $3$-designs are presented and their parameters are also explicitly determined. In particular, the complements of the supports of the minimum weight codewords in the studied cyclic code form a Steiner system. Furthermore, we show that the infinite family of cyclic codes admit $3$-transitive automorphism groups.


title: ModeRNN: Harnessing Spatiotemporal Mode Collapse in Unsupervised Predictive Learning

abstract: Learning predictive models for unlabeled spatiotemporal data is challenging in part because visual dynamics can be highly entangled in real scenes, making existing approaches prone to overfit partial modes of physical processes while neglecting to reason about others. We name this phenomenon spatiotemporal mode collapse and explore it for the first time in predictive learning. The key is to provide the model with a strong inductive bias to discover the compositional structures of latent modes. To this end, we propose ModeRNN, which introduces a novel method to learn structured hidden representations between recurrent states. The core idea of this framework is to first extract various components of visual dynamics using a set of spatiotemporal slots with independent parameters. Considering that multiple space-time patterns may co-exist in a sequence, we leverage learnable importance weights to adaptively aggregate slot features into a unified hidden representation, which is then used to update the recurrent states. Across the entire dataset, different modes result in different responses on the mixtures of slots, which enhances the ability of ModeRNN to build structured representations and thus prevents the so-called mode collapse. Unlike existing models, ModeRNN is shown to prevent spatiotemporal mode collapse and further benefit from learning mixed visual dynamics.


title: Charge capacity characteristics of a Lithium Nickel-Cobalt-Aluminium Oxide battery show fractional-derivative behavior

abstract: Batteries experience capacity offset where available charge depends on the rate at which this charge is drawn. In this work we analyze the capacity offset of a 4.8 A h lithium nickel-cobalt-aluminium oxide battery using an equivalent circuit model of a fractional capacitor in series with a resistor. In this case, the available charge, in theory, becomes infinite in the limit of infinitesimal rate. We show that the fractional properties of the capacitor can be extracted from the charge against rate plot. We then use a network of RC elements to represent the fractional capacitor in order to simulate the data with Matlab. We find that the fractional exponent alpha obtained in this way, 0.971, agrees with that obtained in a more traditional manner from an impedance versus frequency plot, although the fractional capacity does not. Such an approach demonstrates the importance of a fractional description for capacity offset even when an element is nearly a pure capacitor and is valuable for predictions of state-of-charge when low currents are drawn.


title: SO(10) Grand Unification with Minimal Dark Matter and Color Octet Scalars

abstract: The minimal dark matter (MDM) scenario is a very simple framework of physics beyond the Standard Model (SM) to supplement the SM with a DM candidate. In this paper, we consider an ultraviolet completion of the scenario to an SO(10) grand unified theory, which is a well-motivated framework in light of the neutrino oscillation data. Considering various phenomenological constraints, such as the successful SM gauge coupling unification, the proton stability, and the direct/indirect DM detection constraints as well as the absolute electroweak vacuum stability, we have first singled out the minimal particle content of the MDM scenario at low energies. In addition to the SM particle content, our MDM scenario includes an SU(2)$_L$ quintet scalar DM with a 9.4 TeV mass and three degenerate color-octet scalars with mass of 2 TeV. We then have found a way to embed the minimal particle content into SO(10) representations, in which a remnant $Z_2$ symmetry after the SO(10) symmetry breaking ensures the stability of the DM particle. The production cross section of the color-octet scalars at the Large Hadron Collider is found to be a few orders of magnitude below the current experimental bound.


title: Robust charge-density wave strengthened by electron correlations in monolayer 1T-TaSe2 and 1T-NbSe2

abstract: Combination of low-dimensionality and electron correlation is vital for exotic quantum phenomena such as the Mott-insulating phase and high-temperature superconductivity. Transition-metal dichalcogenide (TMD) 1T-TaS2 has evoked great interest owing to its unique nonmagnetic Mott-insulator nature coupled with a charge-density-wave (CDW). To functionalize such a complex phase, it is essential to enhance the CDW-Mott transition temperature TCDW-Mott, whereas this was difficult for bulk TMDs with TCDW-Mott < 200 K. Here we report a strong-coupling 2D CDW-Mott phase with a transition temperature onset of ~530 K in monolayer 1T-TaSe2. Furthermore, the electron correlation derived lower Hubbard band survives under external perturbations such as carrier doping and photoexcitation, in contrast to the bulk counterpart. The enhanced Mott-Hubbard and CDW gaps for monolayer TaSe2 compared to NbSe2, originating in the lattice distortion assisted by strengthened correlations and disappearance of interlayer hopping, suggest stabilization of a likely nonmagnetic CDW-Mott insulator phase well above the room temperature. The present result lays the foundation for realizing monolayer CDW-Mott insulator based devices operating at room temperature.


title: A conservative implicit-PIC scheme for the hybrid kinetic-ion fluid-electron plasma model on curvilinear meshes

abstract: The hybrid kinetic-ion fluid-electron plasma model is widely used to study challenging multi-scale problems in space and laboratory plasma physics. Here, a novel conservative scheme for this model employing implicit particle-in-cell techniques is extended to arbitrary coordinate systems via curvilinear maps from logical to physical space. The scheme features a fully non-linear electromagnetic formulation with a multi-rate time advance - including sub-cycling and orbit-averaging for the kinetic ions. By careful choice of compatible particle-based kinetic-ion and mesh-based fluid-electron discretizations in curvilinear coordinates, as well as particle-mesh interpolations and implicit midpoint time advance, the scheme is proven to conserve total energy for arbitrary curvilinear meshes. In the electrostatic limit, the method is also proven to conserve total momentum for arbitrary curvilinear meshes. Although momentum is not conserved for arbitrary curvilinear meshes in the electromagnetic case, it is for an important subset of Cartesian tensor-packed meshes. The scheme and its novel conservation properties are demonstrated for several challenging numerical problems using different curvilinear meshes, including a merging flux-rope simulation for a space weather application, and a helical $m=1$ mode simulation for magnetic fusion energy application.


title: Environment Aware Text-to-Speech Synthesis

abstract: This study aims at designing an environment-aware text-to-speech (TTS) system that can generate speech to suit specific acoustic environments. It is also motivated by the desire to leverage massive data of speech audio from heterogeneous sources in TTS system development. The key idea is to model the acoustic environment in speech audio as a factor of data variability and incorporate it as a condition in the process of neural network based speech synthesis. Two embedding extractors are trained with two purposely constructed datasets for characterization and disentanglement of speaker and environment factors in speech. A neural network model is trained to generate speech from extracted speaker and environment embeddings. Objective and subjective evaluation results demonstrate that the proposed TTS system is able to effectively disentangle speaker and environment factors and synthesize speech audio that carries designated speaker characteristics and environment attribute. Audio samples are available online for demonstration https://daxintan-cuhk.github.io/Environment-Aware-TTS/ .


title: M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining

abstract: Recent expeditious developments in deep learning algorithms, distributed training, and even hardware design for large models have enabled training extreme-scale models, say GPT-3 and Switch Transformer possessing hundreds of billions or even trillions of parameters. However, under limited resources, extreme-scale model training that requires enormous amounts of computes and memory footprint suffers from frustratingly low efficiency in model convergence. In this paper, we propose a simple training strategy called "Pseudo-to-Real" for high-memory-footprint-required large models. Pseudo-to-Real is compatible with large models with architecture of sequential layers. We demonstrate a practice of pretraining unprecedented 10-trillion-parameter model, an order of magnitude larger than the state-of-the-art, on solely 512 GPUs within 10 days. Besides demonstrating the application of Pseudo-to-Real, we also provide a technique, Granular CPU offloading, to manage CPU memory for training large model and maintain high GPU utilities. Fast training of extreme-scale models on a decent amount of resources can bring much smaller carbon footprint and contribute to greener AI.


title: A Decision Model for Selecting Patterns and Strategies to Decompose Applications into Microservices

abstract: Microservices Architecture (MSA) style is a promising design approach to develop software applications consisting of multiple small and independently deployable services. Over the past few years, researchers and practitioners have proposed many MSA patterns and strategies covering various aspects of microservices design, such as application decomposition. However, selecting appropriate patterns and strategies can entail various challenges for practitioners. To this end, this study proposes a decision model for selecting patterns and strategies to decompose applications into microservices. We used peer-reviewed and grey literature to collect the patterns, strategies, and quality attributes for creating this decision model.


title: The Southern Hemisphere Narrow-Line Seyfert 1 Infrared Survey

abstract: We present a near-infrared spectroscopic survey of narrow-line Seyfert 1 galaxies in the southern hemisphere (using the SOFI instrument on the ESO-NTT telescope), sampled from optical surveys. We examine the kinematics of the broad-line region, probed by the emission line width of hydrogen (Pa$\alpha$ and H$\beta$). We observed 57 objects, of which we could firmly measure Pa$\alpha$ in 49 cases. We find that a single Lorentzian fit (preferred on theoretical grounds) is preferred over multi-component Gaussian fits to the line profiles; a lack of narrow-line region emission, overwhelmed by the pole-on view of the broad line region (BLR) light, supports this. We recompute the catalog black hole (BH) mass estimates, using the values of FWHM and luminosity of H$\beta$, both from catalog values and re-fitted Lorentzian values. We find a relationship slope greater than unity compared to the catalog values. We ascribe this to contamination by galactic light or difficulties with line flux measurements. However, the comparison of masses computed by the fitted Lorentzian and Gaussian measurements show a slope close to unity. Comparing the BH masses estimated from both Pa$\alpha$ and H$\beta$, the line widths and fluxes shows deviations from expected; in general, however, the computed BH masses are comparable. We posit a scenario where an intermixture of dusty and dust-free clouds (or alternately a structured atmosphere) differentially absorbs the line radiation of the BLR, due to dust absorption and hydrogen bound-free absorption.


title: Does Momentum Change the Implicit Regularization on Separable Data?

abstract: The momentum acceleration technique is widely adopted in many optimization algorithms. However, there is no theoretical answer on how the momentum affects the generalization performance of the optimization algorithms. This paper studies this problem by analyzing the implicit regularization of momentum-based optimization. We prove that on the linear classification problem with separable data and exponential-tailed loss, gradient descent with momentum (GDM) converges to the L2 max-margin solution, which is the same as vanilla gradient descent. That means gradient descent with momentum acceleration still converges to a low-complexity model, which guarantees their generalization. We then analyze the stochastic and adaptive variants of GDM (i.e., SGDM and deterministic Adam) and show they also converge to the L2 max-margin solution. Technically, to overcome the difficulty of the error accumulation in analyzing the momentum, we construct new potential functions to analyze the gap between the model parameter and the max-margin solution. Numerical experiments are conducted and support our theoretical results.


title: Bounding-box deep calibration for high performance face detection

abstract: Modern convolutional neural networks (CNNs)-based face detectors have achieved tremendous strides due to large annotated datasets. However, misaligned results with high detection confidence but low localization accuracy restrict the further improvement of detection performance. In this paper, the authors first predict high confidence detection results on the training set itself. Surprisingly, a considerable part of them exist in the same misalignment problem. Then, the authors carefully examine these cases and point out that annotation misalignment is the main reason. Later, a comprehensive discussion is given for the replacement rationality between predicted and annotated bounding-boxes. Finally, the authors propose a novel Bounding-Box Deep Calibration (BDC) method to reasonably replace misaligned annotations with model predicted bounding-boxes and offer calibrated annotations for the training set. Extensive experiments on multiple detectors and two popular benchmark datasets show the effectiveness of BDC on improving models' precision and recall rate, without adding extra inference time and memory consumption. Our simple and effective method provides a general strategy for improving face detection, especially for light-weight detectors in real-time situations.


title: En route to nanoscopic quantum optical imaging: counting emitters with photon-number-resolving detectors

abstract: Fundamental understanding of biological pathways requires minimally invasive nanoscopic optical resolution imaging. Many approaches to high-resolution imaging rely on localization of single emitters, such as fluorescent molecule or quantum dot. Exact determination of the number of such emitters in an imaging volume is essential for a number of applications; however, in a commonly employed intensity-based microscopy it is not possible to distinguish individual emitters without initial knowledge of system parameters. Here we explore how quantum measurements of the emitted photons using photon number resolving detectors can be used to address this challenging task. In the proposed new approach, the problem of counting emitters reduces to the task of determining differences between the emitted photons and the Poisson limit. We show that quantum measurements of the number of photons emitted from an ensemble of emitters enable the determination of both the number of emitters and the probability of emission. This method can be applied for any type of emitters, including Raman and infrared emitters, which makes it a truly universal way to achieve super-resolution optical imaging. The scaling laws of this new approach are presented by the Cramer-Rao Lower Bounds and define the extent this technique can be used for quantum optical imaging with nanoscopic resolution.


title: Neural Model Reprogramming with Similarity Based Mapping for Low-Resource Spoken Command Recognition

abstract: In this study, we propose a novel adversarial reprogramming (AR) approach for low-resource spoken command recognition (SCR), and build an AR-SCR system. The AR procedure aims to modify the acoustic signals (from the target domain) to repurpose a pretrained SCR model (from the source domain). To solve the label mismatches between source and target domains, and further improve the stability of AR, we propose a novel similarity-based label mapping technique to align classes. In addition, the transfer learning (TL) technique is combined with the original AR process to improve the model adaptation capability. We evaluate the proposed AR-SCR system on three low-resource SCR datasets, including Arabic, Lithuanian, and dysarthric Mandarin speech. Experimental results show that with a pretrained AM trained on a large-scale English dataset, the proposed AR-SCR system outperforms the current state-of-the-art results on Arabic and Lithuanian speech commands datasets, with only a limited amount of training data.


title: ALL-IN-ONE: Multi-Task Learning BERT models for Evaluating Peer Assessments

abstract: Peer assessment has been widely applied across diverse academic fields over the last few decades and has demonstrated its effectiveness. However, the advantages of peer assessment can only be achieved with high-quality peer reviews. Previous studies have found that high-quality review comments usually comprise several features (e.g., contain suggestions, mention problems, use a positive tone). Thus, researchers have attempted to evaluate peer-review comments by detecting different features using various machine learning and deep learning models. However, there is no single study that investigates using a multi-task learning (MTL) model to detect multiple features simultaneously. This paper presents two MTL models for evaluating peer-review comments by leveraging the state-of-the-art pre-trained language representation models BERT and DistilBERT. Our results demonstrate that BERT-based models significantly outperform previous GloVe-based methods by around 6% in F1-score on tasks of detecting a single feature, and MTL further improves performance while reducing model size.


title: Complete crystal field calculation of Zeeman-hyperfine splittings in europium

abstract: Computational crystal-field models have provided consistent models of both electronic and Zeeman-hyperfine structure for several rare earth ions. These techniques have not yet been applied to the Zeeman-hyperfine structure of Eu$^{3+}$ because modeling the structure of the $J=0$ singlet levels in Eu$^{3+}$ requires inclusion of the commonly omitted lattice electric quadrupole and nuclear Zeeman interactions. Here, we include these terms in a computational model to fit the crystal field levels and the Zeeman-hyperfine structure of the $^7F_0$ and $^5D_0$ states in three Eu$^{3+}$ sites: the C$_{4v}$ and C$_{3v}$ sites in CaF$_2$ and the C$_2$ site in EuCl$_3$.6H$_2$O. Close fits are obtained for all three sites which are used to resolve ambiguities in previously published parameters, including quantifying the anomalously large crystal-field-induced state mixing in the C$_{3v}$ site and determining the signs of Zeeman-hyperfine parameters in all three sites. We show that this model allows accurate prediction of properties for Eu$^{3+}$ important for quantum information applications of these ions, such as relative transition strengths. The model could be used to improve crystal field calculations for other non-Kramers singlet states. We also present a spin Hamiltonian formalism without the normal assumption of no $J$ mixing, suitable for other rare earth ion energy levels where this effect is important.


title: Quantisation of Lorentz invariant scalar field theory in non-commutative space-time and its consequence

abstract: Quantisation of Lorentz invariant scalar field theory in Doplicher-Fredenhagen-Roberts (DFR) space-time, a Lorentz invariant, non-commutative space-time is studied. Absence of a unique Lagrangian in non-commutative space-time necessitates us to use an approach to quantisation that is based on the equations of motion alone. Using this we derive the equal time commutation relation between Doplicher-Fredenhagen-Roberts-Amorim (DFRA) scalar field and its conjugate, which has non-commutative dependent modifications, but the corresponding creation and annihilation operators obey usual algebra. We show that imposing the condition that the commutation relation between the field and its conjugate is same as that in the commutative space-time leads to a deformation of the algebra of quantised oscillators. Both these deformed commutation relations derived are valid to all orders in the non-commutative parameter. By analysing the first non-vanishing terms which are $\theta^3$ order, we show that the deformed commutaton relations scale as $1/\lambda^4$, where $\lambda$ is the length scale set by the non-commutativity of the space-time. We also derive the conserved currents for DFRA scalar field. Further, we analyse the effects of non-commutativity on Unruh effect by analysing a detector coupled to the DFRA scalar field, showing that the Unruh temperature is not modified but the thermal radiation seen by the accelerated observer gets correction due to the non-commutativity of space-time.


title: Differentiable Programming of Isometric Tensor Networks

abstract: Differentiable programming is a new programming paradigm which enables large scale optimization through automatic calculation of gradients also known as auto-differentiation. This concept emerges from deep learning, and has also been generalized to tensor network optimizations. Here, we extend the differentiable programming to tensor networks with isometric constraints with applications to multiscale entanglement renormalization ansatz (MERA) and tensor network renormalization (TNR). By introducing several gradient-based optimization methods for the isometric tensor network and comparing with Evenbly-Vidal method, we show that auto-differentiation has a better performance for both stability and accuracy. We numerically tested our methods on 1D critical quantum Ising spin chain and 2D classical Ising model. We calculate the ground state energy for the 1D quantum model and internal energy for the classical model, and scaling dimensions of scaling operators and find they all agree with the theory well.


title: Separation of interface and substrate carrier dynamics at a heterointerface based on coherent optical phonons

abstract: Transient reflectivity spectroscopy is widely used to study ultrafast carrier- and phonon-dynamics in semiconductors. In their heterostructures, it is often not straightforward to distinguish contributions to the signal from the various layers. In this work, we perform transient reflectivity measurements on lattice-matched GaP/Si(001) using a near infrared pulse, to which GaP is transparent. The pump laser pulse can generate coherent longitudinal optical (LO) phonons both in the GaP overlayer as well as in the Si substrate which have distinct frequencies. This enables us to track the amplitude of the respective signal contributions as a function of GaP layer thickness $d$. The Si phonon amplitude in the signal exhibits an oscillatory behavior with increasing $d$. This can be quantitatively explained by the interference of the probe light reflected at the air/GaP/Si heterointerface. Based on this knowledge, we can then separate the interface- and the substrate-contributions in the carrier-induced non-oscillatory transient reflectivity signal. The obtained interface signal provides evidence for ultrafast carrier injection from the Si substrate into the GaP overlayer. This is also corroborated by examining the deviation of the polarization-dependence of the GaP coherent optical phonon signal from that of the bulk semiconductor.


title: Neural Strokes: Stylized Line Drawing of 3D Shapes

abstract: This paper introduces a model for producing stylized line drawings from 3D shapes. The model takes a 3D shape and a viewpoint as input, and outputs a drawing with textured strokes, with variations in stroke thickness, deformation, and color learned from an artist's style. The model is fully differentiable. We train its parameters from a single training drawing of another 3D shape. We show that, in contrast to previous image-based methods, the use of a geometric representation of 3D shape and 2D strokes allows the model to transfer important aspects of shape and texture style while preserving contours. Our method outputs the resulting drawing in a vector representation, enabling richer downstream analysis or editing in interactive applications.


title: Characterizing and Demystifying the Implicit Convolution Algorithm on Commercial Matrix-Multiplication Accelerators

abstract: Many of today's deep neural network accelerators, e.g., Google's TPU and NVIDIA's tensor core, are built around accelerating the general matrix multiplication (i.e., GEMM). However, supporting convolution on GEMM-based accelerators is not trivial. The naive method explicitly lowers the convolution to GEMM, commonly known as im2col, which introduces significant performance and memory overhead. Existing implicit im2col algorithms require unscalable hardware and are inefficient in supporting important convolution variants such as strided convolution. In this paper, we propose a memory-efficient and hardware-friendly implicit im2col algorithm used by Google's TPU, which dynamically converts a convolution into a GEMM with practically zero performance and memory overhead, fully unleashing the power of GEMM engines. Through comprehensive experimental results, we quantitatively argue that this algorithm has been adopted in commercial closed-source platforms, and we are the first to describe its high-level idea and implementation details. Finally, we show that our algorithm can also be generally applied to Nvidia's Tensor Cores (TC), matching and out-performing the measured performance on TCs.


title: Multi-trends Enhanced Dynamic Micro-video Recommendation

abstract: The explosively generated micro-videos on content sharing platforms call for recommender systems to permit personalized micro-video discovery with ease. Recent advances in micro-video recommendation have achieved remarkable performance in mining users' current preference based on historical behaviors. However, most of them neglect the dynamic and time-evolving nature of users' preference, and the prediction on future micro-videos with historically mined preference may deteriorate the effectiveness of recommender systems. In this paper, we propose the DMR framework to explicitly model dynamic multi-trends of users' current preference and make predictions based on both the history and future potential trends. We devise the DMR framework, which comprises: 1) the implicit user network module which identifies sequence fragments from other users with similar interests and extracts the sequence fragments that are chronologically behind the identified fragments; 2) the multi-trend routing module which assigns each extracted sequence fragment into a trend group and update the corresponding trend vector; 3) the history-future trend prediction module jointly uses the history preference vectors and future trend vectors to yield the final click-through-rate. We validate the effectiveness of DMR over multiple state-of-the-art micro-video recommenders on two publicly available real-world datasets. Relatively extensive analysis further demonstrate the superiority of modeling dynamic multi-trend for micro-video recommendation.


title: Kinematically consistent recurrent neural networks for learning inverse problems in wave propagation

abstract: Although machine learning (ML) is increasingly employed recently for mechanistic problems, the black-box nature of conventional ML architectures lacks the physical knowledge to infer unforeseen input conditions. This implies both severe overfitting during a dearth of training data and inadequate physical interpretability, which motivates us to propose a new kinematically consistent, physics-based ML model. In particular, we attempt to perform physically interpretable learning of inverse problems in wave propagation without suffering overfitting restrictions. Towards this goal, we employ long short-term memory (LSTM) networks endowed with a physical, hyperparameter-driven regularizer, performing penalty-based enforcement of the characteristic geometries. Since these characteristics are the kinematical invariances of wave propagation phenomena, maintaining their structure provides kinematical consistency to the network. Even with modest training data, the kinematically consistent network can reduce the $L_1$ and $L_\infty$ error norms of the plain LSTM predictions by about 45% and 55%, respectively. It can also increase the horizon of the plain LSTM's forecasting by almost two times. To achieve this, an optimal range of the physical hyperparameter, analogous to an artificial bulk modulus, has been established through numerical experiments. The efficacy of the proposed method in alleviating overfitting, and the physical interpretability of the learning mechanism, are also discussed. Such an application of kinematically consistent LSTM networks for wave propagation learning is presented here for the first time.


title: E-learning model for art education: Case study in Iran

abstract: According to the characteristics of art, art education according to Bloom's classification, should take place at high and close to the level of creativity. E-learning related to the subject of art is different from ordinary E-learning. In this paper, a general circular model for E-learning for art education is presented, a case study which has been done in Iran among students and artists. Art in the general sense, in addition to the same and Comprehensive features, has characteristics specific to different countries and cultures, and consequently there are differences in art education.


title: COVID-19 Monitoring System using Social Distancing and Face Mask Detection on Surveillance video datasets

abstract: In the current times, the fear and danger of COVID-19 virus still stands large. Manual monitoring of social distancing norms is impractical with a large population moving about and with insufficient task force and resources to administer them. There is a need for a lightweight, robust and 24X7 video-monitoring system that automates this process. This paper proposes a comprehensive and effective solution to perform person detection, social distancing violation detection, face detection and face mask classification using object detection, clustering and Convolution Neural Network (CNN) based binary classifier. For this, YOLOv3, Density-based spatial clustering of applications with noise (DBSCAN), Dual Shot Face Detector (DSFD) and MobileNetV2 based binary classifier have been employed on surveillance video datasets. This paper also provides a comparative study of different face detection and face mask classification models. Finally, a video dataset labelling method is proposed along with the labelled video dataset to compensate for the lack of dataset in the community and is used for evaluation of the system. The system performance is evaluated in terms of accuracy, F1 score as well as the prediction time, which has to be low for practical applicability. The system performs with an accuracy of 91.2% and F1 score of 90.79% on the labelled video dataset and has an average prediction time of 7.12 seconds for 78 frames of a video.


title: Nash Convergence of Mean-Based Learning Algorithms in First Price Auctions

abstract: Understanding the convergence properties of learning dynamics in repeated auctions is a timely and important question in the area of learning in auctions, with numerous applications in, e.g., online advertising markets. This work focuses on repeated first price auctions where bidders with fixed values for the item learn to bid using mean-based algorithms -- a large class of online learning algorithms that include popular no-regret algorithms such as Multiplicative Weights Update and Follow the Perturbed Leader. We completely characterize the learning dynamics of mean-based algorithms, in terms of convergence to a Nash equilibrium of the auction, in two senses: (1) time-average: the fraction of rounds where bidders play a Nash equilibrium approaches 1 in the limit; (2)last-iterate: the mixed strategy profile of bidders approaches a Nash equilibrium in the limit. Specifically, the results depend on the number of bidders with the highest value: - If the number is at least three, the bidding dynamics almost surely converges to a Nash equilibrium of the auction, both in time-average and in last-iterate. - If the number is two, the bidding dynamics almost surely converges to a Nash equilibrium in time-average but not necessarily in last-iterate. - If the number is one, the bidding dynamics may not converge to a Nash equilibrium in time-average nor in last-iterate. Our discovery opens up new possibilities in the study of convergence dynamics of learning algorithms.


title: The Shape of Phylogenies Under Phase-Type Distributed Times to Speciation and Extinction

abstract: Phylogenetic trees are widely used to understand the evolutionary history of organisms. Tree shapes provide information about macroevolutionary processes. However, macroevolutionary models are unreliable for inferring the true processes underlying empirical trees. Here, we propose a flexible and biologically plausible macroevolutionary model for phylogenetic trees where times to speciation or extinction events are drawn from a Coxian phase-type (PH) distribution. First, we show that different choices of parameters in our model lead to a range of tree balances as measured by Aldous' $\beta$ statistic. In particular, we demonstrate that it is possible to find parameters that correspond well to empirical tree balance. Next, we provide a natural extension of the $\beta$ statistic to sets of trees. This extension produces less biased estimates of $\beta$ compared to using the median $\beta$ values from individual trees. Furthermore, we derive a likelihood expression for the probability of observing any tree with branch lengths under a model with speciation but no extinction. Finally, we illustrate the application of our model by performing both absolute and relative goodness-of-fit tests for two large empirical phylogenies (squamates and angiosperms) that compare models with Coxian PH distributed times to speciation with models that assume exponential or Weibull distributed waiting times. In our numerical analysis, we found that, in most cases, models assuming a Coxian PH distribution provided the best fit.


title: Yukawa Alignment Revisited in the Higgs Basis

abstract: We implement a comprehensive and detailed study of the alignment of Yukawa couplings in the so-called Higgs basis taking the framework of general two Higgs doublet models (2HDMs). We clarify the model input parameters and derive the Yukawa couplings considering the two types of CP-violating sources: one from the Higgs potential and the other from the three complex alignment parameters $\zeta_{f=u,d,e}$. We consider the theoretical constraints from the perturbative unitarity and for the Higgs potential to be bounded from below as well as the experimental ones from electroweak precision observables. Also considered are the constraints on the alignment parameters from flavor-changing $\tau$ decays, $Z\to b\bar b$, $\epsilon_K$, and the radiative $b\to s\gamma$ decay. By introducing the basis-independent Yukawa delay factor $\Delta_{H_1\bar f f}\equiv |\zeta_{f}|(1-g_{_{H_1VV}}^2)^{1/2}$, we scrutinize the alignment of the Yukawa couplings of the lightest Higgs boson to the SM fermions.


title: Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning

abstract: In few-shot learning scenarios, the challenge is to generalize and perform well on new unseen examples when only very few labeled examples are available for each task. Model-agnostic meta-learning (MAML) has gained the popularity as one of the representative few-shot learning methods for its flexibility and applicability to diverse problems. However, MAML and its variants often resort to a simple loss function without any auxiliary loss function or regularization terms that can help achieve better generalization. The problem lies in that each application and task may require different auxiliary loss function, especially when tasks are diverse and distinct. Instead of attempting to hand-design an auxiliary loss function for each application and task, we introduce a new meta-learning framework with a loss function that adapts to each task. Our proposed framework, named Meta-Learning with Task-Adaptive Loss Function (MeTAL), demonstrates the effectiveness and the flexibility across various domains, such as few-shot classification and few-shot regression.


title: Inertial Modified S-Iteration Process for Split Monotone Inclusion and Fixed Point Problem In Real Hilbert Space

abstract: In this article we present a modified S-iteration process that we combine with inertial extrapolation to find a common solution to the split monotone inclusion problem and the fixed point problem in real Hilbert space.Our goal is to establish a strong convergence theorem for approximating a common solution.Under some mild conditions,the problem can be solved. We also provide a numerical example to show that our algorithms acceleration works well.


title: Nonlinear sequential fractional boundary value problems involving generalized $\psi$-Caputo fractional derivatives

abstract: This paper is devoted to study the nonlinear sequential fractional boundary value problems involving generalized $\psi$-Caputo fractional derivatives with nonlocal boundary conditions. We investigate the Green function and some of its properties, from which we obtain a new Lyapunov-type inequality for our problem. A lower bound for the possible eigenvalues of our problem is derived. Furthermore, we apply some properties of the Green function to obtain some existence results for our problem. It is worth mentioning that our results still work with some source functions including singularities.


title: Stereo Dense Scene Reconstruction and Accurate Localization for Learning-Based Navigation of Laparoscope in Minimally Invasive Surgery

abstract: Objective: The computation of anatomical information and laparoscope position is a fundamental block of surgical navigation in Minimally Invasive Surgery (MIS). Recovering a dense 3D structure of surgical scene using visual cues remains a challenge, and the online laparoscopic tracking primarily relies on external sensors, which increases system complexity. Methods: Here, we propose a learning-driven framework, in which an image-guided laparoscopic localization with 3D reconstructions of complex anatomical structures is obtained. To reconstruct the 3D structure of the whole surgical environment, we first fine-tune a learning-based stereoscopic depth perception method, which is robust to the texture-less and variant soft tissues, for depth estimation. Then, we develop a dense visual reconstruction algorithm to represent the scene by surfels, estimate the laparoscope poses and fuse the depth maps into a unified reference coordinate for tissue reconstruction. To estimate poses of new laparoscope views, we achieve a coarse-to-fine localization method, which incorporates our reconstructed 3D model. Results: We evaluate the reconstruction method and the localization module on three datasets, namely, the stereo correspondence and reconstruction of endoscopic data (SCARED), the ex-vivo phantom and tissue data collected with Universal Robot (UR) and Karl Storz Laparoscope, and the in-vivo DaVinci robotic surgery dataset, where the reconstructed 3D structures have rich details of surface texture with an accuracy error under 1.71 mm and the localization module can accurately track the laparoscope with only images as input. Conclusions: Experimental results demonstrate the superior performance of the proposed method in 3D anatomy reconstruction and laparoscopic localization. Significance: The proposed framework can be potentially extended to the current surgical navigation system.


title: Entanglement Spectroscopy and probing the Li-Haldane Conjecture in Topological Quantum Matter

abstract: Topological phases are characterized by their entanglement properties, which is manifest in a direct relation between entanglement spectra and edge states discovered by Li and Haldane. We propose to leverage the power of synthetic quantum systems for measuring entanglement via the Entanglement Hamiltonian to probe this relationship experimentally. This is made possible by exploiting the quasi-local structure of Entanglement Hamiltonians. The feasibility of this proposal is illustrated for two paradigmatic examples realizable with current technology, an integer quantum Hall state of non-interacting fermions on a 2D lattice and a symmetry protected topological state of interacting fermions on a 1D chain. Our results pave the road towards an experimental identification of topological order in strongly correlated quantum many-body systems.


title: Scalar Triplet Flavor Leptogenesis with Dark Matter

abstract: We investigate a simple variant of type-II seesaw, responsible for neutrino mass generation, where the particle spectrum is extended with one singlet right-handed neutrino and an inert Higgs doublet, both odd under an additional $Z_2$ symmetry. While the role of the dark matter is played by the lightest neutral component of the inert Higgs doublet, its interaction with the Standard Model lepton doublets and the right-handed neutrino turns out to be crucial in generating the correct baryon abundance of the Universe through flavored leptogenesis from the decay of the $SU(2)_L$ scalar triplet, involved in type-II framework.


title: Optimal QoS-Aware Network Slicing for Service-Oriented Networks with Flexible Routing

abstract: In this paper, we consider the network slicing problem which attempts to map multiple customized virtual network requests (also called services) to a common shared network infrastructure and allocate network resources to meet diverse quality of service (QoS) requirements. We first propose a mixed integer nonlinear program (MINLP) formulation for this problem that optimizes the network resource consumption while jointly considers QoS requirements, flow routing, and resource budget constraints. In particular, the proposed formulation is able to flexibly route the traffic flow of the services on multiple paths and provide end-to-end (E2E) delay and reliability guarantees for all services. Due to the intrinsic nonlinearity, the MINLP formulation is computationally difficult to solve. To overcome this difficulty, we then propose a mixed integer linear program (MILP) formulation and show that the two formulations and their continuous relaxations are equivalent. Different from the continuous relaxation of the MINLP formulation which is a nonconvex nonlinear programming problem, the continuous relaxation of the MILP formulation is a polynomial time solvable linear programming problem, which makes the MILP formulation much more computationally solvable. Numerical results demonstrate the effectiveness and efficiency of the proposed formulations over existing ones.


title: Optical Flow Estimation for Spiking Camera

abstract: As a bio-inspired sensor with high temporal resolution, the spiking camera has an enormous potential in real applications, especially for motion estimation in high-speed scenes. However, frame-based and event-based methods are not well suited to spike streams from the spiking camera due to the different data modalities. To this end, we present, SCFlow, a tailored deep learning pipeline to estimate optical flow in high-speed scenes from spike streams. Importantly, a novel input representation is introduced which can adaptively remove the motion blur in spike streams according to the prior motion. Further, for training SCFlow, we synthesize two sets of optical flow data for the spiking camera, SPIkingly Flying Things and Photo-realistic High-speed Motion, denoted as SPIFT and PHM respectively, corresponding to random high-speed and well-designed scenes. Experimental results show that the SCFlow can predict optical flow from spike streams in different high-speed scenes. Moreover, SCFlow shows promising generalization on \textbf{real spike streams}. Codes and datasets refer to https://github.com/Acnext/Optical-Flow-For-Spiking-Camera.


title: On behavior of conductors, Picard schemes, and Jacobian numbers of varieties over imperfect fields

abstract: Let $X$ be a regular geometrically integral variety over an imperfect field $K$. Unlike the case of characteristic $0$, $X':=X\times_{\mathrm{Spec}\,K}\mathrm{Spec}\,K'$ may have singular points for a (necessarily inseparable) field extension $K'/K$. In this paper, we define new invariants of the local rings of codimension $1$ points of $X'$, and use these invariants for the calculation of $\delta$-invariants (, which relate to genus changes,) and conductors of such points. As a corollary, we give refinements of Tate's genus change theorem and the Patakfalvi-Waldron Theorem. Moreover, when $X$ is a curve, we show that the Jacobian number of $X$ is $2p/(p-1)$ times of the genus change by using the above calculation. In this case, we also relate the structure of the Picard scheme of $X$ with invariants of singular points of $X$. To prove such a relation, we give a characterization of the geometrical normality of algebras over fields of positive characteristic.


title: Relationship between low-discrepancy sequence and static solution to multi-bodies problem

abstract: The main interest of this paper is to study the relationship between the low-discrepancy sequence and the static solution to the multi-bodies problem in high-dimensional space. An assumption that the static solution to the multi-bodies problem is a low-discrepancy sequence is proposed. Considering the static solution to the multi-bodies problem corresponds to the minimum potential energy principle, we further assume that the distribution of the bodies is the most uniform when the potential energy is the smallest. To verify the proposed assumptions, a dynamical evolutionary model (DEM) based on the minimum potential energy is established to find out the static solution. The central difference algorithm is adopted to solve the DEM and an evolutionary iterative scheme is developed. The selection of the mass and the damping coefficient to ensure the convergence of the evolutionary iteration is discussed in detail. Based on the DEM, the relationship between the potential energy and the discrepancy during the evolutionary iteration process is studied. It is found that there is a significant positive correlation between them, which confirms the proposed assumptions. We also combine the DEM with the restarting technique to generate a series of low-discrepancy sequences. These sequences are unbiased and perform better than other low-discrepancy sequences in terms of the discrepancy, the potential energy, integrating eight test functions and computing the statistical moments for two practical stochastic problems. Numerical examples also show that the DEM can not only generate uniformly distributed sequences in cubes, but also in non-cubes.


title: Analysis of trilinear Higgs self coupling in Two Higgs Doublet model at lepton collider

abstract: In this study, computational analysis of neutral Higgs bosons $h$, $H$ and $A$ is carried out within the parameter space of Two Higgs Doublet Model (2HDM) type-I in exact alignment limit of $\sin{(\beta - \alpha)} = 1$ at compact linear collider. Assuming Compact Linear Collider (CLIC) scenario where the electron-positron beams will be collided at $\sqrt{s}$ = 1.5 TeV. Two different values of predicted integrated luminosities are used in our calculations, 1000 $fb^{-1}$ and 2500 $fb^{-1}$. Three signal processes $e^+ e^- \rightarrow Zhh \rightarrow jjb\bar{b}b\bar{b}$, $e^+ e^- \rightarrow ZHH \rightarrow jjb\bar{b}b\bar{b}$ and $e^+ e^- \rightarrow Zhh \rightarrow jjb\bar{b}b\bar{b}$ are selected for analysis. The polarized colliding beams are used to enhance the signal production cross-section. Low $\tan{\beta}$ and equal Higgs masses regime is chosen in favor of Hadronic decay of $Z$ boson and $H \rightarrow b\bar{b}$. Different signal scenarios are selected and event generation is performed for each process separately. The $W$ and $Z$ boson, as well as top quark backgrounds are analyzed. Signal significance is computed at each Higgs mass hypothesis for three signal processes. After a comprehensive study, we did not find sizeable amount of signal events on top of the background but still, signal significance is found to be larger than 1, without taking into account the detector effects and systematics. The maximum calculated value of signal significance is observed to lie in the range of 150 $\leq$ $m_H$ $\leq$ 250 GeV for $Zhh$ while for $ZHH$ the range is 175 $\leq$ $m_H$ $\leq$ 200 GeV at 1000 $fb^{-1}$ and 175 $\leq$ $m_H$ $\leq$ 225 GeV region at 2500 $fb^{-1}$. Similarly, for $ZAA$ process, the significance is highest at $m_A$ = 175 GeV for both 1000 and 2500 $fb^{-1}$.