title: How Hateful are Movies? A Study and Prediction on Movie Subtitles

abstract: In this research, we investigate techniques to detect hate speech in movies. We introduce a new dataset collected from the subtitles of six movies, where each utterance is annotated either as hate, offensive or normal. We apply transfer learning techniques of domain adaptation and fine-tuning on existing social media datasets, namely from Twitter and Fox News. We evaluate different representations, i.e., Bag of Words (BoW), Bi-directional Long short-term memory (Bi-LSTM), and Bidirectional Encoder Representations from Transformers (BERT) on 11k movie subtitles. The BERT model obtained the best macro-averaged F1-score of 77%. Hence, we show that transfer learning from the social media domain is efficacious in classifying hate and offensive speech in movies through subtitles.


title: Relative binary and ternary 4D velocities in the Special Relativity in terms of manifestly covariant Lorentz transformation

abstract: Zbigniew Oziewicz was a pioneer of the 4D space-time approach to covariant relative velocities. In the 1980s (according to private correspondence) he discovered two types of 4D relative velocities: binary and ternary, along with the rules for adding them. They were first published in conference materials in 2004, and the second time in a peer-reviewed journal in 2007. These physically logical and mathematically precise concepts are so subtle that Oziewicz's numerous preprints have yet to receive the recognition they deserve. This work was planned to be a more review, but a thorough review of the little-known results was made in an original synthetic manner with numerous generalizations. The Part I presents the Oziewicz-\'Swierk-Bol\'os (and Matolsci or Bini-Carini-Jantzen) binary relative velocity and the Oziewicz-Ungar-Dragan (also Celakoska-Chakmakov-Petrushevski on the basis of Urbantke, as well as Wyk) ternary relative velocity. The Einstein-Oziewicz and Einstein-Minkowski velocities, which are a four-dimensional generalization of Einstein velocities addition, also have a ternary character. This also applies to Oziewicz-Minkowski relative velocity, which is a time-like equivalent (generalization) of the canonical ternary velocity. It turns out that the Lorentz transformation of velocity itself is already ternary anchored. This fact is explicitly revealed by the manifestly covariant Lorentz transformation of velocity, which is the main tool of the work.


title: Review and concrete description of the irreducible unitary representations of the universal cover of the complexified Poincar\'e group

abstract: We give a pedagogical presentation of the irreducible unitary representations of $\mathbb{C}^4\rtimes\mathbf{Spin}(4,\mathbb{C})$, that is, of the universal cover of the complexified Poincar\'e group $\mathbb{C}^4\rtimes\mathbf{SO}(4,\mathbb{C})$. These representations were first investigated by Roffman in 1967. We provide a modern formulation of his results together with some facts from the general Wigner-Mackey theory which are relevant in this context. Moreover, we discuss different ways to realize these representations and, in the case of a non-zero "complex mass", we give a detailed construction of a more explicit realization. This explicit realization parallels and extends the one used in the classical Wigner case of $\mathbb{R}^4\rtimes\mathbf{Spin}^0(1,3)$. Our analysis is motivated by the interest in the Euclidean formulation of Fermionic theories.


title: Gravitational Waves from the Cosmological Quark-Hadron Phase Transition Revisited

abstract: The recent claim by the NANOGrav collaboration of a possible detection of an isotropic gravitational wave background stimulated a series of investigations searching for the origin of such a signal. The QCD phase transition appears as a natural candidate and in this paper the gravitational spectrum generated during the conversion of quarks into hadrons is calculated. Here, contrary to recent studies, equations of state for the quark-gluon plasma issued from the lattice approach were adopted. The duration of the transition, an important parameter affecting the amplitude of the gravitational wave spectrum, was estimated self-consistently with the dynamics of the universe controlled by the Einstein equations. The gravitational signal generated during the transition peaks around 0,28 \mu Hz, being unable to explain the claimed NANOGrav signal. However, the expected QCD gravitational wave background could be detected by the planned spatial interferometer Big Bang Observer in its advanced version for frequencies above 1.0 mHz. This possible detection assumes that algorithms recently proposed will be able to disentangle the cosmological signal from that expected for the astrophysical background generated by black hole binaries.


title: What is an Algorithm?: a Modern View

abstract: Although algorithm is one of the central subjects, there have been little common understandings of what an algorithm is. For example, Gurevich view algorithms as abstract state machines, while others view algorithms as recursors. We promote a third view: it is a combination to these two disparate views. This approach -- based on computability logic -- describes an algorithm as $A(I,O)$ where $I$ is a set of input services and $O$ an output service. It leads to the following modern definition: {\it An algorithm $A$ is a (tree of) sequence of legal moves for providing $O$ using $I$. } In the above, $A$ is written in an imperative language/abstract state machine and $I,O$ are written in recursors/logical specifications.


title: The Polstar High Resolution Spectropolarimetry MIDEX Mission

abstract: The Polstar mission will provide for a space-borne 60cm telescope operating at UV wavelengths with spectropolarimetric capability capturing all four Stokes parameters (intensity, two linear polarization components, and circular polarization). Polstar's capabilities are designed to meet its goal of determining how circumstellar gas flows alter massive stars' evolution, and finding the consequences for the stellar remnant population and the stirring and enrichment of the interstellar medium, by addressing four key science objectives. In addition, Polstar will determine drivers for the alignment of the smallest interstellar grains, and probe the dust, magnetic fields, and environments in the hot diffuse interstellar medium, including for the first time a direct measurement of the polarized and energized properties of intergalactic dust. Polstar will also characterize processes that lead to the assembly of exoplanetary systems and that affect exoplanetary atmospheres and habitability. Science driven design requirements include: access to ultraviolet bands: where hot massive stars are brightest and circumstellar opacity is highest; high spectral resolution: accessing diagnostics of circumstellar gas flows and stellar composition in the far-UV at 122-200nm, including the NV, SiIV, and CIV resonance doublets and other transitions such as NIV, AlIII, HeII, and CIII; polarimetry: accessing diagnostics of circumstellar magnetic field shape and strength when combined with high FUV spectral resolution and diagnostics of stellar rotation and distribution of circumstellar gas when combined with low near-UV spectral resolution; sufficient signal-to-noise ratios: ~1000 for spectropolarimetric precisions of 0.1% per exposure; ~100 for detailed spectroscopic studies; ~10 for exploring dimmer sources; and cadence: ranging from 1-10 minutes for most wind variability studies.


title: Additional Baryons and Mesons

abstract: In a particle theory model whose most readily discovered new particle is the $\sim 1$TeV bilepton resonance in same-sign leptons, currently being sought at CERN's LHC, there exist three quarks ${\cal D, S, T}$ which will be bound by QCD into baryons and mesons. We consider the decays of these additional baryons and mesons whose detailed experimental study will be beyond the reach of the 14 TeV CERN collider and accessible only at an O(100 TeV) collider.


title: $F$-factors in Quasi-random Hypergraphs

abstract: Given $k\ge 2$ and two $k$-graphs ($k$-uniform hypergraphs) $F$ and $H$, an $F$-factor in $H$ is a set of vertex-disjoint copies of $F$ that together covers the vertex set of $H$. Lenz and Mubayi [J. Combin. Theory Ser. B, 2016] studied the $F$-factor problem in quasi-random $k$-graphs with minimum degree $\Omega(n^{k-1})$. They posed the problem of characterizing the $k$-graphs $F$ such that every sufficiently large quasi-random $k$-graph with constant edge density and minimum degree $\Omega(n^{k-1})$ contains an $F$-factor, and in particular, they showed that all linear $k$-graphs satisfy this property. In this paper we prove a general theorem on $F$-factors which reduces the $F$-factor problem of Lenz and Mubayi to a natural sub-problem, that is, the $F$-cover problem. By using this result, we answer the question of Lenz and Mubayi for those $F$ which are $k$-partite $k$-graphs, and for all 3-graphs $F$, separately. Our characterization result on 3-graphs is motivated by the recent work of Reiher, R\"odl and Schacht [J. Lond. Math. Soc., 2018] that classifies the 3-graphs with vanishing Tur\'an density in quasi-random $k$-graphs.


title: Search for enhanced magnetism at the interface between Bi$_2$Se$_3$ and EuSe

abstract: Enhanced magnetism has recently been reported for the topological-insulator/ferromagnet interface Bi$_2$Se$_3$/EuS with Curie temperatures claimed to be raised above room temperature from the bulk EuS value of 16 K. Here we investigate the analogous interface Bi$_2$Se$_3$/EuSe. EuSe is a low-temperature layered ferrimagnet that is particularly sensitive to external perturbations. We find that superconducting quantum interference device (SQUID) magnetometry of Bi$_2$Se$_3$/EuSe heterostructures reveals precisely the magnetic phase diagram known from EuSe, including the ferrimagnetic phase below 5 K, without any apparent changes from the bulk behavior. Choosing a temperature of 10 K to search for magnetic enhancement, we determine an upper limit for a possible magnetic coercive field of 3 mT. Using interface sensitive x-ray absorption spectroscopy we verify the magnetic divalent configuration of the Eu at the interface without contamination by Eu3+, and by x-ray magnetic circular dichroism (XMCD) we confirm at the interface the magnetic hysteresis obtained by SQUID. XMCD data obtained at 10 K in a magnetic field of 6 T indicate a magnetic spin moment of mz,spin = 7 $\mu$B/Eu$^{2+}$, in good agreement with the SQUID data and the expected theoretical moment of Eu2+. Subsequent XMCD measurements in zero field show, however, that sizable remanent magnetization is absent at the interface for temperatures down to about 10 K.


title: Graph Neural Networks: Methods, Applications, and Opportunities

abstract: In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks with state-of-the-art performance. The data is generally represented in the Euclidean space in these domains. Various other domains conform to non-Euclidean space, for which graph is an ideal representation. Graphs are suitable for representing the dependencies and interrelationships between various entities. Traditionally, handcrafted features for graphs are incapable of providing the necessary inference for various tasks from this complex data representation. Recently, there is an emergence of employing various advances in deep learning to graph data-based tasks. This article provides a comprehensive survey of graph neural networks (GNNs) in each learning setting: supervised, unsupervised, semi-supervised, and self-supervised learning. Taxonomy of each graph based learning setting is provided with logical divisions of methods falling in the given learning setting. The approaches for each learning task are analyzed from both theoretical as well as empirical standpoints. Further, we provide general architecture guidelines for building GNNs. Various applications and benchmark datasets are also provided, along with open challenges still plaguing the general applicability of GNNs.


title: Principle-driven Fiber Transmission Model based on PINN Neural Network

abstract: In this paper, a novel principle-driven fiber transmission model based on physical induced neural network (PINN) is proposed. Unlike data-driven models which regard fiber transmission problem as data regression tasks, this model views it as an equation solving problem. Instead of adopting input signals and output signals which are calculated by SSFM algorithm in advance before training, this principle-driven PINN based fiber model adopts frames of time and distance as its inputs and the corresponding real and imaginary parts of NLSE solutions as its outputs. By taking into account of pulses and signals before transmission as initial conditions and fiber physical principles as NLSE in the design of loss functions, this model will progressively learn the transmission rules. Therefore, it can be effectively trained without the data labels, referred as the pre-calculated signals after transmission in data-driven models. Due to this advantage, SSFM algorithm is no longer needed before the training of principle-driven fiber model which can save considerable time consumption. Through numerical demonstration, the results show that this principle-driven PINN based fiber model can handle the prediction tasks of pulse evolution, signal transmission and fiber birefringence for different transmission parameters of fiber telecommunications.


title: Misleading the Covid-19 vaccination discourse on Twitter: An exploratory study of infodemic around the pandemic

abstract: In this work, we collect a moderate-sized representative corpus of tweets (200,000 approx.) pertaining Covid-19 vaccination spanning over a period of seven months (September 2020 - March 2021). Following a Transfer Learning approach, we utilize the pre-trained Transformer-based XLNet model to classify tweets as Misleading or Non-Misleading and validate against a random subset of results manually. We build on this to study and contrast the characteristics of tweets in the corpus that are misleading in nature against non-misleading ones. This exploratory analysis enables us to design features (such as sentiments, hashtags, nouns, pronouns, etc) that can, in turn, be exploited for classifying tweets as (Non-)Misleading using various ML models in an explainable manner. Specifically, several ML models are employed for prediction, with up to 90% accuracy, and the importance of each feature is explained using SHAP Explainable AI (XAI) tool. While the thrust of this work is principally exploratory analysis in order to obtain insights on the online discourse on Covid-19 vaccination, we conclude the paper by outlining how these insights provide the foundations for a more actionable approach to mitigate misinformation. The curated dataset and code is made available (Github repository) so that the research community at large can reproduce, compare against, or build upon this work.


title: Models of the Muonium to Antimuonium Transition

abstract: Muonium is a bound state composed of an antimuon and an electron, and it constitutes a hydrogen-like atom. Because of the absence of the hadronic matter in the bound state, the muonium is a useful probe to explore new physics being free from the hadronic uncertainties. The process of the muonium-to-antimuonium transition is considered to be effective to identify fundamental interactions which relate to the lepton flavor and lepton number violation. New experiments are being planned at J-PARC in Japan and CSNS in China, and it is expected to attract more attention in the near future. In this paper, we will study what kind of model can be verified in the next generation of the muonium-to-antimuonium transition search experiments while escaping the limitations from other experiments. Though the transition probability is strongly suppressed by the lepton flavor conservation in the standard model, it can be much larger by the exchanges of neutral and doubly charged bosons, and by box loop diagrams in new physics beyond the standard model. We study the neutrino models with heavy Majorana neutrinos at TeV scale, a type-II seesaw model, left--right models, and models for radiative neutrino masses such as the Zee-Babu model in particular, in addition to other possible models to induce the sizable transition probability, which can be tested in the forthcoming experiments.


title: Spatially homogeneous few-cycle compression of Yb lasers via all-solid-state free-space soliton management

abstract: The high power and variable repetition rate of Yb femtosecond lasers make them very attractive for ultrafast science. However, for capturing sub-200 fs dynamics, efficient, high-fidelity, and high-stability pulse compression techniques are essential. Spectral broadening using an all-solid-state free-space geometry is particularly attractive, as it is simple, robust, and low-cost. However, spatial and temporal losses caused by spatio-spectral inhomogeneities have been a major challenge to date, due to coupled space-time dynamics associated with unguided nonlinear propagation. In this work, we use all-solid-state free-space compressors to demonstrate compression of 170 fs pulses at a wavelength of 1030nm from a Yb:KGW laser to ~9.2 fs, with a highly spatially homogeneous mode. This is achieved by ensuring that the nonlinear beam propagation in periodic layered Kerr media occurs in soliton modes and confining the nonlinear phase through each material layer to less than 1.0 rad. A remarkable spatio-spectral homogeneity of ~0.87 can be realized, which yields a high efficiency of >50% for few-cycle compression. The universality of the method is demonstrated by implementing high-quality pulse compression under a wide range of laser conditions. The high spatiotemporal quality and the exceptional stability of the compressed pulses are further verified by high-harmonic generation. This work represents the highest efficiency and the best spatio-spectral quality ever achieved by an all-solid-state free-space pulse compressor for few-cycle-pulse generation.


title: Nonclassical photon statistics in two-tone continuously driven optomechanics

abstract: In cavity optomechanics, single photon detection of Raman scattered photons can be a useful tool for observing nonclassical features of both radiation and motion. While this tool has been employed in experiments with pulsed laser driving of a cavity mode, it has not been readily accessible to experiments with continuous and constant laser driving. To address this, we present a study of a standard optomechanical system where the cavity mode is continuously driven at two different frequencies, and where sideband photons are detected by single photon detectors after frequency filtering the output from the cavity mode around its resonance frequency. We first derive the normalized second order coherence associated with the detected photons, and show that it contains signatures of the quantum nature of the mechanical mode which would be absent with only single-tone driving. To identify model-independent nonclassical features, we derive two inequalities for the sideband photon statistics that should be valid in any classical model of the system. We show that these inequalities are violated in the proposed setup. This is provided that the average phonon occupation number of the mechanical mode is sufficiently small, which in principle can be achieved through sideband cooling intrinsic to the setup. Violation of the first inequality means that there is no well-defined probability distribution of the Glauber-Sudarshan type for the cavity mode. In contrast, a violation of the second inequality means that there is no joint probability distribution for the cavity mode at two times separated by a finite interval, which originates from the noncommutativity of the motional quadratures of the mechanical mode. The proposed setup thus employs a mechanical oscillator in order to generate a steady-state source of nonclassical radiation.


title: Cosmological impact of redshift drift measurements

abstract: The redshift drift is a model-independent probe of fundamental cosmology, but choosing a fiducial model one can also use it to constrain the model parameters. We compare the constraining power of redshift drift measurements by the Extremely Large Telescope (ELT), as studied by Liske {\it et al.} (2008), with that of two recently proposed alternatives: the cosmic accelerometer of Eikenberry {\it et al.} (2020), and the differential redshift drift of Cooke (2020). We find that the cosmic accelerometer with a 6-year baseline leads to weaker constraints than those of the ELT (by $60\%$), but with identical time baselines it outperforms the ELT by up to a factor of 6. The differential redshift drift always performs worse that the standard approach if the goal is to constrain the matter density, but it can perform significantly better than it if the goal is to constrain the dark energy equation of state. Our results show that accurately measuring the redshift drift and using these measurements to constrain cosmological parameters are different merit functions: an experiment optimized for one of them will not be optimal for the other. These non-trivial trade-offs must be kept in mind as next generation instruments enter their final design and construction phases.


title: Deformation quantization of moduli spaces of Higgs bundles on a Riemann surface with translation structure

abstract: Let X be a compact connected Riemann surface of genus g > 0 equipped with a nonzero holomorphic 1-form. Let M denote the moduli space of semistable Higgs bundles on X of rank r and degree r(g-1)+1; it is a complex symplectic manifold. Using the translation structure on the open subset of X where the 1-form does not vanish, we construct a natural deformation quantization of a certain nonempty Zariski open subset of M.


title: Sums and products of symplectic eigenvalues

abstract: For every $2n\times 2n$ real positive definite matrix $A,$ there exists a real symplectic matrix $M$ such that $M^TAM=\diag(D,D),$ where $D$ is the $n\times n$ positive diagonal matrix with diagonal entries $d_1(A)\le \cdots\le d_n(A).$ The numbers $d_1(A),\ldots,d_n(A)$ are called the symplectic eigenvalues of $A.$ We derive analogues of Wielandt's extremal principle and multiplicative Lidskii's inequalities for symplectic eigenvalues.


title: DEATHSTAR: Nearby AGB stars with the Atacama Compact Array II. CO envelope sizes and asymmetries: The S-type stars

abstract: We aim to constrain the sizes of the CO circumstellar envelopes (CSEs) of 16 S-type stars, along with an additional 7 and 4 CSEs of C-type and M-type AGB stars, respectively. We map the emission from the CO J=2-1 and 3-2 lines observed with the Atacama Compact Array (ACA) and its total power (TP) antennas, and fit with a Gaussian distribution in the uv- and image planes for ACA-only and TP observations, respectively. The major axis of the fitted Gaussian for the CO(2-1) line data gives a first estimate of the size of the CO-line-emitting CSE. We investigate possible signs of deviation from spherical symmetry by analysing the line profiles, the results from visibility fitting, and by investigating the deconvolved images. The sizes of the CO-line-emitting CSEs of low-mass-loss-rate (low-MLR) S-stars fall between the sizes of the CSEs of C-stars, which are larger, and those of M-stars, which are smaller, as expected because of the differences in their respective CO abundances. The sizes of the low-MLR S-type stars show no dependence on circumstellar density, while a steeper density dependence is observed at high MLR. Furthermore, our results show that the CO CSEs of most of the S-stars in our sample are consistent with a spherically symmetric and smooth outflow. The CO envelope sizes obtained in this paper will be used to constrain detailed radiative transfer modelling to directly determine more accurate MLR estimates for the stars in our sample. For several of our sources that present signs of deviation from spherical symmetry, further high-resolution observations would be necessary to investigate the nature of, and the physical processes behind, these asymmetrical structures. This will provide further insight into the mass-loss process and its related chemistry in S-type AGB stars.


title: DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization

abstract: Panorama images have a much larger field-of-view thus naturally encode enriched scene context information compared to standard perspective images, which however is not well exploited in the previous scene understanding methods. In this paper, we propose a novel method for panoramic 3D scene understanding which recovers the 3D room layout and the shape, pose, position, and semantic category for each object from a single full-view panorama image. In order to fully utilize the rich context information, we design a novel graph neural network based context model to predict the relationship among objects and room layout, and a differentiable relationship-based optimization module to optimize object arrangement with well-designed objective functions on-the-fly. Realizing the existing data are either with incomplete ground truth or overly-simplified scene, we present a new synthetic dataset with good diversity in room layout and furniture placement, and realistic image quality for total panoramic 3D scene understanding. Experiments demonstrate that our method outperforms existing methods on panoramic scene understanding in terms of both geometry accuracy and object arrangement. Code is available at https://chengzhag.github.io/publication/dpc.


title: Interpretable deep-learning models to help achieve the Sustainable Development Goals

abstract: We discuss our insights into interpretable artificial-intelligence (AI) models, and how they are essential in the context of developing ethical AI systems, as well as data-driven solutions compliant with the Sustainable Development Goals (SDGs). We highlight the potential of extracting truly-interpretable models from deep-learning methods, for instance via symbolic models obtained through inductive biases, to ensure a sustainable development of AI.


title: Modeling Intense-Electron-Beam Generated Plasmas Using a Rigid-Beam Approximation

abstract: A model of an electron-beam-plasma system is introduced to model the electrical breakdown physics of low-pressure nitrogen irradiated by an intense pulsed electron beam. The rapidly rising beam current induces an electric field which drives a return current in the plasma. The rigid-beam model is a reduction of the problem geometry to cylindrical coordinates and simplifications to Maxwell's equations that are driven by a prescribed electron beam current density. The model is convenient for comparing various reductions of the plasma dynamics and plasma chemistry while maintaining a good approximation to the overall magnitude of the beam-created electric field. The usefulness of this model is demonstrated by coupling the rigid-beam model to a fluid plasma model and a simplified nitrogen plasma chemistry. The dynamics of this coupled system are computed for a range of background gas pressures, and the results are compared with experimental measurements. At pressures 1 Torr and above, the simulated line-integrated electron densities are within a factor of two of measurements, and show the same trend with pressure as observed in experiment.


title: Higher-order interlacing for matrix-valued meromorphic Herglotz functions

abstract: Scalar-valued meromorphic Herglotz-Nevanlinna functions are characterized by the interlacing property of their poles and zeros together with some growth properties. We give a characterization of matrix-valued Herglotz-Nevanlinna functions by means of a higher-order interlacing property. As an application we deduce a matrix version of the classical Hermite-Biehler Theorem for entire functions.


title: Model calibration using ESEm v1.0.0 -- an open, scalable Earth System Emulator

abstract: Large computer models are ubiquitous in the earth sciences. These models often have tens or hundreds of tuneable parameters and can take thousands of core-hours to run to completion while generating terabytes of output. It is becoming common practice to develop emulators as fast approximations, or surrogates, of these models in order to explore the relationships between these inputs and outputs, understand uncertainties and generate large ensembles datasets. While the purpose of these surrogates may differ, their development is often very similar. Here we introduce ESEm: an open-source tool providing a general workflow for emulating and validating a wide variety of models and outputs. It includes efficient routines for sampling these emulators for the purpose of uncertainty quantification and model calibration. It is built on well-established, high-performance libraries to ensure robustness, extensibility and scalability. We demonstrate the flexibility of ESEm through three case-studies using ESEm to reduce parametric uncertainty in a general circulation model, explore precipitation sensitivity in a cloud resolving model and scenario uncertainty in the CMIP6 multi-model ensemble.


title: Federated Learning for UAV Swarms Under Class Imbalance and Power Consumption Constraints

abstract: The usage of unmanned aerial vehicles (UAVs) in civil and military applications continues to increase due to the numerous advantages that they provide over conventional approaches. Despite the abundance of such advantages, it is imperative to investigate the performance of UAV utilization while considering their design limitations. This paper investigates the deployment of UAV swarms when each UAV carries a machine learning classification task. To avoid data exchange with ground-based processing nodes, a federated learning approach is adopted between a UAV leader and the swarm members to improve the local learning model while avoiding excessive air-to-ground and ground-to-air communications. Moreover, the proposed deployment framework considers the stringent energy constraints of UAVs and the problem of class imbalance, where we show that considering these design parameters significantly improves the performances of the UAV swarm in terms of classification accuracy, energy consumption and availability of UAVs when compared with several baseline algorithms.


title: Federated Learning for Open Banking

abstract: Open banking enables individual customers to own their banking data, which provides fundamental support for the boosting of a new ecosystem of data marketplaces and financial services. In the near future, it is foreseeable to have decentralized data ownership in the finance sector using federated learning. This is a just-in-time technology that can learn intelligent models in a decentralized training manner. The most attractive aspect of federated learning is its ability to decompose model training into a centralized server and distributed nodes without collecting private data. This kind of decomposed learning framework has great potential to protect users' privacy and sensitive data. Therefore, federated learning combines naturally with an open banking data marketplaces. This chapter will discuss the possible challenges for applying federated learning in the context of open banking, and the corresponding solutions have been explored as well.


title: Relation Extraction from Tables using Artificially Generated Metadata

abstract: Relation Extraction (RE) from tables is the task of identifying relations between pairs of columns of a table. Generally, RE models for this task require labelled tables for training. These labelled tables can also be generated artificially from a Knowledge Graph (KG), which makes the cost to acquire them much lower in comparison to manual annotations. However, unlike real tables, these synthetic tables lack associated metadata, such as, column-headers, captions, etc; this is because synthetic tables are created out of KGs that do not store such metadata. Meanwhile, previous works have shown that metadata is important for accurate RE from tables. To address this issue, we propose methods to artificially create some of this metadata for synthetic tables. Afterward, we experiment with a BERT-based model, in line with recently published works, that takes as input a combination of proposed artificial metadata and table content. Our empirical results show that this leads to an improvement of 9\%-45\% in F1 score, in absolute terms, over 2 tabular datasets.


title: Understanding the Basis of Graph Convolutional Neural Networks via an Intuitive Matched Filtering Approach

abstract: Graph Convolutional Neural Networks (GCNN) are becoming a preferred model for data processing on irregular domains, yet their analysis and principles of operation are rarely examined due to the black box nature of NNs. To this end, we revisit the operation of GCNNs and show that their convolution layers effectively perform matched filtering of input data with the chosen patterns (features). This allows us to provide a unifying account of GCNNs through a matched filter perspective, whereby the nonlinear ReLU and max-pooling layers are also discussed within the matched filtering framework. This is followed by a step-by-step guide on information propagation and learning in GCNNs. It is also shown that standard CNNs and fully connected NNs can be obtained as a special case of GCNNs. A carefully chosen numerical example guides the reader through the various steps of GCNN operation and learning both visually and numerically.


title: Generalizing RNN-Transducer to Out-Domain Audio via Sparse Self-Attention Layers

abstract: Recurrent neural network transducer (RNN-T) is an end-to-end speech recognition framework converting input acoustic frames into a character sequence. The state-of-the-art encoder network for RNN-T is the Conformer, which can effectively model the local-global context information via its convolution and self-attention layers. Although Conformer RNN-T has shown outstanding performance, most studies have been verified in the setting where the train and test data are drawn from the same domain. The domain mismatch problem for Conformer RNN-T has not been intensively investigated yet, which is an important issue for the product-level speech recognition system. In this study, we identified that fully connected self-attention layers in the Conformer caused high deletion errors, specifically in the long-form out-domain utterances. To address this problem, we introduce sparse self-attention layers for Conformer-based encoder networks, which can exploit local and generalized global information by pruning most of the in-domain fitted global connections. Also, we propose a state reset method for the generalization of the prediction network to cope with long-form utterances. Applying proposed methods to an out-domain test, we obtained 27.6% relative character error rate (CER) reduction compared to the fully connected self-attention layer-based Conformers.


title: Data-driven predictive control with improved performance using segmented trajectories

abstract: A class of data-driven control methods has recently emerged based on Willems' fundamental lemma. Such methods can ease the modelling burden in control design but can be sensitive to disturbances acting on the system under control. In this paper, we propose a restructuring of the problem to incorporate segmented prediction trajectories. The proposed segmentation leads to reduced tracking error for longer prediction horizons in the presence of unmeasured disturbance and noise when compared to an unsegmented formulation. The performance characteristics are illustrated in a set-point tracking case study in which the segmented formulation enables more consistent performance over a wide range of prediction horizons. The method is then applied to a building energy management problem using a detailed simulation environment. The case studies show that good tracking performance is achieved for a range of horizon choices, whereas performance degrades with longer horizons without segmentation.


title: Bicyclic commutator quotients with one non-elementary component

abstract: For any number field K with non-elementary 3-class group Cl(3,K) = C(3^e) x C(3), e >= 2, the punctured capitulation type kappa(K) of K in its unramified cyclic cubic extensions Li, 1 <= i <= 4, is an orbit under the action of S3 x S3. By means of Artin's reciprocity law, the arithmetical invariant kappa(K) is translated to the punctured transfer kernel type kappa(G2) of the automorphism group G2 = Gal(F(3,2,K)/K) of the second Hilbert 3-class field of K. A classification of finite 3-groups G with low order and bicyclic commutator quotient G/G' = C(3^e) x C(3), 2 <= e <= 6, according to the algebraic invariant kappa(G), admits conclusions concerning the length of the Hilbert 3-class field tower F(3,infty,K) of imaginary quadratic number fields K.


title: More Than Words: Collocation Tokenization for Latent Dirichlet Allocation Models

abstract: Traditionally, Latent Dirichlet Allocation (LDA) ingests words in a collection of documents to discover their latent topics using word-document co-occurrences. However, it is unclear how to achieve the best results for languages without marked word boundaries such as Chinese and Thai. Here, we explore the use of Pearson's chi-squared test, t-statistics, and Word Pair Encoding (WPE) to produce tokens as input to the LDA model. The Chi-squared, t, and WPE tokenizers are trained on Wikipedia text to look for words that should be grouped together, such as compound nouns, proper nouns, and complex event verbs. We propose a new metric for measuring the clustering quality in settings where the vocabularies of the models differ. Based on this metric and other established metrics, we show that topics trained with merged tokens result in topic keys that are clearer, more coherent, and more effective at distinguishing topics than those unmerged models.


title: Derivation of Computational Formulas for certain class of finite sums: Approach to Generating functions arising from $p$-adic integrals and special functions

abstract: The aim of this paper is to construct generating functions for some families of special finite sums with the aid of the Newton-Mercator series, hypergeometric series, and $p$-adic integral (the Volkenborn integral). By using these generating functions, their functional equations, and their partial derivative equations, many novel computational formulas involving the special finite sums of (inverse) binomial coefficients, the Bernoulli type polynomials and numbers, Euler polynomials and numbers, the Stirling numbers, the (alternating) harmonic numbers, the Leibnitz polynomials and others. Among these formulas, by considering a computational formula which computes the aforementioned certain class of finite sums with the aid of the Bernoulli numbers and the Stirling numbers of the first kind, we present a computation algorithm and we provide some of their special values. Morover, using the aforementioned special finite sums and combinatorial numbers, we give relations among multiple alternating zeta functions, the Bernoulli polynomials of higher order and the Euler polynomials of higher order. We also give decomposition of the multiple Hurwitz zeta functions with the aid of finite sums. Relationships and comparisons between the main results given in the article and previously known results have been criticized. With the help of the results of this paper, the solution of the problem that Charalambides [8, Exercise 30, p. 273] gave in his book was found and with the help of this solution, we also find very new formulas. In addition, the solutions of some of the problems we have raised in [48] are also given.


title: A matrix formula for Schur complements of nonnegative selfadjoint linear relations

abstract: If a nonnegative selfadjoint linear relation $A$ in a Hilbert space and a closed subspace $\mathcal{S}$ are assumed to satisfy that the domain of $A$ is invariant under the orthogonal projector onto $\mathcal{S},$ then $A$ admits a particular matrix representation with respect to the decomposition $\mathcal{S} \oplus \mathcal{S}^{\perp}$. This matrix representation of $A$ is used to give explicit formulae for the Schur complement of $A$ on $\mathcal{S}$ as well as the $\mathcal{S}-$compression of $A$.


title: Characterization of a Spatially Resolved Multi-Element Laser Ablation Ion Source

abstract: A laser ablation ion source (LAS) is a powerful tool by which diverse species of ions can be produced for mass spectrometer calibration, or surface study applications. It is necessary to frequently shift the laser position on the target to selectively ablate materials in a controlled manner, and to mitigate degradation of the target surface caused by ablation. An alternative to mounting the target onto a rotation wheel or $x-y$ translation stage, is to shift the laser position with a final reflection from a motorized kinematic mirror mount. Such a system has been developed, assembled and characterized with a two axis motorized mirror and various metal targets. In the system presented here, ions are ablated from the target surface and guided by a 90 degree quadrupole bender to a Faraday cup where the ion current is measured. Spatially resolved scans of the target are produced by actuating the mirror motors, thus moving the laser spot across the target, and performing synchronous measurements of the ion current to construct 2D images of a target surface which can be up to 50~mm in diameter. The spatial resolution of the system has been measured by scanning the interfaces between metals such as steel and niobium, where it was demonstrated that the LAS can selectively ablate an area of diameter $\approx$50 $\mu$m. This work informs the development of subsequent LAS systems, that are intended to serve as multi-element ion sources for commercial and custom-built time-of-flight mass spectrometers, or to selectively study surface specific regions of samples.


title: PQ-Calculus of Fibonacci Divisors and Method of Images in Planar Hydrodynamics

abstract: By introducing the hierarchy of Fibonacci divisors and corresponding quantum derivatives, we develop the golden calculus, hierarchy of golden binomials and related exponential functions, translation operator and infinite hierarchy of Golden analytic functions. The hierarchy of Golden periodic functions, appearing in this calculus we relate with the method of images in planar hydrodynamics for incompressible and irrotational flow in bounded domain. We show that the even hierarchy of these functions determine the flow in the annular domain, bounded by concentric circles with the ratio of radiuses in powers of the Golden ratio. As an example, complex potential and velocity field for the set of point vortices with Golden proportion of images are calculated explicitly.


title: Simplified Doppler frequency shift measurement enabled by Serrodyne optical frequency translation

abstract: A simplified Doppler frequency shift measurement approach based on Serrodyne optical frequency translation is reported. A sawtooth wave with an appropriate amplitude is sent to one phase modulation arm of a Mach-Zehnder modulator in conjunction with the transmitted signal to implement the Serrodyne optical frequency transition, as well as the optical phase modulation of the transmitted signal on the frequency-shifted optical carrier. The echo signal is applied to the other phase modulation arm of the Mach-Zehnder modulator. The optical signals from the two arms are combined in the Mach-Zehnder modulator, whose lower optical sidebands are selected by an optical bandpass filter and then detected in a photodetector. By simply measuring the frequency of the output low-frequency signal, the value and direction of DFS can be determined simultaneously. An experiment is performed. DFS from -100 to 100 kHz is measured for microwave signals from 6 to 17 GHz with a measurement error of less than 0.03 Hz and a measurement stability of 0.015 Hz in 30 minutes when a 500-kHz sawtooth wave is used as the reference.


title: Federated Learning for Privacy-Preserving Open Innovation Future on Digital Health

abstract: Privacy protection is an ethical issue with broad concern in Artificial Intelligence (AI). Federated learning is a new machine learning paradigm to learn a shared model across users or organisations without direct access to the data. It has great potential to be the next-general AI model training framework that offers privacy protection and therefore has broad implications for the future of digital health and healthcare informatics. Implementing an open innovation framework in the healthcare industry, namely open health, is to enhance innovation and creative capability of health-related organisations by building a next-generation collaborative framework with partner organisations and the research community. In particular, this game-changing collaborative framework offers knowledge sharing from diverse data with a privacy-preserving. This chapter will discuss how federated learning can enable the development of an open health ecosystem with the support of AI. Existing challenges and solutions for federated learning will be discussed.


title: The isoperimetric problem in $2$d domains without necks

abstract: We give a complete characterization of all isoperimetric sets contained in a domain of the Euclidean plane, that is bounded by a Jordan curve and satisfies a no-neck property. Further, we prove that the isoperimetric profile of such domain is convex above the volume of the largest ball contained in it, and that its square is globally convex.


title: ComSum: Commit Messages Summarization and Meaning Preservation

abstract: We present ComSum, a data set of 7 million commit messages for text summarization. When documenting commits, software code changes, both a message and its summary are posted. We gather and filter those to curate developers' work summarization data set. Along with its growing size, practicality and challenging language domain, the data set benefits from the living field of empirical software engineering. As commits follow a typology, we propose to not only evaluate outputs by Rouge, but by their meaning preservation.


title: Regularizing Transformers With Deep Probabilistic Layers

abstract: Language models (LM) have grown with non-stop in the last decade, from sequence-to-sequence architectures to the state-of-the-art and utter attention-based Transformers. In this work, we demonstrate how the inclusion of deep generative models within BERT can bring more versatile models, able to impute missing/noisy words with richer text or even improve BLEU score. More precisely, we use a Gaussian Mixture Variational Autoencoder (GMVAE) as a regularizer layer and prove its effectiveness not only in Transformers but also in the most relevant encoder-decoder based LM, seq2seq with and without attention.


title: The MuX Project

abstract: The \emph{muX} project is conducting a series of muonic X-ray measurements in medium- and high-Z nuclei at PSI, utilizing a high-purity germanium detector array, in-beam muon detectors, and a modern digital data-acquisition system. A novel hydrogen target for muon transfer was developed, enabling measurements with as little as a few micrograms of target material. First measurements with radioactive Cm and Ra targets were conducted, aimed at determining their nuclear charge radii. These serve as important input for upcoming atomic parity violation experiments. The apparatus is also used to perform a feasibility study of an atomic parity violation experiment with the $2s-1s$ muonic X-ray transition. In addition, the setup has been made available for a wider range of nuclear, particle, and solid-state physics measurements.


title: Do Comments follow Commenting Conventions? A Case Study in Java and Python

abstract: Assessing code comment quality is known to be a difficult problem. A number of coding style guidelines have been created with the aim to encourage writing of informative, readable, and consistent comments. However, it is not clear from the research to date which specific aspects of comments the guidelines cover (e.g., syntax, content, structure). Furthermore, the extent to which developers follow these guidelines while writing code comments is unknown. We analyze various style guidelines in Java and Python and uncover that the majority of them address more the content aspect of the comments rather than syntax or formatting, but when considering the different types of information developers embed in comments and the concerns they raise on various online platforms about the commenting practices, existing comment conventions are not yet specified clearly enough, nor do they adequately cover important concerns. We also analyze commenting practices of developers in diverse projects to see the extent to which they follow the guidelines. Our results highlight the mismatch between developer commenting practices and style guidelines, and provide several focal points for the design and improvement of comment quality checking tools.


title: Tachyonic Preheating in Plateau Inflation

abstract: Plateau inflation is an experimentally consistent framework in which the scale of inflation can be kept relatively low. Close to the edge of the plateau, scalar perturbations are subject to a strong tachyonic instability. Tachyonic preheating is realized when, after inflation, the oscillating inflaton repeatedly re-enters the plateau. We develop the analytic theory of this process and expand the linear approach by including backreaction between the coherent background and growing perturbations. For a family of plateau models, the analytic predictions are confronted with numerical estimates. Our analysis shows that the inflaton fragments in a fraction of an $e$-fold in all examples supporting tachyonic preheating, generalizing the results of previous similar studies. In these scenarios, the scalar-to-tensor ratio is tiny, $r<10^{-7}$.


title: Globules and pillars in Cygnus X III. Herschel and upGREAT/SOFIA far-infrared spectroscopy of the globule IRAS 20319+3958 inCygnus X

abstract: IRAS 20319+3958 in Cygnus X South is a rare example of a free-floating globule (mass ~240 Msun, length ~1.5 pc) with an internal HII region created by the stellar feedback of embedded intermediate-mass stars, in particular, one Herbig Be star. Here, we present a Herschel/HIFI CII 158 mu map of the whole globule and a large set of other FIR lines (mid-to high-J CO lines observed with Herschel/PACS and SPIRE, the OI 63 mu line and the CO 16-15 line observed with upGREAT on SOFIA), covering the globule head and partly a position in the tail. The CII map revealed that the whole globule is probably rotating. Highly collimated, high-velocity CII emission is detected close to the Herbig Be star. We performed a PDR analysis using the KOSMA-tau PDR code for one position in the head and one in the tail. The observed FIR lines in the head can be reproduced with a two-component model: an extended, non-clumpy outer PDR shell and a clumpy, dense, and thin inner PDR layer, representing the interface between the HII region cavity and the external PDR. The modelled internal UV field of ~2500 Go is similar to what we obtained from the Herschel FIR fluxes, but lower than what we estimated from the census of the embedded stars. External illumination from the ~30 pc distant Cyg OB2 cluster, producing an UV field of ~150-600 G0 as an upper limit, is responsible for most of the CII emission. For the tail, we modelled the emission with a non-clumpy component, exposed to a UV-field of around 140 Go.


title: Low dephasing and robust micromagnet designs for silicon spin qubits

abstract: Using micromagnets to enable electron spin manipulation in silicon qubits has emerged as a very popular method, enabling single-qubit gate fidelities larger than 99:9%. However, these micromagnets also apply stray magnetic field gradients onto the qubits, making the spin states susceptible to electric field noise and limiting their coherence times. We describe here a magnet design that minimizes qubit dephasing, while allowing for fast qubit control and addressability. Specifically, we design and optimize magnet dimensions and position relative to the quantum dots, minimizing dephasing from magnetic field gradients. The micromagnet-induced dephasing rates with this design are up to 3-orders of magnitude lower than state-of-the-art implementations, allowing for long coherence times. This design is robust against fabrication errors, and can be combined with a wide variety of silicon qubit device geometries, thereby allowing exploration of coherence limiting factors and novel upscaling approaches.


title: On the linear complexity of feedforward clock-controlled sequence

abstract: As a research field of stream ciphers, the pursuit of a balance of security and practicality is the focus. The conditions for security usually have to satisfy at least high period and high linear complexity. Because the feedforward clock-controlled structure can provide quite a high period and utility, many sequence ciphers are constructed based on this structure. However, the past study of its linear complexity only works when the controlled sequence is an m-sequence. Using the theory of matrix over the ring and block matrix in this paper, we construct a more helpful method. It can estimate the lower bound of the linear complexity of the feedforward clock-controlled sequence. Even the controlled sequence has great linear complexity.


title: Transient Execution of Non-Canonical Accesses

abstract: Recent years have brought microarchitectural security intothe spotlight, proving that modern CPUs are vulnerable toseveral classes of microarchitectural attacks. These attacksbypass the basic isolation primitives provided by the CPUs:process isolation, memory permissions, access checks, andso on. Nevertheless, most of the research was focused on In-tel CPUs, with only a few exceptions. As a result, few vulner-abilities have been found in other CPUs, leading to specula-tions about their immunity to certain types of microarchi-tectural attacks. In this paper, we provide a black-box anal-ysis of one of these under-explored areas. Namely, we inves-tigate the flaw of AMD CPUs which may lead to a transientexecution hijacking attack. Contrary to nominal immunity,we discover that AMD Zen family CPUs exhibit transient ex-ecution patterns similar for Meltdown/MDS. Our analysisof exploitation possibilities shows that AMDs design deci-sions indeed limit the exploitability scope comparing to In-tel CPUs, yet it may be possible to use them to amplify othermicroarchitectural attacks.


title: DU-GAN: Generative Adversarial Networks with Dual-Domain U-Net Based Discriminators for Low-Dose CT Denoising

abstract: LDCT has drawn major attention in the medical imaging field due to the potential health risks of CT-associated X-ray radiation to patients. Reducing the radiation dose, however, decreases the quality of the reconstructed images, which consequently compromises the diagnostic performance. Various deep learning techniques have been introduced to improve the image quality of LDCT images through denoising. GANs-based denoising methods usually leverage an additional classification network, i.e. discriminator, to learn the most discriminate difference between the denoised and normal-dose images and, hence, regularize the denoising model accordingly; it often focuses either on the global structure or local details. To better regularize the LDCT denoising model, this paper proposes a novel method, termed DU-GAN, which leverages U-Net based discriminators in the GANs framework to learn both global and local difference between the denoised and normal-dose images in both image and gradient domains. The merit of such a U-Net based discriminator is that it can not only provide the per-pixel feedback to the denoising network through the outputs of the U-Net but also focus on the global structure in a semantic level through the middle layer of the U-Net. In addition to the adversarial training in the image domain, we also apply another U-Net based discriminator in the image gradient domain to alleviate the artifacts caused by photon starvation and enhance the edge of the denoised CT images. Furthermore, the CutMix technique enables the per-pixel outputs of the U-Net based discriminator to provide radiologists with a confidence map to visualize the uncertainty of the denoised results, facilitating the LDCT-based screening and diagnosis. Extensive experiments on the simulated and real-world datasets demonstrate superior performance over recently published methods both qualitatively and quantitatively.


title: Morphology of supernova remnants and their halos

abstract: Supernova remnants (SNRs) are known to accelerate particles to relativistic energies, on account of their nonthermal emission. The observational progress from radio to gamma-ray observations reveals more and more morphological features that need to be accounted for when modeling the emission from those objects. We use our time-dependent acceleration code RATPaC to study the formation of extended gamma-ray halos around supernova remnants and the morphological implications that arise when the high-energetic particles start to escape from the SNRs. We performed spherically symmetric 1D simulations in which we simultaneously solved the transport equations for cosmic rays, magnetic turbulence, and the hydrodynamical flow of the thermal plasma. Our simulations span 25,000 years, thus covering the free-expansion and the Sedov-Taylor phase of the SNR's evolution. We find a strong difference in the morphology of the gamma-ray emission from SNRs at later stages dependent on the emission process. At early times, both the inverse-Compton and the Pion-decay morphology are shell-like. However, as soon as the maximum-energy of the freshly accelerated particles starts to fall, the inverse-Compton morphology starts to become center-filled, whereas the Pion-decay morphology keeps its shell-like structure. Escaping high-energy electrons start to form an emission halo around the SNR at this time. There are good prospects for detecting this spectrally hard emission with the future Cerenkov Telescope Array, as there are for detecting variations in the gamma-ray spectral index across the interior of the SNR. Further, we find a constantly decreasing nonthermal X-ray flux that makes a detection of X-ray unlikely after the first few thousand years of the SNR's evolution. The radio flux is increasing throughout the SNR's lifetime and changes from a shell-like to a more center-filled morphology later on.


title: Can $\overline{MS}$ parton distributions be negative?

abstract: We review our recent paper, where we proved Parton distributions functions (PDFs) to be positive at NLO in the $\overline{MS}$ factorization scheme. We present some additional material that was useful in completing the steps for the actual proof, but we won't attempt to report on the full proof, but referring the reader to the paper itself.


title: Cosmographic model of the astroparticle skies

abstract: Modeling the extragalactic astroparticle skies involves reconstructing the 3D distribution of the most extreme sources in the Universe. Full-sky tomographic surveys at near-infrared wavelengths have already enabled the astroparticle community to bind the density of sources of astrophysical neutrinos and ultra-high cosmic rays (UHECRs), constrain the distribution of binary black-hole mergers and identify some of the components of the extragalactic gamma-ray background. This contribution summarizes the efforts of cleaning and complementing the catalogs developed by the gravitational-wave and near-infrared communities, in order to obtain a cosmographic view on stellar mass ($M_*$) and star formation rate (SFR). Unprecedented cosmography is offered by a sample of about 400,000 galaxies within 350 Mpc, with a 50-50 ratio of spectroscopic and photometric distances, $M_*$, SFR and corrections for incompleteness with increasing distance and decreasing Galactic latitude. The inferred 3D distribution of $M_*$ and SFR is consistent with Cosmic Flows. The $M_*$ and SFR densities converge towards values compatible with deep-field observations beyond 100 Mpc, suggesting a close-to-isotropic distribution of more distant sources. In addition to highlighting relevant applications for the four astroparticle communities, this contribution explores the distribution of $B$-fields at Mpc scales deduced from the 3D distribution of matter, which is believed to be crucial in shaping the ultra-high-energy sky. These efforts provide a new basis for modeling UHECR anisotropies, which bodes well for the identification of their long-sought sources.


title: Succinct Data Structures for Series-Parallel, Block-Cactus and 3-Leaf Power Graphs

abstract: We design succinct encodings of {\it series-parallel, block-cactus} and {\it 3-leaf power} graphs while supporting the basic navigational queries such as degree, adjacency and neighborhood {\it optimally} in the RAM model with logarithmic word size. One salient feature of our representation is that it can achieve optimal space even though the exact space lower bound for these graph classes is not known. For these graph classes, we provide succinct data structures with optimal query support for the first time in the literature. For series-parallel multigraphs, our work also extends the works of Uno et al. (Disc. Math. Alg. and Appl., 2013) and Blelloch and Farzan (CPM, 2010) to produce optimal bounds.


title: Dynamical moduli spaces and polynomial endomorphisms of configurations

abstract: A portrait is a combinatorial model for a discrete dynamical system on a finite set. We study the geometry of portrait moduli spaces, whose points correspond to equivalence classes of point configurations on the affine line for which there exist polynomials realizing the dynamics of a given portrait. We present results and pose questions inspired by a large-scale computational survey of intersections of portrait moduli spaces for polynomials in low degree.


title: Cosmic-ray antiproton excess from annihilating tensor dark matter

abstract: In this paper we calculate the antiproton production in the annihilation of tensor dark matter and explore the possibility that the excess of antiprotons in the range $E_{K}=10-20 ~GeV$ reported by several groups in the analysis of the AMS-02 Collaboration data is due to this production mechanism. We find that these contributions improve the fit to the data on the antiproton to proton ratio for the narrow window $M\in [62.470,62.505] \text{ GeV}$ for the tensor dark matter mass and $g_s \in [0.98,1.01]\times 10^{-3}$ for the Higgs portal coupling in the effective theory. These are precisely the range of values compatible with several experimental constraints, such as dark matter relic density, limits on the spin-independent dark matter-nucleon cross-section from XENON1T, indirect detection limits for the annihilation of dark matter into $\bar{b}b$, $\tau^+ \tau^-$, $\mu^+ \mu^-$ and $\gamma \gamma$, as well as with the gamma-ray excess at the Milky Way galactic center.


title: Randomized C/C++ dynamic memory allocator

abstract: Dynamic memory management requires special attention in programming. It should be fast and secure at the same time. This paper proposes a new randomized dynamic memory management algorithm designed to meet these requirements. Randomization is a key feature intended to protect applications from "use-after-free" or similar attacks. At the same time, the state in the algorithm consists only of one pointer, so it does not consume extra memory for itself. However, our algorithm is not a universal solution. It does not solve the memory fragmentation problem and it needs further development and testing.


title: Unraveling correlated material properties with noisy quantum computers: Natural orbitalized variational quantum eigensolving of extended impurity models within a slave-boson approach

abstract: We propose a method for computing space-resolved correlation properties of the two-dimensional Hubbard model within a quantum-classical embedding strategy that uses a Noisy, Intermediate Scale Quantum (NISQ) computer to solve the embedded model. While previous approaches were limited to purely local, one-impurity embedded models, requiring at most four qubits and relatively shallow circuits, we solve a two-impurity model requiring eight qubits with an advanced hybrid scheme on top of the Variational Quantum Eigensolver algorithm. This iterative scheme, dubbed Natural Orbitalization (NOization), gradually transforms the single-particle basis to the approximate Natural-Orbital basis, in which the ground state can be minimally expressed, at the cost of measuring the one-particle reduced density-matrix of the embedded problem. We show that this transformation tends to make the variational optimization of existing (but too deep) ansatz circuits faster and more accurate, and we propose an ansatz, the Multireference Excitation Preserving (MREP) ansatz, that achieves great expressivity without requiring a prohibitive gate count. The one-impurity version of the ansatz has only one parameter, making the ground state preparation a trivial step, which supports the optimal character of our approach. Within a Rotationally Invariant Slave Boson embedding scheme that requires a minimal number of bath sites and does not require computing the full Green's function, the NOization combined with the MREP ansatz allow us to compute accurate, space-resolved quasiparticle weights and static self-energies for the Hubbard model even in the presence of noise levels representative of current NISQ processors. This paves the way to a controlled solution of the Hubbard model with larger and larger embedded problems solved by quantum computers.


title: Adaptive Explainable Continual Learning Framework for Regression Problems with Focus on Power Forecasts

abstract: Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn new tasks and overcome forgetting the knowledge obtained from the old tasks as the amount of data keeps increasing in applications. In this article, two continual learning scenarios will be proposed to describe the potential challenges in this context. Besides, based on our previous work regarding the CLeaR framework, which is short for continual learning for regression tasks, the work will be further developed to enable models to extend themselves and learn data successively. Research topics are related but not limited to developing continual deep learning algorithms, strategies for non-stationarity detection in data streams, explainable and visualizable artificial intelligence, etc. Moreover, the framework- and algorithm-related hyperparameters should be dynamically updated in applications. Forecasting experiments will be conducted based on power generation and consumption data collected from real-world applications. A series of comprehensive evaluation metrics and visualization tools can help analyze the experimental results. The proposed framework is expected to be generally applied to other constantly changing scenarios.


title: An improved spectral approach for solving the nonclassical neutron particle transport equation

abstract: An improvement modification of the Spectral Approach (SA) used for approximating the nonclassical neutral particle transport equation is described in this work. The main focus of the modified SA lies on a slight modification of the nonclassical angular flux representation as a function of truncated Laguerre series. This leads, in some cases, to a considerable decrease of the Laguerre truncation order required to generate accurate solutions. Numerical results are given to illustrate this proposed improvement.


title: Local existence and uniqueness of heat conductive compressible Navier-Stokes equations in the presence of vacuum and without initial compatibility conditions

abstract: In this paper, we investigate the initial-boundary value problem to the heat conductive compressible Navier-Stokes equations. Local existence and uniqueness of strong solutions is established with any such initial data that the initial density $\rho_0$, velocity $u_0$, and temperature $\theta_0$ satisfy $\rho_0\in W^{1,q}$, with $q\in(3,6)$, $u_0\in H^1$, and $\sqrt{\rho_0}\theta_0\in L^2$. The initial density is assumed to be only nonnegative and thus the initial vacuum is allowed. In addition to the necessary regularity assumptions, we do not require any initial compatibility conditions such as those proposed in (Y. Cho and H. Kim, \emph{Existence results for viscous polytropic fluids with vacuum}, J. Differential Equations {\bf 228} (2006), no.~2, 377--411.), which although are widely used in many previous works but put some inconvenient constraints on the initial data. Due to the weaker regularities of the initial data and the absence of the initial compatibility conditions, leading to weaker regularities of the solutions compared with those in the previous works, the uniqueness of solutions obtained in the current paper does not follow from the arguments used in the existing literatures. Our proof of the uniqueness of solutions is based on the following new idea of two-stages argument: (i) showing that the difference of two solutions (or part of their components) with the same initial data is controlled by some power function of the time variable; (ii) carrying out some singular-in-time weighted energy differential inequalities fulfilling the structure of the Gr\"onwall inequality. The existence is established in the Euler coordinates, while the uniqueness is proved in the Lagrangian coordinates first and then transformed back to the Euler coordinates.


title: Quasi-upward Planar Drawings with Minimum Curve Complexity

abstract: This paper studies the problem of computing quasi-upward planar drawings of bimodal plane digraphs with minimum curve complexity, i.e., drawings such that the maximum number of bends per edge is minimized. We prove that every bimodal plane digraph admits a quasi-upward planar drawing with curve complexity two, which is worst-case optimal. We also show that the problem of minimizing the curve complexity in a quasi-upward planar drawing can be modeled as a min-cost flow problem on a unit-capacity planar flow network. This gives rise to an $\tilde{O}(m^\frac{4}{3})$-time algorithm that computes a quasi-upward planar drawing with minimum curve complexity; in addition, the drawing has the minimum number of bends when no edge can be bent more than twice. For a contrast, we show bimodal planar digraphs whose bend-minimum quasi-upward planar drawings require linear curve complexity even in the variable embedding setting.


title: Nonhomogeneous Stochastic Geometry Analysis of Massive LEO Communication Constellations

abstract: Providing truly ubiquitous connectivity requires development of low Earth orbit (LEO) satellite Internet, whose theoretical study is lagging behind network-specific simulations. In this paper, we derive analytical expressions for the downlink coverage probability and average data rate of a massive inclined LEO constellation in terms of total interference power's Laplace transform in the presence of fading and shadowing, ergo presenting a stochastic geometry based analysis. We assume the desired link to experience Nakagami m fading, which serves to represent different fading scenarios by varying integer m, while the interfering channels can follow any fading model without an effect on analytical tractability. To take into account the inherent nonuniform distribution of satellites across different latitudes, we model the LEO network as a nonhomogeneous Poisson point process with its intensity being a function of satellites' actual distribution in terms of constellation size, the altitude of the constellation, and the inclination of orbital planes. From the numerical results, we observe optimum points for both the constellation altitude and the number of orthogonal frequency channels; interestingly, the optimum user's latitude is greater than the inclination angle due to the presence of fewer interfering satellites. Overall, the presented study facilitates general stochastic evaluation and planning of satellite Internet constellations without specific orbital simulations or tracking data on satellites' exact positions in space.


title: Interleaved Resonance Decays and Electroweak Radiation in Vincia

abstract: We propose a framework for high-energy interactions in which resonance decays and electroweak branching processes are interleaved with the QCD evolution in a single common sequence of decreasing resolution scales. The interleaved treatment of resonance decays allows for a new treatment of finite-width effects in parton showers. At scales above their offshellness, resonances participate explicitly as incoming and outgoing states in branching processes, while they are effectively "integrated out" of the description at lower scales. We implement this formalism, together with a full set of antenna functions for branching processes involving electroweak (W/Z/H) bosons in the Vincia shower module in Pythia 8.3, and study some of the consequences.


title: Construction of energy density functional for arbitrary spin polarization using functional renormalization group

abstract: We show an application of the functional-renormalization-group aided density functional theory to the homogeneous electron gas with arbitrary spin polarization, which gives the energy density functional in the local spin density approximation. The correlation energy per particle is calculated at arbitrary Wigner-Seitz radius $ r_{\rm s} $ and spin polarization $ \zeta $. In the high-density region, our result shows good agreement with Monte Carlo (MC) data. The agreement with MC data is better in the case of small spin polarization, while the discrepancy increases as the spin polarization increases. The magnetic properties given by our numerical results are also discussed.

categories: cond-mat.str-el cond-mat.quant-gas hep-th nucl-th


title: Giant Tuning of Electronic and Thermoelectric Properties by Epitaxial Strain in p-Type Sr-Doped LaCrO3 Transparent Thin Films

abstract: The impact of epitaxial strain on the structural, electronic, and thermoelectric properties of p-type transparent Sr-doped LaCrO3 thin films has been investigated. For this purpose, high-quality fully strained La0.75Sr0.25CrO3 (LSCO) epitaxial thin films were grown by molecular beam epitaxy on three different (pseudo)cubic (001)-oriented perovskite oxide substrates: LaAlO3, (LaAlO3)0.3(Sr2AlTaO6)0.7, and DyScO3. The lattice mismatch between the LSCO films and the substrates induces in-plane strain ranging from -2.06% (compressive) to +1.75% (tensile). The electric conductivity can be controlled over 2 orders of magnitude, ranging from 0.5 S/cm (tensile strain) to 35 S/cm (compressive strain). Consistently, the Seebeck coefficient S can be finely tuned by a factor of almost 2 from 127 microV/K (compressive strain) to 208 microV/K (tensile strain). Interestingly, we show that the thermoelectric power factor can consequently be tuned by almost 2 orders of magnitude. The compressive strain yields a remarkable enhancement by a factor of 3 for 2% compressive strain with respect to almost relaxed films. These results demonstrate that epitaxial strain is a powerful lever to control the electric properties of LSCO and enhance its thermoelectric properties, which is of high interest for various devices and key applications such as thermal energy harvesters, coolers, transparent conductors, photocatalyzers, and spintronic memories.


title: Transversity GPDs of the proton from lattice QCD

abstract: We present the first calculation of the $x$-dependence of the isovector transversity generalized parton distributions (GPDs) for the proton within lattice QCD. We compute the matrix elements with non-local operators containing a Wilson line. The calculation implements the Breit symmetric frame. The proton momenta are chosen as $0.83,\,1.25,\,1.67$ GeV, and the values of the momentum transfer squared are $0.69,\,1.02$ GeV$^2$. These combinations include cases with zero and nonzero skewness. The calculation is performed using one ensemble of two degenerate-mass light, a strange and a charm quark of maximally twisted mass fermions with a clover term. The lattice results are renormalized non-perturbatively and finally matched to the light-cone GPDs using one-loop perturbation theory within the framework of large momentum effective theory. The final GPDs are given in the $\overline{\rm MS}$ scheme at a scale of 2 GeV. In addition to the individual GPDs, we form the combination of the transversity GPDs that is related to the transverse spin structure of the proton. Finally, we extract the lowest two moments of GPDs and draw a number of important qualitative conclusions.


title: Consistent Simplification of Polyline Tree Bundles

abstract: The Polyline Bundle Simplification (PBS) problem is a generalization of the classical polyline simplification problem. Given a set of polylines, which may share line segments and points, PBS asks for the smallest consistent simplification of these polylines with respect to a given distance threshold. Here, consistent means that each point is either kept in or discarded from all polylines containing it. In previous work, it was proven that PBS is NP-hard to approximate within a factor of $n^{\frac{1}{3}-\varepsilon}$ for any $\varepsilon > 0$ where $n$ denotes the number of points in the input. This hardness result holds even for two polylines. In this paper we first study the practically relevant setting of planar inputs. While for many combinatorial optimization problems the restriction to planar settings makes the problem substantially easier, we show that the inapproximability bound known for general inputs continues to hold even for planar inputs. We proceed with the interesting special case of PBS where the polylines form a rooted tree. Such tree bundles naturally arise in the context of movement data visualization. We prove that optimal simplifications of these tree bundles can be computed in $O(n^3)$ for the Fr\'echet distance and in $O(n^2)$ for the Hausdorff distance (which both match the computation time for single polylines). Furthermore, we present a greedy heuristic that allows to decompose polyline bundles into tree bundles in order to make our exact algorithm for trees useful on general inputs. The applicability of our approaches is demonstrated in an experimental evaluation on real-world data.


title: Ensuring the Inclusive Use of Natural Language Processing in the Global Response to COVID-19

abstract: Natural language processing (NLP) plays a significant role in tools for the COVID-19 pandemic response, from detecting misinformation on social media to helping to provide accurate clinical information or summarizing scientific research. However, the approaches developed thus far have not benefited all populations, regions or languages equally. We discuss ways in which current and future NLP approaches can be made more inclusive by covering low-resource languages, including alternative modalities, leveraging out-of-the-box tools and forming meaningful partnerships. We suggest several future directions for researchers interested in maximizing the positive societal impacts of NLP.


title: Hilbert Complexes with Mixed Boundary Conditions -- Part 2: Elasticity Complex

abstract: We show that the elasticity Hilbert complex with mixed boundary conditions on bounded strong Lipschitz domains is closed and compact. The crucial results are compact embeddings which follow by abstract arguments using functional analysis together with particular regular decompositions. Higher Sobolev order results are proved as well. This paper extends recent results on the de Rham Hilbert complex with mixed boundary conditions from [11] and recent results on the elasticity Hilbert complex with empty or full boundary conditions from [15].


title: Bosonic field digitization for quantum computers

abstract: Quantum simulation of quantum field theory is a flagship application of quantum computers that promises to deliver capabilities beyond classical computing. The realization of quantum advantage will require methods to accurately predict error scaling as a function of the resolution and parameters of the model that can be implemented efficiently on quantum hardware. In this paper, we address the representation of lattice bosonic fields in a discretized field amplitude basis, develop methods to predict error scaling, and present efficient qubit implementation strategies. A low-energy subspace of the bosonic Hilbert space, defined by a boson occupation cutoff, can be represented with exponentially good accuracy by a low-energy subspace of a finite size Hilbert space. The finite representation construction and the associated errors are directly related to the accuracy of the Nyquist-Shannon sampling and the Finite Fourier transforms of the boson number states in the field and the conjugate-field bases. We analyze the relation between the boson mass, the discretization parameters used for wavefunction sampling and the finite representation size. Numerical simulations of small size $\Phi^4$ problems demonstrate that the boson mass optimizing the sampling of the ground state wavefunction is a good approximation to the optimal boson mass yielding the minimum low-energy subspace size. However, we find that accurate sampling of general wavefunctions does not necessarily result in accurate representation. We develop methods for validating and adjusting the discretization parameters to achieve more accurate simulations.


title: A Bulk Spectral Gap in the Presence of Edge States for a Truncated Pseudopotential

abstract: We study the low-energy properties of a truncated Haldane pseudopotential with maximal half filling, which describes a strongly correlated system of spinless bosons in a cylinder geometry. For this Hamiltonian with either open or periodic boundary conditions, we prove a spectral gap above the highly degenerate ground-state space which is uniform in the volume and particle number. Our proofs rely on identifying invariant subspaces to which we apply gap-estimate methods previously developed only for quantum spin Hamiltonians. In the case of open boundary conditions, the lower bound on the spectral gap accurately reflects the presence of edge states, which do not persist into the bulk. Customizing the gap technique to the invariant subspace, we avoid the edge states and establish a more precise estimate on the bulk gap in the case of periodic boundary conditions.


title: Gravitational particle production of superheavy massive particles in Quintessential Inflation: A numerical analysis

abstract: We compute numerically the reheating temperature due to the gravitational production of conformally coupled superheavy particles during the phase transition from the end of inflation to the beginning of kination in two different Quintessential Inflation (QI) scenarios, namely Lorentzian Quintessential Inflation (LQI) and $\alpha$-attractors in the context of Quintessential Inflation ($\alpha$-QI). Once these superheavy particles have been created, they must decay into lighter ones to form a relativistic plasma, whose energy density will eventually dominate the one of the inflaton field in order to reheat after inflation our universe with a very high temperature, in both cases greater than $10^7$ GeV, contrary to the usual belief that heavy masses suppress the particle production and, thus, lead to an inefficient reheating temperature. Finally, we will show that the over-production of Gravitational Waves (GWs) during this phase transition, when one deals with our models, does not disturb the Big Bang Nucleosynthesis (BBN) success.


title: Markovian baths and quantum avalanches

abstract: In this work I will discuss some numerical results on the stability of the many-body localized phase to thermal inclusions. The work simplifies a recent proposal by Morningstar et al. [arXiv:2107.05642] and studies small disordered spin chains which are perturbatively coupled to a Markovian bath. The critical disorder for avalanche stability of the canonical disordered Heisenberg chain is shown to exceed W>20. In stark contrast to the Anderson insulator, the avalanche threshold drifts considerably with system size, with no evidence of saturation in the studied regime. I will argue that the results are most easily explained by the absence of a many-body localized phase.


title: A theoretical model of an off-axis GRB jet

abstract: In light of the most recent observations of late afterglows produced by the merger of compact objects or by the core-collapse of massive dying stars, we research the evolution of the afterglow produced by an off-axis top-hat jet and its interaction with a surrounding medium. The medium is parametrized by a power law distribution of the form $n(r)\propto r^{-k}$ is the stratification parameter and contains the development when the surrounding density is constant ($k=0$) or wind-like ($k=2$). We develop an analytical synchrotron forward-shock model when the outflow is viewed off-axis, and it is decelerated by a stratified medium. Using the X-ray data points collected by a large campaign of orbiting satellites and ground telescopes, we have managed to apply our model and fit the X-ray spectrum of the GRB afterglow associated to SN 2020bvc with conventional parameters. Our model predicts that its circumburst medium is parametrized by a power law with stratification parameter $k=1.5$.


title: Pseudo-Hermitian Levin-Wen models from non-semisimple TQFTs

abstract: We construct large classes of exactly solvable pseudo-Hermitian 2D spin Hamiltonians. The ground states of these systems depend only on the spatial topology of the system. We identify the ground state system on a surface with the value assigned to the surface by a non-semisimple TQFT generalizing the Turaev-Viro model. A non-trivial example arises from a non-semisimple subcategory of representations of quantum sl(2) where the quantum parameter is specialized to a root of unity.

categories: cond-mat.str-el math.GT math.QA quant-ph


title: Characterizing Transaction-Reverting Statements in Ethereum Smart Contracts

abstract: Smart contracts are programs running on blockchain to execute transactions. When input constraints or security properties are violated at runtime, the transaction being executed by a smart contract needs to be reverted to avoid undesirable consequences. On Ethereum, the most popular blockchain that supports smart contracts, developers can choose among three transaction-reverting statements (i.e., require, if...revert, and if...throw) to handle anomalous transactions. While these transaction-reverting statements are vital for preventing smart contracts from exhibiting abnormal behaviors or suffering malicious attacks, there is limited understanding of how they are used in practice. In this work, we perform the first empirical study to characterize transaction-reverting statements in Ethereum smart contracts. We measured the prevalence of these statements in 3,866 verified smart contracts from popular dapps and built a taxonomy of their purposes via manually analyzing 557 transaction-reverting statements. We also compared template contracts and their corresponding custom contracts to understand how developers customize the use of transaction-reverting statements. Finally, we analyzed the security impact of transaction-reverting statements by removing them from smart contracts and comparing the mutated contracts against the original ones. Our study led to important findings, which can shed light on further research in the broad area of smart contract quality assurance and provide practical guidance to smart contract developers on the appropriate use of transaction-reverting statements.


title: A Benchmark for Spray from Nearby Cutting Vehicles

abstract: Current driver assistance systems and autonomous driving stacks are limited to well-defined environment conditions and geo fenced areas. To increase driving safety in adverse weather conditions, broadening the application spectrum of autonomous driving and driver assistance systems is necessary. In order to enable this development, reproducible benchmarking methods are required to quantify the expected distortions. In this publication, a testing methodology for disturbances from spray is presented. It introduces a novel lightweight and configurable spray setup alongside an evaluation scheme to assess the disturbances caused by spray. The analysis covers an automotive RGB camera and two different LiDAR systems, as well as downstream detection algorithms based on YOLOv3 and PV-RCNN. In a common scenario of a closely cutting vehicle, it is visible that the distortions are severely affecting the perception stack up to four seconds showing the necessity of benchmarking the influences of spray.


title: On the dissociation number of Kneser graphs

abstract: A set $D$ of vertices of a graph $G$ is a dissociation set if each vertex of $D$ has at most one neighbor in $D$. The dissociation number of $G$, $diss(G)$, is the cardinality of a maximum dissociation set in a graph $G$. In this paper we study dissociation in the well-known class of Kneser graphs $K_{n,k}$. In particular, we establish that the dissociation number of Kneser graphs $K_{n,2}$ equals $\max{\{n-1,6\}}$. We show that for any $k \geq 2$, there exists $n_0 \in \mathbb{N}$ such that $diss(K_{n,k})=\alpha(K_{n,k})$ for any $n \geq n_0$. We consider the case $k=3$ in more details and prove that $n_0=8$ in this case. Then we improve a trivial upper bound $2\alpha(K_{n,k})$ for the dissociation number of Kneser graphs $K_{n,k}$ by using Katona's cyclic arrangement of integers from $\{1,\ldots , n\}$. Finally we investigate the odd graphs, that is, the Kneser graphs with $n=2k+1$. We prove that $diss(K_{2k+1,k})={2k \choose k}$.


title: High Dimensional Quadratic Discriminant Analysis: Optimality and Phase Transitions

abstract: Consider a two-class classification problem where we observe samples $(X_i, Y_i)$ for i = 1, ..., n, $X_i \in R^p$ and $Y_i$ in {0, 1}. Given $Y_i = k$, $X_i$ is assumed to follow a multivariate normal distribution with mean $\mu_k \in R^k$ and covariance matrix $\Sigma_k$, k=0,1. Supposing a new sample X from the same mixture is observed, our goal is to estimate its class label Y. Such a high-dimensional classification problem has been studied thoroughly when Sigma_0 = Sigma_1. However, the discussions over the case $\Sigma_0 \neq \Sigma_1$ are much less over the years. This paper presents the quadratic discriminant analysis (QDA) for the weak signals (QDAw) algorithm, and the QDA with feature selection (QDAfs) algorithm. QDAfs applies Partial Correlation Screening to estimate $\hat{\Omega}_0$ and $\hat{\Omega}_1$, and then applies a hard-thresholding on the diagonals of $\hat{\Omega}_0 - \hat\Omega_1$. QDAfs further includes the linear term $d^T X$, where d is achieved by a hard-thresholding on $\hat{\Omega}_1\hat{\mu}_1 - \hat{\Omega}_0\hat{\mu}_0$. We further propose the rare and weak model to model the signals in $\Omega_0 - \Omega_1$ and $\mu_0 - \mu_1$. Based on the signal weakness and sparsity in $\mu_0 - \mu_1$, we propose two ways to estimate labels: 1) QDAw for weak but dense signals; 2) QDAfs for relatively strong but sparse signals. We figure out the classification boundary on the 4-dim parameter space: 1) Region of possibility, where either QDAw or QDAfs will achieve a mis-classification error rate of 0; 2) Region of impossibility, where all classifiers will have a constant error rate. The numerical results from real datasets support our theories and demonstrate the necessity and superiority of using QDA over LDA for classification.


title: Reducing Exposure Bias in Training Recurrent Neural Network Transducers

abstract: When recurrent neural network transducers (RNNTs) are trained using the typical maximum likelihood criterion, the prediction network is trained only on ground truth label sequences. This leads to a mismatch during inference, known as exposure bias, when the model must deal with label sequences containing errors. In this paper we investigate approaches to reducing exposure bias in training to improve the generalization of RNNT models for automatic speech recognition (ASR). A label-preserving input perturbation to the prediction network is introduced. The input token sequences are perturbed using SwitchOut and scheduled sampling based on an additional token language model. Experiments conducted on the 300-hour Switchboard dataset demonstrate their effectiveness. By reducing the exposure bias, we show that we can further improve the accuracy of a high-performance RNNT ASR model and obtain state-of-the-art results on the 300-hour Switchboard dataset.


title: Optimization Applied to Selected Exoplanets

abstract: Transit and radial velocity models were applied to archival data in order to examine exoplanet properties, in particular for the recently discovered super-Earth GJ 357b. There is however considerable variation in estimated model parameters across the literature, and especially their uncertainty estimates. This applies even for relatively uncomplicated systems and basic parameters. Some published accuracy values thus appear highly over-optimistic. We present our reanalyses with these variations in mind and specify parameters with appropriate confidence intervals for the exoplanets Kepler-1b, -2b, -8b, -12b, -13b, -14b, -15b, -40b \& -77b and 51 Peg. More sophisticated models in WinFitter, EXOFAST, and DACE were applied, leading to mean planet densities for Kepler-12b, -14b, -15b, and -40b as: $0.11 \pm 0.01$, $4.04 \pm 0.58$, $0.43 \pm 0.05$, and $1.19^{+0.31}_{-0.36}$ g per cc respectively. We confirm a rocky mean density for the Earth-like GJ357b, although we urge caution about the modelling given the low S/N data. We cannot confidently specify parameters for the other two proposed planets in this system.


title: Hole in one: Pathways to deterministic single-acceptor incorporation in Si(100)-2$\times$1

abstract: Stochastic incorporation kinetics can be a limiting factor in the scalability of semiconductor fabrication technologies using atomic-precision techniques. While these technologies have recently been extended from donors to acceptors, the extent to which kinetics will impact single-acceptor incorporation has yet to be assessed. We develop and apply an atomistic model for the single-acceptor incorporation rates of several recently demonstrated precursor molecules: diborane (B$_2$H$_6$), boron trichloride (BCl$_3$), and aluminum trichloride in both monomer (AlCl$_3$) and dimer forms (Al$_2$Cl$_6$), to identify the acceptor precursor and dosing conditions most likely to yield deterministic incorporation. While all three precursors can achieve single-acceptor incorporation, we predict that diborane is unlikely to achieve deterministic incorporation, boron trichloride can achieve deterministic incorporation with modest heating (50 $^{\circ}$C), and aluminum trichloride can achieve deterministic incorporation at room temperature. We conclude that both boron and aluminum trichloride are promising precursors for atomic-precision single-acceptor applications, with the potential to enable the reliable production of large arrays of single-atom quantum devices.


title: Simulating the outcome of binary neutron star merger in common envelope jets supernovae

abstract: We simulate the influence of the energy that the merger process of two neutron stars (NSs) releases inside a red supergiant (RSG) star on the RSG envelope inner to the merger location. In the triple star common envelope evolution (CEE) that we consider a tight binary system of two NSs spirals-in inside an RSG envelope and because of mass accretion and dynamical friction the two NS merge. We deposit merger-explosion energies of 3e50 and 1e51 erg at distances of 25Ro and 50Ro from the center of the RSG, and with the three-dimensional hydrodynamical code FLASH we follow the evolution of the RSG envelope in inner regions. For the parameters we explore we find that more than 90 per cent of the RSG envelope mass inner to the merger site stays bound to the RSG. NSs that experience a CEE are likely to accrete RSG envelope mass through an accretion disk that launches jets. These jets power a luminous transient event, a common envelope jets supernova (CEJSN). The merger process adds to the CEJSN energy. Our finding implies that the interaction of the merger product, a massive NS or a BH, with the envelope can continue to release more energy, both by further in-spiral and by mass accretion by the merger product. Massive RSG envelopes can force the merger product to spiral-in into the core of the RSG, leading to an even more energetic CEJSN.


title: Expansion by regions with pySecDec

abstract: We discuss the technique of expansion by regions from a geometric perspective, and its implementation within pySecDec, a toolbox for the evaluation of dimensionally regulated parameter integrals. The program offers an automated way to perform asymptotic expansions and provides a new mechanism for efficiently evaluating amplitudes, as well as individual integrals. The usage of the new features available within pySecDec is illustrated with several examples.