title: Learning Robust Controllers Via Probabilistic Model-Based Policy Search

abstract: Model-based Reinforcement Learning estimates the true environment through a world model in order to approximate the optimal policy. This family of algorithms usually benefits from better sample efficiency than their model-free counterparts. We investigate whether controllers learned in such a way are robust and able to generalize under small perturbations of the environment. Our work is inspired by the PILCO algorithm, a method for probabilistic policy search. We show that enforcing a lower bound to the likelihood noise in the Gaussian Process dynamics model regularizes the policy updates and yields more robust controllers. We demonstrate the empirical benefits of our method in a simulation benchmark.


title: Open Rule Induction

abstract: Rules have a number of desirable properties. It is easy to understand, infer new knowledge, and communicate with other inference systems. One weakness of the previous rule induction systems is that they only find rules within a knowledge base (KB) and therefore cannot generalize to more open and complex real-world rules. Recently, the language model (LM)-based rule generation are proposed to enhance the expressive power of the rules. In this paper, we revisit the differences between KB-based rule induction and LM-based rule generation. We argue that, while KB-based methods inducted rules by discovering data commonalities, the current LM-based methods are "learning rules from rules". This limits these methods to only produce "canned" rules whose patterns are constrained by the annotated rules, while discarding the rich expressive power of LMs for free text. Therefore, in this paper, we propose the open rule induction problem, which aims to induce open rules utilizing the knowledge in LMs. Besides, we propose the Orion (\underline{o}pen \underline{r}ule \underline{i}nducti\underline{on}) system to automatically mine open rules from LMs without supervision of annotated rules. We conducted extensive experiments to verify the quality and quantity of the inducted open rules. Surprisingly, when applying the open rules in downstream tasks (i.e. relation extraction), these automatically inducted rules even outperformed the manually annotated rules.


title: Distributional Reinforcement Learning for Multi-Dimensional Reward Functions

abstract: A growing trend for value-based reinforcement learning (RL) algorithms is to capture more information than scalar value functions in the value network. One of the most well-known methods in this branch is distributional RL, which models return distribution instead of scalar value. In another line of work, hybrid reward architectures (HRA) in RL have studied to model source-specific value functions for each source of reward, which is also shown to be beneficial in performance. To fully inherit the benefits of distributional RL and hybrid reward architectures, we introduce Multi-Dimensional Distributional DQN (MD3QN), which extends distributional RL to model the joint return distribution from multiple reward sources. As a by-product of joint distribution modeling, MD3QN can capture not only the randomness in returns for each source of reward, but also the rich reward correlation between the randomness of different sources. We prove the convergence for the joint distributional Bellman operator and build our empirical algorithm by minimizing the Maximum Mean Discrepancy between joint return distribution and its Bellman target. In experiments, our method accurately models the joint return distribution in environments with richly correlated reward functions, and outperforms previous RL methods utilizing multi-dimensional reward functions in the control setting.


title: Extremal K\"ahler metrics on blowups

abstract: Consider a compact K\"ahler manifold which either admits an extremal K\"ahler metric, or is a small deformation of such a manifold. We show that the blowup of the manifold at a point admits an extremal K\"ahler metric in K\"ahler classes making the exceptional divisor sufficiently small if and only if it is relatively K-stable, thus proving a special case of the Yau-Tian-Donaldson conjecture. We also give a geometric interpretation of what relative K-stability means in this case in terms of finite dimensional geometric invariant theory. This gives a complete solution to a problem addressed in special cases by Arezzo, Pacard, Singer and Sz\'ekelyhidi. In addition, the case of a deformation of an extremal manifold proves the first non-trivial case of a general conjecture of Donaldson.


abstract: Geometric effects in the infinite-layer nickelates $R$NiO$_2$ associated with the relative size of the $R$-site atom are investigated via first-principles calculations. We consider, in particular, the prospective YNiO$_2$ material to illustrate the impact of these effects. Compared to LaNiO$_2$, we find that the La $\to$ Y substitution is equivalent to a pressure of 19 GPa and that the presence of topotactic hydrogen can be precluded. However, the electronic structure of YNiO$_2$ departs from the cuprate-like picture due to an increase in both self-doping effect and $e_g$ hybridization. Furthermore, we find that geometric effects introduce a quantum critical point in the $R$NiO$_2$ series. This implies a $P4/mmm \leftrightarrow I4/mcm$ structural transformation associated to a $A_3^+$ normal mode, according to which the oxygen squares undergo an in-plane rotation around Ni that alternates along $c$. We find that such a $A_3^+$-mode instability has a generic character in the infinite-layer nickelates and can be tuned via either the effective $R$-site atom size or epitaxial strain.


title: Gradient representations in ReLU networks as similarity functions

abstract: Feed-forward networks can be interpreted as mappings with linear decision surfaces at the level of the last layer. We investigate how the tangent space of the network can be exploited to refine the decision in case of ReLU (Rectified Linear Unit) activations. We show that a simple Riemannian metric parametrized on the parameters of the network forms a similarity function at least as good as the original network and we suggest a sparse metric to increase the similarity gap.


title: H$\alpha$ and He I absorption in HAT-P-32 b observed with CARMENES -- Detection of Roche lobe overflow and mass loss

abstract: We analyze two high-resolution spectral transit time series of the hot Jupiter HAT-P-32 b obtained with the CARMENES spectrograph. Our new XMM-Newton X-ray observations of the system show that the fast-rotating F-type host star exhibits a high X-ray luminosity of 2.3e29~erg/s (5-100 A), corresponding to a flux of 6.9e4 erg/cm**2/s at the planetary orbit, which results in an energy-limited escape estimate of about 1e13 g/s for the planetary mass-loss rate. The spectral time series show significant, time-dependent absorption in the Halpha and He I triplet lines with maximum depths of about 3.3% and 5.3%. The mid-transit absorption signals in the Halpha and He I lines are consistent with results from one-dimensional hydrodynamic modeling, which also yields mass-loss rates on the order of 1e13 g/s. We observe an early ingress of a redshifted component of the transmission signal, which extends into a redshifted absorption component, persisting until about the middle of the optical transit. While a super-rotating wind can explain redshifted ingress absorption, we find that an up-orbit stream, transporting planetary mass in the direction of the star, also provides a plausible explanation for the pre-transit signal. This makes HAT-P-32 a benchmark system for exploring atmospheric dynamics via transmission spectroscopy.


title: Real-time Human Response Prediction Using a Non-intrusive Data-driven Model Reduction Scheme

abstract: Recent research in non-intrusive data-driven model order reduction (MOR) enabled accurate and efficient approximation of parameterized ordinary differential equations (ODEs). However, previous studies have focused on constant parameters, whereas time-dependent parameters have been neglected. The purpose of this paper is to introduce a novel two-step MOR scheme to tackle this issue. In a first step, classic MOR approaches are applied to calculate a low-dimensional representation of high-dimensional ODE solutions, i.e. to extract the most important features of simulation data. Based on this representation, a long short-term memory (LSTM) is trained to predict the reduced dynamics iteratively in a second step. This enables the parameters to be taken into account during the respective time step. The potential of this approach is demonstrated on an occupant model within a car driving scenario. The reduced model's response to time-varying accelerations matches the reference data with high accuracy for a limited amount of time. Furthermore, real-time capability is achieved. Accordingly, it is concluded that the presented method is well suited to approximate parameterized ODEs and can handle time-dependent parameters in contrast to common methods.


title: Phase Estimation of Local Hamiltonians on NISQ Hardware

abstract: In this work we investigate a binned version of Quantum Phase Estimation (QPE) set out by [Somma 2019] and known as the Quantum Eigenvalue Estimation Problem (QEEP). Specifically, we determine whether the circuit decomposition techniques we set out in previous work, [Clinton et al 2020], can improve the performance of QEEP in the NISQ regime. To this end we adopt a physically motivated abstraction of NISQ device capabilities as in [Clinton et al 2020]. Within this framework, we find that our techniques reduce the threshold at which it becomes possible to perform the minimum two-bin instance of this algorithm by an order of magnitude. This is for the specific example of a two dimensional spin Fermi-Hubbard model. For example, given a $10\%$ acceptable error on a $3\times 3$ spin Fermi-Hubbard model, with a depolarizing noise rate of $10^{-6}$, we find that the phase estimation protocol of [Somma 2019] could be performed with a bin width of approximately $1/9$ the total spectral range at the circuit depth where traditional gate synthesis methods would yield a bin width that covers the entire spectral range. We explore possible modifications to this protocol and propose an application, which we call Randomized Quantum Eigenvalue Estimation Problem (rQeep). rQeep outputs estimates on the fraction of eigenvalues which lie within randomly chosen bins and upper bounds the total deviation of these estimates from the true values. One use case we envision for this algorithm is resolving density of states features of local Hamiltonians, such as spectral gaps.


title: Concepts for Automated Machine Learning in Smart Grid Applications

abstract: Undoubtedly, the increase of available data and competitive machine learning algorithms has boosted the popularity of data-driven modeling in energy systems. Applications are forecasts for renewable energy generation and energy consumption. Forecasts are elementary for sector coupling, where energy-consuming sectors are interconnected with the power-generating sector to address electricity storage challenges by adding flexibility to the power system. However, the large-scale application of machine learning methods in energy systems is impaired by the need for expert knowledge, which covers machine learning expertise and a profound understanding of the application's process. The process knowledge is required for the problem formalization, as well as the model validation and application. The machine learning skills include the processing steps of i) data pre-processing, ii) feature engineering, extraction, and selection, iii) algorithm selection, iv) hyperparameter optimization, and possibly v) post-processing of the model's output. Tailoring a model for a particular application requires selecting the data, designing various candidate models and organizing the data flow between the processing steps, selecting the most suitable model, and monitoring the model during operation - an iterative and time-consuming procedure. Automated design and operation of machine learning aim to reduce the human effort to address the increasing demand for data-driven models. We define five levels of automation for forecasting in alignment with the SAE standard for autonomous vehicles, where manual design and application reflect Automation level 0.


title: Towards Audio Domain Adaptation for Acoustic Scene Classification using Disentanglement Learning

abstract: The deployment of machine listening algorithms in real-life applications is often impeded by a domain shift caused for instance by different microphone characteristics. In this paper, we propose a novel domain adaptation strategy based on disentanglement learning. The goal is to disentangle task-specific and domain-specific characteristics in the analyzed audio recordings. In particular, we combine two strategies: First, we apply different binary masks to internal embedding representations and, second, we suggest a novel combination of categorical cross-entropy and variance-based losses. Our results confirm the disentanglement of both tasks on an embedding level but show only minor improvement in the acoustic scene classification performance, when training data from both domains can be used. As a second finding, we can confirm the effectiveness of a state-of-the-art unsupervised domain adaptation strategy, which performs across-domain adaptation on a feature-level instead.


title: Arbitrary Distribution Modeling with Censorship in Real-Time Bidding Advertising

abstract: The purpose of Inventory Pricing is to bid the right prices to online ad opportunities, which is crucial for a Demand-Side Platform (DSP) to win advertising auctions in Real-Time Bidding (RTB). In the planning stage, advertisers need the forecast of probabilistic models to make bidding decisions. However, most of the previous works made strong assumptions on the distribution form of the winning price, which reduced their accuracy and weakened their ability to make generalizations. Though some works recently tried to fit the distribution directly, their complex structure lacked efficiency on online inference. In this paper, we devise a novel loss function, Neighborhood Likelihood Loss (NLL), collaborating with a proposed framework, Arbitrary Distribution Modeling (ADM), to predict the winning price distribution under censorship with no pre-assumption required. We conducted experiments on two real-world experimental datasets and one large-scale, non-simulated production dataset in our system. Experiments showed that ADM outperformed the baselines both on algorithm and business metrics. By replaying historical data of the production environment, this method was shown to lead to good yield in our system. Without any pre-assumed specific distribution form, ADM showed significant advantages in effectiveness and efficiency, demonstrating its great capability in modeling sophisticated price landscapes.


title: Distributional Robustness Regularized Scenario Optimization with Application to Model Predictive Control

abstract: We provide a functional view of distributional robustness motivated by robust statistics and functional analysis. This results in two practical computational approaches for approximate distributionally robust nonlinear optimization based on gradient norms and reproducing kernel Hilbert spaces. Our method can be applied to the settings of statistical learning with small sample size and test distribution shift. As a case study, we robustify scenario-based stochastic model predictive control with general nonlinear constraints. In particular, we demonstrate constraint satisfaction with only a small number of scenarios under distribution shift.


title: AQP: An Open Modular Python Platform for Objective Speech and Audio Quality Metrics

abstract: Audio quality assessment has been widely researched in the signal processing area. Full-reference objective metrics (e.g., POLQA, ViSQOL) have been developed to estimate the audio quality relying only on human rating experiments. To evaluate the audio quality of novel audio processing techniques, researchers constantly need to compare objective quality metrics. Testing different implementations of the same metric and evaluating new datasets are fundamental and ongoing iterative activities. In this paper, we present AQP - an open-source, node-based, light-weight Python pipeline for audio quality assessment. AQP allows researchers to test and compare objective quality metrics helping to improve robustness, reproducibility and development speed. We introduce the platform, explain the motivations, and illustrate with examples how, using AQP, objective quality metrics can be (i) compared and benchmarked; (ii) prototyped and adapted in a modular fashion; (iii) visualised and checked for errors. The code has been shared on GitHub to encourage adoption and contributions from the community.


title: Octet lattice-based plate for elastic wave control

abstract: Motivated by the importance of lattice structures in multiple fields, we investigate the propagation of flexural waves in a thin woven plate augmented with two classes of metastructures for wave mitigation and guiding, namely metabarriers and metalenses. The cellular architecture of this plate invokes the well-known octet topology, while the metadevices rely on novel customized octets either comprising spherical masses added to the midpoint of their struts or variable node thickness. We numerically determine the dispersion curves of a doubly-periodic array of octets, which produce a broad bandgap whose underlying physics is elucidated and leveraged as a design paradigm, allowing the construction of a metabarrier effective for inhibiting the transmission of waves. More sophisticated effects emerge upon parametric analyses of the added masses and node thickness, leading to graded designs that spatially filter waves through an enlarged bandgap via rainbow trapping. Additionally, Luneburg and Maxwell metalenses are realized using the spatial modulation of the tuning parameters and numerically tested. Wavefronts impinging on these structures are progressively curved within the inhomogeneous media and steered toward a focal point. Our results yield new perspectives for the use of octet-like lattices, paving the way for promising applications in vibration isolation and energy focusing.


title: CII*/CII ratio in high-redshift DLAs: ISM phase separation drives the observed bimodality of [CII] cooling rates

abstract: We discuss observations of CII*/CII ratios and cooling rates due to [CII]$\,$158$\mu$m emission in high-redshift intervening damped Lyman-$\alpha$ systems towards quasars. We show that the observed bimodality in the CII cooling rates actually reflects a bimodality in the CII*/CII-metallicity plane that can be naturally explained by phase segregation of the neutral medium, without invoking differences in star-formation scenarios. Assuming realistic distributions of the physical parameters to calculate the phase diagrams, we also reproduce qualitatively the metallicity dependence of this bimodality. We emphasize that high-z DLAs mostly probe low-metallicity gas ($Z\lesssim 0.1 Z_{\odot}$), where heating is dominated by cosmic rays (and/or turbulence), and not by photoelectric heating. Therefore even if the gas of DLA is predominantly cold (where the cooling is dominated by [CII]), the excitation of CII can be used to derive the cosmic ray ionization rate (and/or turbulent heating), but not the UV field, as was previously considered. Alternatively, if the gas in DLA is predominantly warm, CII*/CII can be used to constrain its number density. Finally, we also discuss the importance of the ionized medium, which, if also present along the line of sight, can significantly increase the average CII*/CII ratio.


title: Analytical results for the distribution of cover times of random walks on random regular graphs

abstract: We present analytical results for the distribution of cover times of random walks (RWs) on random regular graphs consisting of $N$ nodes of degree $c$ ($c \ge 3$). Starting from a random initial node at time $t=1$, at each time step $t \ge 2$ an RW hops into a random neighbor of its previous node. In some of the time steps the RW may visit a new, yet-unvisited node, while in other time steps it may revisit a node that has already been visited before. The cover time $T_{\rm C}$ is the number of time steps required for the RW to visit every single node in the network at least once. We derive a master equation for the distribution $P_t(S=s)$ of the number of distinct nodes $s$ visited by an RW up to time $t$ and solve it analytically. Inserting $s=N$ we obtain the cumulative distribution of cover times, namely the probability $P(T_{\rm C} \le t) = P_t(S=N)$ that up to time $t$ an RW will visit all the $N$ nodes in the network. Taking the large network limit, we show that $P(T_{\rm C} \le t)$ converges to a Gumbel distribution. We calculate the distribution of partial cover (PC) times $P( T_{{\rm PC},k} = t )$, which is the probability that at time $t$ an RW will complete visiting $k$ distinct nodes. We also calculate the distribution of random cover (RC) times $P( T_{{\rm RC},k} = t )$, which is the probability that at time $t$ an RW will complete visiting all the nodes in a subgraph of $k$ randomly pre-selected nodes at least once. The analytical results for the distributions of cover times are found to be in very good agreement with the results obtained from computer simulations.


title: Geometric Probabilities and Fibonacci Numbers for Maximally Random n-Qubit Quantum Information States

abstract: The problems of Hadamard quantum coin flipping in n-trials and related generalized Fibonacci sequences of numbers were introduced in [1]. It was shown that for an arbitrary number of repeated consecutive states, probabilities are determined by Fibonacci numbers for duplicated states, Tribonacci numbers for triplicated states and N-Bonacci numbers for arbitrary N-plicated states. In the present paper we generalize these results for direct product of multiple qubit states and arbitrary position of repeated states. The calculations are based on structure of Fibonacci trees in space of qubit states, growing in the left and in the right directions, and number of branches and allowed paths on the trees. By using $n$-qubit quantum coins as random n-qubit states with maximal Shannon entropy, we show that quantum probabilities can be calculated by means of geometric probabilities. It illustrates possible application of geometric probabilities in quantum information theory. The Golden ratio of probabilities and the limit of n going to infinity are discussed.


title: A catalogue of double-mode high amplitude $\delta$ Scuti stars in the Galaxy and their statistical properties

abstract: We present the first catalogue of double-mode and multi-mode high amplitude $\delta$ Scuti star (HADS) in the Galaxy. The catalogue contains source name, coordinates, radial modes such as the fundamental (F, period P0), first-overtone (1O, period P1), second-overtone (2O, period P2), and the third-overtone (3O, period P3) if available, period ratios, magnitude, and the relevant literature. Totally, 155 sources were collected until March 2021, in which 142 HADS with double-mode (132 with F and 1O, and 10 with 1O and 2O), 11 triple-mode, and 2 quadruple-mode. Statistical analysis shows clear features: P0 lies in a range of 0.05 days to 0.175 days (sample: 132 double-mode HADS pulsating in F and 1O); P1/P0 lies in a range of 0.761 $-$ 0.787 (sample: 142 with P0 and P1), in which about 90\% in 0.765 $-$ 0.785, which is wider than previous studies. The Petersen diagram was created with a much larger sample (144 HADS with P0 and P1) and we find that stars with periods in 0.05 $-$ 0.1 days scatter largely from the updated linear relation (i.e., Eq.1), the reason of which however needs further investigation. Particularly, we discover that the ratio P2/P1 (sample: 21 HADS with P1 and P2) equals 0.802$\pm$0.004, which could be viewed as a possible indicator to identify the modes 1O and 2O for multi-mode HADS. In addition, several unusual stars are pointed out, which may need more attention to their pulsations and stellar parameters in the future.


title: Hyperbolic groups with logarithmic separation profile

abstract: We prove that hyperbolic groups with logarithmic separation profiles split over cyclic groups. This shows that such groups can be inductively built from Fuchsian groups and free groups by amalgamations and HNN extensions over finite or virtually cyclic groups. However, we show that not all groups admitting such a hierarchy have logarithmic separation profile by providing an example of a surface amalgam over a cyclic group with superlogarithmic separation profile.


title: TME-BNA: Temporal Motif-Preserving Network Embedding with Bicomponent Neighbor Aggregation

abstract: Evolving temporal networks serve as the abstractions of many real-life dynamic systems, e.g., social network and e-commerce. The purpose of temporal network embedding is to map each node to a time-evolving low-dimension vector for downstream tasks, e.g., link prediction and node classification. The difficulty of temporal network embedding lies in how to utilize the topology and time information jointly to capture the evolution of a temporal network. In response to this challenge, we propose a temporal motif-preserving network embedding method with bicomponent neighbor aggregation, named TME-BNA. Considering that temporal motifs are essential to the understanding of topology laws and functional properties of a temporal network, TME-BNA constructs additional edge features based on temporal motifs to explicitly utilize complex topology with time information. In order to capture the topology dynamics of nodes, TME-BNA utilizes Graph Neural Networks (GNNs) to aggregate the historical and current neighbors respectively according to the timestamps of connected edges. Experiments are conducted on three public temporal network datasets, and the results show the effectiveness of TME-BNA.


title: Crossover between bulk and interface photovoltaic mechanisms in ferroelectric vertical heterostructure

abstract: Bulk photovoltaic (BPVE) effect in crystals lacking inversion symmetry offers great potential for optoelectronic applications due to its unique properties such as above bandgap photovoltage and switchable photocurrent. Because of their large spontaneous polarizations, ferroelectric materials are ideal platforms for studying BPVE. However, identifying the origin of experimentally observed photovoltaic response is often challenging due to the entanglement between bulk and interface effects, leading to much debate in the field. This issue is particularly pronounced in vertical heterostructures, where the two effects are comparable. Here we report a crossover between bulk- and interface-dominant response in vertical BiFeO3 heterostructures when changing the photon energy. We show that well above-bandgap excitation leads to bulk photovoltaic response, but band-edge excitation requires interface band bending to separate the photocarriers. Our findings not only help to clarify contradicting reports in the literature, but also lay the ground for a deeper understanding of ferroelectric photovoltaic effect and its applications in various devices.


title: Incremental Learning for Animal Pose Estimation using RBF k-DPP

abstract: Pose estimation is the task of locating keypoints for an object of interest in an image. Animal Pose estimation is more challenging than estimating human pose due to high inter and intra class variability in animals. Existing works solve this problem for a fixed set of predefined animal categories. Models trained on such sets usually do not work well with new animal categories. Retraining the model on new categories makes the model overfit and leads to catastrophic forgetting. Thus, in this work, we propose a novel problem of "Incremental Learning for Animal Pose Estimation". Our method uses an exemplar memory, sampled using Determinantal Point Processes (DPP) to continually adapt to new animal categories without forgetting the old ones. We further propose a new variant of k-DPP that uses RBF kernel (termed as "RBF k-DPP") which gives more gain in performance over traditional k-DPP. Due to memory constraints, the limited number of exemplars along with new class data can lead to class imbalance. We mitigate it by performing image warping as an augmentation technique. This helps in crafting diverse poses, which reduces overfitting and yields further improvement in performance. The efficacy of our proposed approach is demonstrated via extensive experiments and ablations where we obtain significant improvements over state-of-the-art baseline methods.


title: Fermion-Parity-Based Computation and its Majorana-Zero-Mode Implementation

abstract: Majorana zero modes (MZMs) promise a platform for topologically protected fermionic quantum computation. However, creating multiple MZMs and generating (directly or via measurements) the requisite transformations (e.g., braids) pose significant challenges. We introduce fermion-parity-based computation (FPBC): a measurement-based scheme, modeled on Pauli-based computation, that uses efficient classical processing to virtually increase the number of available MZMs and which, given magic state inputs, operates without transformations. FPBC requires all MZM parities to be measurable, but this conflicts with constraints in proposed MZM hardware. We thus introduce a design in which all parities are directly measurable and which is hence well suited for FPBC. While developing FPBC, we identify the "logical braid group" as the fermionic analog of the Clifford group.


title: Strong gravitational lensing around Kehagias-Sfetsos compact objects surrounded by plasma

abstract: We present the analysis how Ho\v{r}ava gravity and plasma influence the strong lensing phenomena around Kehagias-Sfetsos (KS) black holes. Using the semi-analytical Bozza method of strong lensing limit, we determine the multiple images, namely their separation S, and magnification R. We apply our calculations to the case of supermassive black hole having mass $M=6.5\times 10^{9}\textrm{M}_\odot$ and being at distance $d_0=16.8\textrm{Mpc}$ from observer corresponding to those observed in M87. We show that the sensitivity of image magnification, image separation, and shadow angular size on KS parameter $\omega$ and plasma parameter $k$ are of order from $1\%$ to $10\%$ for $R$ and $~\,16\%$ for $S$.


title: DAG Card is the new Model Card

abstract: With the progressive commoditization of modeling capabilities, data-centric AI recognizes that what happens before and after training becomes crucial for real-world deployments. Following the intuition behind Model Cards, we propose DAG Cards as a form of documentation encompassing the tenets of a data-centric point of view. We argue that Machine Learning pipelines (rather than models) are the most appropriate level of documentation for many practical use cases, and we share with the community an open implementation to generate cards from code.


title: Evaporating primordial black holes, the string axiverse, and hot dark radiation

abstract: We show that primordial black holes (PBHs) develop non-negligible spins through Hawking emission of the large number of axion-like particles generically present in string theory compactifications. This is because scalars can be emitted in the monopole mode ($l=0$), where no angular momentum is removed from the BH, so a sufficiently large number of scalars can compensate for the spin-down produced by fermion, gauge boson, and graviton emission. The resulting characteristic spin distributions for $10^8$-$10^{12}$ kg PBHs could potentially be measured by future gamma-ray observatories, provided that the PBH abundance is not too small. This yields a unique probe of the total number of light scalars in the fundamental theory, independent of how weakly they interact with known matter. The present local energy density of hot, MeV-TeV, axions produced by this Hawking emission can possibly exceed $\rho_{\rm CMB}$. Evaporation constraints on PBHs are also somewhat weakened.


title: Local and collective transitions in sparsely-interacting ecological communities

abstract: Interactions in natural communities can be highly heterogeneous, with any given species interacting appreciably with only some of the others, a situation commonly represented by sparse interaction networks. We study the consequences of sparse competitive interactions, in a theoretical model of a community assembled from a species pool. We find that communities can be in a number of different regimes, depending on the interaction strength. When interactions are strong, the network of coexisting species breaks up into small subgraphs, while for weaker interactions these graphs are larger and more complex, eventually encompassing all species. This process is driven by emergence of new allowed subgraphs as interaction strength decreases, leading to sharp changes in diversity and other community properties, and at weaker interactions to two distinct collective transitions: a percolation transition, and a transition between having a unique equilibrium and having multiple alternative equilibria. Understanding community structure is thus made up of two parts: first, finding which subgraphs are allowed at a given interaction strength, and secondly, a discrete problem of matching these structures over the entire community. In a shift from the focus of many previous theories, these different regimes can be traversed by modifying the interaction strength alone, without need for heterogeneity in either interaction strengths or the number of competitors per species.


title: Finite Element Approximation of Large-Scale Isometric Deformations of Parametrized Surfaces

abstract: In this paper, the numerical approximation of isometric deformations of thin elastic shells is discussed. To this end, for a thin shell represented by a parametrized surface, it is shown how to transform the stored elastic energy for an isometric deformation such that the highest order term is quadratic. For this reformulated model, existence of optimal isometric deformations is shown. A finite element approximation is obtained using the Discrete Kirchhoff Triangle (DKT) approach and the convergence of discrete minimizers to a continuous minimizer is demonstrated. In that respect, this paper generalizes the results by Bartels for the approximation of bending isometries of plates. A Newton scheme is derived to numerically simulate large bending isometries of shells. The proven convergence properties are experimentally verified and characteristics of isometric deformations are discussed.


title: $B$ anomalies and muon $g-2$ from Dark Matter

abstract: Motivated by the result of the Muon g-2 experiment and the long-standing anomalies in semileptonic $B$ meson decays, we systematically build a class of minimal models that can address both experimental results thanks to the contributions of a set of new fields that include a thermal Dark Matter candidate.


title: AUTO-DISCERN: Autonomous Driving Using Common Sense Reasoning

abstract: Driving an automobile involves the tasks of observing surroundings, then making a driving decision based on these observations (steer, brake, coast, etc.). In autonomous driving, all these tasks have to be automated. Autonomous driving technology thus far has relied primarily on machine learning techniques. We argue that appropriate technology should be used for the appropriate task. That is, while machine learning technology is good for observing and automatically understanding the surroundings of an automobile, driving decisions are better automated via commonsense reasoning rather than machine learning. In this paper, we discuss (i) how commonsense reasoning can be automated using answer set programming (ASP) and the goal-directed s(CASP) ASP system, and (ii) develop the AUTO-DISCERN system using this technology for automating decision-making in driving. The goal of our research, described in this paper, is to develop an autonomous driving system that works by simulating the mind of a human driver. Since driving decisions are based on human-style reasoning, they are explainable, their ethics can be ensured, and they will always be correct, provided the system modeling and system inputs are correct.


title: An extension of the order-preserving mapping to the WENO-Z-type schemes

abstract: In our latest studies, by introducing the novel order-preserving (OP) criterion, we have successfully addressed the widely concerned issue of the previously published mapped weighted essentially non-oscillatory (WENO) schemes that it is rather difficult to achieve high resolutions on the premise of removing spurious oscillations for long-run simulations of the hyperbolic systems. In the present study, we extend the OP criterion to the WENO-Z-type schemes as the forementioned issue has also been extensively observed numerically for these schemes. Firstly, we innovatively present the concept of the generalized mapped WENO schemes by rewriting the Z-type weights in a uniform formula from the perspective of the mapping relation. Then, we naturally introduce the OP criterion to improve the WENO-Z-type schemes, and the resultant schemes are denoted as MOP-GMWENO-X. Finally, extensive numerical experiments have been conducted to demonstrate the benefits of these new schemes. We draw the conclusion that, the convergence propoties of the proposed schemes are equivalent to the corresponding WENO-X schemes. The major benefit of the new schemes is that they have the capacity to achieve high resolutions and simultaneously remove spurious oscillations for long simulations. The new schemes have the additional benefit that they can greatly decrease the post-shock oscillations on solving 2D Euler problems with strong shock waves.


title: Using Traceless Genetic Programming for Solving Multiobjective Optimization Problems

abstract: Traceless Genetic Programming (TGP) is a Genetic Programming (GP) variant that is used in cases where the focus is rather the output of the program than the program itself. The main difference between TGP and other GP techniques is that TGP does not explicitly store the evolved computer programs. Two genetic operators are used in conjunction with TGP: crossover and insertion. In this paper, we shall focus on how to apply TGP for solving multi-objective optimization problems which are quite unusual for GP. Each TGP individual stores the output of a computer program (tree) representing a point in the search space. Numerical experiments show that TGP is able to solve very fast and very well the considered test problems.


title: Resolving Anomalies in the Behaviour of a Modularity Inducing Problem Domain with Distributional Fitness Evaluation

abstract: Discrete gene regulatory networks (GRNs) play a vital role in the study of robustness and modularity. A common method of evaluating the robustness of GRNs is to measure their ability to regulate a set of perturbed gene activation patterns back to their unperturbed forms. Usually, perturbations are obtained by collecting random samples produced by a predefined distribution of gene activation patterns. This sampling method introduces stochasticity, in turn inducing dynamicity. This dynamicity is imposed on top of an already complex fitness landscape. So where sampling is used, it is important to understand which effects arise from the structure of the fitness landscape, and which arise from the dynamicity imposed on it. Stochasticity of the fitness function also causes difficulties in reproducibility and in post-experimental analyses. We develop a deterministic distributional fitness evaluation by considering the complete distribution of gene activity patterns, so as to avoid stochasticity in fitness assessment. This fitness evaluation facilitates repeatability. Its determinism permits us to ascertain theoretical bounds on the fitness, and thus to identify whether the algorithm has reached a global optimum. It enables us to differentiate the effects of the problem domain from those of the noisy fitness evaluation, and thus to resolve two remaining anomalies in the behaviour of the problem domain of~\citet{espinosa2010specialization}. We also reveal some properties of solution GRNs that lead them to be robust and modular, leading to a deeper understanding of the nature of the problem domain. We conclude by discussing potential directions toward simulating and understanding the emergence of modularity in larger, more complex domains, which is key both to generating more useful modular solutions, and to understanding the ubiquity of modularity in biological systems.


title: Robust physics discovery via supervised and unsupervised pattern recognition using the Euler characteristic

abstract: Machine learning approaches have been widely used for discovering the underlying physics of dynamical systems from measured data. Existing approaches, however, still lack robustness, especially when the measured data contain a large level of noise. The lack of robustness is mainly attributed to the insufficient representativeness of used features. As a result, the intrinsic mechanism governing the observed system cannot be accurately identified. In this study, we use an efficient topological descriptor for complex data, i.e., the Euler characteristics (ECs), as features to characterize the spatiotemporal data collected from dynamical systems and discover the underlying physics. Unsupervised manifold learning and supervised classification results show that EC can be used to efficiently distinguish systems with different while similar governing models. We also demonstrate that the machine learning approaches using EC can improve the confidence level of sparse regression methods of physics discovery.


title: Dendritic Self-Organizing Maps for Continual Learning

abstract: Current deep learning architectures show remarkable performance when trained in large-scale, controlled datasets. However, the predictive ability of these architectures significantly decreases when learning new classes incrementally. This is due to their inclination to forget the knowledge acquired from previously seen data, a phenomenon termed catastrophic-forgetting. On the other hand, Self-Organizing Maps (SOMs) can model the input space utilizing constrained k-means and thus maintain past knowledge. Here, we propose a novel algorithm inspired by biological neurons, termed Dendritic-Self-Organizing Map (DendSOM). DendSOM consists of a single layer of SOMs, which extract patterns from specific regions of the input space accompanied by a set of hit matrices, one per SOM, which estimate the association between units and labels. The best-matching unit of an input pattern is selected using the maximum cosine similarity rule, while the point-wise mutual information is employed for class inference. DendSOM performs unsupervised feature extraction as it does not use labels for targeted updating of the weights. It outperforms classical SOMs and several state-of-the-art continual learning algorithms on benchmark datasets, such as the Split-MNIST and Split-CIFAR-10. We propose that the incorporation of neuronal properties in SOMs may help remedy catastrophic forgetting.


title: An explicit and non-iterative moving-least-squares immersed-boundary method with low boundary velocity error

abstract: In this work, based on the moving-least-squares immersed boundary method, we proposed a new technique to improve the calculation of the volume force representing the body boundary. For boundary with simple geometry, we theoretically analyse the error between the desired volume force at boundary and the actual force given by the original method. The ratio between the two forces is very close to a constant. Numerical experiments reveal that for complex geometry, this ratio exhibits very narrow distribution around certain value. A spatially uniform coefficient is then introduced to correct the force and fixed by the least-square method over all boundary markers. Such method is explicit and non-iterative, and can be easily implemented into the existing scheme. Several test cases have been simulated with stationary and moving boundaries. Our new method can reduce the residual boundary velocity to the level comparable to that given by the iterative method, but requires much less computing time. Moreover, the new method can be readily combined with the iterative method and further reduces the residual boundary velocity.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: Subsampling Spectral Clustering for Large-Scale Social Networks

abstract: Online social network platforms such as Twitter and Sina Weibo have been extremely popular over the past 20 years. Identifying the network community of a social platform is essential to exploring and understanding the users' interests. However, the rapid development of science and technology has generated large amounts of social network data, creating great computational challenges for community detection in large-scale social networks. Here, we propose a novel subsampling spectral clustering algorithm to identify community structures in large-scale social networks with limited computing resources. More precisely, spectral clustering is conducted using only the information of a small subsample of the network nodes, resulting in a huge reduction in computational time. As a result, for large-scale datasets, the method can be realized even using a personal computer. Specifically, we introduce two different sampling techniques, namely simple random subsampling and degree corrected subsampling. The methodology is applied to the dataset collected from Sina Weibo, which is one of the largest Twitter-type social network platforms in China. Our method can very effectively identify the community structure of registered users. This community structure information can be applied to help Sina Weibo promote advertisements to target users and increase user activity.


title: Model-Free Prediction of Chaotic Systems Using High Efficient Next-generation Reservoir Computing

abstract: To predict the future evolution of dynamical systems purely from observations of the past data is of great potential application. In this work, a new formulated paradigm of reservoir computing is proposed for achieving model-free predication for both low-dimensional and very large spatiotemporal chaotic systems. Compared with traditional reservoir computing models, it is more efficient in terms of predication length, training data set required and computational expense. By taking the Lorenz and Kuramoto-Sivashinsky equations as two classical examples of dynamical systems, numerical simulations are conducted, and the results show our model excels at predication tasks than the latest reservoir computing methods.


title: Cramer-Castillon on a Triangle's Incircle and Excircles

abstract: The Cramer-Castillon problem (CCP) consists in finding one or more polygons inscribed in a circle such that their sides pass cyclically through a list of $N$ points. We study this problem where the points are the vertices of a triangle and the circle is either the incircle or excircles.


title: LTL-Based Non-Markovian Inverse Reinforcement Learning

abstract: The successes of reinforcement learning in recent years are underpinned by the characterization of suitable reward functions. However, in settings where such rewards are non-intuitive, difficult to define, or otherwise error-prone in their definition, it is useful to instead learn the reward signal from expert demonstrations. This is the crux of inverse reinforcement learning (IRL). While eliciting learning requirements in the form of scalar reward signals has been shown to effective, such representations lack explainability and lead to opaque learning. We aim to mitigate this situation by presenting a novel IRL method for eliciting declarative learning requirements in the form of a popular formal logic -- Linear Temporal Logic (LTL) -- from a set of traces given by the expert policy. A key novelty of the proposed approach is quantitative semantics of satisfaction of an LTL formula by a word that, following Occam's razor principle, incentivizes simpler explanations. Given a sample $S=(P,N)$ consisting of positive traces $P$ and negative traces $N$, the proposed algorithms automate the search for a formula $\varphi$ which provides the simplest explanation (in the $GF$ fragment of LTL) of the samples. We have implemented this approach as an open-source tool QuantLearn to perform logic-based non-Markovian IRL. Our results demonstrate the feasibility of the proposed approach in eliciting intuitive LTL-based reward signals from noisy data.


title: An alternative formalism for modeling spin

abstract: We present an alternative formalism for modeling spin. The ontological elements of this formalism are base-2 sequences of length $n$. The machinery necessary to model physics is then developed by considering correlations between base-2 sequences. Upon choosing a reference base-2 sequence, a relational system of numbers can be defined, which we interpret as quantum numbers. Based on the properties of these relational quantum numbers, the selection rules governing interacting spin systems are derived from first principles. A tool for calculating the associated probabilities, which are the squared Clebsch-Gordan coefficients in quantum mechanics, is also presented. The resulting model offers a vivid information theoretic picture of spin and interacting spin systems. Importantly, this model is developed without making any assumptions about the nature of space-time, which presents an interesting opportunity to study emergent space-time models.


title: Ultra-High Energy Proton-Proton Collision in the Laboratory System as the Source of Proton, Neutrino and Gamma Spectra in Astrophysics

abstract: This paper is dedicated to the study how HE particle spectra, which are measured in cosmic ray physics and astrophysics, are influenced by the specifics of collider spectrum of protons.LHC experiments are providing us with the proton spectra at very high energy (VHE) measured in center-of-mass system. A QCD phenomenological study of previous years gave us the Quark-Gluon String Model for the modeling of baryon and meson production spectra in full kinematical range from centrally produced hadrons up to very forward ones. In 1990, I have applied the method for the recalculation the collider distribution of neutral pions for the description of gamma spectrum from supernova that was measured in the laboratory system. Here, I used the same method. The main statement of this study is that the features of leading spectra of cosmic protons, neutrinos and gamma are to be formed already in first collision of UHE proton at the power source of cosmic particles. The specifics of collider spectrum of protons are as following: the growing distribution at the central rapidity's, which reflects in the "knee" of cosmic proton spectrum, and the triple-Pomeron peak at the end of c.m.s. spectrum that leads to the enhancements in spectra of leading cosmic protons, neutrinos, gamma-photons, and as I assume, positrons too. These conclusions desire for more experimental facts to be collected and new observations to be made.


title: Vaccine skepticism detection by network embedding

abstract: We demonstrate the applicability of network embedding to vaccine skepticism, a controversial topic of long-past history. With the Covid-19 pandemic outbreak at the end of 2019, the topic is more important than ever. Only a year after the first international cases were registered, multiple vaccines were developed and passed clinical testing. Besides the challenges of development, testing, and logistics, another factor that might play a significant role in the fight against the pandemic are people who are hesitant to get vaccinated, or even state that they will refuse any vaccine offered to them. Two groups of people commonly referred to as a) pro-vaxxer, those who support vaccinating people b) vax-skeptic, those who question vaccine efficacy or the need for general vaccination against Covid-19. It is very difficult to tell exactly how many people share each of these views. It is even more difficult to understand all the reasoning why vax-skeptic opinions are getting more popular. In this work, our intention was to develop techniques that are able to efficiently differentiate between pro-vaxxer and vax-skeptic content. After multiple data preprocessing steps, we analyzed the tweet text as well as the structure of user interactions on Twitter. We deployed several node embedding and community detection models that scale well for graphs with millions of edges.


title: Low-energy reactor neutrino physics with the CONNIE experiment

abstract: The Coherent Neutrino-Nucleus Interaction Experiment (CONNIE) uses fully depleted high-resistivity CCDs (charge coupled devices) with the aim of detecting the coherent elastic scattering of reactor antineutrinos off silicon nuclei and probing physics beyond the Standard Model. The analysis of the 2016--2018 data allowed us to set an upper limit at 95% confidence level on the coherent scattering rate, which was used to place stringent constraints on simplified extensions of the Standard Model with light scalar and vector mediators. In 2019, the experiment operated with an improved readout and a lower energy threshold of 50 eV. We present the performance of the CONNIE experiment, new results of the analysis of 2019 data, and the recent update of the detector with skipper CCDs.


title: Model-based Reinforcement Learning for Service Mesh Fault Resiliency in a Web Application-level

abstract: Microservice-based architectures enable different aspects of web applications to be created and updated independently, even after deployment. Associated technologies such as service mesh provide application-level fault resilience through attribute configurations that govern the behavior of request-response service -- and the interactions among them -- in the presence of failures. While this provides tremendous flexibility, the configured values of these attributes -- and the relationships among them -- can significantly affect the performance and fault resilience of the overall application. Furthermore, it is impossible to determine the best and worst combinations of attribute values with respect to fault resiliency via testing, due to the complexities of the underlying distributed system and the many possible attribute value combinations. In this paper, we present a model-based reinforcement learning workflow towards service mesh fault resiliency. Our approach enables the prediction of the most significant fault resilience behaviors at a web application-level, scratching from single service to aggregated multi-service management with efficient agent collaborations.


title: On a structure of the one-loop divergences in $4D, {\cal N}=2$ supersymmetric sigma-model

abstract: We study the quantum structure of four-dimensional ${\cal N}=2$ superfield sigma-model formulated in harmonic superspace in terms of the omega-hypermultiplet superfield $\omega$. The model is described by harmonic superfield sigma-model metric $g_{ab}(\omega)$ and two potential-like superfields $L^{++}_{a}(\omega)$ and $L^{(+4)}(\omega)$. In bosonic component sector this model describes some hyper-K\"{a}hler manifold. The manifestly ${\cal N}=2$ supersymmetric covariant background-quantum splitting is constructed and the superfield proper-time technique is developed to calculate the one-loop effective action. The one-loop divergences of the superfield effective action are found for arbitrary $g_{ab}(\omega), L^{++}_{a}(\omega), L^{(+4)}(\omega)$, where some specific analogy between the algebra of covariant derivatives in the sigma-model and the corresponding algebra in the ${\cal N}=2$ SYM theory is used. The component structure of divergences in the bosonic sector is discussed.


title: Contrastive Neural Processes for Self-Supervised Learning

abstract: Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision. However, they are less successful in domains without established data transformations such as time series data. In this paper, we propose a novel self-supervised learning framework that combines contrastive learning with neural processes. It relies on recent advances in neural processes to perform time series forecasting. This allows to generate augmented versions of data by employing a set of various sampling functions and, hence, avoid manually designed augmentations. We extend conventional neural processes and propose a new contrastive loss to learn times series representations in a self-supervised setup. Therefore, unlike previous self-supervised methods, our augmentation pipeline is task-agnostic, enabling our method to perform well across various applications. In particular, a ResNet with a linear classifier trained using our approach is able to outperform state-of-the-art techniques across industrial, medical and audio datasets improving accuracy over 10% in ECG periodic data. We further demonstrate that our self-supervised representations are more efficient in the latent space, improving multiple clustering indexes and that fine-tuning our method on 10% of labels achieves results competitive to fully-supervised learning.


title: Technology Fitness Landscape for Design Innovation: A Deep Neural Embedding Approach Based on Patent Data

abstract: Technology is essential to innovation and economic prosperity. Understanding technological changes can guide innovators to find new directions of design innovation and thus make breakthroughs. In this work, we construct a technology fitness landscape via deep neural embeddings of patent data. The landscape consists of 1,757 technology domains and their respective improvement rates. In the landscape, we found a high hill related to information and communication technologies (ICT) and a vast low plain of the remaining domains. The landscape presents a bird's eye view of the structure of the total technology space, providing a new way for innovators to interpret technology evolution with a biological analogy, and a biologically-inspired inference to the next innovation.


title: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning

abstract: Goal-conditioned hierarchical reinforcement learning (HRL) has shown promising results for solving complex and long-horizon RL tasks. However, the action space of high-level policy in the goal-conditioned HRL is often large, so it results in poor exploration, leading to inefficiency in training. In this paper, we present HIerarchical reinforcement learning Guided by Landmarks (HIGL), a novel framework for training a high-level policy with a reduced action space guided by landmarks, i.e., promising states to explore. The key component of HIGL is twofold: (a) sampling landmarks that are informative for exploration and (b) encouraging the high-level policy to generate a subgoal towards a selected landmark. For (a), we consider two criteria: coverage of the entire visited state space (i.e., dispersion of states) and novelty of states (i.e., prediction error of a state). For (b), we select a landmark as the very first landmark in the shortest path in a graph whose nodes are landmarks. Our experiments demonstrate that our framework outperforms prior-arts across a variety of control tasks, thanks to efficient exploration guided by landmarks.


title: A Pipeline for Graph-Based Monitoring of the Changes in the Information Space of Russian Social Media during the Lockdown

abstract: With the COVID-19 outbreak and the subsequent lockdown, social media became a vital communication tool. The sudden outburst of online activity influenced information spread and consumption patterns. It increases the relevance of studying the dynamics of social networks and developing data processing pipelines that allow a comprehensive analysis of social media data in the temporal dimension. This paper scopes the weekly dynamics of the information space represented by Russian social media (Twitter and Livejournal) during a critical period (massive COVID-19 outbreak and first governmental measures). The approach is twofold: a) build the time series of topic similarity indicators by identifying COVID-related topics in each week and measuring user contribution to the topic space, and b) cluster user activity and display user-topic relationships on graphs in a dashboard application. The paper describes the development of the pipeline, explains the choices made and provides a case study of the adaptation to virus control measures. The results confirm that social processes and behaviour in response to pandemic-triggered changes can be successfully traced in social media. Moreover, the adaptation trends revealed by psychological and sociological studies are reflected in our data and can be explored using the proposed method.


title: Degree-Based Random Walk Approach for Graph Embedding

abstract: Graph embedding, representing local and global neighborhood information by numerical vectors, is a crucial part of the mathematical modeling of a wide range of real-world systems. Among the embedding algorithms, random walk-based algorithms have proven to be very successful. These algorithms collect information by creating numerous random walks with a redefined number of steps. Creating random walks is the most demanding part of the embedding process. The computation demand increases with the size of the network. Moreover, for real-world networks, considering all nodes on the same footing, the abundance of low-degree nodes creates an imbalanced data problem. In this work, a computationally less intensive and node connectivity aware uniform sampling method is proposed. In the proposed method, the number of random walks is created proportionally with the degree of the node. The advantages of the proposed algorithm become more enhanced when the algorithm is applied to large graphs. A comparative study by using two networks namely CORA and CiteSeer is presented. Comparing with the fixed number of walks case, the proposed method requires 50% less computational effort to reach the same accuracy for node classification and link prediction calculations.


title: New Tsallis Holographic Dark Energy

abstract: Tsallis entropy is a generalization of the Boltzmann-Gibbs entropy in statistical theory which uses a parameter $\delta$ to measure the deviation from the standard scenario quantitatively. Using concepts of Tsallis entropy and future event horizon, we construct a new Tsallis holographic dark energy model. The parameters $c$ and $\delta$ will be used to characterize various aspects of the model. Analytical expressions for various cosmological parameters such as the differential equation describing the evolution of the effective dark energy density parameter, the equation of state parameter and the deceleration parameter are obtained. The equation of state parameter for the current model exhibits the pure quintessence behaviour for $c>1$, quintom behaviour for $c<1$ whereas the $\Lambda$CDM model is recovered for $c=1$. To analyze the thermal history of the universe, we obtained the expression for the deceleration parameter and found that for $z \approx 0.6$, the phase transits from deceleration to acceleration.


title: Bayesian Optimization and Deep Learning forsteering wheel angle prediction

abstract: Automated driving systems (ADS) have undergone a significant improvement in the last years. ADS and more precisely self-driving cars technologies will change the way we perceive and know the world of transportation systems in terms of user experience, mode choices and business models. The emerging field of Deep Learning (DL) has been successfully applied for the development of innovative ADS solutions. However, the attempt to single out the best deep neural network architecture and tuning its hyperparameters are all expensive processes, both in terms of time and computational resources. In this work, Bayesian Optimization (BO) is used to optimize the hyperparameters of a Spatiotemporal-Long Short Term Memory (ST-LSTM) network with the aim to obtain an accurate model for the prediction of the steering angle in a ADS. BO was able to identify, within a limited number of trials, a model -- namely BOST-LSTM -- which resulted, on a public dataset, the most accurate when compared to classical end-to-end driving models.


title: Entangled photons from composite cascade emitters

abstract: Entangled photons are crucial for quantum technologies, but generating arbitrary entangled photon states deterministically, efficiently, and with high fidelity remains a challenge. Here, we demonstrate how hybridization and dipole-dipole interactions -- potentially simultaneously available in colloidal quantum dots and molecular aggregates -- leveraged in conjunction can couple simple, well understood emitters into composite emitters with flexible control over the level structure. We show that cascade decay through carefully designed level structures can result in emission of frequency-entangled photons with Bell states and three-photon GHZ states as example cases. These results pave the way toward rational design of quantum optical emitters of arbitrarily entangled photons.


title: On Chow stability and balanced embeddings

abstract: An important result of Zhang states that for a projective variety, the existence of a balanced embedding is equivalent to Chow stability. In this paper, we shall prove that Chow stability implies that a balanced embedding exists via the continuity method. Our proof is conditional on a technical hypothesis about restrictions of Hamiltonians to subschemes of projective space.


title: Generative Networks for Precision Enthusiasts

abstract: Generative networks are opening new avenues in fast event generation for the LHC. We show how generative flow networks can reach percent-level precision for kinematic distributions, how they can be trained jointly with a discriminator, and how this discriminator improves the generation. Our joint training relies on a novel coupling of the two networks which does not require a Nash equilibrium. We then estimate the generation uncertainties through a Bayesian network setup and through conditional data augmentation, while the discriminator ensures that there are no systematic inconsistencies compared to the training data.


title: Optimal non-pharmaceutical intervention policy for Covid-19 epidemic via neuroevolution algorithm

abstract: National responses to the Covid-19 pandemic varied markedly across countries, from business-as-usual to complete shutdowns. Policies aimed at disrupting the viral transmission cycle and preventing the healthcare system from being overwhelmed, simultaneously exact an economic toll. We developed a intervention policy model that comprised the relative human, economic and healthcare costs of non-pharmaceutical epidemic intervention and arrived at the optimal strategy using the neuroevolution algorithm. The proposed model finds the minimum required reduction in contact rates to maintain the burden on the healthcare system below the maximum capacity. We find that such a policy renders a sharp increase in the control strength at the early stages of the epidemic, followed by a steady increase in the subsequent ten weeks as the epidemic approaches its peak, and finally control strength is gradually decreased as the population moves towards herd immunity. We have also shown how such a model can provide an efficient adaptive intervention policy at different stages of the epidemic without having access to the entire history of its progression in the population. This work emphasizes the importance of imposing intervention measures early and provides insights into adaptive intervention policies to minimize the economic impacts of the epidemic without putting an extra burden on the healthcare system.


title: Stabilization and satellite construction of doubly slice links

abstract: A 2-component oriented link in $S^3$ is called weakly doubly slice if it is a cross-section of an unknotted sphere in $S^4$, and strongly doubly slice if it is a cross-section of a 2-component trivial spherical link in $S^4$. We give the first example of 2-component boundary links which are weakly doubly slice but not strongly doubly slice. We also introduce a new invariant $g_{st}$ of homotopically trivial links that measures the failure of a link from being strongly doubly slice and that bounds the doubly slice genus $g_{ds}$ from below. Our examples have arbitrarily large doubly slice genus but satisfy $g_{st}=1$. We also prove that the Conway-Orson signature lower bound on $g_{ds}$ is actually a lower bound on $g_{st}$.


title: Electromagnetic Viscosity in Complex Structured Environments: From black-body to Quantum Friction

abstract: We investigate the nonconservative open-system dynamics of an atom in a generic complex structured electromagnetic environment at temperature $T$. In such systems, when the atom moves along a translation-invariant axis of the environment, a frictional force acts on the particle. The effective viscosity due to friction results from the nonequilibrium interaction with the fluctuating (quantum) electromagnetic field, which effectively sets a privileged reference frame. We study the impact of both quantum or thermal fluctuations on the interaction and highlight how they induce qualitatively different types of viscosity, i.e. quantum and black-body friction. To this end, we develop a self-consistent non-Markovian description that contains the latter as special cases. In particular, we show how the interplay between the nonequilibrium dynamics, the quantum and the thermal properties of the radiation, as well as the confinement of light at the vacuum-material interface is responsible for several interesting and intriguing features. Our analyses is relevant for a future experimental test of noncontact friction and the resulting electromagnetic viscosity.


title: Searching for Axion-Like Particles with the Blazar Observations of MAGIC and Fermi-LAT

abstract: We explore the axion-like particle (ALP)-photon oscillation effect in the $\gamma$-ray spectra of the blazars Markarian 421 (Mrk 421) and PG 1553+113, which are measured by the Major Atmospheric Gamma Imaging Cherenkov Telescopes (MAGIC) and Fermi Large Area Telescope (Fermi-LAT) with high precision. We investigate the constraints on the ALP parameter space using the Mrk 421 and PG 1553+113 observations of 15 and 5 phases, respectively. We find that the combined analysis with all the 15 phases improves the limits from the Mrk 421 observations. The combined limit set by the Mrk 421 observations has excluded the ALP parameter region with the ALP-photon coupling of $g_{a\gamma} \gtrsim 2 \times 10^{-11} \, \rm GeV^{-1}$ for the ALP mass of $\sim 8\times 10^{-9}\, {\rm eV} \lesssim m_a \lesssim 2\times 10^{-7}\rm \, eV$ at 95% $\rm C.L.$ We also find that the ALP hypothesis can slightly improve the fit to the PG 1553+113 results in some parameter regions, and do not set the limit in this case.


title: Gas sensing technologies -- status, trends, perspectives and novel applications

abstract: The strong, continuous progresses in gas sensors and electronic noses resulted in improved performance and enabled an increasing range of applications with large impact on modern societies, such as environmental monitoring, food quality control and diagnostics by breath analysis. Here we review this field with special attention to established and emerging approaches as well as the most recent breakthroughs, challenges and perspectives. In particular, we focus on (1) the transduction principles employed in different architectures of gas sensors, analysing their advantages and limitations; (2) the sensing layers including recent trends toward nanostructured, low-dimensional and composite materials; (3) advances in signal processing methodologies, including the recent advent of artificial neural networks. Finally, we conclude with a summary on the latest achievements and trends in terms of applications.


title: EDLaaS: Fully Homomorphic Encryption Over Neural Network Graphs for Vision and Private Strawberry Yield Forecasting

abstract: We present automatically parameterised Fully Homomorphic Encryption (FHE) for encrypted neural network inference and exemplify our inference over FHE compatible neural networks with our own open-source framework and reproducible examples. We use the 4th generation Cheon, Kim, Kim and Song (CKKS) FHE scheme over fixed points provided by the Microsoft Simple Encrypted Arithmetic Library (MS-SEAL). We significantly enhance the usability and applicability of FHE in deep learning contexts, with a focus on the constituent graphs, traversal, and optimisation. We find that FHE is not a panacea for all privacy preserving machine learning (PPML) problems, and that certain limitations still remain, such as model training. However we also find that in certain contexts FHE is well suited for computing completely private predictions with neural networks. The ability to privately compute sensitive problems more easily, while lowering the barriers to entry, can allow otherwise too-sensitive fields to begin advantaging themselves of performant third-party neural networks. Lastly we show how encrypted deep learning can be applied to a sensitive real world problem in agri-food, i.e. strawberry yield forecasting, demonstrating competitive performance. We argue that the adoption of encrypted deep learning methods at scale could allow for a greater adoption of deep learning methodologies where privacy concerns exists, hence having a large positive potential impact within the agri-food sector and its journey to net zero.


title: Wet Scandium Etching for hard mask formation on a silicon substrate

abstract: Nowadays, microelectronics and nanoelectronics require the search for new materials, including masks for creating structures. Today, the intermediate hard mask strategy is one of the key issues in achieving a good balance between lithography and etching at the microelectronic fabrication. One of the interesting challenges in microelectronics and photovoltaics is the creation of interspacing, vertically oriented silicon arrays on Si substrate for semiconductor devices with multi-function. The fabrication of such structures is still a serious technological problem and requires searching for new approaches and materials. In this work, we propose using scandium as a new hard mask material over silicon due to its high resistance to plasma chemical etching and low sputtering coefficient. We have shown that a wet etching of the scandium layer with a thickness of several nanometers can be used to obtain pattern structures with a resolution of up to 4 microns, which is a good result for the wet etching approach. Scandium metal was found to be an excellent resistant mask over silicon under the selected plasma etching conditions. Therefore, a scandium hard mask can open up new possibilities for the formation of different microscale topographical patterns.


title: s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning

abstract: Pretrained bidirectional Transformers, such as BERT, have achieved significant improvements in a wide variety of language understanding tasks, while it is not straightforward to directly apply them for natural language generation. In this paper, we present a sequence-to-sequence fine-tuning toolkit s2s-ft, which adopts pretrained Transformers for conditional generation tasks. Inspired by UniLM, we implement three sequence-to-sequence fine-tuning algorithms, namely, causal fine-tuning, masked fine-tuning, and pseudo-masked fine-tuning. By leveraging the existing pretrained bidirectional Transformers, experimental results show that s2s-ft achieves strong performance on several benchmarks of abstractive summarization, and question generation. Moreover, we demonstrate that the package s2s-ft supports both monolingual and multilingual NLG tasks. The s2s-ft toolkit is available at https://github.com/microsoft/unilm/tree/master/s2s-ft.


title: The effects of draw restrictions on knockout tournaments

abstract: The paper analyses how draw constraints influence the outcome of a knockout tournament. The research question is inspired by European club football competitions, where the organiser generally imposes an association constraint in the first round of the knockout phase: teams from the same country cannot be drawn against each other. Its effects are explored in both theoretical and simulation models. An association constraint in the first round(s) is found to increase the likelihood of same nation matchups to approximately the same extent in each subsequent round. If the favourite teams are concentrated in some associations, they will have a higher probability to win the tournament under this policy but the increase is less than linear if it is used in more rounds. Our results might explain the recent introduction of the association constraint for both the knockout round play-offs with 16 teams and the Round of 16 in the UEFA Europa League and UEFA Europa Conference League.


title: Selective area epitaxy of PbTe-Pb hybrid nanowires on a lattice-matched substrate

abstract: Topological quantum computing is based on braiding of Majorana zero modes encoding topological qubits. A promising candidate platform for Majorana zero modes is semiconductor-superconductor hybrid nanowires. The realization of topological qubits and braiding operations requires scalable and disorder-free nanowire networks. Selective area growth of in-plane InAs and InSb nanowires, together with shadow-wall growth of superconductor structures, have demonstrated this scalability by achieving various network structures. However, the noticeable lattice mismatch at the nanowire-substrate interface, acting as a disorder source, imposes a serious obstacle along with this roadmap. Here, combining selective area and shadow-wall growth, we demonstrate the fabrication of PbTe-Pb hybrid nanowires - another potentially promising Majorana system - on a nearly perfectly lattice-matched substrate CdTe, all done in one molecular beam epitaxy chamber. Transmission electron microscopy shows the single-crystal nature of the PbTe nanowire and its atomically sharp and clean interfaces to the CdTe substrate and the Pb overlayer, without noticeable inter-diffusion or strain. The nearly ideal interface condition, together with the strong screening of charge impurities due to the large dielectric constant of PbTe, hold promise towards a clean nanowire system to study Majorana zero modes and topological quantum computing.


title: Zinc Oxide-Based Piezoelectric Pressure Sensor

abstract: This paper reports the application of zinc oxide (ZnO) in the pressure sensors that can be integrated with a microelectromechanical system (MEMS). ZnO is one of the materials that has received a great deal of attention due to its unique properties of being a semiconductor with wide bandgap and piezoelectric effects. The simpler crystal growth mechanisms of ZnO have resulted in a lower cost of ZnO-based sensors. Different types of pressure sensors based on ZnO sensing elements have also been explored. A thin circular ZnO film was simulated as a piezoelectric sensor employing the finite element method in COMSOL. The pressure applied on the thin film surface was varied and a boundary point probe was used to study the displacement field and voltage at the center of the membrane. The displacement field and voltage induced by pressure vary linearly with increasing pressure on the ZnO layer. Also. the method used in this paper was applied to different piezoelectric materials, such as barium titanate (BaTiO3), polyvinylidene fluoride (PVDF), and gallium arsenide (GaAs) that were studied by other groups, and similar conclusions were made. These simulations can be used in the design of piezoelectric sensors and the optimization of the sensitivity and performance of the materials used in pressure sensor applications.


title: Optical interface for a hybrid magnon-photon resonator

abstract: We study optical detection of magnetic resonance of a ferrimagnetic sphere resonator, which is strongly coupled to a microwave loop gap resonator. Optical fibers are employed for coupling the sphere resonator with light in the telecom band. We find that magnetic resonance can be optically detected in the region of anti-crossing between the loop gap and the ferrimagnetic resonances. By measuring the response time of the optical detection we rule out the possibility that microwave induced heating is responsible for the optical detectability.


title: Symmetric properties and two variants of shuffle-cubes

abstract: Li et al. in [Inf. Process. Lett. 77 (2001) 35--41] proposed the shuffle cube $SQ_{n}$ as an attractive interconnection network topology for massive parallel and distributed systems. By far, symmetric properties of the shuffle cube remains unknown. In this paper, we show that $SQ_{n}$ is not vertex-transitive for all $n>2$, which is not an appealing property in interconnection networks. To overcome this limitation, two novel vertex-transitive variants of the shuffle-cube, namely simplified shuffle-cube $SSQ_{n}$ and balanced shuffle cube $BSQ_{n}$ are introduced. Then, routing algorithms of $SSQ_{n}$ and $BSQ_{n}$ for all $n>2$ are given respectively. Furthermore, we show that both $SSQ_{n}$ and $BSQ_{n}$ possess Hamiltonian cycle embedding for all $n>2$. Finally, as a by-product, we mend a flaw in the Property 3 in [IEEE Trans. Comput. 46 (1997) 484--490].


title: $H_2$-reducible matrices in six-dimensional mutually unbiased bases

abstract: Finding four six-dimensional mutually unbiased bases (MUBs) containing the identity matrix is a long-standing open problem in quantum information. We show that if they exist, then the $H_2$-reducible matrix in the four MUBs has exactly nine $2\times2$ Hadamard submatrices. We apply our result to exclude from the four MUBs some known CHMs, such as symmetric $H_2$-reducible matrix, the Hermitian matrix, Dita family, Bjorck's circulant matrix, and Szollosi family. Our results represent the latest progress on the existence of six-dimensional MUBs.


title: Resonant mode coupling approximation for calculation of optical spectra of photonic crystal slabs

abstract: We develop the resonant mode coupling approximation to calculate the optical spectra of a stack of two photonic crystal slabs. The method is based on a derivation of the input and output resonant vectors in each slab in terms of the Fourier modal method in the scattering matrix form. We show that using the resonant mode coupling approximation of the scattering matrices of the upper and lower slabs, one can construct the total scattering matrix of the stack. The formation of the resonant output and input vectors of the stacked system is rigorously derived by means of an effective Hamiltonian. We demonstrate that the proposed procedure dramatically decreases the computation time without sufficient loss of accuracy. We believe that the proposed technique can be a powerful tool for fast solving inverse scattering problems using stochastic optimization methods such as genetic algorithms or machine learning.


title: Anonymous multi-party quantum computation with a third party

abstract: We reconsider and modify the second secure multi-party quantum addition protocol proposed in our original work. We show that the protocol is an anonymous multi-party quantum addition protocol rather than a secure multi-party quantum addition protocol. Through small changes, we develop the protocol to propose, for the first time, anonymous multiparty quantum computation with a third party, who faithfully executes protocol processes, but is interested in the identity of the data owners. Further, we propose a new anonymous multiparty quantum protocol based on our original protocol. We calculate the success probability of the proposed protocols, which is also a modification of the success probability of the original protocols.


title: An algorithm for the computation of joint Hawkes moments with exponential kernel

abstract: The purpose of this paper is to present a recursive algorithm and its implementation in Maple and Mathematica for the computation of joint moments and cumulants of Hawkes processes with exponential kernels. Numerical results and computation times are also discussed. Obtaining closed form expressions can be computationally intensive, as joint fifth cumulant and moment formulas can be respectively expanded into up to 3,288 and 27,116 summands.


title: GANash -- A GAN approach to steganography

abstract: Data security is of the utmost concern of a communication system. Since the early days, many developments have been made to improve the performance of the system. PSNR of the received signal, secure transmission channel, quality of encoding used, etc. are some of the key attributes of a good system. To ensure security, the most commonly used technique is cryptography in which the message is altered with respect to a key and using the same, the encoded message is decoded at the receiver side. A complementary technique that is popularly used to insure security is steganography. The advancements in Artificial Intelligence(AI) have paved way for performing steganography in an intelligent, tamper-proof manner. The recent discovery by researchers in the field of Deep Learning(DL), an unsupervised learning network known as the Generative Adversarial Networks(GAN) has improved the performance of this technique exponentially. It has been demonstrated that deep neural networks are highly sensitive to tiny perturbations of input data, giving rise to adversarial examples. Though this property is usually considered a weakness of learned models, it could be beneficial if used appropriately. The work that has been accomplished by MIT for this purpose, a deep-neural model by the name of SteganoGAN, has shown obligation for using this technique for steganography. In this work, we have proposed a novel approach to improve the performance of the existing system using latent space compression on the encoded data. This theoretically would improve the performance exponentially. Thus, the algorithms used to improve the system's performance and the results obtained have been enunciated in this work. The results indicate the level of dominance this system could achieve to be able to diminish the difficulties in solving real-time problems in terms of security, deployment and database management.


title: Quantum contribution to luminosity of quasars

abstract: The accretion of galactic gas is regarded as the source of the giant luminosity of quasars. The gravitational energy converts itself into radiation close to the Schwarzschild horizon of the central supermassive black hole with efficiency of ca. 30% mass to radiation energy conversion rate. Particularities of such an extremely effective mechanism of mass to energy conversion are, however, still obscure. We propose to take into account quantum statistics properties of fermions, which could emit in close outer vicinity of the Schwarzschild zone a giant energy accumulated in the Fermi spheres of electrons and protons in degenerate quantum collective state created in this region by the gravitational compression of plasma. The release of photons is possible due to the local revoking of Pauli exclusion principle constraint induced by the rapid change of the homotopy of multiparticle trajectories beneath the innermost unstable circular orbit of the black hole, which causes the collapse of Fermi spheres of electrons and protons.


title: A Precision Diagnostic Framework of Renal Cell Carcinoma on Whole-Slide Images using Deep Learning

abstract: Diagnostic pathology, which is the basis and gold standard of cancer diagnosis, provides essential information on the prognosis of the disease and vital evidence for clinical treatment. Tumor region detection, subtype and grade classification are the fundamental diagnostic indicators for renal cell carcinoma (RCC) in whole-slide images (WSIs). However, pathological diagnosis is subjective, differences in observation and diagnosis between pathologists is common in hospitals with inadequate diagnostic capacity. The main challenge for developing deep learning based RCC diagnostic system is the lack of large-scale datasets with precise annotations. In this work, we proposed a deep learning-based framework for analyzing histopathological images of patients with renal cell carcinoma, which has the potential to achieve pathologist-level accuracy in diagnosis. A deep convolutional neural network (InceptionV3) was trained on the high-quality annotated dataset of The Cancer Genome Atlas (TCGA) whole-slide histopathological image for accurate tumor area detection, classification of RCC subtypes, and ISUP grades classification of clear cell carcinoma subtypes. These results suggest that our framework can help pathologists in the detection of cancer region and classification of subtypes and grades, which could be applied to any cancer type, providing auxiliary diagnosis and promoting clinical consensus.


title: Learning Speaker Representation with Semi-supervised Learning approach for Speaker Profiling

abstract: Speaker profiling, which aims to estimate speaker characteristics such as age and height, has a wide range of applications inforensics, recommendation systems, etc. In this work, we propose a semisupervised learning approach to mitigate the issue of low training data for speaker profiling. This is done by utilizing external corpus with speaker information to train a better representation which can help to improve the speaker profiling systems. Specifically, besides the standard supervised learning path, the proposed framework has two more paths: (1) an unsupervised speaker representation learning path that helps to capture the speaker information; (2) a consistency training path that helps to improve the robustness of the system by enforcing it to produce similar predictions for utterances of the same speaker.The proposed approach is evaluated on the TIMIT and NISP datasets for age, height, and gender estimation, while the Librispeech is used as the unsupervised external corpus. Trained both on single-task and multi-task settings, our approach was able to achieve state-of-the-art results on age estimation on the TIMIT Test dataset with Root Mean Square Error(RMSE) of6.8 and 7.4 years and Mean Absolute Error(MAE) of 4.8 and5.0 years for male and female speakers respectively.


title: Decentralized Thermal Control of Buildings

abstract: Energy requirements for heating and cooling of buildings constitute a major fraction of end use energy consumed. Therefore, it is important to provide the occupant comfort requirements in buildings in an energy efficient manner. However, buildings are large scale complex systems, susceptible to sensor, actuator or communication network failures in their thermal control infrastructure, that can affect their performance in terms of occupant comfort and energy efficiency. The degree of decentralization in the control architecture determines a fundamental tradeoff between performance and robustness. This thesis studies the problem of thermal control of buildings from the perspective of partitioning them into clusters for decentralized control, to balance underlying performance and robustness requirements. Measures of deviation in performance and robustness between centralized and decentralized architectures in the Model Predictive Control framework are derived. Appropriate clustering algorithms are then proposed to determine decentralized control architectures which provide a satisfactory trade-off between the underlying performance and robustness objectives. Two different partitioning methodologies the CLF-MCS method and the OLF-FPM method are developed and compared. The problem of decentralized control design based on the architectures obtained using these methodologies is also considered. It entails the use of decentralized extended state observers to address the issue of unavailability of unknown states and disturbances in the system. The potential use of the proposed control architecture selection and decentralized control design methodologies is demonstrated in simulation on a real world multi-zone building.


title: Bridging the gap to real-world for network intrusion detection systems with data-centric approach

abstract: Most research using machine learning (ML) for network intrusion detection systems (NIDS) uses well-established datasets such as KDD-CUP99, NSL-KDD, UNSW-NB15, and CICIDS-2017. In this context, the possibilities of machine learning techniques are explored, aiming for metrics improvements compared to the published baselines (model-centric approach). However, those datasets present some limitations as aging that make it unfeasible to transpose those ML-based solutions to real-world applications. This paper presents a systematic data-centric approach to address the current limitations of NIDS research, specifically the datasets. This approach generates NIDS datasets composed of the most recent network traffic and attacks, with the labeling process integrated by design.


title: CLLD: Contrastive Learning with Label Distance for Text Classification

abstract: Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between similar texts cannot be effectively distinguished by advanced pre-trained models, which have a great influence on the performance of hard-to-distinguish classes. To address this problem, we propose a novel Contrastive Learning with Label Distance (CLLD) in this work. Inspired by recent advances in contrastive learning, we specifically design a classification method with label distance for learning contrastive classes. CLLD ensures the flexibility within the subtle differences that lead to different label assignments, and generates the distinct representations for each class having similarity simultaneously. Extensive experiments on public benchmarks and internal datasets demonstrate that our method improves the performance of pre-trained models on classification tasks. Importantly, our experiments suggest that the learned label distance relieve the adversarial nature of interclasses.


title: Riesz capacities of a set due to Dobi\'nski

abstract: We study the Riesz $(a,p)$-capacity of the so called Dobi\'nski set. We characterize the values of the parameters $a$ and $p$ for which the $(a,p)$-Riesz capacity of the Dobi\'nski set is positive. In particular we show that the Dobi\'nski set has positive logarithmic capacity, thus answering a question of Dayan, Fernand\'ez and Gonz\'alez. We approach the problem by considering the dyadic analogues of the Riesz $(a,p)$-capacities which seem to be better adapted to the problem.


title: Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios?

abstract: Recent impressive improvements in NLP, largely based on the success of contextual neural language models, have been mostly demonstrated on at most a couple dozen high-resource languages. Building language models and, more generally, NLP systems for non-standardized and low-resource languages remains a challenging task. In this work, we focus on North-African colloquial dialectal Arabic written using an extension of the Latin script, called NArabizi, found mostly on social media and messaging communication. In this low-resource scenario with data displaying a high level of variability, we compare the downstream performance of a character-based language model on part-of-speech tagging and dependency parsing to that of monolingual and multilingual models. We show that a character-based model trained on only 99k sentences of NArabizi and fined-tuned on a small treebank of this language leads to performance close to those obtained with the same architecture pre-trained on large multilingual and monolingual models. Confirming these results a on much larger data set of noisy French user-generated content, we argue that such character-based language models can be an asset for NLP in low-resource and high language variability set-tings.


title: A class of quantum synchronizable codes of length $2^n$ over ${\rm F}_q$

abstract: Quantum synchronizable codes (QSCs) are special quantum error-correcting codes which can be used to correct the effects of quantum noise on qubits and misalignment in block synchronization. In this paper, a new class of quantum synchronizable codes of length $2^n$ are constructed by using the cyclotomic cosets, whose synchronization capabilities always reach the upper bound $2^n$.


title: Energy density balance during shock wave implosion in water

abstract: Analytical modeling of the evolution of cylindrical and spherical shock waves (shocks) during an implosion in water is presented for an intermediate range of convergence radii. Up to now this range is determined only in experiments observations as a range of implosion radii which are already far from the piston influence, but yet not described by well-known self-similar solutions. The model is based on an analysis of the change in pressure and kinetic energy density, as well as on the corresponding fluxes of internal and kinetic energy densities behind the shock front. It shows that the spatial evolution of the shock velocity strongly depends on the initial compression, the adiabatic index of water, and the geometry of convergence. The model also explains the transition to a rapid like self-similar increase in the shock velocity at only a certain radius of the shock that is observed in experiments. The dependence of the threshold radius, where the shock implosion follows the power law (quasi self-similarity), on the initial compression is determined. It is stated that in the entire range of the shock radii the internal and kinetic energy density fluxes are equal, which is in agreement with known experimental data.