title: Energy loss reduction of a charge moving through an anisotropic plasma-like medium

abstract: We analyze radiation of a charge moving in a vacuum channel in an anisotropic non-gyrotropic medium with plasma-like components of the permittivity tensor. The expressions for field components are obtained and analyzed. It is shown that the field contains both the radiation field and the plasma oscillations. Most attention is focused on the energy loss of the charge per the unit path length. The dependencies of the loss on the charge velocity and the plasma frequencies are studied. The relative roles of radiation loss and polarization one are considered. The most interesting result is that the energy loss is negligible when one of the permittivity tensor components is equal to 1, and the charge velocity tends to the speed of light in vacuum. This effect can be promising for applying in collimators of ultrarelativistic bunches.


title: The Second Plateau in X-ray Afterglow Providing Additional Evidence for Rapidly Spinning Magnetars as the GRB Central Engine

abstract: Evidence for the central engine of gamma-ray bursts (GRBs) has been collected in the Neil Gehrels \emph{Swift} data. For instance, some GRBs show an internal X-ray plateau followed by very steep decay, which is difficult to be interpreted within the framework of a black hole (BH) central engine, but are consistent within a rapidly spinning magnetar engine picture. The very steep decay at the end of the plateau suggests a sudden cessation of the central engine, which is explained as the collapse of a supra-massive magnetar into a black hole when it spins down. Here we propose that some additional evidence, such as a second X-ray plateau feature would show up, if the fall-back accretion could activate the newborn BH and sufficient energy could be transferred from the newborn BH to the GRB blast wave. With a systematic data analysis for all long GRBs, we find three candidates in \emph{Swift} sample, i.e., GRBs 070802, 090111, and 120213A, whose X-ray afterglow light curves contain two plateaus, with the first one being an internal plateau. We find that in a fairly loose and reasonable parameter space, the second X-ray plateau data for all 3 GRBs could be well interpreted with our proposed model. Future observations are likely to discover more similar events, which could offer more information of the properties of the magnetar as well as the newborn BH.


title: Supportive Actions for Manipulation in Human-Robot Coworker Teams

abstract: The increasing presence of robots alongside humans, such as in human-robot teams in manufacturing, gives rise to research questions about the kind of behaviors people prefer in their robot counterparts. We term actions that support interaction by reducing future interference with others as supportive robot actions and investigate their utility in a co-located manipulation scenario. We compare two robot modes in a shared table pick-and-place task: (1) Task-oriented: the robot only takes actions to further its own task objective and (2) Supportive: the robot sometimes prefers supportive actions to task-oriented ones when they reduce future goal-conflicts. Our experiments in simulation, using a simplified human model, reveal that supportive actions reduce the interference between agents, especially in more difficult tasks, but also cause the robot to take longer to complete the task. We implemented these modes on a physical robot in a user study where a human and a robot perform object placement on a shared table. Our results show that a supportive robot was perceived as a more favorable coworker by the human and also reduced interference with the human in the more difficult of two scenarios. However, it also took longer to complete the task highlighting an interesting trade-off between task-efficiency and human-preference that needs to be considered before designing robot behavior for close-proximity manipulation scenarios.


title: Exploring and Predicting Transferability across NLP Tasks

abstract: Recent advances in NLP demonstrate the effectiveness of training large-scale language models and transferring them to downstream tasks. Can fine-tuning these models on tasks other than language modeling further improve performance? In this paper, we conduct an extensive study of the transferability between 33 NLP tasks across three broad classes of problems (text classification, question answering, and sequence labeling). Our results show that transfer learning is more beneficial than previously thought, especially when target task data is scarce, and can improve performance even when the source task is small or differs substantially from the target task (e.g., part-of-speech tagging transfers well to the DROP QA dataset). We also develop task embeddings that can be used to predict the most transferable source tasks for a given target task, and we validate their effectiveness in experiments controlled for source and target data size. Overall, our experiments reveal that factors such as source data size, task and domain similarity, and task complexity all play a role in determining transferability.


title: ProtoQA: A Question Answering Dataset for Prototypical Common-Sense Reasoning

abstract: Given questions regarding some prototypical situation such as Name something that people usually do before they leave the house for work? a human can easily answer them via acquired experiences. There can be multiple right answers for such questions, with some more common for a situation than others. This paper introduces a new question answering dataset for training and evaluating common sense reasoning capabilities of artificial intelligence systems in such prototypical situations. The training set is gathered from an existing set of questions played in a long-running international game show FAMILY- FEUD. The hidden evaluation set is created by gathering answers for each question from 100 crowd-workers. We also propose a generative evaluation task where a model has to output a ranked list of answers, ideally covering all prototypical answers for a question. After presenting multiple competitive baseline models, we find that human performance still exceeds model scores on all evaluation metrics with a meaningful gap, supporting the challenging nature of the task.


title: Alternating Convolutions of Catalan Numbers

abstract: A new class of alternating convolutions concerning binomial coefficients and Catalan numbers are evaluated in closed forms.


title: Complex fluids in the animal kingdom

abstract: Animals have evolved distinctive survival strategies in response to constant selective pressure. In this review, we highlight how animals exploit complex flow phenomena by manipulating their habitat or by producing complex fluids. In particular, we outline different strategies evolved for movement, defense from predators, attacking of prey, and reproduction and breeding. From the slimy defense of the notorious hagfish to the circus-like mating spectacle of leopard slugs, we unveil remarkable correlations within the flow behavior and biological purpose of biological complex fluids. We discuss recurring phenomena, propose flow behavior for undescribed complex fluids, and put these in context with the animals survival strategy. With this review, we hope to underline the importance of complex fluids and material flow in the animal kingdom.


title: Spreading out the Hodge filtration in non-archimedean geometry

abstract: The goal of the current text is to study non-archimedean analytic derived de Rham cohomology by means of formal completions. Our approach is inspired by the deformation to the normal cone provided in \cite{Gaitsgory_Study_II}. More specifically, given a morphism $f \colon X \to Y$ of (derived) $k$-analytic spaces we construct the \emph{non-archimedean deformation to the normal cone} associated to $f$. The latter can be thought as an $\mathbf A^1_k$-parametrized deformation whose fiber at $1 \in \mathbf A^1_k$ coincides with the formal completion of $f$ and the fiber at $0 \in \mathbf A^1_k$ with the (derived) normal cone associated to $f$. We further show that such deformation can be endowed with a natural filtration which spreads out the usual Hodge filtration on the (completed shifted) analytic tangent bundle to the formal completion. Such filtration agrees with the $I$-adic filtration in the case where $f$ is a locally complete intersection morphism between (derived) $k$-affinoid spaces. Along the way we develop the theory of (ind-inf)-$k$-analytic spaces or in other words $k$-analytic formal moduli problems.


title: Quark and lepton flavors with common modulus $\tau$ in $A_4$ modular symmetry

abstract: We study quark and lepton mass matrices with the common modulus $\tau$ in the $A_4$ modular symmetry. The viable quark mass matrices are composed of modular forms of weights $2$, $4$ and $6$. It is remarked that the modulus $\tau$ is close to $i$, which is a fixed point in the fundamental region of SL$(2,Z)$, and the CP symmetry is not violated. Indeed, the observed CP violation is reproduced at $\tau$ which is deviated a little bit from $\tau=i$. The charged lepton mass matrix is also given by using modular forms of weights $2$, $4$ and $6$, where five cases have been examined. The neutrino mass matrix is generated in terms of the modular forms of weight $4$ through the Weinberg operator. Lepton mass matrices are also consistent with the observed mixing angles at $\tau$ close to $i$ for NH of neutrino masses. Allowed regions of $\tau$ of quarks and leptons overlap each other for all cases of the charged lepton mass matrix. However, the sum of neutrino masses is crucial to test the common $\tau$ for quarks and leptons. The minimal sum of neutrino masses $\sum m_i$ is $140$meV at the common $\tau$. The inverted hierarchy of neutrino masses is unfavorable in our framework. It is emphasized that our result suggests the residual symmetry $\mathbb{Z}_2^{S}=\{ I, S \}$ in the quark and lepton mass matrices.


title: Results on Total and Elastic Cross Sections in Proton-Proton Collisions at $\sqrt{s}$ = 200 GeV Obtained with the STAR Detector at RHIC

abstract: We report the first results on differential, total and elastic cross sections in proton-proton collisions at the Relativistic Heavy Ion Collider (RHIC) at $\sqrt{s}=200$ GeV. The data lwere obtained with the Roman Pot Detector subsystem of the STAR experiment. The data used for this analysis cover the four-momentum transfer squared ~($t$) range $ 0.045 \le |t| \le 0.135$ (GeV/c)$^2$. The Roman Pot system was placed downstream of the STAR detector. During the data taking the Roman Pots were moved to ~8$\sigma_{y}$, the vertical distance of from the beam center. They were operated during standard data taking procedure. The results include values of the exponential slope parameter (B), elastic cross section ($\sigma_{el}$) and the total cross section ($\sigma_{tot}$) obtained by extrapolation of the elastic differential cross section ($d\sigma/dt$) to the optical point at $|t| = 0$ (GeV/c)$^{2}$. The detector setup and analysis procedure are reviewed. All results are compared with the world data.


title: Deep Feature Mining via Attention-based BiLSTM-GCN for Human Motor Imagery Recognition

abstract: Recognition accuracy and response time are both critically essential ahead of building practical electroencephalography (EEG) based brain-computer interface (BCI). Recent approaches, however, have either compromised in the classification accuracy or responding time. This paper presents a novel deep learning approach designed towards remarkably accurate and responsive motor imagery (MI) recognition based on scalp EEG. Bidirectional Long Short-term Memory (BiLSTM) with the Attention mechanism manages to derive relevant features from raw EEG signals. The connected graph convolutional neural network (GCN) promotes the decoding performance by cooperating with the topological structure of features, which are estimated from the overall data. The 0.4-second detection framework has shown effective and efficient prediction based on individual and group-wise training, with 98.81% and 94.64% accuracy, respectively, which outperformed all the state-of-the-art studies. The introduced deep feature mining approach can precisely recognize human motion intents from raw EEG signals, which paves the road to translate the EEG based MI recognition to practical BCI systems.


title: A self-monitoring precision calibration light source for large-volume neutrino telescopes

abstract: With the rise of neutrino astronomy using large-volume detector arrays, calibration improvements of optical media and photosensors have emerged as significant means to reduce detector systematics. To improve understanding of the detector volume and its instrumentation, we developed an absolutely-calibrated, self-monitoring, isotropic, nanosecond, high-intensity calibration light source called "Precision Optical Calibration Module" (POCAM). This now third iteration of the instrument was developed for an application in the IceCube Upgrade but, with a modular instrument communications and synchronization backend, can provide a calibration light source standard for any large-volume photodetector array. This work summarizes the functional principle of the POCAM and all related device characteristics as well as its precision calibration procedure. The latter provides fingerprint-characterized instruments with knowledge on absolute and relative behavior of the emitted light pulses as well as their temperature dependencies.


title: Low Mass Group Environments have no Substantial Impact on the Circumgalactic Medium Metallicity

abstract: We explore how environment affects the metallicity of the circumgalactic medium (CGM) using 13 low mass galaxy groups (2-5 galaxies) at $\langle z_{abs}\rangle=0.25$ identified near background quasars. Using quasar spectra from HST/COS and from Keck/HIRES or VLT/UVES we measure column densities of, or determine limits on, CGM absorption lines. We use a Markov chain Monte Carlo approach with Cloudy to estimate metallicities of cool ($T\sim10^4$K) CGM gas within groups and compare them to CGM metallicities of 47 isolated galaxies. Both group and isolated CGM metallicities span a wide range ($-2<$[Si/H]$<0$), where the mean group ($-0.54\pm0.22$) and isolated ($-0.77\pm0.14$) CGM metallicities are similar. Group and isolated environments have similar distributions of {\HI} column densities as a function of impact parameter. However, contrary to isolated galaxies, we do not find an anti-correlation between {\HI} column density and the nearest group galaxy impact parameter. We additionally divided the groups by member luminosity ratios (i.e., galaxy-galaxy and galaxy-dwarf groups). While there was no significant difference in their mean metallicities, a modest increase in sample size should allow one to statistically identify a higher CGM metallicity in galaxy-dwarf groups compared to galaxy-galaxy groups. We conclude that either environmental effects have not played an important role in the metallicity of the CGM at this stage and expect that this may only occur when galaxies are strongly interacting or merging, or that some isolated galaxies have higher CGM metallicities due to past interactions. Thus, environment does not seem to be the cause of the CGM metallicity bimodality.


title: Approximations Related to the Sums of $m$-dependent Random Variables

abstract: In this paper, we consider the sums of non-negative integer valued $m$-dependent random variables, and its approximation to the power series distribution. We first discuss some relevant results for power series distribution such as Stein operator, uniform and non-uniform bounds on the solution of Stein equation, and etc. Using Stein's method, we obtain the error bounds for the approximation problem considered. As special cases, we discuss two applications, namely, $2$-runs and $(k_1,k_2)$-runs and compare the bound with the existing bounds.


title: A Survey on Cellular-connected UAVs: Design Challenges, Enabling 5G/B5G Innovations, and Experimental Advancements

abstract: As an emerging field of aerial robotics, Unmanned Aerial Vehicles (UAVs) have gained significant research interest within the wireless networking research community. As soon as national legislations allow UAVs to fly autonomously, we will see swarms of UAV populating the sky of our smart cities to accomplish different missions: parcel delivery, infrastructure monitoring, event filming, surveillance, tracking, etc. The UAV ecosystem can benefit from existing 5G/B5G cellular networks, which can be exploited in different ways to enhance UAV communications. Because of the inherent characteristics of UAV pertaining to flexible mobility in 3D space, autonomous operation and intelligent placement, these smart devices cater to wide range of wireless applications and use cases. This work aims at presenting an in-depth exploration of integration synergies between 5G/B5G cellular systems and UAV technology, where the UAV is integrated as a new aerial User Equipment (UE) to existing cellular networks. In this integration, the UAVs perform the role of flying users within cellular coverage, thus they are termed as cellular-connected UAVs (a.k.a. UAV-UE, drone-UE, 5G-connected drone, or aerial user). The main focus of this work is to present an extensive study of integration challenges along with key 5G/B5G technological innovations and ongoing efforts in design prototyping and field trials corroborating cellular-connected UAVs. This study highlights recent progress updates with respect to 3GPP standardization and emphasizes socio-economic concerns that must be accounted before successful adoption of this promising technology. Various open problems paving the path to future research opportunities are also discussed.


title: RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms

abstract: Pre-trained language models (PTLMs) have achieved impressive performance on commonsense inference benchmarks, but their ability to employ commonsense to make robust inferences, which is crucial for effective communications with humans, is debated. In the pursuit of advancing fluid human-AI communication, we propose a new challenge, RICA: Robust Inference capability based on Commonsense Axioms, that evaluates robust commonsense inference despite textual perturbations. To generate data for this challenge, we develop a systematic and scalable procedure using commonsense knowledge bases and probe PTLMs across two different evaluation settings. Extensive experiments on our generated probe sets with more than 10k statements show that PTLMs perform no better than random guessing on the zero-shot setting, are heavily impacted by statistical biases, and are not robust to perturbation attacks. We also find that fine-tuning on similar statements offer limited gains, as PTLMs still fail to generalize to unseen inferences. Our new large-scale benchmark exposes a significant gap between PTLMs and human-level language understanding and offers a new challenge for PTLMs to demonstrate commonsense.


title: Differentially Private Generation of Small Images

abstract: We explore the training of generative adversarial networks with differential privacy to anonymize image data sets. On MNIST, we numerically measure the privacy-utility trade-off using parameters from $\epsilon$-$\delta$ differential privacy and the inception score. Our experiments uncover a saturated training regime where an increasing privacy budget adds little to the quality of generated images. We also explain analytically why differentially private Adam optimization is independent of the gradient clipping parameter. Furthermore, we highlight common errors in previous works on differentially private deep learning, which we uncovered in recent literature. Throughout the treatment of the subject, we hope to prevent erroneous estimates of anonymity in the future.


title: Ball k-means

abstract: This paper presents a novel accelerated exact k-means algorithm called the Ball k-means algorithm, which uses a ball to describe a cluster, focusing on reducing the point-centroid distance computation. The Ball k-means can accurately find the neighbor clusters for each cluster resulting distance computations only between a point and its neighbor clusters' centroids instead of all centroids. Moreover, each cluster can be divided into a stable area and an active area, and the later one can be further divided into annulus areas. The assigned cluster of the points in the stable area is not changed in the current iteration while the points in the annulus area will be adjusted within a few neighbor clusters in the current iteration. Also, there are no upper or lower bounds in the proposed Ball k-means. Furthermore, reducing centroid-centroid distance computation between iterations makes it efficient for large k clustering. The fast speed, no extra parameters and simple design of the Ball k-means make it an all-around replacement of the naive k-means algorithm.


title: Visually Grounded Continual Learning of Compositional Phrases

abstract: Humans acquire language continually with much more limited access to data samples at a time, as compared to contemporary NLP systems. To study this human-like language acquisition ability, we present VisCOLL, a visually grounded language learning task, which simulates the continual acquisition of compositional phrases from streaming visual scenes. In the task, models are trained on a paired image-caption stream which has shifting object distribution; while being constantly evaluated by a visually-grounded masked language prediction task on held-out test sets. VisCOLL compounds the challenges of continual learning (i.e., learning from continuously shifting data distribution) and compositional generalization (i.e., generalizing to novel compositions). To facilitate research on VisCOLL, we construct two datasets, COCO-shift and Flickr-shift, and benchmark them using different continual learning methods. Results reveal that SoTA continual learning approaches provide little to no improvements on VisCOLL, since storing examples of all possible compositions is infeasible. We conduct further ablations and analysis to guide future work.


title: Visible and near-infrared observations of interstellar comet 2I/Borisov with the 10.4-m GTC and the 3.6-m TNG telescopes

abstract: In this work, we present the results of an observational study of 2I/Borisov carried out with the 10.4-m Gran Telescopio Canarias (GTC) and the 3.6-m Telescopio Nazionale Galileo (TNG), both telescopes located at the Roque de Los Muchachos Observatory, in the island of La Palma (Spain). The study includes images in the visible and near-infrared, as well as visible spectra in the 3600 - 9200 A wavelength range. N-body simulations were also performed to explore its orbital evolution and Galactic kinematic context. The comet's dust continuum and near-infrared colours are compatible with those observed for Solar system comets. From its visible spectrum on the nights of 2019, September 24 and 26 we measured CN gas production rates Q(CN) = (2.3 +- 0.4) x 10^{24} mol/s and Q(CN) = (9.5 +- 0.2) x 10^{24} mol/s, respectively, in agreement with measurements reported by other authors on similar nights. We also obtained an upper limit for the C2 production rate of Q(C2) < (4.5 +- 0.1) x 10^{24} mol/s. Dust modelling results indicate a moderate dust production rate of about 50 kg/s at heliocentric distance r_h=2.6 au, with a differential power-law dust size distribution of index -3.4, within the range reported for many comet comae. Our simulations show that the Galactic velocity of 2I/Borisov matches well that of known stars in the solar neighbourhood and also those of more distant regions of the Galactic disc.


title: Anisotropic Spin-Acoustic Resonance in Silicon Carbide at Room Temperature

abstract: We report on acoustically driven spin resonances in atomic-scale centers in silicon carbide at room temperature. Specifically, we use a surface acoustic wave cavity to selectively address spin transitions with magnetic quantum number differences of $\pm$1 and $\pm$2 in the absence of external microwave electromagnetic fields. These spin-acoustic resonances reveal a non-trivial dependence on the static magnetic field orientation, which is attributed to the intrinsic symmetry of the acoustic fields combined with the peculiar properties of a half-integer spin system. We develop a microscopic model of the spin-acoustic interaction, which describes our experimental data without fitting parameters. Furthermore, we predict that traveling surface waves lead to a chiral spin-acoustic resonance, which changes upon magnetic field inversion. These results establish silicon carbide as a highly-promising hybrid platform for on-chip spin-optomechanical quantum control enabling engineered interactions at room temperature.


title: A complement to the Chebyshev integral inequality

abstract: We give necessary and sufficient conditions for the Chebyshev inequality to be an equality.


title: Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning

abstract: Has there been real progress in multi-hop question-answering? Models often exploit dataset artifacts to produce correct answers, without connecting information across multiple supporting facts. This limits our ability to measure true progress and defeats the purpose of building multi-hop QA datasets. We make three contributions towards addressing this. First, we formalize such undesirable behavior as disconnected reasoning across subsets of supporting facts. This allows developing a model-agnostic probe for measuring how much any model can cheat via disconnected reasoning. Second, using a notion of \emph{contrastive support sufficiency}, we introduce an automatic transformation of existing datasets that reduces the amount of disconnected reasoning. Third, our experiments suggest that there hasn't been much progress in multi-hop QA in the reading comprehension setting. For a recent large-scale model (XLNet), we show that only 18 points out of its answer F1 score of 72 on HotpotQA are obtained through multifact reasoning, roughly the same as that of a simpler RNN baseline. Our transformation substantially reduces disconnected reasoning (19 points in answer F1). It is complementary to adversarial approaches, yielding further reductions in conjunction.


abstract: Variational problems of splitting-type with mixed linear-superlinear growth conditions are considered. In the twodimensional case the minimizing problem is given by \[ J [w] = \int_{\Omega} \Big[f_1\big(\partial_1 w\big) + f_2\big(\partial_2 w\big)\Big] \,dx \to \min \] w.r.t. a suitable class of comparison functions. Here $f_1$ is supposed to be a convex energy density with linear growth, $f_2$ is supposed to be of superlinear growth, for instance to be given by a $N$-function or just bounded from below by a $N$-function. One motivation for this kind of problem located between the well known splitting-type problems of superlinear growth and the splitting-type problems with linear growth (recently considered in [1]) is the link to mathematical problems in plasticity (compare [2]). Here we prove results on the appropriate way of relaxation including approximation procedures, duality, existence and uniqueness of solutions as well as some new higher integrability results.


title: KinGDOM: Knowledge-Guided DOMain adaptation for sentiment analysis

abstract: Cross-domain sentiment analysis has received significant attention in recent years, prompted by the need to combat the domain gap between different applications that make use of sentiment analysis. In this paper, we take a novel perspective on this task by exploring the role of external commonsense knowledge. We introduce a new framework, KinGDOM, which utilizes the ConceptNet knowledge graph to enrich the semantics of a document by providing both domain-specific and domain-general background concepts. These concepts are learned by training a graph convolutional autoencoder that leverages inter-domain concepts in a domain-invariant manner. Conditioning a popular domain-adversarial baseline method with these learned concepts helps improve its performance over state-of-the-art approaches, demonstrating the efficacy of our proposed framework.


title: ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data

abstract: Event forecasting is a challenging, yet important task, as humans seek to constantly plan for the future. Existing automated forecasting studies rely mostly on structured data, such as time-series or event-based knowledge graphs, to help predict future events. In this work, we aim to formulate a task, construct a dataset, and provide benchmarks for developing methods for event forecasting with large volumes of unstructured text data. To simulate the forecasting scenario on temporal news documents, we formulate the problem as a restricted-domain, multiple-choice, question-answering (QA) task. Unlike existing QA tasks, our task limits accessible information, and thus a model has to make a forecasting judgement. To showcase the usefulness of this task formulation, we introduce ForecastQA, a question-answering dataset consisting of 10,392 event forecasting questions, which have been collected and verified via crowdsourcing efforts. We present our experiments on ForecastQA using BERT-based models and find that our best model achieves 60.1% accuracy on the dataset, which still lags behind human performance by about 19%. We hope ForecastQA will support future research efforts in bridging this gap.


title: Upper and lower bounds for Littlewood-Paley square functions in the Dunkl setting

abstract: The aim of this paper is to prove upper and lower $L^p$ estimates, $1<p<\infty$, for Littlewood-Paley square functions in the rational Dunkl setting.


title: Binding of Endpoints to Identifiers by On-Chain Proofs

abstract: In many applications, identity management (IdM) is used to associate a subject public key with an endpoint at which the subject can be contacted (telephone number, email, etc.). In decentralized applications based on distributed ledger technologies (DLTes), it is desirable for the IdM to be decentralized as well. Currently, endpoints are either verified by who needs it, which is impractical in DLT-based applications, or by a centralized authority, which contrasts with the spirit of DLTes. In this paper, we show two DLT-based protocols to prove the association between a subject and an endpoint in a decentralized manner, contributing in filling the gap of the current IdM approaches with respect to decentralization. Our protocols are compatible with a wide variety of endpoints. We analyze the security of our protocols and evaluate their performance and cost against the common approaches.


title: Structure-Preserving Interpolation of Bilinear Control Systems

abstract: In this paper, we extend the structure-preserving interpolatory model reduction framework, originally developed for linear systems, to structured bilinear control systems. Specifically, we give explicit construction formulae for the model reduction bases to satisfy different types of interpolation conditions. First, we establish the analysis for transfer function interpolation for single-input single-output structured bilinear systems. Then, we extend these results to the case of multi-input multi-output structured bilinear systems by matrix interpolation. The effectiveness of our structure-preserving approach is illustrated by means of various numerical examples.

categories: math.NA cs.NA cs.SY eess.SY math.DS math.OC


title: A Simple Language Model for Task-Oriented Dialogue

abstract: Task-oriented dialogue is often decomposed into three tasks: understanding user input, deciding actions, and generating a response. While such decomposition might suggest a dedicated model for each sub-task, we find a simple, unified approach leads to state-of-the-art performance on the MultiWOZ dataset. SimpleTOD is a simple approach to task-oriented dialogue that uses a single, causal language model trained on all sub-tasks recast as a single sequence prediction problem. This allows SimpleTOD to fully leverage transfer learning from pre-trained, open domain, causal language models such as GPT-2. SimpleTOD improves over the prior state-of-the-art in joint goal accuracy for dialogue state tracking, and our analysis reveals robustness to noisy annotations in this setting. SimpleTOD also improves the main metrics used to evaluate action decisions and response generation in an end-to-end setting: inform rate by 8.1 points, success rate by 9.7 points, and combined score by 7.2 points.


title: Multi-consensus Decentralized Accelerated Gradient Descent

abstract: This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation complexity and near optimal communication complexity. Our theoretical results give affirmative answers to the open problem on whether there exists an algorithm that can achieve a communication complexity (nearly) matching the lower bound depending on the global condition number instead of the local one. Furthermore, the linear convergence of our algorithms only depends on the strong convexity of global objective and it does \emph{not} require the local functions to be convex. The design of our methods relies on a novel integration of well-known techniques including Nesterov's acceleration, multi-consensus and gradient-tracking. Empirical studies show the outperformance of our methods for machine learning applications.


title: Sample dependence of the half-integer quantized thermal Hall effect in the Kitaev candidate $\alpha$-RuCl$_3$

abstract: We have investigated the sample dependence of the half-integer thermal Hall effect in $\alpha$-RuCl$_3$ under a magnetic field tilted 45 degree from the $c$ axis to the $a$ axis. We find that the sample with the largest longitudinal thermal conductivity ($\kappa_{xx}$) shows the half-integer quantized thermal Hall effect expected in the Kitaev model. On the other hand, the quantized thermal Hall effect was not observed in the samples with smaller $\kappa_{xx}$. We suggest that suppressing the magnetic scattering effects on the phonon thermal conduction, which broaden the field-induced gap protecting the chiral edge current of the Majorana fermions, is important to observe the quantized thermal Hall effect.


title: Consistency, convergence and error estimates for a mixed finite element / finite volume scheme to compressible Navier-Stokes equations with general inflow/outflow boundary data

abstract: We study convergence of a mixed finite element-finite volume scheme for the compressible Navier Stokes equations in the isentropic regime under the full range of the adiabatic coefficient gamma for the problem with general non zero inflow/outflow boundary conditions. We propose a modification of Karper scheme [Numer. Math. 125:441-510, 2013] in order to accommodate the non zero boundary data, prove existence of its solutions, establish the stability and uniform estimates, derive a convenient consistency formulation of the balance laws and use it to show the weak convergence of the numerical solutions to a dissipative solution with the Reynold defect introduced in Abbatiello et al. [Preprint Arxiv 1912.12896]. If the target system admits a strong solution then the convergence is strong towards the strong solution. Moreover, we establish the convergence rate of the strong convergence in terms of the size of the space discretization h (which is supposed to be comparable with the time step). In the case of non zero inflow/outflow boundary data, all results are new. The latter result is new also for the no-slip boundary conditions.


title: Treebank Embedding Vectors for Out-of-domain Dependency Parsing

abstract: A recent advance in monolingual dependency parsing is the idea of a treebank embedding vector, which allows all treebanks for a particular language to be used as training data while at the same time allowing the model to prefer training data from one treebank over others and to select the preferred treebank at test time. We build on this idea by 1) introducing a method to predict a treebank vector for sentences that do not come from a treebank used in training, and 2) exploring what happens when we move away from predefined treebank embedding vectors during test time and instead devise tailored interpolations. We show that 1) there are interpolated vectors that are superior to the predefined ones, and 2) treebank vectors can be predicted with sufficient accuracy, for nine out of ten test languages, to match the performance of an oracle approach that knows the most suitable predefined treebank embedding for the test set.


title: The Physics of Star Cluster Formation and Evolution

abstract: Star clusters form in dense, hierarchically collapsing gas clouds. Bulk kinetic energy is transformed to turbulence with stars forming from cores fed by filaments. In the most compact regions, stellar feedback is least effective in removing the gas and stars may form very efficiently. These are also the regions where, in high-mass clusters, ejecta from some kind of high-mass stars are effectively captured during the formation phase of some of the low mass stars and effectively channeled into the latter to form multiple populations. Star formation epochs in star clusters are generally set by gas flows that determine the abundance of gas in the cluster. We argue that there is likely only one star formation epoch after which clusters remain essentially clear of gas by cluster winds. Collisional dynamics is important in this phase leading to core collapse, expansion and eventual dispersion of every cluster. We review recent developments in the field with a focus on theoretical work.


title: Collision-induced amplitude dynamics of fast 2D solitons in saturable nonlinear media with weak nonlinear loss

abstract: We study the amplitude dynamics of two-dimensional (2D) solitons in a fast collision described by the coupled nonlinear Schr\"odinger equations with a saturable nonlinearity and weak nonlinear loss. We extend the perturbative technique for calculating the collision-induced dynamics of two one-dimensional (1D) solitons to derive the theoretical expression for the collision-induced amplitude dynamics in a fast collision of two 2D solitons. Our perturbative approach is based on two major steps. The first step is the standard adiabatic perturbation for the calculations on the energy balance of perturbed solitons and the second step, which is the crucial one, is for the analysis of the collision-induced change in the envelope of the perturbed 2D soliton. Furthermore, we also present the dependence of the collision-induced amplitude shift on the angle of the two 2D colliding-solitons. In addition, we show that the current perturbative technique can be simply applied to study the collision-induced amplitude shift in a fast collision of two perturbed 1D solitons. Our analytic calculations are confirmed by numerical simulations with the corresponding coupled nonlinear Schr\"odinger equations in the presence of the cubic loss and in the presence of the quintic loss.


title: Lagrangian Neural Style Transfer for Fluids

abstract: Artistically controlling the shape, motion and appearance of fluid simulations pose major challenges in visual effects production. In this paper, we present a neural style transfer approach from images to 3D fluids formulated in a Lagrangian viewpoint. Using particles for style transfer has unique benefits compared to grid-based techniques. Attributes are stored on the particles and hence are trivially transported by the particle motion. This intrinsically ensures temporal consistency of the optimized stylized structure and notably improves the resulting quality. Simultaneously, the expensive, recursive alignment of stylization velocity fields of grid approaches is unnecessary, reducing the computation time to less than an hour and rendering neural flow stylization practical in production settings. Moreover, the Lagrangian representation improves artistic control as it allows for multi-fluid stylization and consistent color transfer from images, and the generality of the method enables stylization of smoke and liquids likewise.


title: Knowledge Base Completion: Baseline strikes back (Again)

abstract: Knowledge Base Completion (KBC) has been a very active area lately. Several recent KBCpapers propose architectural changes, new training methods, or even new formulations. KBC systems are usually evaluated on standard benchmark datasets: FB15k, FB15k-237, WN18, WN18RR, and Yago3-10. Most existing methods train with a small number of negative samples for each positive instance in these datasets to save computational costs. This paper discusses how recent developments allow us to use all available negative samples for training. We show that Complex, when trained using all available negative samples, gives near state-of-the-art performance on all the datasets. We call this approach COMPLEX-V2. We also highlight how various multiplicative KBC methods, recently proposed in the literature, benefit from this train-ing regime and become indistinguishable in terms of performance on most datasets. Our work calls for a reassessment of their individual value, in light of these findings.


title: Fighting seizures with seizures: diffusion and stability in neural systems

abstract: Seizure activity is a ubiquitous and pernicious pathophysiology that, in principle, should yield to mathematical treatments of (neuronal) ensemble dynamics - and therefore interventions on stochastic chaos. A seizure can be characterised as a deviation of neural activity from a stable dynamical regime, i.e. one in which signals fluctuate only within a limited range. In silico treatments of neural activity are an important tool for understanding how the brain can achieve stability, as well as how pathology can lead to seizures and potential strategies for mitigating instabilities, e.g. via external stimulation. Here, we demonstrate that the (neuronal) state equation used in Dynamic Causal Modelling generalises to a Fokker-Planck formalism when propagation of neuronal activity along structural connections is considered. Using the Jacobian of this generalised state equation, we show that an initially unstable system can be rendered stable via a reduction in diffusivity (i.e., connectivity that disperses neuronal fluctuations). We show, for neural systems prone to epileptic seizures, that such a reduction can be achieved via external stimulation. Specifically, we show that this stimulation should be applied in such a way as to temporarily mirror epileptic activity in the areas adjoining an affected brain region - thus 'fighting seizures with seizures'. We offer proof of principle using simulations based on functional neuroimaging data collected from patients with idiopathic generalised epilepsy, in which we successfully suppress pathological activity in a distinct sub-network. Our hope is that this technique can form the basis for real-time monitoring and intervention devices that are capable of suppressing or even preventing seizures in a non-invasive manner.


title: Teaching Machine Comprehension with Compositional Explanations

abstract: Advances in machine reading comprehension (MRC) rely heavily on the collection of large scale human-annotated examples in the form of (question, paragraph, answer) triples. In contrast, humans are typically able to generalize with only a few examples, relying on deeper underlying world knowledge, linguistic sophistication, and/or simply superior deductive powers. In this paper, we focus on "teaching" machines reading comprehension, using a small number of semi-structured explanations that explicitly inform machines why answer spans are correct. We extract structured variables and rules from explanations and compose neural module teachers that annotate instances for training downstream MRC models. We use learnable neural modules and soft logic to handle linguistic variation and overcome sparse coverage; the modules are jointly optimized with the MRC model to improve final performance. On the SQuAD dataset, our proposed method achieves 70.14% F1 score with supervision from 26 explanations, comparable to plain supervised learning using 1,100 labeled instances, yielding a 12x speed up.


title: Space-Time Medium Functions as a Perfect Antenna-Mixer-Amplifier Transceiver

abstract: We show that a space-time-varying medium can function as a front-end transceiver, i.e., an antenna-mixer-amplifier. Such a unique functionality is endowed by space-time surface waves associated with complex space-time wave vectors in a subluminal space-time medium. The proposed structure introduces pure frequency up- and down-conversions and with very weak undesired time harmonics. In contrast to other recently proposed space-time mixers, a large frequency up-/down conversion ratio, associated with gain is achievable. Furthermore, as the structure does not operate based on progressive energy transition between the space-time modulation and the incident wave, it possesses a subwavelength thickness (metasurface). Such a multi-functional, highly efficient and compact medium is expected to find various applications in modern wireless telecommunication systems.


title: Dimensions of Diversity in Human Perceptions of Algorithmic Fairness

abstract: A growing number of oversight boards and regulatory bodies seek to monitor and govern algorithms that make decisions about people's lives. Prior work has explored how people believe algorithmic decisions should be made, but there is little understanding of how individual factors like sociodemographics or direct experience with a decision-making scenario may affect their ethical views. We take a step toward filling this gap by exploring how people's perceptions of one aspect of procedural algorithmic fairness (the fairness of using particular features in an algorithmic decision) relate to their (i) demographics (age, education, gender, race, political views) and (ii) personal experiences with the algorithmic decision-making scenario. We find that political views and personal experience with the algorithmic decision context significantly influence perceptions about the fairness of using different features for bail decision-making. Drawing on our results, we discuss the implications for stakeholder engagement and algorithmic oversight including the need to consider multiple dimensions of diversity in composing oversight and regulatory bodies.


title: On P Versus NP

abstract: Consider a following NP-problem DOUBLE CLIQUE (abbr.: CLIQ$_{2}$): Given a natural number $k>2$ and a pair of two disjoint subgraphs of a fixed graph $G$ decide whether each subgraph in question contains a $k$-clique. I prove that CLIQ$_{2}$ can't be solved in polynomial time by a deterministic TM, which infers $\mathbf{P}\neq \mathbf{NP}$. This proof upgrades the well-known proof of polynomial unsolvability of the partial result with respect to analogous monotone problem CLIQUE (abbr.: CLIQ) as well as my previous presentation that used appropriate 3-value semantics. Note that problem CLIQ$_{2}$ is not monotone and appears more complex than just iterated CLIQ, as the required subgraphs are mutually dependent.


title: Simulating Met-Enkephalin With Population Annealing Molecular Dynamics

abstract: Met-enkephalin, one of the smallest opiate peptides and an important neurotransmitter, is a widely used benchmarking problem in the field of molecular simulation. Through its range of possible low-temperature conformations separated by free-energy barriers it was previously found to be hard to thermalize using straight canonical molecular dynamics simulations. Here, we demonstrate how one can use the recently proposed population annealing molecular dynamics scheme to overcome these difficulties. We show how the use of multi-histogram reweighting allows one to accurately estimate the density of states of the system and hence derive estimates such as the potential energy as quasi continuous functions of temperature. We further investigate the free-energy surface as a function of end-to-end distance and radius-of-gyration and observe two distinct basins of attraction.


title: Enhancing Text-based Reinforcement Learning Agents with Commonsense Knowledge

abstract: In this paper, we consider the recent trend of evaluating progress on reinforcement learning technology by using text-based environments and games as evaluation environments. This reliance on text brings advances in natural language processing into the ambit of these agents, with a recurring thread being the use of external knowledge to mimic and better human-level performance. We present one such instantiation of agents that use commonsense knowledge from ConceptNet to show promising performance on two text-based environments.


title: MultiQT: Multimodal Learning for Real-Time Question Tracking in Speech

abstract: We address a challenging and practical task of labeling questions in speech in real time during telephone calls to emergency medical services in English, which embeds within a broader decision support system for emergency call-takers. We propose a novel multimodal approach to real-time sequence labeling in speech. Our model treats speech and its own textual representation as two separate modalities or views, as it jointly learns from streamed audio and its noisy transcription into text via automatic speech recognition. Our results show significant gains of jointly learning from the two modalities when compared to text or audio only, under adverse noise and limited volume of training data. The results generalize to medical symptoms detection where we observe a similar pattern of improvements with multimodal learning.


title: Social Biases in NLP Models as Barriers for Persons with Disabilities

abstract: Building equitable and inclusive NLP technologies demands consideration of whether and how social attitudes are represented in ML models. In particular, representations encoded in models often inadvertently perpetuate undesirable social biases from the data on which they are trained. In this paper, we present evidence of such undesirable biases towards mentions of disability in two different English language models: toxicity prediction and sentiment analysis. Next, we demonstrate that the neural embeddings that are the critical first step in most NLP pipelines similarly contain undesirable biases towards mentions of disability. We end by highlighting topical biases in the discourse about disability which may contribute to the observed model biases; for instance, gun violence, homelessness, and drug addiction are over-represented in texts discussing mental illness.


title: On the Wassertein distance for a martingale central limit theorem

abstract: We prove an upper bound on the Wassertein distance between normalized martingales and the standard normal random variable, which extends a result of R\"ollin [Statist. Probabil. Lett. 138 (2018) 171-176]. The proof is based on a method of Bolthausen [Ann. Probab. 10 (1982) 672-688].


title: Multi-Objective Eco-Routing for Dynamic Control of Connected & Automated Vehicles

abstract: The advent of intelligent vehicles that can communicate with infrastructure as well as automate the movement provides a range of new options to address key urban traffic issues such as congestion and pollution, without the need for centralized traffic control. Furthermore, the advances in the information, communication, and sensing technologies have provided access to real-time traffic and emission data. Leveraging these advancements, a dynamic multi-objective eco-routing strategy for connected & automated vehicles (CAVs) is proposed and implemented in a distributed traffic management system. It is applied to the road network of downtown Toronto in an in-house agent-based traffic simulation platform. The performance of the proposed system is compared to various single-objective optimizations. Simulation results show the significance of incorporating real-time emission and traffic state into the dynamic routing, along with considering the expected delays at the downstream intersections. The proposed multi-objective eco-routing has the potential of reducing GHG and NOx emissions by 43% and 18.58%, respectively, while reducing average travel time by 40%.


title: DQI: Measuring Data Quality in NLP

abstract: Neural language models have achieved human level performance across several NLP datasets. However, recent studies have shown that these models are not truly learning the desired task; rather, their high performance is attributed to overfitting using spurious biases, which suggests that the capabilities of AI systems have been over-estimated. We introduce a generic formula for Data Quality Index (DQI) to help dataset creators create datasets free of such unwanted biases. We evaluate this formula using a recently proposed approach for adversarial filtering, AFLite. We propose a new data creation paradigm using DQI to create higher quality data. The data creation paradigm consists of several data visualizations to help data creators (i) understand the quality of data and (ii) visualize the impact of the created data instance on the overall quality. It also has a couple of automation methods to (i) assist data creators and (ii) make the model more robust to adversarial attacks. We use DQI along with these automation methods to renovate biased examples in SNLI. We show that models trained on the renovated SNLI dataset generalize better to out of distribution tasks. Renovation results in reduced model performance, exposing a large gap with respect to human performance. DQI systematically helps in creating harder benchmarks using active learning. Our work takes the process of dynamic dataset creation forward, wherein datasets evolve together with the evolving state of the art, therefore serving as a means of benchmarking the true progress of AI.


title: A survey on modern trainable activation functions

abstract: In neural networks literature, there is a strong interest in identifying and defining activation functions which can improve neural network performance. In recent years there has been a renovated interest of the scientific community in investigating activation functions which can be trained during the learning process, usually referred to as "trainable", "learnable" or "adaptable" activation functions. They appear to lead to better network performance. Diverse and heterogeneous models of trainable activation function have been proposed in the literature. In this paper, we present a survey of these models. Starting from a discussion on the use of the term "activation function" in literature, we propose a taxonomy of trainable activation functions, highlight common and distinctive proprieties of recent and past models, and discuss main advantages and limitations of this type of approach. We show that many of the proposed approaches are equivalent to adding neuron layers which use fixed (non-trainable) activation functions and some simple local rule that constraints the corresponding weight layers.


title: The embedding problem for Markov matrices

abstract: Characterizing whether a Markov process of discrete random variables has an homogeneous continuous-time realization is a hard problem. In practice, this problem reduces to deciding when a given Markov matrix can be written as the exponential of some rate matrix (a Markov generator). This is an old question known in the literature as the embedding problem (Elfving37), which has been only solved for matrices of size $2\times 2$ or $3\times 3$. In this paper, we address this problem and related questions and obtain results in two different lines. First, for matrices of any size, we give a bound on the number of Markov generators in terms of the spectrum of the Markov matrix. Based on this, we establish a criterion for deciding whether a generic Markov matrix (different eigenvalues) is embeddable and propose an algorithm that lists all its Markov generators. Then, motivated and inspired by recent results on substitution models of DNA, we focus in the $4\times 4$ case and completely solve the embedding problem for any Markov matrix. The solution in this case is more concise as the embeddability is given in terms of a single condition.


title: High-energy soliton fission dynamics in multimode GRIN fiber

abstract: The process of high-energy soliton fission is experimentally and numerically investigated in a graded-index multimode fiber. Fission dynamics is analyzed by comparing numerical observations and simulations. A novel regime is observed, where solitons produced by the fission have a nearly constant Raman wavelength shift and same pulse width over a wide range of soliton energies.


title: Generalized Entropy Regularization or: There's Nothing Special about Label Smoothing

abstract: Prior work has explored directly regularizing the output distributions of probabilistic models to alleviate peaky (i.e. over-confident) predictions, a common sign of overfitting. This class of techniques, of which label smoothing is one, has a connection to entropy regularization. Despite the consistent success of label smoothing across architectures and data sets in language generation tasks, two problems remain open: (1) there is little understanding of the underlying effects entropy regularizers have on models, and (2) the full space of entropy regularization techniques is largely unexplored. We introduce a parametric family of entropy regularizers, which includes label smoothing as a special case, and use it to gain a better understanding of the relationship between the entropy of a model and its performance on language generation tasks. We also find that variance in model performance can be explained largely by the resulting entropy of the model. Lastly, we find that label smoothing provably does not allow for sparsity in an output distribution, an undesirable property for language generation models, and therefore advise the use of other entropy regularization methods in its place.


title: An open set of $4\times4$ embeddable matrices whose principal logarithm is not a Markov generator

abstract: A Markov matrix is embeddable if it can represent a homogeneous continuous-time Markov process. It is well known that if a Markov matrix has real and pairwise-different eigenvalues, then the embeddability can be determined by checking whether its principal logarithm is a rate matrix or not. The same holds for Markov matrices close enough to the identity matrix or that rule a Markov process subjected to certain restrictions. In this paper we prove that this criterion cannot be generalized and we provide open sets of Markov matrices that are embeddable and whose principal logarithm is a not a rate matrix.


title: Finite record sets of chip-firing games

abstract: A finite graph with an assignment of non-negative integers to vertices gives chip-firing games. Chip-firing games determine languages (sets of words) called the record sets of legal games. Bj\"orner, Lov\'asz and Shor found several properties that are satisfied by record sets. In this paper, we will find two more properties of record sets. Under the assumption that the record set is finite and the game fires only two vertices, these properties characterize the record sets of graphs.


title: Silicon Pixel R&D for the CLIC Tracking Detector

abstract: The physics aims at the proposed high-energy $e^+e^-$ collider CLIC pose challenging demands on the performance of the detector system. Precise hit-time tagging, an excellent spatial resolutions, and a low mass are required for the vertex and tracking detectors. To meet these requirements, an all-silicon vertex and tracking detector system is foreseen, for which a broad R&D programme on a variety of novel silicon detector technologies is being pursued. For the ultra-low mass vertex detector, different hybrid technologies with innovative sensor concepts and interconnection techniques are explored. For the large-scale tracking detector, the focus of the R&D lies on monolithic HV-MAPS and HR-CMOS technologies. This contribution gives an overview of the ongoing activities with a focus on monolithic technologies for the CLIC tracking detector. Recent results from laboratory and test-beam measurement campaigns of the ATLASpix_Simple and the CLICTD sensor prototypes are presented.


title: Liouvillian Skin Effect: Slowing Down of Relaxation Processes without Gap Closing

abstract: It is highly nontrivial to what extent we can deduce the relaxation behavior of a quantum dissipative system from the spectral gap of the Liouvillian that governs the time evolution of the density matrix. We investigate the relaxation processes of a quantum dissipative system that exhibits the Liouvillian skin effect, which means that the eigenmodes of the Liouvillian are localized exponentially close to the boundary of the system, and find that the timescale for the system to reach a steady state depends not only on the Liouvillian gap $\Delta$ but also on the localization length $\xi$ of the eigenmodes. In particular, we show that the longest relaxation time $\tau$ that is maximized over initial states and local observables is given by $\tau \sim \Delta^{-1}(1+L/\xi)$ with $L$ being the system size. This implies that the longest relaxation time can diverge for $L \to \infty$ without gap closing.


title: SIGVerse: A cloud-based VR platform for research on social and embodied human-robot interaction

abstract: Common sense and social interaction related to daily-life environments are considerably important for autonomous robots, which support human activities. One of the practical approaches for acquiring such social interaction skills and semantic information as common sense in human activity is the application of recent machine learning techniques. Although recent machine learning techniques have been successful in realizing automatic manipulation and driving tasks, it is difficult to use these techniques in applications that require human-robot interaction experience. Humans have to perform several times over a long term to show embodied and social interaction behaviors to robots or learning systems. To address this problem, we propose a cloud-based immersive virtual reality (VR) platform which enables virtual human-robot interaction to collect the social and embodied knowledge of human activities in a variety of situations. To realize the flexible and reusable system, we develop a real-time bridging mechanism between ROS and Unity, which is one of the standard platforms for developing VR applications. We apply the proposed system to a robot competition field named RoboCup@Home to confirm the feasibility of the system in a realistic human-robot interaction scenario. Through demonstration experiments at the competition, we show the usefulness and potential of the system for the development and evaluation of social intelligence through human-robot interaction. The proposed VR platform enables robot systems to collect social experiences with several users in a short time. The platform also contributes in providing a dataset of social behaviors, which would be a key aspect for intelligent service robots to acquire social interaction skills based on machine learning techniques.


title: Learning Model Predictive Control for Competitive Autonomous Racing

abstract: The goal of this thesis is to design a learning model predictive controller (LMPC) that allows multiple agents to race competitively on a predefined race track in real-time. This thesis addresses two major shortcomings in the already existing single-agent formulation. Previously, the agent determines a locally optimal trajectory but does not explore the state space, which may be necessary for overtaking maneuvers. Additionally, obstacle avoidance for LMPC has been achieved in the past by using a non-convex terminal set, which increases the complexity for determining a solution to the optimization problem. The proposed algorithm for multi-agent racing explores the state space by executing the LMPC for multiple different initializations, which yields a richer terminal safe set. Furthermore, a new method for selecting states in the terminal set is developed, which keeps the convexity for the terminal safe set and allows for taking suboptimal states.


title: Quasi-particle functional Renormalisation Group calculations in the two-dimensional half-filled Hubbard model at finite temperatures

abstract: We present a highly parallelisable scheme for treating functional Renormalisation Group equations which incorporates a quasi-particle-based feedback on the flow and provides direct access to real-frequency self-energy data. This allows to map out the boundaries of Fermi-liquid regimes and to study the effect of quasi-particle degradation near Fermi liquid instabilities. As a first application, selected results for the two-dimensional half-filled perfectly nested Hubbard model are shown.


title: DroTrack: High-speed Drone-based Object Tracking Under Uncertainty

abstract: We present DroTrack, a high-speed visual single-object tracking framework for drone-captured video sequences. Most of the existing object tracking methods are designed to tackle well-known challenges, such as occlusion and cluttered backgrounds. The complex motion of drones, i.e., multiple degrees of freedom in three-dimensional space, causes high uncertainty. The uncertainty problem leads to inaccurate location predictions and fuzziness in scale estimations. DroTrack solves such issues by discovering the dependency between object representation and motion geometry. We implement an effective object segmentation based on Fuzzy C Means (FCM). We incorporate the spatial information into the membership function to cluster the most discriminative segments. We then enhance the object segmentation by using a pre-trained Convolution Neural Network (CNN) model. DroTrack also leverages the geometrical angular motion to estimate a reliable object scale. We discuss the experimental results and performance evaluation using two datasets of 51,462 drone-captured frames. The combination of the FCM segmentation and the angular scaling increased DroTrack precision by up to $9\%$ and decreased the centre location error by $162$ pixels on average. DroTrack outperforms all the high-speed trackers and achieves comparable results in comparison to deep learning trackers. DroTrack offers high frame rates up to 1000 frame per second (fps) with the best location precision, more than a set of state-of-the-art real-time trackers.


title: Inverse scattering transform and multi-solition solutions for the sextic nonlinear Schr\"{o}dinger equation

abstract: In this work, we consider the inverse scattering transform and multi-solition solutions of the sextic nonlinear Schr\"{o}dinger equation. The Jost functions of spectrum problem are derived directly, and the scattering data with $t=0$ are obtained according to analyze the symmetry and other related properties of the Jost functions. Then we take use of translation transformation to get the relation between potential and kernel, and recover potential according to Gel'fand-Levitan-Marchenko (GLM) integral equations. Furthermore, the time evolution of scattering data is considered, on the basic of that, the multi-solition solutions are derived. In addition, some solutions of the equation are analyzed and revealed its dynamic behavior via graphical analysis, which could be enriched the nonlinear phenomena of the sextic nonlinear Schr\"{o}dinger equation.


title: On the Navier-Stokes equations on surfaces

abstract: We consider the motion of an incompressible viscous fluid that completely covers a smooth, compact and embedded hypersurface $\Sigma$ without boundary and flows along $\Sigma$. Local-in-time well-posedness is established in the framework of $L_p$-$L_q$-maximal regularity. We characterize the set of equilibria as the set of all Killing vector fields on $\Sigma$ and we show that each equilibrium on $\Sigma$ is stable. Moreover, it is shown that any solution starting close to an equilibrium exists globally and converges at an exponential rate to a (possibly different) equilibrium as time tends to infinity.


title: Time evolution of the free Dirac field in spatially flat FLRW space-times

abstract: The framework of the relativistic quantum mechanics on spatially flat FLRW space-times is considered for deriving the analytical solutions of the Dirac equation in different local charts of these manifolds. Systems of commuting conserved operators are used for determining the fundamental solutions as common eigenspinors giving thus physical meaning to the integration constants related to the eigenvalues of these operators. Since these systems, in general, are incomplete on the FLRW space-times there are integration constants that must be fixed by setting the vacuum either as the traditional adiabatic one or as the rest frame vacuum we proposed recently. All the known solutions of the Dirac equation on these manifolds are discussed in all details and a new type of spherical waves of given energy in the de Sitter expanding universe is reported here for the first time.


title: Flying Car Transportation System: Advances, Techniques, and Challenges

abstract: Since the development of transport systems, humans have exploited ground-level, below-ground, and high-altitude spaces for transportation purposes. However, with the increasing burden of expanding populations and rapid urbanization in recent decades, public transportation systems and freight traffic are suffering huge pressure, plaguing local governments and straining economies. Engineers and researchers have started to re-examine, propose, and develop the underused near-ground spaces (NGS) for transportation purposes. For instance, flying cars, which are not a totally novel idea, aim at solving the traffic congestion problem and releasing the strains on existing city transport networks by utilizing unoccupied NGS. Flying cars differ from traditional grounded transportation systems that are entirely limited by their physical space, such as trains on tracks or automobiles on roads. Flying cars do not occupy or compete for high-altitude spaces used by air traffic for long-distance transfer. However, there is a clear lack of specific literature on flying cars and flying car transportation systems (FCTS), which this paper aims to address by describing modern advances, techniques, and challenges of FCTS. We explore the inherent nature of NGS transportation and devise useful proposals to facilitate the construction and commercialization of FCTS. We begin with an introduction to the increasing need for NGS transportation and we address the advantages of using flying cars. Next, we present a brief overview of the history of the development of flying cars in terms of the historic timeline and technique development. Then, we discuss and compare the state of the art in the design of flying cars, including the take-off \& landing (TOL) modes, pilot modes, operation modes, and power types, ...


title: Transfer Learning-Based Received Power Prediction with Ray-tracing Simulation and Small Amount of Measurement Data

abstract: This paper proposes a method to predict received power in urban area deterministically, which can learn a prediction model from small amount of measurement data by a simulation-aided transfer learning and data augmentation. Recent development in machine learning such as artificial neural network (ANN) enables us to predict radio propagation and path loss accurately. However, training a high-performance ANN model requires a significant number of data, which are difficult to obtain in real environments. The main motivation for this work was to facilitate accurate prediction using small amount of measurement data. To this end, we propose a transfer learning-based prediction method with data augmentation. The proposed method pre-trains a prediction model using data generated from ray-tracing simulations, increases the number of data using simulation-assisted data augmentation, and then fine-tunes a model using the augmented data to fit the target environment. Experiments using Wi-Fi devices were conducted, and the results demonstrate that the proposed method predicts received power with 50% (or less) of the RMS error of conventional methods.


title: Learning-based super interpolation and extrapolation for speckled image reconstruction

abstract: Speckles arise when coherent light interacts with biological tissues. Information retrieval from speckles is desired yet challenging, requiring understanding or mapping of the multiple scattering process, or reliable capability to reverse or compensate for the scattering-induced phase distortions. In whatever situation, insufficient sampling of speckles undermines the encoded information, impeding successful object reconstruction from speckle patterns. In this work, we propose a deep learning method to combat the physical limit: the sub-Nyquist sampled speckles (~14 below the Nyquist criterion) are interpolated up to a well-resolved level (1024 times more pixels to resolve the same FOV) with smoothed morphology fine-textured. More importantly, the lost information can be retraced, which is impossible with classic interpolation or any existing methods. The learning network inspires a new perspective on the nature of speckles and a promising platform for efficient processing or deciphering of massive scattered optical signals, enabling widefield high-resolution imaging in complex scenarios.


title: Two New Gestures on Peirce's Continuum and the Existential Graphs

abstract: We present (1) a new model for Peirce's full continuum (Vargas 2012-2015), based on an iterated sheaf of real numbers over all ordinal numbers, (2) a new model for Peirce's existential graphs (Oostra 2010), based on a new geometrical symbol for intuitionistic implication, and (3) two new mathematical gestures that synthetically capture Vargas' and Oostra's constructions (Hugueth 2017).


title: Towards Deep Learning Methods for Quality Assessment of Computer-Generated Imagery

abstract: Video gaming streaming services are growing rapidly due to new services such as passive video streaming, e.g. Twitch.tv, and cloud gaming, e.g. Nvidia Geforce Now. In contrast to traditional video content, gaming content has special characteristics such as extremely high motion for some games, special motion patterns, synthetic content and repetitive content, which makes the state-of-the-art video and image quality metrics perform weaker for this special computer generated content. In this paper, we outline our plan to build a deep learningbased quality metric for video gaming quality assessment. In addition, we present initial results by training the network based on VMAF values as a ground truth to give some insights on how to build a metric in future. The paper describes the method that is used to choose an appropriate Convolutional Neural Network architecture. Furthermore, we estimate the size of the required subjective quality dataset which achieves a sufficiently high performance. The results show that by taking around 5k images for training of the last six modules of Xception, we can obtain a relatively high performance metric to assess the quality of distorted video games.


title: Uniform boundedness of the Fourier partial sum operators on the weighted spaces of local fields

abstract: Let $S_n f$ be the $n$th partial sum of the Fourier series of a function $f$ in $L^1(\D)$, where $\D$ is the ring of integers of a local field $K$. For $1<p<\infty$, we characterize all weight functions $w$ so that the partial sum operators $S_n$, $n\geq 0$, are uniformly bounded on the weighted space $L^p(\D, w)$ and that $S_n f$ converges to $f$ in $L^p(\D,w)$. This includes the case where $K$ is a $p$-adic number field or a field of formal Laurent series $\mathbb{F}_q((X))$ over a finite field $\mathbb{F}_q$, and in particular, when $\D$ is the Walsh-Paley or dyadic group $2^\omega$. As an application, in a local field $K$ of positive characteristic, we provide a necessary and sufficient condition on a function $\varphi\in L^2(K)$ for which the collection of translates of $\varphi$ forms a Schauder basis for its closed linear span. Moreover, we establish sharp bounds for the Hardy-Littlewood maximal operator.


title: Implicit Linear Algebra and Basic Circuit Theory

abstract: In this paper we derive some basic results of circuit theory using `Implicit Linear Algebra' (ILA). This approach has the advantage of simplicity and generality. Implicit linear algebra is outlined in [1]. We denote the space of all vectors on $S$ by $\mathcal{F}_S$ and the space containing only the zero vector on $S$ by $\mathbf{0}_S.$ The dual $\mathcal{V}_S^{\perp}$ of a vector space $\mathcal{V}_S$ is the collection of all vectors whose dot product with vectors in $\mathcal{V}_S$ is zero. The basic operation of ILA is a linking operation ('matched composition`) between vector spaces $\mathcal{V}_{SP},\mathcal{V}_{PQ}$ (regarded as collections of row vectors on column sets $S\cup P, P\cup Q,$ respectively with $S,P,Q$ disjoint) defined by $\mathcal{V}_{SP}\leftrightarrow \mathcal{V}_{PQ}\equiv \{(f_S,h_Q):((f_S,g_P)\in \mathcal{V}_{SP}, (g_P,h_Q) \in \mathcal{V}_{PQ}\},$ and another ('skewed composition`) defined by $\mathcal{V}_{SP}\rightleftharpoons \mathcal{V}_{PQ}\equiv \{(f_S,h_Q):((f_S,g_P)\in \mathcal{V}_{SP}, (-g_P,h_Q) \in \mathcal{V}_{PQ}\}.$ The basic results of ILA are the Implicit Inversion Theorem (which states that $\mathcal{V}_{SP}\leftrightarrow(\mathcal{V}_{SP}\leftrightarrow \mathcal{V}_S)= \mathcal{V}_S,$ iff $\mathcal{V}_{SP}\leftrightarrow \mathbf{0}_P\subseteq \mathcal{V}_S\subseteq \mathcal{V}_{SP}\leftrightarrow\mathcal{F}_S$) and Implicit Duality Theorem (which states that $(\mathcal{V}_{SP}\leftrightarrow \mathcal{V}_{PQ})^{\perp}= (\mathcal{V}_{SP}^{\perp}\rightleftharpoons \mathcal{V}_{PQ}^{\perp}$). We show that the operations and results of ILA are useful in understanding basic circuit theory. We illustrate this by using ILA to present a generalization of Thevenin-Norton theorem where we compute multiport behaviour using adjoint multiport termination through a gyrator and a very general version of maximum power transfer theorem, which states that the port conditions that appear, during adjoint multiport termination through an ideal transformer, correspond to maximum power transfer.


title: PON-based connectivity for fog computing

abstract: Fog computing plays a crucial role in satisfying the requirements of delay-sensitive applications such as connected vehicles, smart grids, and actuator networks by moving data processing close to end users. Passive optical networks (PONs) are widely used in access networks to reduce the power consumption while providing high bandwidth to end users under flexible designs. Typically, distributed fog computing units in access networks have limited processing and storage capacities that can be under or over utilized depending on instantaneous demands. To extend the available capacity in access network, this paper proposes a fog computing architecture based on SDN-enabled PONs to achieve full connectivity among distributed fog computing servers. The power consumption results show that this architecture can achieve up to about 80% power savings in comparison to legacy fog computing based on spine and leaf data centers with the same number of servers.


title: Decision Support for Intoxication Prediction Using Graph Convolutional Networks

abstract: Every day, poison control centers (PCC) are called for immediate classification and treatment recommendations if an acute intoxication is suspected. Due to the time-sensitive nature of these cases, doctors are required to propose a correct diagnosis and intervention within a minimal time frame. Usually the toxin is known and recommendations can be made accordingly. However, in challenging cases only symptoms are mentioned and doctors have to rely on their clinical experience. Medical experts and our analyses of a regional dataset of intoxication records provide evidence that this is challenging, since occurring symptoms may not always match the textbook description due to regional distinctions, inter-rater variance, and institutional workflow. Computer-aided diagnosis (CADx) can provide decision support, but approaches so far do not consider additional information of the reported cases like age or gender, despite their potential value towards a correct diagnosis. In this work, we propose a new machine learning based CADx method which fuses symptoms and meta information of the patients using graph convolutional networks. We further propose a novel symptom matching method that allows the effective incorporation of prior knowledge into the learning process and evidently stabilizes the poison prediction. We validate our method against 10 medical doctors with different experience diagnosing intoxication cases for 10 different toxins from the PCC in Munich and show our method's superiority in performance for poison prediction.


title: On the Origin of Metallicity and Stability of the Metastable Phase in Chemically Exfoliated MoS$_2$

abstract: Chemical exfoliation of MoS$_2$ via Li-intercalation route has led to many desirable properties and spectacular applications due to the presence of a metastable state in addition to the stable H phase. However, the nature of the specific metastable phase formed, and its basic charge conduction properties have remained controversial. Using spatially resolved Raman spectroscopy (~1 micrometer resolution) and photoelectron spectroscopy (~120 nm resolution), we probe such chemically exfoliated MoS$_2$ samples in comparison to a mechanically exfoliated H phase sample and confirm that the dominant metastable state formed by this approach is a distorted T' state with a small semiconducting gap. Investigating two such samples with different extents of Li residues present, we establish that Li+ ions, not only help to exfoliate MoS$_2$ into few layer samples, but also contribute to enhancing the relative stability of the metastable state as well as dope the system with electrons, giving rise to a lightly doped small bandgap system with the T' structure, responsible for its spectacular properties.


title: Language Models as an Alternative Evaluator of Word Order Hypotheses: A Case Study in Japanese

abstract: We examine a methodology using neural language models (LMs) for analyzing the word order of language. This LM-based method has the potential to overcome the difficulties existing methods face, such as the propagation of preprocessor errors in count-based methods. In this study, we explore whether the LM-based method is valid for analyzing the word order. As a case study, this study focuses on Japanese due to its complex and flexible word order. To validate the LM-based method, we test (i) parallels between LMs and human word order preference, and (ii) consistency of the results obtained using the LM-based method with previous linguistic studies. Through our experiments, we tentatively conclude that LMs display sufficient word order knowledge for usage as an analysis tool. Finally, using the LM-based method, we demonstrate the relationship between the canonical word order and topicalization, which had yet to be analyzed by large-scale experiments.


title: The $\mathfrak{su}(2)$ spin $s$ representations via $\mathbb{C}P^{2s}$ sigma models

abstract: We establish and analyze a new relationship between the matrices describing an arbitrary component of a spin $s$, where $2s\in \mathbb{Z}^+$, and the matrices of $\mathbb{C}P^{2s}$ two-dimensional Euclidean sigma models. The spin matrices are constructed from the rank-1 Hermitian projectors of the sigma models or from the antihermitian immersion functions of their soliton surfaces in the $\mathfrak{su}(2s+1)$ algebra. For the spin matrices which can be represented as a linear combination of the generalized Pauli matrices, we find the dynamics equation satisfied by its coefficients. The equation proves to be identical to the stationary equation of a two-dimensional Heisenberg model. We show that the same holds for the matrices congruent to the generalized Pauli ones by any coordinate-independent unitary linear transformation. These properties open the possibility for new interpretations of the spins and also for application of the methods known from the theory of sigma models to the situations described by the Heisenberg model, from statistical mechanics to quantum computing.


title: Derivation of a Constant Velocity Motion Model for Visual Tracking

abstract: Motion models play a great role in visual tracking applications for predicting the possible locations of objects in the next frame. Unlike target tracking in radar or aerospace domain which considers only points, object tracking in computer vision involves sizes of objects. Constant velocity motion model is the most widely used motion model for visual tracking, however, there is no clear and understandable derivation involving sizes of objects specially for new researchers joining this research field. In this document, we derive the constant velocity motion model that incorporates sizes of objects that, we think, can help the new researchers to adapt to it very quickly.


title: Deep Convolutional Neural Networks to Diagnose COVID-19 and other Pneumonia Diseases from Posteroanterior Chest X-Rays

abstract: The article explores different deep convolutional neural network architectures trained and tested on posteroanterior chest X-rays of 327 patients who are healthy (152 patients), diagnosed with COVID-19 (125), and other types of pneumonia (48). In particular, this paper looks at the deep convolutional neural networks VGG16 and VGG19, InceptionResNetV2 and InceptionV3, as well as Xception, all followed by a flat multi-layer perceptron and a final 30% drop-out. The paper has found that the best performing network is VGG16 with a final $30$% drop-out trained over 3 classes (COVID-19, No Finding, Other Pneumonia). It has an internal cross-validated accuracy of $93.9(\pm3.4)$%, a COVID-19 sensitivity of $87.7(-1.9,+2)$%, and a No Finding sensitivity of $96.8(\pm0.8)$%. The respective external cross-validated values are $84.1(\pm13.5)$%, $87.7(-1.9,2)$%, and $96.8(\pm0.8)$%. The model optimizer was Adam with a 1e-4 learning rate, and categorical cross-entropy loss. It is hoped that, once this research will be put to practice in hospitals, healthcare professionals will be able in the medium to long-term to diagnosing through machine learning tools possible pneumonia, and if detected, whether it is linked to a COVID-19 infection, allowing the detection of new possible COVID-19 foyers after the end of possible "stop-and-go" lockdowns as expected by until a vaccine is found and widespread. Furthermore, in the short-term, it is hoped practitioners can compare the diagnosis from the deep convolutional neural networks with possible RT-PCR testing results, and if clashing, a Computed Tomography could be performed as they are more accurate in showing COVID-19 pneumonia.


title: All-electrical monitoring of bacterial antibiotic susceptibility in a microfluidic device

abstract: The lack of rapid antibiotic susceptibility tests adversely affects the treatment of bacterial infections and contributes to increased prevalence of multidrug resistant bacteria. Here, we describe an all-electrical approach that allows for ultra-sensitive measurement of growth signals from only tens of bacteria in a microfluidic device. Our device is essentially a set of microfluidic channels, each with a nano-constriction at one end and cross-sectional dimensions close to that of a single bacterium. Flowing a liquid bacteria sample (e.g., urine) through the microchannels rapidly traps the bacteria in the device, allowing for subsequent incubation in drugs. We measure the electrical resistance of the microchannels, which increases (or decreases) in proportion to the number of bacteria in the microchannels. The method and device allow for rapid antibiotic susceptibility tests in about two hours. Further, the short-time fluctuations in the electrical resistance during an antibiotic susceptibility test are correlated with the morphological changes of bacteria caused by the antibiotic. In contrast to other electrical approaches, the underlying geometric blockage effect provides a robust and sensitive signal, which is straightforward to interpret without electrical models. The approach also obviates the need for a high-resolution microscope and other complex equipment, making it potentially usable in resource-limited settings.


title: Sources of Transfer in Multilingual Named Entity Recognition

abstract: Named-entities are inherently multilingual, and annotations in any given language may be limited. This motivates us to consider polyglot named-entity recognition (NER), where one model is trained using annotated data drawn from more than one language. However, a straightforward implementation of this simple idea does not always work in practice: naive training of NER models using annotated data drawn from multiple languages consistently underperforms models trained on monolingual data alone, despite having access to more training data. The starting point of this paper is a simple solution to this problem, in which polyglot models are fine-tuned on monolingual data to consistently and significantly outperform their monolingual counterparts. To explain this phenomena, we explore the sources of multilingual transfer in polyglot NER models and examine the weight structure of polyglot models compared to their monolingual counterparts. We find that polyglot models efficiently share many parameters across languages and that fine-tuning may utilize a large number of those parameters.


title: Visualization of Diseases at Risk in the COVID-19 Literature

abstract: This paper presents a project, named VIDAR-19, able to extract automatically diseases from the CORD-19 dataset, and also diseases which might be considered as risk factors. The project relies on the ICD-11 classification of diseases maintained by the WHO. This nomenclature is used as a data source of the extraction mechanism, and also as the repository for the results. Developed for the COVID-19, the project has the ability to extract diseases at risk and to calculate relevant indicators. The outcome of the project is presented in a dashboard which enables the user to explore graphically diseases at risk which are put back in the classification hierarchy. Beyond the COVID-19, VIDAR has much broader applications and might be directly used for any corpus dealing with other pathologies.


title: Directed Steiner tree packing and directed tree connectivity

abstract: For a digraph $D=(V(D), A(D))$, and a set $S\subseteq V(D)$ with $r\in S$ and $|S|\geq 2$, an $(S, r)$-tree is an out-tree $T$ rooted at $r$ with $S\subseteq V(T)$. Two $(S, r)$-trees $T_1$ and $T_2$ are said to be arc-disjoint if $A(T_1)\cap A(T_2)=\emptyset$. Two arc-disjoint $(S, r)$-trees $T_1$ and $T_2$ are said to be internally disjoint if $V(T_1)\cap V(T_2)=S$. Let $\kappa_{S,r}(D)$ and $\lambda_{S,r}(D)$ be the maximum number of internally disjoint and arc-disjoint $(S, r)$-trees in $D$, respectively. The generalized $k$-vertex-strong connectivity of $D$ is defined as $$\kappa_k(D)= \min \{\kappa_{S,r}(D)\mid S\subset V(D), |S|=k, r\in S\}.$$ Similarly, the generalized $k$-arc-strong connectivity of $D$ is defined as $$\lambda_k(D)= \min \{\lambda_{S,r}(D)\mid S\subset V(D), |S|=k, r\in S\}.$$ The generalized $k$-vertex-strong connectivity and generalized $k$-arc-strong connectivity are also called directed tree connectivity which extends the well-established tree connectivity on undirected graphs to directed graphs and could be seen as a generalization of classical connectivity of digraphs. In this paper, we completely determine the complexity for both $\kappa_{S, r}(D)$ and $\lambda_{S, r}(D)$ on general digraphs, symmetric digraphs and Eulerian digraphs. In particular, among our results, we prove and use the NP-completeness of 2-linkage problem restricted to Eulerian digraphs. We also give sharp bounds and characterizations for the two parameters $\kappa_k(D)$ and $\lambda_k(D)$.


title: ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation

abstract: We propose to train a non-autoregressive machine translation model to minimize the energy defined by a pretrained autoregressive model. In particular, we view our non-autoregressive translation system as an inference network (Tu and Gimpel, 2018) trained to minimize the autoregressive teacher energy. This contrasts with the popular approach of training a non-autoregressive model on a distilled corpus consisting of the beam-searched outputs of such a teacher model. Our approach, which we call ENGINE (ENerGy-based Inference NEtworks), achieves state-of-the-art non-autoregressive results on the IWSLT 2014 DE-EN and WMT 2016 RO-EN datasets, approaching the performance of autoregressive models.


title: A language score based output selection method for multilingual speech recognition

abstract: The quality of a multilingual speech recognition system can be improved by adaptation methods if the input language is specified. For systems that can accept multilingual inputs, the popular approach is to apply a language identifier to the input then switch or configure decoders in the next step, or use one more subsequence model to select the output from a set of candidates. Motivated by the goal of reducing the latency for real-time applications, in this paper, a language model rescoring method is firstly applied to produce all possible candidates for target languages, then a simple score is proposed to automatically select the output without any identifier model or language specification of the input language. The main point is that this score can be simply and automatically estimated on-the-fly so that the whole decoding pipeline is more simple and compact. Experimental results showed that this method can achieve the same quality as when the input language is specified. In addition, we present to design an English and Vietnamese End-to-End model to deal with not only the problem of cross-lingual speakers but also as a solution to improve the accuracy of borrowed words of English in Vietnamese.


title: Unconditional finite amplitude stability of a viscoelastic fluid in a mechanically isolated vessel with spatially non-uniform wall temperature

abstract: We investigate finite amplitude stability of spatially inhomogeneous steady state of an incompressible viscoelastic fluid which occupies a mechanically isolated vessel with walls kept at spatially non-uniform temperature. For a wide class of incompressible viscoelastic models including the Oldroyd-B model, the Giesekus model, the FENE-P model, the Johnson--Segalman model, and the Phan--Thien--Tanner model we prove that the steady state is stable subject to any finite perturbation.


title: Lower Bounds for Non-Elitist Evolutionary Algorithms via Negative Multiplicative Drift

abstract: A decent number of lower bounds for non-elitist population-based evolutionary algorithms has been shown by now. Most of them are technically demanding due to the (hard to avoid) use of negative drift theorems -- general results which translate an expected progress away from the target into a high hitting time. We propose a simple negative drift theorem for multiplicative drift scenarios and show that it can simplify existing analyses. We discuss in more detail Lehre's (PPSN 2010) \emph{negative drift in populations} method, one of the most general tools to prove lower bounds on the runtime of non-elitist mutation-based evolutionary algorithms for discrete search spaces. Together with other arguments, we obtain an alternative and simpler proof, which also strengthens and simplifies this method. In particular, now only three of the five technical conditions of the previous result have to be verified. The lower bounds we obtain are explicit instead of only asymptotic. This allows to compute concrete lower bounds for concrete algorithms, but also enables us to show that super-polynomial runtimes appear already when the reproduction rate is only a $(1 - \omega(n^{-1/2}))$ factor below the threshold. For the special case of algorithms using standard bit mutation with a random mutation rate (called uniform mixing in the language of hyper-heuristics), we prove the result stated by Dang and Lehre (PPSN 2016) and extend it to mutation rates other than $\Theta(1/n)$, which includes the heavy-tailed mutation operator proposed by Doerr, Le, Makhmara, and Nguyen (GECCO 2017). We finally apply our method and a novel domination argument to show an exponential lower bound for the runtime of the mutation-only simple genetic algorithm on \onemax for arbitrary population size.


title: On branches of the KS black hole

abstract: The Klebanov-Strassler black hole is a holographic dual to ${\cal N}=1$ supersymmetric $SU(N)\times SU(N+M)$ cascading gauge theory plasma with spontaneously broken chiral symmetry. The chiral symmetry breaking sector of the cascading gauge theory contains two dimension-3 operators and a single dimension-7 operator. The black hole solution constructed in arXiv:1809.08484 represents the end point of the instability triggered by the condensation of one of the dimension-3 operators. We study here all three branches of the quasinormal modes of the chiral symmetry breaking sector -- there are no additional instabilities beyond the one identified in arXiv:1012.2404. Thus, the Klebanov-Strassler black hole solution of arXiv:1809.08484 is the only one with homogeneous and isotropic horizon, perturbatively connected to the chirally symmetric Klebanov-Tseytlin black hole arXiv:0706.1768.


title: A relatively short self-contained proof of the Baker-Campbell-Hausdorff theorem

abstract: We give a new purely algebraic proof of the Baker-Campbell-Hausdorff theorem, which states that the homogeneous components of the formal expansion of $\log(e^Ae^B)$ are Lie polynomials. Our proof is based on a recurrence formula for these components and a lemma that states that if under certain conditions a commutator of a non-commuting variable and a given polynomial is a Lie polynomial, then the given polynomial itself is a Lie polynomial.