title: Knowledge-Enhanced Personalized Review Generation with Capsule Graph Neural Network

abstract: Personalized review generation (PRG) aims to automatically produce review text reflecting user preference, which is a challenging natural language generation task. Most of previous studies do not explicitly model factual description of products, tending to generate uninformative content. Moreover, they mainly focus on word-level generation, but cannot accurately reflect more abstractive user preference in multiple aspects. To address the above issues, we propose a novel knowledge-enhanced PRG model based on capsule graph neural network~(Caps-GNN). We first construct a heterogeneous knowledge graph (HKG) for utilizing rich item attributes. We adopt Caps-GNN to learn graph capsules for encoding underlying characteristics from the HKG. Our generation process contains two major steps, namely aspect sequence generation and sentence generation. First, based on graph capsules, we adaptively learn aspect capsules for inferring the aspect sequence. Then, conditioned on the inferred aspect label, we design a graph-based copy mechanism to generate sentences by incorporating related entities or words from HKG. To our knowledge, we are the first to utilize knowledge graph for the PRG task. The incorporated KG information is able to enhance user preference at both aspect and word levels. Extensive experiments on three real-world datasets have demonstrated the effectiveness of our model on the PRG task.


title: Counting Hypergraphs with Large Girth

abstract: Morris and Saxton used the method of containers to bound the number of $n$-vertex graphs with $m$ edges containing no $\ell$-cycles, and hence graphs of girth more than $\ell$. We consider a generalization to $r$-uniform hypergraphs. The {\em girth} of a hypergraph $H$ is the minimum $\ell$ such that for some $F \subseteq H$, there exists a bijection $\phi : E(C_\ell) \to E(F)$ with $e\subseteq \phi(e)$ for all $e\in E(C_\ell)$. Letting $N_m^r(n,\ell)$ denote the number of $n$-vertex $r$-uniform hypergraphs with $m$ edges and girth larger than $\ell$ and defining $\lambda = \lceil (r - 2)/(\ell - 2)\rfloor$, we show \[ N_m^r(n,\ell) \leq N_m^2(n,\ell)^{r - 1 + \lambda}\] which is tight when $\ell - 2 $ divides $r - 2$ up to a $1 + o(1)$ term in the exponent. This result is used to address the extremal problem for subgraphs of girth more than $\ell$ in random $r$-uniform hypergraphs.


title: Reproducible Science with LaTeX

abstract: This paper proposes a procedure to execute external source codes from a LaTeX document and include the calculation outputs in the resulting Portable Document Format (pdf) file automatically. It integrates programming tools into the LaTeX writing tool to facilitate the production of reproducible research. In our proposed approach to a LaTeX-based scientific notebook the user can easily invoke any programming language or a command-line program when compiling the LaTeX document, while using their favorite LaTeX editor in the writing process. The required LaTeX setup, a new Python package, and the defined preamble are discussed in detail, and working examples using R, Julia, and MatLab to reproduce existing research are provided to illustrate the proposed procedure. We also demonstrate how to include system setting information in a paper by invoking shell scripts when compiling the document.


title: Global existence and blow-up of solutions to a class of non-Newton filtration equations with singular potential and logarithmic nonlinearity

abstract: In this paper, a class of non-Newton filtration equations with singular potential and logarithmic nonlinearity under initial-boundary condition is investigated. Based on potential well method and Hardy-Sobolev inequality, the global existence of solutions is derived when the initial energy $J(u_0)$ is subcritical($J(u_0)<d$), critical($J(u_0)=d$) with $d$ being the mountain-pass level. Finite time blow-up results are obtained as well when the initial energy $J(u_0)$ satisfies specific conditions. Moreover, the upper and lower bounds of the blow-up time are given.


title: Unified Framework for Charge-Spin Interconversion in Spin-Orbit Materials

abstract: Materials with spin-orbit coupling are of great interest for various spintronics applications due to the efficient electrical generation and detection of spin-polarized electrons. Over the past decade, many materials have been studied, including topological insulators, transition metals, Kondo insulators, semimetals, semiconductors, and oxides; however, there is no unifying physical framework for understanding the physics and therefore designing a material system and devices with the desired properties. We present a model that binds together the experimental data observed on the wide variety of materials in a unified manner. We show that in a material with a given spin-momentum locking, the density of states plays a crucial role in determining the charge-spin interconversion efficiency, and a simple inverse relationship can be obtained. Remarkably, experimental data obtained over the last decade on many different materials closely follow such an inverse relationship. We further deduce two figure-of-merits of great current interest: the spin-orbit torque (SOT) efficiency (for the direct effect) and the inverse Rashba-Edelstein effect length (for the inverse effect), which statistically show good agreement with the existing experimental data on wide varieties of materials. Especially, we identify a scaling law for the SOT efficiency with respect to the carrier concentration in the sample, which agrees with existing data. Such an agreement is intriguing since our transport model includes only Fermi surface contributions and fundamentally different from the conventional views of the SOT efficiency that includes contributions from all the occupied states.


title: Improving Lesion Detection by exploring bias on Skin Lesion dataset

abstract: All datasets contain some biases, often unintentional, due to how they were acquired and annotated. These biases distort machine-learning models' performance, creating spurious correlations that the models can unfairly exploit, or, contrarily destroying clear correlations that the models could learn. With the popularity of deep learning models, automated skin lesion analysis is starting to play an essential role in the early detection of Melanoma. The ISIC Archive is one of the most used skin lesion sources to benchmark deep learning-based tools. Bissoto et al. experimented with different bounding-box based masks and showed that deep learning models could classify skin lesion images without clinically meaningful information in the input data. Their findings seem confounding since the ablated regions (random rectangular boxes) are not significant. The shape of the lesion is a crucial factor in the clinical characterization of a skin lesion. In that context, we performed a set of experiments that generate shape-preserving masks instead of rectangular bounding-box based masks. A deep learning model trained on these shape-preserving masked images does not outperform models trained on images without clinically meaningful information. That strongly suggests spurious correlations guiding the models. We propose use of general adversarial network (GAN) to mitigate the underlying bias.


title: Paragraph-level Commonsense Transformers with Recurrent Memory

abstract: Human understanding of narrative texts requires making commonsense inferences beyond what is stated explicitly in the text. A recent model, COMET, can generate such implicit commonsense inferences along several dimensions such as pre- and post-conditions, motivations, and mental states of the participants. However, COMET was trained on commonsense inferences of short phrases, and is therefore discourse-agnostic. When presented with each sentence of a multi-sentence narrative, it might generate inferences that are inconsistent with the rest of the narrative. We present the task of discourse-aware commonsense inference. Given a sentence within a narrative, the goal is to generate commonsense inferences along predefined dimensions, while maintaining coherence with the rest of the narrative. Such large-scale paragraph-level annotation is hard to get and costly, so we use available sentence-level annotations to efficiently and automatically construct a distantly supervised corpus. Using this corpus, we train PARA-COMET, a discourse-aware model that incorporates paragraph-level information to generate coherent commonsense inferences from narratives. PARA-COMET captures both semantic knowledge pertaining to prior world knowledge, and episodic knowledge involving how current events relate to prior and future events in a narrative. Our results show that PARA-COMET outperforms the sentence-level baselines, particularly in generating inferences that are both coherent and novel.


title: On the Gauge Invariance of Scalar Induced Gravitational Waves: Gauge Fixings Considered

abstract: The energy density spectrum is an observable of gravitational waves. Divergence has appeared in the energy density spectra of the scalar induced gravitational waves for different gauge fixings. To resolve the discrepancy, we investigate the gauge invariance of the scalar induced gravitational waves. It is shown that the gauge invariant induced gravitational waves can be obtained by subtracting the fictitious tensor perturbations via introducing the counter term composed of the first order scalar perturbations. The kernel function uniquely determines the energy density spectrum of the scalar induced gravitational waves. We explicitly calculate the gauge invariant kernel functions in the Newtonian gauge and the uniform density gauge, respectively. The discrepancy between the energy density spectra upon the Newtonian gauge and the uniform density gauge is shown to be eliminated in the gauge invariant framework. In fact, the gauge invariant approach is also available to other kinds of gauge fixings.


title: Learning Compositional Structures for Deep Learning: Why Routing-by-agreement is Necessary

abstract: A formal description of the compositionality of neural networks is associated directly with the formal grammar-structure of the objects it seeks to represent. This formal grammar-structure specifies the kind of components that make up an object, and also the configurations they are allowed to be in. In other words, objects can be described as a parse-tree of its components -- a structure that can be seen as a candidate for building connection-patterns among neurons in neural networks. We present a formal grammar description of convolutional neural networks and capsule networks that shows how capsule networks can enforce such parse-tree structures, while CNNs do not. Specifically, we show that the entropy of routing coefficients in the dynamic routing algorithm controls this ability. Thus, we introduce the entropy of routing weights as a loss function for better compositionality among capsules. We show by experiments, on data with a compositional structure, that the use of this loss enables capsule networks to better detect changes in compositionality. Our experiments show that as the entropy of the routing weights increases, the ability to detect changes in compositionality reduces. We see that, without routing, capsule networks perform similar to convolutional neural networks in that both these models perform badly at detecting changes in compositionality. Our results indicate that routing is an important part of capsule networks -- effectively answering recent work that has questioned its necessity. We also, by experiments on SmallNORB, CIFAR-10, and FashionMNIST, show that this loss keeps the accuracy of capsule network models comparable to models that do not use it .


title: Gravito-magnetic instabilities of Relativistic Magnetohydrodynamics

abstract: We study gravito-magnetic instabilities of a static homogeneous medium with an aligned magnetic field in the two contexts of relativistic magnetohydrodynamics (MHD): first, MHD with post-Newtonian (PN) corrections, and second, special relativistic (SR) MHD with weak gravity. The analysis in the PN MHD is made without taking the temporal gauge condition, thus results are gauge-invariant. The PN corrections of the internal energy, pressure, sound velocity and the Alfv\'en velocity lower the critical (Jeans) wavelength. {All relativistic effects tend to destabilize the system.} Although the SR MHD with weak gravity is presented in the harmonic gauge, in the presence of gravity the stability analysis is strictly valid to Newtonian order. In the absence of gravity, the SR MHD is independent of the gauge condition. We present the plane wave velocities and the stability criteria in both cases.


title: Primordial particles and waves in the early Universe

abstract: The observational evidence points to the origin of our Universe from a big-bang explosion, the normal matter we observed can be well explained by the particles created in the strong and weak interacting phases of the early universe. The dark energy and dark matter, which occupy major contents of the universe, may be created from earlier times than that of quarks. We propose that the dark energy is an integration of the gravitational waves (GWs) in early universe, and the dark matter is composed of x particles which are created earlier and have much heavier mass than quarks in early universe. The x particles may be bosons with no or little interaction with normal matter except gravity, and they can be free particles or Bose-Einstein Condensed (BEC) matter as the dominant matter in the galaxy clusters and galactic halos. This paper notes as a framework of ideas need to be investigated further.


title: Bessel ultrasonic probe based on conical acoustic lens: simulation study

abstract: Ultrasonic transducer is a sensor that realizes the mutual conversion of ultrasonic and electrical signals, and it is widely used in quality inspection, biomedical imaging and other fields. Commonly used ultrasonic transducers have a small detection range and low sensitivity due to the diffraction of sound waves. Focused transducers are used to improve detection sensitivity. Unfortunately, focused transducers have narrow depth of field. Here, we developed a Bessel ultrasonic transducer for large depth of field by using conical acoustic lens. An acoustic lens is attached to a unfocused ultrasonic. And the acoustic lens is a cuboid prism with a concave cone on the bottom, made of fused silica. Similar to an axicon that can generate a Bessel beam, the Bessel ultrasonic transducer can produce nondiffracting Bessel ultrasonic beams. Therefore, extended depth of field with uniformly high resolution and high detection sensitivity can be obtained. We used COMSOL to simulate the transmission of ultrasonic field of the designed conical acoustic lens, and compare it with the spherical focused ultrasonic transducer. The results show that the depth of field of the Bessel ultrasonic transducer is about 8 times that of the conventional spherical focused ultrasonic transducer. And the depth of field of the Bessel ultrasonic transducer can be further adjusted by adjusting the cone angle of the conical acoustic lens. The Bessel ultrasonic transducer will help improve the capabilities of the ultrasound probe and expand its application range. For example, an ultrasonic probe with a large depth of field will expand the imaging depth of photoacoustic microscopy and enhance its ability in non-destructive testing.


title: A Class of Time-Varying Vector Moving Average Models: Nonparametric Kernel Estimation and Application

abstract: Multivariate dynamic time series models are widely encountered in practical studies, e.g., modelling policy transmission mechanism and measuring connectedness between economic agents. To better capture the dynamics, this paper proposes a wide class of multivariate dynamic models with time-varying coefficients, which have a general time-varying vector moving average (VMA) representation, and nest, for instance, time-varying vector autoregression (VAR), time-varying vector autoregression moving-average (VARMA), and so forth as special cases. The paper then develops a unified estimation method for the unknown quantities before an asymptotic theory for the proposed estimators is established. In the empirical study, we investigate the transmission mechanism of monetary policy using U.S. data, and uncover a fall in the volatilities of exogenous shocks. In addition, we find that (i) monetary policy shocks have less influence on inflation before and during the so-called Great Moderation, (ii) inflation is more anchored recently, and (iii) the long-run level of inflation is below, but quite close to the Federal Reserve's target of two percent after the beginning of the Great Moderation period.


title: Critical behaviour at the onset of synchronization in a neuronal model

abstract: The presence of both critical behavior and oscillating patterns in brain dynamics is a very interesting issue. In this paper, we consider a model for a neuron population, where each neuron is modeled by an over-damped rotator. We find that in the space of external parameters, there exist some regions that system shows synchronization. Interestingly, just at the transition point, the avalanche statistics show a power-law behavior. Also, in the case of small systems, the (partially) synchronization and power-law behavior can happen at the same time.


title: PTUM: Pre-training User Model from Unlabeled User Behaviors via Self-supervision

abstract: User modeling is critical for many personalized web services. Many existing methods model users based on their behaviors and the labeled data of target tasks. However, these methods cannot exploit useful information in unlabeled user behavior data, and their performance may be not optimal when labeled data is scarce. Motivated by pre-trained language models which are pre-trained on large-scale unlabeled corpus to empower many downstream tasks, in this paper we propose to pre-train user models from large-scale unlabeled user behaviors data. We propose two self-supervision tasks for user model pre-training. The first one is masked behavior prediction, which can model the relatedness between historical behaviors. The second one is next $K$ behavior prediction, which can model the relatedness between past and future behaviors. The pre-trained user models are finetuned in downstream tasks to learn task-specific user representations. Experimental results on two real-world datasets validate the effectiveness of our proposed user model pre-training method.


title: Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning

abstract: Sentence function is an important linguistic feature indicating the communicative purpose in uttering a sentence. Incorporating sentence functions into conversations has shown improvements in the quality of generated responses. However, the number of utterances for different types of fine-grained sentence functions is extremely imbalanced. Besides a small number of high-resource sentence functions, a large portion of sentence functions is infrequent. Consequently, dialogue generation conditioned on these infrequent sentence functions suffers from data deficiency. In this paper, we investigate a structured meta-learning (SML) approach for dialogue generation on infrequent sentence functions. We treat dialogue generation conditioned on different sentence functions as separate tasks, and apply model-agnostic meta-learning to high-resource sentence functions data. Furthermore, SML enhances meta-learning effectiveness by promoting knowledge customization among different sentence functions but simultaneously preserving knowledge generalization for similar sentence functions. Experimental results demonstrate that SML not only improves the informativeness and relevance of generated responses, but also can generate responses consistent with the target sentence functions.


title: Explaining Deep Neural Networks

abstract: Deep neural networks are becoming more and more popular due to their revolutionary success in diverse areas, such as computer vision, natural language processing, and speech recognition. However, the decision-making processes of these models are generally not interpretable to users. In various domains, such as healthcare, finance, or law, it is critical to know the reasons behind a decision made by an artificial intelligence system. Therefore, several directions for explaining neural models have recently been explored. In this thesis, I investigate two major directions for explaining deep neural networks. The first direction consists of feature-based post-hoc explanatory methods, that is, methods that aim to explain an already trained and fixed model (post-hoc), and that provide explanations in terms of input features, such as tokens for text and superpixels for images (feature-based). The second direction consists of self-explanatory neural models that generate natural language explanations, that is, models that have a built-in module that generates explanations for the predictions of the model.


title: Understanding Incentivized Mobile App Installs on Google Play Store

abstract: "Incentivized" advertising platforms allow mobile app developers to acquire new users by directly paying users to install and engage with mobile apps (e.g., create an account, make in-app purchases). Incentivized installs are banned by the Apple App Store and discouraged by the Google Play Store because they can manipulate app store metrics (e.g., install counts, appearance in top charts). Yet, many organizations still offer incentivized install services for Android apps. In this paper, we present the first study to understand the ecosystem of incentivized mobile app install campaigns in Android and its broader ramifications through a series of measurements. We identify incentivized install campaigns that require users to install an app and perform in-app tasks targeting manipulation of a wide variety of user engagement metrics (e.g., daily active users, user session lengths) and revenue. Our results suggest that these artificially inflated metrics can be effective in improving app store metrics as well as helping mobile app developers to attract funding from venture capitalists. Our study also indicates lax enforcement of the Google Play Store's existing policies to prevent these behaviors. It further motivates the need for stricter policing of incentivized install campaigns. Our proposed measurements can also be leveraged by the Google Play Store to identify potential policy violations.


title: A Chirplet Transform-based Mode Retrieval Method for Multicomponent Signals with Crossover Instantaneous Frequencies

abstract: In nature and engineering world, the acquired signals are usually affected by multiple complicated factors and appear as multicomponent nonstationary modes. In such and many other situations, it is necessary to separate these signals into a finite number of monocomponents to represent the intrinsic modes and underlying dynamics implicated in the source signals. In this paper, we consider the mode retrieval of a multicomponent signal which has crossing instantaneous frequencies (IFs), meaning that some of the components of the signal overlap in the time-frequency domain. We use the chirplet transform (CT) to represent a multicomponent signal in the three-dimensional space of time, frequency and chirp rate and introduce a CT-based signal separation scheme (CT3S) to retrieve modes. In addition, we analyze the error bounds for IF estimation and component recovery with this scheme. We also propose a matched-filter along certain specific time-frequency lines with respect to the chirp rate to make nonstationary signals be further separated and more concentrated in the three-dimensional space of CT. Furthermore, based on the approximation of source signals with linear chirps at any local time, we propose an innovative signal reconstruction algorithm, called the group filter-matched CT3S (GFCT3S), which also takes a group of components into consideration simultaneously. GFCT3S is suitable for signals with crossing IFs. It also decreases component recovery errors when the IFs curves of different components are not crossover, but fast-varying and close to one and other. Numerical experiments on synthetic and real signals show our method is more accurate and consistent in signal separation than the empirical mode decomposition, synchrosqueezing transform, and other approaches


title: A New Mask R-CNN Based Method for Improved Landslide Detection

abstract: This paper presents a novel method of landslide detection by exploiting the Mask R-CNN capability of identifying an object layout by using a pixel-based segmentation, along with transfer learning used to train the proposed model. A data set of 160 elements is created containing landslide and non-landslide images. The proposed method consists of three steps: (i) augmenting training image samples to increase the volume of the training data, (ii) fine tuning with limited image samples, and (iii) performance evaluation of the algorithm in terms of precision, recall and F1 measure, on the considered landslide images, by adopting ResNet-50 and 101 as backbone models. The experimental results are quite encouraging as the proposed method achieves Precision equals to 1.00, Recall 0.93 and F1 measure 0.97, when ResNet-101 is used as backbone model, and with a low number of landslide photographs used as training samples. The proposed algorithm can be potentially useful for land use planners and policy makers of hilly areas where intermittent slope deformations necessitate landslide detection as prerequisite before planning.


title: Affine Linear Parameter-Varying Embedding of Nonlinear Models with Improved Accuracy and Minimal Overbounding

abstract: In this paper, automated generation of linear parameter-varying (LPV) state-space models to embed the dynamical behavior of nonlinear systems is considered, focusing on the trade-off between scheduling complexity and model accuracy and on the minimization of the conservativeness of the resulting embedding. The LPV state-space model is synthesized with affine scheduling dependency, while the scheduling variables themselves are nonlinear functions of the state and input variables of the original system. The method allows to generate complete or approximative embedding of the nonlinear system model and also it can be used to minimize complexity of existing LPV embeddings. The capabilities of the method are demonstrated on simulation examples and also in an empirical case study where the first-principle motion model of a 3-DOF control moment gyroscope is converted by the proposed method to LPV model with low scheduling complexity. Using the resulting model, a gain-scheduled controller is designed and applied on the gyroscope, demonstrating the efficiency of the developed approach.


title: Uniqueness of unconditional basis of $H_p(\mathbb{T})\oplus\ell_{2}$ and $H_p(\mathbb{T})\oplus\mathcal{T}^{(2)}$ for $0<p<1$

abstract: Our goal in this paper is to advance the state of the art of the topic of uniqueness of unconditional basis. To that end we establish general conditions on a pair $(\mathbb{X}, \mathbb{Y})$ formed by a quasi-Banach space $\mathbb{X}$ and a Banach space $\mathbb{Y}$ which guarantee that every unconditional basis of their direct sum $\mathbb{X}\oplus\mathbb{Y}$ splits into unconditional bases of each summand. As application of our methods we obtain that, among others, the spaces $H_p(\mathbb{T}^d) \oplus\mathcal{T}^{(2)}$ and $H_p(\mathbb{T}^d)\oplus\ell_2$, for $p\in(0,1)$ and $d\in\mathbb{N}$, have a unique unconditional basis (up to equivalence and permutation).


title: Multi-turn Response Selection using Dialogue Dependency Relations

abstract: Multi-turn response selection is a task designed for developing dialogue agents. The performance on this task has a remarkable improvement with pre-trained language models. However, these models simply concatenate the turns in dialogue history as the input and largely ignore the dependencies between the turns. In this paper, we propose a dialogue extraction algorithm to transform a dialogue history into threads based on their dependency relations. Each thread can be regarded as a self-contained sub-dialogue. We also propose Thread-Encoder model to encode threads and candidates into compact representations by pre-trained Transformers and finally get the matching score through an attention layer. The experiments show that dependency relations are helpful for dialogue context understanding, and our model outperforms the state-of-the-art baselines on both DSTC7 and DSTC8*, with competitive results on UbuntuV2.


title: Distributed Constructions of Dual-Failure Fault-Tolerant Distance Preservers

abstract: Fault tolerant distance preservers (spanners) are sparse subgraphs that preserve (approximate) distances between given pairs of vertices under edge or vertex failures. So-far, these structures have been studied mainly from a centralized viewpoint. Despite the fact fault tolerant preservers are mainly motivated by the error-prone nature of distributed networks, not much is known on the distributed computational aspects of these structures. In this paper, we present distributed algorithms for constructing fault tolerant distance preservers and $+2$ additive spanners that are resilient to at most \emph{two edge} faults. Prior to our work, the only non-trivial constructions known were for the \emph{single} fault and \emph{single source} setting by [Ghaffari and Parter SPAA'16]. Our key technical contribution is a distributed algorithm for computing distance preservers w.r.t. a subset $S$ of source vertices, resilient to two edge faults. The output structure contains a BFS tree $BFS(s,G \setminus \{e_1,e_2\})$ for every $s \in S$ and every $e_1,e_2 \in G$. The distributed construction of this structure is based on a delicate balance between the edge congestion (formed by running multiple BFS trees simultaneously) and the sparsity of the output subgraph. No sublinear-round algorithms for constructing these structures have been known before.


title: Path integrals in a multiply-connected configuration space (50 years after)

abstract: The proposal made 50 years ago by Schulman (1968), Laidlaw & Morette-DeWitt (1971) and Dowker (1972) to decompose the propagator according to the homotopy classes of paths was a major breakthrough: it showed how Feynman functional integrals opened a direct window on quantum properties of topological origin in the configuration space. This paper casts a critical look at the arguments brought by this series of papers and its numerous followers in an attempt to clarify the reason why the emergence of the unitary linear representation of the first homotopy group is not only sufficient but also necessary.


title: Unstable cracks trigger asymptotic rupture modes in bimaterial friction

abstract: The rupture of the interface joining two materials under frictional contact controls their macroscopic sliding. Interface rupture dynamics depend markedly on the mechanical properties of the bulk materials that bound the frictional interface. When the materials are similar, recent experimental and theoretical work has shown that shear cracks described by Linear Elastic Fracture Mechanics (LEFM) quantitatively describe the rupture of frictional interfaces. When the elastic properties of the two materials are dissimilar, many new effects take place that result from bimaterial coupling: the normal stress at the interface is elastodynamically coupled to local slip rates. At low rupture velocities, bimaterial coupling is not very significant and interface rupture is governed by `bimaterial cracks' that are described well by LEFM. As rupture velocities increase, we experimentally and theoretically show how bimaterial cracks become unstable at a subsonic critical rupture velocity, $c_T$. When the rupture direction opposes the direction of applied shear in the softer material, we show that $c_T$ is the subsonic limiting velocity. When ruptures propagate in the direction of applied shear in the softer material, we demonstrate that $c_T$ provides an explanation for how and when slip pulses (new rupture modes characterized by spatially localized slip) are generated. This work completes the fundamental physical description of how the frictional rupture of bimaterial interfaces takes place.


title: A Study for Universal Adversarial Attacks on Texture Recognition

abstract: Given the outstanding progress that convolutional neural networks (CNNs) have made on natural image classification and object recognition problems, it is shown that deep learning methods can achieve very good recognition performance on many texture datasets. However, while CNNs for natural image classification/object recognition tasks have been revealed to be highly vulnerable to various types of adversarial attack methods, the robustness of deep learning methods for texture recognition is yet to be examined. In our paper, we show that there exist small image-agnostic/univesal perturbations that can fool the deep learning models with more than 80\% of testing fooling rates on all tested texture datasets. The computed perturbations using various attack methods on the tested datasets are generally quasi-imperceptible, containing structured patterns with low, middle and high frequency components.


title: Derivative over Wasserstein spaces along curves of densities

abstract: In this paper, given any random variable $\xi$ defined over a probability space $(\Omega,\mathcal{F},Q)$, we focus on the study of the derivative of functions of the form $L\mapsto F_Q(L):=f\big((LQ)_{\xi}\big),$ defined over the convex cone of densities $L\in\mathcal{L}^Q:=\{ L\in L^1(\Omega,\mathcal{F},Q;\mathbb{R}_+):\ E^Q[L]=1\}$ in $L^1(\Omega,\mathcal{F},Q).$ Here $f$ is a function over the space $\mathcal{P}(\mathbb{R}^d)$ of probability laws over $\mathbb{R}^d$ endowed with its Borel $\sigma$-field $\mathcal{B}(\mathbb{R}^d)$. The problem of the differentiability of functions $F_Q$ of the above form has its origin in the study of mean-field control problems for which the controlled dynamics admit only weak solutions. Inspired by P.-L. Lions' results [18] we show that, if for given $L\in\mathcal{L}^Q$, $L'\mapsto F_{LQ}(L'):\mathcal{L}^{LQ}\rightarrow\mathbb{R}$ is differentiable at $L'=1$, the derivative is of the form $g(\xi)$, where $g:\mathbb{R}^d\rightarrow\mathbb{R}$ is a Borel function which depends on $(Q,L,\xi)$ only through the law $(LQ)_\xi$. Denoting this derivative by $\partial_1F((LQ)_\xi,x):=g(x),\, x\in\mathbb{R}^d$, we study its properties, and we relate it to partial derivatives, recently investigated in [6], and, moreover, in the case when $f$ restricted to the 2-Wasserstein space $\mathcal{P}_2(\mathbb{R}^d)$ is differentiable in P.-L. Lions' sense and $(LQ)_{\xi}\in\mathcal{P}_2(\mathbb{R}^d)$, we investigate the relation between the derivative with respect to the density of $F_Q(L)=f\big((LQ)_{\xi}\big)$ and the derivative of $f$ with respect to the probability measure. Our main result here shows that $\partial_x\partial_1F((LQ)_\xi,x)=\partial_\mu f((LQ)_\xi,x),\ x\in \mathbb{R}^d,$ where $\partial_\mu f((LQ)_\xi,x)$ denotes the derivative of $f:\mathcal{P}_2(\mathbb{R}^d)\rightarrow \mathbb{R}$ at $(LQ)_\xi$.


title: Photoluminescence Lineshapes for Color Centers in Silicon Carbide from Density Functional Theory Calculations

abstract: Silicon carbide with optically and magnetically active point defects offers unique opportunities for quantum technology applications. Since interaction with these defects commonly happens through optical excitation and de-excitation, a complete understanding of their light-matter interaction in general and optical signatures, in particular, is crucial. Here, we employ quantum mechanical density functional theory calculations to investigate the photoluminescence lineshapes of selected, experimentally observed color centers (including single vacancies, double vacancies, and vacancy impurity pairs) in 4H-SiC. The analysis of zero-phonon lines as well as Huang-Rhys and Debye-Waller factors are accompanied by a detailed study of the underlying lattice vibrations. We show that the defect lineshapes are governed by strong coupling to bulk phonons at lower energies and localized vibrational modes at higher energies. Generally, good agreement to the available experimental data is obtained, and thus we expect our theoretical work to be beneficial for the identification of defect signatures in the photoluminescence spectra and thereby advance the research in quantum photonics and quantum information processing.


title: Was GW190814 a black hole -- strange quark star system?

abstract: We investigate the possibility that the low mass companion of the black hole in the source of GW190814 was a strange quark star. This possibility is viable within the so-called two-families scenario in which neutron stars and strange quark stars coexist. Strange quark stars can reach the mass range indicated by GW190814, $M\sim (2.5-2.67) M_\odot$ due to a large value of the adiabatic index, without the need for a velocity of sound close to the causal limit. Neutron stars (actually hyperonic stars in the two-families scenario) can instead fulfill the presently available astrophysical and nuclear physics constraints which require a softer equation of state. In this scheme it is possible to satisfy both the request of very large stellar masses and of small radii while using totally realistic and physically motivated equations of state. Moreover it is possible to get a radius for a 1.4 $M_\odot$ star of the order or less than 11 km, which is impossible if only one family of compact stars exists.


title: High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm

abstract: Efficient sampling from a high-dimensional Gaussian distribution is an old but high-stake issue. Vanilla Cholesky samplers imply a computational cost and memory requirements which can rapidly become prohibitive in high dimension. To tackle these issues, multiple methods have been proposed from different communities ranging from iterative numerical linear algebra to Markov chain Monte Carlo (MCMC) approaches. Surprisingly, no complete review and comparison of these methods have been conducted. This paper aims at reviewing all these approaches by pointing out their differences, close relations, benefits and limitations. In addition to this state of the art, this paper proposes a unifying Gaussian simulation framework by deriving a stochastic counterpart of the celebrated proximal point algorithm in optimization. This framework offers a novel and unifying revisit of most of the existing MCMC approaches while extending them. Guidelines to choose the appropriate Gaussian simulation method for a given sampling problem in high dimension are proposed and illustrated with numerical examples.


title: Conjugates of Pisot numbers

abstract: In this paper we investigate the Galois conjugates of a Pisot number $q \in (m, m+1)$, $m \geq 1$. In particular, we conjecture that for $q \in (1,2)$ we have $|q'| \geq \frac{\sqrt{5}-1}{2}$ for all conjugates $q'$ of $q$. Further, for $m \geq 3$, we conjecture that for all Pisot numbers $q \in (m, m+1)$ we have $|q'| \geq \frac{m+1-\sqrt{m^2+2m-3}}{2}$. A similar conjecture if made for $m =2$. We conjecture that all of these bounds are tight. We provide partial supporting evidence for this conjecture. This evidence is both of a theoretical and computational nature. Lastly, we connect this conjecture to a result on the dimension of Bernoulli convolutions parameterized by $\beta$, whose conjugate is the reciprocal of a Pisot number.


title: A Multi-task Learning Framework for Opinion Triplet Extraction

abstract: The state-of-the-art Aspect-based Sentiment Analysis (ABSA) approaches are mainly based on either detecting aspect terms and their corresponding sentiment polarities, or co-extracting aspect and opinion terms. However, the extraction of aspect-sentiment pairs lacks opinion terms as a reference, while co-extraction of aspect and opinion terms would not lead to meaningful pairs without determining their sentiment dependencies. To address the issue, we present a novel view of ABSA as an opinion triplet extraction task, and propose a multi-task learning framework to jointly extract aspect terms and opinion terms, and simultaneously parses sentiment dependencies between them with a biaffine scorer. At inference phase, the extraction of triplets is facilitated by a triplet decoding method based on the above outputs. We evaluate the proposed framework on four SemEval benchmarks for ASBA. The results demonstrate that our approach significantly outperforms a range of strong baselines and state-of-the-art approaches.


title: A Sylvester-Gallai theorem for cubic curves

abstract: We prove a variant of the Sylvester-Gallai theorem for cubics (algebraic curves of degree three): If a finite set of sufficiently many points in $\mathbb{R}^2$ is not contained in a cubic, then there is a cubic that contains exactly nine of the points. This resolves the first unknown case of a conjecture of Wiseman and Wilson from 1988, who proved a variant of Sylvester-Gallai for conics and conjectured that similar statements hold for curves of any degree.


title: Energy transmission control for a Grid-connected modern power system Non-Linear loads with a Series Multi-Stage Transformer Voltage Reinjection with controlled converters

abstract: The effective way of energy transmission plays a key factor in improving the overall transmission systems efficiency. Many methods are proposed to control the reactive power flow, voltage fluctuations and power factor improvement, The proposed converter topology gives a much significant improvement in transmission systems performance which includes multistage transformers control with the controlled converters along with the series active filters. The overall control strategy which involves the Multistage Voltage Re-Injection Transformer Controlled Converters (MSVRITCC) to reinject the voltages into the grid to compensate the voltages and remaining parameters and power flow control. The proposed topology improves the grid security, flexibility in reaching the desired load requirements with grid adaptability and reduces THD values into a significant values and made the control of power conditioning circuit flexible and easy to perform the voltage compensations in grid to load connected applications. The binary control is used to trigger the power converter circuits which made the controlling much simpler.


title: An energy-splitting high order numerical method for multi-material flows

abstract: This chapter deals with multi-material flow problems by a kind of effective numerical methods, based on a series of reduced forms of the Baer-Nunziato (BN) model. Numerical simulations often face a host of difficult challenges, typically including the volume fraction positivity and stability of multi-material shocks. To cope with these challenges, we propose a new non-oscillatory {\em energy-splitting} Godunov-type scheme for computing multi-fluid flows in the Eulerian framework. A novel reduced version of the BN model is introduced as the basis for the energy-splitting scheme. In comparison with existing two-material compressible flow models obtained by reducing the BN model in the literature, it is shown that our new reduced model can simulate the kinetic energy exchange around material interfaces very effectively. Then a second-order accurate extension of the energy-splitting Godunov-type scheme is made using the generalized Riemann problem (GRP) solver. Numerical experiments are carried out for the shock-interface interaction, shock-bubble interaction and the Richtmyer-Meshkov instability problems, which demonstrate the excellent performance of this type of schemes.


title: Trajectory-Based Spatiotemporal Entity Linking

abstract: Trajectory-based spatiotemporal entity linking is to match the same moving object in different datasets based on their movement traces. It is a fundamental step to support spatiotemporal data integration and analysis. In this paper, we study the problem of spatiotemporal entity linking using effective and concise signatures extracted from their trajectories. This linking problem is formalized as a k-nearest neighbor (k-NN) query on the signatures. Four representation strategies (sequential, temporal, spatial, and spatiotemporal) and two quantitative criteria (commonality and unicity) are investigated for signature construction. A simple yet effective dimension reduction strategy is developed together with a novel indexing structure called the WR-tree to speed up the search. A number of optimization methods are proposed to improve the accuracy and robustness of the linking. Our extensive experiments on real-world datasets verify the superiority of our approach over the state-of-the-art solutions in terms of both accuracy and efficiency.


title: Noether's problem and rationality problem for multiplicative invariant fields: a survey

abstract: In this paper, we give a brief survey of recent developments on Noether's problem and rationality problem for multiplicative invariant fields including author's recent papers Hoshi [Hos15] about Noether's problem over Q, Hoshi, Kang and Kunyavskii [HKK13], Chu, Hoshi, Hu and Kang [CHHK15], Hoshi [Hos16] and Hoshi, Kang and Yamasaki [HKY16] about Noether's problem over C, and Hoshi, Kang and Kitayama [HKK14] and Hoshi, Kang and Yamasaki [HKY] about rationality problem for multiplicative invariant fields.


title: Magnetic field dependent cycloidal rotation in pristine and Ge doped CoCr$_2$O$_4$

abstract: We report a soft x-ray resonant magnetic scattering study of the spin configuration in multiferroic thin films of Co$_{0.975}$Ge$_{0.025}$Cr$_2$O$_4$ (Ge-CCO) and CoCr$_2$O$_4$ (CCO), under low- and high-magnetic fields, from 0.2 T up to 6.5 T. A characterization of Ge-CCO at a low magnetic field is performed and the results are compared to those of pure CCO. The ferrimagnetic phase transition temperature $T_C \approx 95$ K and the multiferroic transition temperature $T_S \approx 27$ K in Ge-CCO are comparable to those observed in CCO. In Ge-CCO, the ordering wave vector $\textit{(qq0)}$ observed below $T_S$ is slightly larger compared to that of CCO, and, unlike CCO, the diffraction intensity consists of two contributions that show a dissimilar x-ray polarization dependence. In Ge-CCO, the coercive field observed at low temperatures was larger than the one reported for CCO. In both compounds, an unexpected reversal of the spiral helicity and therefore the electric polarization was observed on simply magnetic field cooling. In addition, we find a change in the helicity as a function of momentum transfer in the magnetic diffraction peak of Ge-CCO, indicative of the presence of multiple magnetic spirals.


title: What types of chemical problems benefit from density-corrected DFT? A probe using an extensive and chemically diverse test suite

abstract: For the large and chemically diverse GMTKN55 benchmark suite, we have studied the performance of density-corrected density functional theory (HF-DFT), compared to self-consistent DFT, for several pure and hybrid GGA and meta-GGA exchange-correlation (XC) functionals (PBE, BLYP, TPSS, SCAN) as a function of the percentage of HF exchange in the hybrid. The D4 empirical dispersion correction has been added throughout. For subsets dominated by dynamical correlation -- particularly noncovalent interaction subsets -- HF-DFT is highly beneficial, particularly at low HF exchange percentages. For subsets with significant static correlation (i.e., where a Hartree-Fock determinant is not a good zero-order wavefunction), HF-DFT may do more harm than good. While the self-consistent series show optima at or near 37.5% (i.e., 3/8) for all four XC functionals -- consistent with Grimme's proposal of the PBE38 functional -- HF-BnLYP-D4, HF-PBEn-D4, and HF-TPSSn-D4 all exhibit minima nearer 25% (i.e., 1/4). Intriguingly, for HF-SCANn-D4, the minimum is near 10%, but the weighted mean absolute error (WTMAD2) for GMTKN55 is only barely lower than that of HF-SCAN-D4 (i.e., where the post-HF step is a pure meta-GGA). The latter becomes an attractive option, only slightly more costly than pure Hartree-Fock, and devoid of adjustable parameters other than the three in the dispersion correction. Moreover, its WTMAD2 is only surpassed by the highly empirical M06-2X and by the combinatorically optimized empirical range-separated hybrids wB97X-V and wB97M-V.


title: Shrinkage Strategies for Structure Selection and Identification of Piecewise Affine Models

abstract: We propose two optimization-based heuristics for structure selection and identification of PieceWise Affine (PWA) models with exogenous inputs. The first method determines the number of affine sub-models assuming known model order of the sub-models, while the second approach estimates the model order for a given number of affine sub-models. Both approaches rely on the use of regularization-based shrinking strategies, that are exploited within a coordinate-descent algorithm. This allows us to estimate the structure of the PWA models along with its model parameters. Starting from an over-parameterized model, the key idea is to alternate between an identification step and structure refinement, based on the sparse estimates of the model parameters. The performance of the presented strategies is assessed over two benchmark examples.


title: A Privacy Preserved and Cost Efficient Control Scheme for Coronavirus Outbreak Using Call Data Record and Contact Tracing

abstract: Coronavirus or COVID-19, which has been declared pandemic by the World Health Organization, has incurred huge losses to the lives of people throughout the world. Although, the scientists, researchers and doctors are working round the clock to develop a vaccine for COVID-19, it may take a year or two to make a safe and effective vaccine available for the world. In current circumstances, a solution must be developed to control or stop the spread of the virus. For this purpose, a novel technique based on call data record analysis (CDRA)and contact tracing is proposed that can effectively control the coronavirus outbreak. A positive coronavirus patient can be traced through CDRA and contact tracing. The technique can track the path traversed by the patient and collect the cell numbers of all those people who have met with the patient. Keeping in tact the privacy of this group of people, who are contacted through their cell numbers so that they can isolate themselves till the result of their coronavirus test arrives. If a test result of a person comes positive among the group, then he/she must be isolated and same CDRA and contact tracing procedures are adopted for that person. A COVID-19 patient is geo tagged and alerts are sent if any violation of isolation is done by the patient. Moreover, the general public is informed in advance to avoid the path followed by the patients. This cost effective mechanism is not only capable to control the coronavirus outbreak but also helps in isolating the patient in his/her house.


title: Understanding causation via correlations and linear response theory

abstract: In spite of the (correct) common-wisdom statement correlation does not imply causation, a proper employ of time correlations and of fluctuation-response theory allows to understand the causal relations between the variables of a multi-dimensional linear Markov process. It is shown that the fluctuation-response formalism can be used both to find the direct causal links between the variables of a system and to introduce a degree of causation, cumulative in time, whose physical interpretation is straightforward. Although for generic non-linear dynamics there is no simple exact relationship between correlations and response functions, the described protocol can still give a useful proxy also in presence of weak nonlinear terms.


title: RODE: Learning Roles to Decompose Multi-Agent Tasks

abstract: Role-based learning holds the promise of achieving scalable multi-agent learning by decomposing complex tasks using roles. However, it is largely unclear how to efficiently discover such a set of roles. To solve this problem, we propose to first decompose joint action spaces into restricted role action spaces by clustering actions according to their effects on the environment and other agents. Learning a role selector based on action effects makes role discovery much easier because it forms a bi-level learning hierarchy -- the role selector searches in a smaller role space and at a lower temporal resolution, while role policies learn in significantly reduced primitive action-observation spaces. We further integrate information about action effects into the role policies to boost learning efficiency and policy generalization. By virtue of these advances, our method (1) outperforms the current state-of-the-art MARL algorithms on 10 of the 14 scenarios that comprise the challenging StarCraft II micromanagement benchmark and (2) achieves rapid transfer to new environments with three times the number of agents. Demonstrative videos are available at https://sites.google.com/view/rode-marl .


title: Multi-Level Evolution Strategies for High-Resolution Black-Box Control

abstract: This paper introduces a multi-level (m-lev) mechanism into Evolution Strategies (ESs) in order to address a class of global optimization problems that could benefit from fine discretization of their decision variables. Such problems arise in engineering and scientific applications, which possess a multi-resolution control nature, and thus may be formulated either by means of low-resolution variants (providing coarser approximations with presumably lower accuracy for the general problem) or by high-resolution controls. A particular scientific application concerns practical Quantum Control (QC) problems, whose targeted optimal controls may be discretized to increasingly higher resolution, which in turn carries the potential to obtain better control yields. However, state-of-the-art derivative-free optimization heuristics for high-resolution formulations nominally call for an impractically large number of objective function calls. Therefore, an effective algorithmic treatment for such problems is needed. We introduce a framework with an automated scheme to facilitate guided-search over increasingly finer levels of control resolution for the optimization problem, whose on-the-fly learned parameters require careful adaptation. We instantiate the proposed m-lev self-adaptive ES framework by two specific strategies, namely the classical elitist single-child (1+1)-ES and the non-elitist multi-child derandomized $(\mu_W,\lambda)$-sep-CMA-ES. We first show that the approach is suitable by simulation-based optimization of QC systems which were heretofore viewed as too complex to address. We also present a laboratory proof-of-concept for the proposed approach on a basic experimental QC system objective.


title: The smallest spectral radius of bicyclic uniform hypergraphs with a given size

abstract: Identifying graphs with extremal properties is an extensively studied topic in spectral graph theory. In this paper, we study the log-concavity of a type of iteration sequence related to the $\alpha$-normal weighted incidence matrices which is presented by Lu and Man for computing the spectral radius of hypergraphs. By using results obtained about the sequence and the method of some edge operations, we will characterize completely extremal k-graphs with the smallest spectral radius among bicyclic hypergraphs with given size.


title: NLP Service APIs and Models for Efficient Registration of New Clients

abstract: State-of-the-art NLP inference uses enormous neural architectures and models trained for GPU-months, well beyond the reach of most consumers of NLP. This has led to one-size-fits-all public API-based NLP service models by major AI companies, serving large numbers of clients. Neither (hardware deficient) clients nor (heavily subscribed) servers can afford traditional fine tuning. Many clients own little or no labeled data. We initiate a study of adaptation of centralized NLP services to clients, and present one practical and lightweight approach. Each client uses an unsupervised, corpus-based sketch to register to the service. The server uses an auxiliary network to map the sketch to an abstract vector representation, which then informs the main labeling network. When a new client registers with its sketch, it gets immediate accuracy benefits. We demonstrate the success of the proposed architecture using sentiment labeling, NER, and predictive language modeling


title: Magnetically coupled atmosphere, fast sausage MHD waves, and forced magnetic field reconnection during the SOL2014-09-10T17:45 flare

abstract: We study the physical properties and behavior of the solar atmosphere during the GOES X1.6 solar flare on 2014 September 10. The steady plasma flows and the fast sausage MHD waves were analysed with the wavelet separation method. The magnetically coupled atmosphere and the forced magnetic field reconnection were studied with the help of the Vertical-Current Approximation Non-linear Force-Free Field code. We studied a mechanism of MHD wave transfer from the photosphere without dissipation or reflection before reaching the corona and a mechanism of the wave energy distribution over the solar corona. We report a common behavior of (extreme)ultraviolet steady plasma flows (speed of 15.3 -> 10.9 km/s) and fast sausage MHD waves (Alfven speed of 13.7 -> 10.3 km/s and characteristic periods of 1 587 -> 1 607 s), propagating in cylindrical plasma waveguides of the individual atmospheric layers (photosphere -> corona) observed by SDO/AIA/HMI and IRIS space instruments. A magnetically coupled solar atmosphere by a magnetic field flux tube above a sunspot umbra and a magnetic field reconnection forced by the waves were analysed. The solar seismology with trapped, leakage, and tunnelled modes of the waves, dissipating especially in the solar corona, is discussed with respect to its possible contribution to the outer atmosphere heating. We demonstrate that a dispersive nature of fast sausage MHD waves, which can easily generate the leaky and other modes propagating outside of their waveguide, and magnetic field flux tubes connecting the individual atmospheric layers can distribute the magnetic field energy across the active region. This mechanism can contribute to the coronal energy balance and to our knowledge on how the coronal heating is maintained.


title: Remembering for the Right Reasons: Explanations Reduce Catastrophic Forgetting

abstract: The goal of continual learning (CL) is to learn a sequence of tasks without suffering from the phenomenon of catastrophic forgetting. Previous work has shown that leveraging memory in the form of a replay buffer can reduce performance degradation on prior tasks. We hypothesize that forgetting can be further reduced when the model is encouraged to remember the \textit{evidence} for previously made decisions. As a first step towards exploring this hypothesis, we propose a simple novel training paradigm, called Remembering for the Right Reasons (RRR), that additionally stores visual model explanations for each example in the buffer and ensures the model has "the right reasons" for its predictions by encouraging its explanations to remain consistent with those used to make decisions at training time. Without this constraint, there is a drift in explanations and increase in forgetting as conventional continual learning algorithms learn new tasks. We demonstrate how RRR can be easily added to any memory or regularization-based approach and results in reduced forgetting, and more importantly, improved model explanations. We have evaluated our approach in the standard and few-shot settings and observed a consistent improvement across various CL approaches using different architectures and techniques to generate model explanations and demonstrated our approach showing a promising connection between explainability and continual learning. Our code is available at \url{https://github.com/SaynaEbrahimi/Remembering-for-the-Right-Reasons}.


title: On semi-classical limit of spatially homogeneous quantum Boltzmann equation: weak convergence

abstract: It is expected in physics that the homogeneous quantum Boltzmann equation with Fermi-Dirac or Bose-Einstein statistics and with Maxwell-Boltzmann operator (neglecting effect of the statistics) for the weak coupled gases will converge to the homogeneous Fokker-Planck-Landau equation as the Planck constant $\hbar$ tends to zero. In this paper and the upcoming work \cite{HLP2}, we will provide a mathematical justification on this semi-classical limit. Key ingredients into the proofs are the new framework to catch the {\it weak projection gradient}, which is motivated by Villani \cite{V1} to identify the $H$-solution for Fokker-Planck-Landau equation, and the symmetric structure inside the cubic terms of the collision operators.


title: Phase transition of disordered random networks on quasi-transitive graphs

abstract: Given a quasi-transitive infinite graph $G$ with volume growth rate ${\rm gr}(G),$ a transient biased electric network $(G,\, c_1)$ with bias $\lambda_1\in (0,\,{\rm gr}(G))$ and a recurrent biased one $(G,\, c_2)$ with bias $\lambda_2\in ({\rm gr}(G),\infty).$ Write $G(p)$ for the Bernoulli-$p$ bond percolation on $G$ defined by the grand coupling. Let $(G,\, c_1,\, c_2,\, p)$ be the following biased disordered random network: Open edges $e$ in $G(p)$ take the conductance $c_1(e)$, and closed edges $g$ in $G(p)$ take the conductance $c_2(g)$. Our main results are as follows: (i) On connected quasi-transitive infinite graph $G$ with percolation threshold $p_c\in (0,\, 1),$ $(G,\, c_1,\, c_2,\, p)$ has a non-trivial recurrence/transience phase transition such that the threshold $p_{c}^{*}\in (0,\, 1)$ is deterministic, and almost surely $(G,\, c_1,\, c_2,\, p)$ is recurrent for $p<p_c^*$ and transient for $p>p_c^*.$ There is a non-trivial recurrence/transience phase transition for $(G,\, c_1,\, c_2,\, p)$ with $G$ being a Cayley graph if and only if the corresponding group is not virtually $\mathbb{Z}$. (ii) On $\mathbb{Z}^d$ for any $d\geq 1,$ $p_c^{*}= p_c$. And on $d$-regular trees $\mathbb{T}^d$ with $d\geq 3$, $p_c^{*}=(\lambda_1\vee 1) p_c$, and thus $p_c^{*}>p_c$ for any $\lambda_1\in (1,\,{\rm gr}(\mathbb{T}^d)).$ As a contrast, we also consider phase transition of having unique currents or not for $(\mathbb{Z}^d,\, c_1,\, c_2,\, p)$ with $d\geq 2$ and prove that almost surely $(\mathbb{Z}^2,\, c_1,\, c_2,\, p)$ with $\lambda_1<1\leq\lambda_2$ has unique currents for any $p\in [0,1]$.


title: A pre-explosion extended effervescent zone around core collapse supernova progenitors

abstract: I propose a scenario according to which the dense compact circumstellar matter (CSM) that the ejecta of many core collapse supernovae (CCSNe) collide with within several days after explosion results from a dense zone where in addition to the stellar wind there is gas that does not reach the escape velocity. In this effervescent zone around red supergiant (RSG) stars, there are dense clumps that are ejected from the vicinity of the RSG surface, rise to radii of tens of astronomical units, and then fall back. I consider two simple velocity distributions of the ejected clumps. I find that the density of the bound mass can be tens of times that of the escaping wind, and therefore can mimic a very high mass loss rate. The dense effervescent compact CSM zone can (1) explain the collision of the ejecta of many CCSNe with a dense compact CSM days after explosion, (2) facilitate very high mass loss rate if the star experiences powerful pre-explosion activity, (3) form dust that obscures the progenitor in the visible band, and (4) lead to an efficient mass transfer to a stellar companion at separations of tens of astronomical units, if exists. The effervescent zone might exist for thousands of years and more, and therefore the effervescent CSM model removes the requirement from many type II CCSN progenitors to experience a very strong outburst just years to months before explosion.


title: Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillation

abstract: The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering multi-modality data with the same anatomic structures are widely available in clinic routine, in this paper, we aim to exploit the prior knowledge (e.g., shape priors) learned from one modality (aka., assistant modality) to improve the segmentation performance on another modality (aka., target modality) to make up annotation scarcity. To alleviate the learning difficulties caused by modality-specific appearance discrepancy, we first present an Image Alignment Module (IAM) to narrow the appearance gap between assistant and target modality data.We then propose a novel Mutual Knowledge Distillation (MKD) scheme to thoroughly exploit the modality-shared knowledge to facilitate the target-modality segmentation. To be specific, we formulate our framework as an integration of two individual segmentors. Each segmentor not only explicitly extracts one modality knowledge from corresponding annotations, but also implicitly explores another modality knowledge from its counterpart in mutual-guided manner. The ensemble of two segmentors would further integrate the knowledge from both modalities and generate reliable segmentation results on target modality. Experimental results on the public multi-class cardiac segmentation data, i.e., MMWHS 2017, show that our method achieves large improvements on CT segmentation by utilizing additional MRI data and outperforms other state-of-the-art multi-modality learning methods.


title: A maximal $L_p$-regularity theory to initial value problems with time measurable nonlocal operators generated by additive processes

abstract: Let $Z=(Z_t)_{t\geq0}$ be an additive process with a bounded triplet $(0,0,\Lambda_t)_{t\geq0}$. Suppose that for any Schwartz function $\varphi$ on $\mathbb{R}^d$ whose Fourier transform is in $C_c^{\infty}(B_{c_s} \setminus B_{c_s^{-1}} )$, there exist positive constants $N_0$, $N_1$, and $N_2$ such that \begin{equation*} \int_{\mathbb{R}^d}|\mathbb{E}[\varphi(x+r^{-1}Z_t)]|dx\leq N_0 e^{- \frac{N_1 t}{s(r)}},\quad \forall (r,t)\in(0,1)\times[0,T], \end{equation*} and $$ \|\psi^{\mu}(r^{-1}D)\varphi\|_{L_1(\mathbb{R}^d)}\leq \frac{N_2}{s(r)},\quad \forall r\in(0,1). $$ where $s$ is a scaling function (Definition 2.4), $c_s$ is a positive constant related to $s$, $\mu$ is a symmetric L\'evy measure on $\mathbb{R}^d$, $\psi^{\mu}(r^{-1}D)\varphi(x)= \mathcal{F}^{-1} \left[ \psi^{\mu}(r^{-1}\xi) \mathcal{F}[\varphi]\right](x)$ and $$\psi^{\mu}(\xi):=\int_{\mathbb{R}^d}(e^{iy\cdot\xi}-1-iy\cdot\xi 1_{|y|\leq 1})\mu(dy).$$ In this paper, we establish the $L_p$-solvability to the initial value problem \begin{equation} \frac{\partial u}{\partial t}(t,x)=\mathcal{A}_Z(t)u(t,x),\quad u(0,\cdot)=u_0,\quad (t,x)\in(0,T)\times\mathbb{R}^d, \end{equation} In other words, there exists a unique solution $u$ to equation satisfying $$ \|u\|_{L_q((0,T);H_p^{\mu;\gamma}(\mathbb{R}^d))}\leq N\|u_0\|_{B_{p,q}^{s;\gamma-\frac{2}{q}}(\mathbb{R}^d)}, $$ where $N$ is independent of $u$ and $u_0$, and the spaces $B_{p,q}^{s;\gamma-\frac{2}{q}}(\mathbb{R}^d)$ and $H_p^{\mu;\gamma}(\mathbb{R}^d)$ are scaled Besov spaces (see Definition 2.8) and generalized Bessel potential spaces (see Definition 2.3), respectively.


title: Opinion dynamics and consensus formation in a Deffuant model with extremists and moderates

abstract: Among the different disciplines in the social, behavioral and economic sciences, a fundamental class of problems is related to the prediction of the final state of the presence of individual opinions in a large population. The main aspects investigated in the opinion dynamics are related to the possibility of reaching an agreement and the time needed. In general a consensus model allows to understand if a set of interacting agents can reach a consensus when choosing among several options: political vote, opinions, cultural features are well-known examples of them. Opinion dynamics models then can be seen as a sub-set of consensus models, when the options to choose from are opinions and the possible social consensus to be reached is the opinion agreement. Moreover, in large populations it is intuitive to find moderates, whose opinion is not at the extremes of the political opinion spectrum. Due to the wide range of their empirical presence, the study of their influence in the opinion dynamics processes is very important to enhance the comprehension of the political opinions evolution in large populations. The Deffuant model is aimed at studying consensus formation assuming that the opinion distribution of a population evolves via a sequence of random pairwise encounters. In this work we strive to extend the classical Deffuant model with the presence of moderates in addition to the extremists, so as to study the emergence of consensus with different initial configurations of opinions and parameters. Therefore, we assess the role and the importance of the moderates for the appearance of consensus in the opinion dynamics processes within in large populations. We show that the population behavior is affected by the presence of a critical number of moderates, in specific configurations of the model parameters: when this threshold is reached the opinions in the population progressively converge


title: A Survey of Unsupervised Dependency Parsing

abstract: Syntactic dependency parsing is an important task in natural language processing. Unsupervised dependency parsing aims to learn a dependency parser from sentences that have no annotation of their correct parse trees. Despite its difficulty, unsupervised parsing is an interesting research direction because of its capability of utilizing almost unlimited unannotated text data. It also serves as the basis for other research in low-resource parsing. In this paper, we survey existing approaches to unsupervised dependency parsing, identify two major classes of approaches, and discuss recent trends. We hope that our survey can provide insights for researchers and facilitate future research on this topic.


title: On the balancing property of Matkowski means

abstract: Let $I\subseteq\mathbb{R}$ be a nonempty open subinterval. We say that a two-variable mean $M:I\times I\to\mathbb{R}$ enjoys the \emph{balancing property} if, for all $x,y\in I$, the equality \begin{equation}\tag{1} M\big(M(x,M(x,y)),M(M(x,y),y)\big)=M(x,y) \end{equation} holds. The above equation has been investigated by several authors. The first remarkable step was made by Georg Aumann in 1935. Assuming, among other things, that $M$ is \emph{analytic}, he solved (1) and obtained quasi-arithmetic means as solutions. Then, two years later, he proved that (1) characterizes \emph{regular} quasi-arithmetic means among Cauchy means, where, the differentiability assumption appears naturally. In 2015, Lucio R. Berrone, investigating a more general equation, having symmetry and strict monotonicity, proved that the general solutions are quasi-arithmetic means, provided that the means in question are \emph{continuously differentiable}. The aim of this paper is to solve (1), without differentiability assumptions in a class of two-variable means, which contains the class of \emph{Matkowski means}.


title: Second order relativistic viscous hydrodynamics within an effective description of hot QCD medium

abstract: The second-order hydrodynamic equations for evolution of shear and bulk viscous pressure have been derived within the framework of covariant kinetic theory based on the effective fugacity quasiparticle model. The temperature-dependent fugacity parameter in the equilibrium distribution function leads to a mean field term in the Boltzmann equation which affects the interactions in the hot QCD matter. The viscous corrections to distribution function, up to second-order in gradient expansion, have been obtained by employing a Chapman-Enskog like iterative solution of the effective Boltzmann equation within the relaxation time approximation. The effect of mean field contributions to transport coefficients as well as entropy current has been studied up to second-order in gradients. In contrast to the previous calculations, we find non-vanishing entropy flux at second order. The effective description of relativistic second-order viscous hydrodynamics, for a system of interacting quarks and gluons, has been quantitatively analyzed in the case of the $1+1-$dimensional boost invariant longitudinal expansion. We study the proper time evolution of temperature, pressure anisotropy, and viscous corrections to entropy density for this simplified expansion. The second order evolution of quark-gluon plasma is seen to be affected significantly with the inclusion of mean field contributions and the realistic equation of state.


title: Off-diagonal estimates for commutators of bi-parameter singular integrals

abstract: We study the boundedness of commutators of bi-parameter singular integrals between mixed spaces $$ [b,T]: L^{p_1}L^{p_2} \to L^{q_1}L^{q_2} $$ in the off-diagonal situation $q_i,p_i\in(1,\infty)$ where we also allow $q_i\not= p_i.$ Boundedness is fully characterized for several arrangements of the integrability exponents with some open problems presented.


title: A discussion on the approximate solutions of first order systems of non-linear ordinary equations

abstract: We develop a one step matrix method in order to obtain approximate solutions of first order systems and non-linear ordinary differential equations, reducible to first order systems. We find a sequence of such solutions that converge to the exact solution. We study the precision, in terms of the local error, of the method by applying it to different well known examples. The advantage of the method over others widely used lies on the simplicity of its implementation.


title: The Importance of Conference Proceedings in Research Evaluation: a Methodology for Assessing Conference Impact

abstract: Conferences are an essential tool for scientific communication. In disciplines such as Computer Science, over 50% of original research results are published in conference proceedings. In this study, we have analysed the role of conference proceedings in various disciplines and propose an alternative approach to research evaluation based on conference proceedings and Scimago Journal Rank (SJR). The result of the study is a list of conference proceedings, categorised Q1 - Q4 in several disciplines by analogy with SJR journal quartiles. The comparison of this bibliometric-driven ranking with the expert-driven CORE ranking in Computer Science showed a 62% overlap, as well as a significant average rank correlation of the category distribution. Moreover, 38 conference proceedings in Engineering (45% of the list) and 23 in Computer Science (32% of the list) have an SJR level corresponding to the first quartile journals in these areas. This again emphasises the exceptional importance of conferences in these disciplines.


title: Two-stage battery recharge scheduling and vehicle-charger assignment policy for dynamic electric dial-a-ride services

abstract: Coordinating the charging scheduling of electric vehicles for dynamic dial-a-ride services is challenging considering charging queuing delays and stochastic customer demand. We propose a new two-stage solution approach to handle dynamic vehicle charging scheduling to minimize the costs of daily charging operations of the fleet. The approach comprises two components: daily vehicle charging scheduling and online vehicle-charger assignment. A new battery charge scheduling model is proposed to obtain the vehicle charging schedules by minimizing the costs of vehicle daily charging operations while satisfying vehicle driving needs to serve customers. In the second stage, an online vehicle-charger assignment model is developed to minimize the total vehicle idle time for charges by considering queuing delays at the level of chargers. An efficient Lagrangian relaxation algorithm is proposed to solve the large-scale vehicle-charger assignment problem with small optimality gaps. The approach is applied to a realistic dynamic dial-a-ride service case study in Luxembourg and compared with the nearest charging station charging policy and first-come-first-served minimum charging delay policy under different charging infrastructure scenarios. Our computational results show that the approach can achieve significant savings for the operator in terms of charging waiting times (-74.9%), charging times (-38.6%), and charged energy costs (-27.4%). A sensitivity analysis is conducted to evaluate the impact of the different model parameters, showing the scalability and robustness of the approach in a stochastic environment.


title: iPregel: Strategies to Deal with an Extreme Form of Irregularity in Vertex-Centric Graph Processing

abstract: Over the last decade, the vertex-centric programming model has attracted significant attention in the world of graph processing, resulting in the emergence of a number of vertex-centric frameworks. Its simple programming interface, where computation is expressed from a vertex point of view, offers both ease of programming to the user and inherent parallelism for the underlying framework to leverage. However, vertex-centric programs represent an extreme form of irregularity, both inter and intra core. This is because they exhibit a variety of challenges from a workload that may greatly vary across supersteps, through fine-grain synchronisations, to memory accesses that are unpredictable both in terms of quantity and location. In this paper, we explore three optimisations which address these irregular challenges; a hybrid combiner carefully coupling lock-free and lock-based combinations, the partial externalisation of vertex structures to improve locality and the shift to an edge-centric representation of the workload. The optimisations were integrated into the iPregel vertex-centric framework, enabling the evaluation of each optimisation in the context of graph processing across three general purpose benchmarks common in the vertex-centric community, each run on four publicly available graphs covering all orders of magnitude from a million to a billion edges. The result of this work is a set of techniques which we believe not only provide a significant performance improvement in vertex-centric graph processing, but are also applicable more generally to irregular applications.


title: The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing

abstract: The use of High Performance Computing (HPC) to compliment urgent decision making in the event of disasters is an important future potential use of supercomputers. However, the usage modes involved are rather different from how HPC has been used traditionally. As such, there are many obstacles that need to be overcome, not least the unbounded wait times in the batch system queues, to make the use of HPC in disaster response practical. In this paper, we present how the VESTEC project plans to overcome these issues and develop a working prototype of an urgent computing control system. We describe the requirements for such a system and analyse the different technologies available that can be leveraged to successfully build such a system. We finally explore the design of the VESTEC system and discuss ongoing challenges that need to be addressed to realise a production level system.


title: Review4Repair: Code Review Aided Automatic Program Repairing

abstract: Context: Learning-based automatic program repair techniques are showing promise to provide quality fix suggestions for detected bugs in the source code of the software. These tools mostly exploit historical data of buggy and fixed code changes and are heavily dependent on bug localizers while applying to a new piece of code. With the increasing popularity of code review, dependency on bug localizers can be reduced. Besides, the code review-based bug localization is more trustworthy since reviewers' expertise and experience are reflected in these suggestions. Objective: The natural language instructions scripted on the review comments are enormous sources of information about the bug's nature and expected solutions. However, none of the learning-based tools has utilized the review comments to fix programming bugs to the best of our knowledge. In this study, we investigate the performance improvement of repair techniques using code review comments. Method: We train a sequence-to-sequence model on 55,060 code reviews and associated code changes. We also introduce new tokenization and preprocessing approaches that help to achieve significant improvement over state-of-the-art learning-based repair techniques. Results: We boost the top-1 accuracy by 20.33% and top-10 accuracy by 34.82%. We could provide a suggestion for stylistics and non-code errors unaddressed by prior techniques. Conclusion: We believe that the automatic fix suggestions along with code review generated by our approach would help developers address the review comment quickly and correctly and thus save their time and effort.


title: Exploring the acceleration of the Met Office NERC Cloud model using FPGAs

abstract: The use of Field Programmable Gate Arrays (FPGAs) to accelerate computational kernels has the potential to be of great benefit to scientific codes and the HPC community in general. With the recent developments in FPGA programming technology, the ability to port kernels is becoming far more accessible. However, to gain reasonable performance from this technology it is not enough to simple transfer a code onto the FPGA, instead the algorithm must be rethought and recast in a data-flow style to suit the target architecture. In this paper we describe the porting, via HLS, of one of the most computationally intensive kernels of the Met Office NERC Cloud model (MONC), an atmospheric model used by climate and weather researchers, onto an FPGA. We describe in detail the steps taken to adapt the algorithm to make it suitable for the architecture and the impact this has on kernel performance. Using a PCIe mounted FPGA with on-board DRAM, we consider the integration on this kernel within a larger infrastructure and explore the performance characteristics of our approach in contrast to Intel CPUs that are popular in modern HPC machines, over problem sizes involving very large grids. The result of this work is an experience report detailing the challenges faced and lessons learnt in porting this complex computational kernel to FPGAs, as well as exploring the role that FPGAs can play and their fundamental limits in accelerating traditional HPC workloads.


title: Feature Whitening via Gradient Transformation for Improved Convergence

abstract: Feature whitening is a known technique for speeding up training of DNN. Under certain assumptions, whitening the activations reduces the Fisher information matrix to a simple identity matrix, in which case stochastic gradient descent is equivalent to the faster natural gradient descent. Due to the additional complexity resulting from transforming the layer inputs and their corresponding gradients in the forward and backward propagation, and from repeatedly computing the Eigenvalue decomposition (EVD), this method is not commonly used to date. In this work, we address the complexity drawbacks of feature whitening. Our contribution is twofold. First, we derive an equivalent method, which replaces the sample transformations by a transformation to the weight gradients, applied to every batch of B samples. The complexity is reduced by a factor of S=(2B), where S denotes the feature dimension of the layer output. As the batch size increases with distributed training, the benefit of using the proposed method becomes more compelling. Second, motivated by the theoretical relation between the condition number of the sample covariance matrix and the convergence speed, we derive an alternative sub-optimal algorithm which recursively reduces the condition number of the latter matrix. Compared to EVD, complexity is reduced by a factor of the input feature dimension M. We exemplify the proposed algorithms with ResNet-based networks for image classification demonstrated on the CIFAR and Imagenet datasets. Parallelizing the proposed algorithms is straightforward and we implement a distributed version thereof. Improved convergence, in terms of speed and attained accuracy, can be observed in our experiments.


title: It's all about data movement: Optimising FPGA data access to boost performance

abstract: The use of reconfigurable computing, and FPGAs in particular, to accelerate computational kernels has the potential to be of great benefit to scientific codes and the HPC community in general. However, whilst recent advanced in FPGA tooling have made the physical act of programming reconfigurable architectures much more accessible, in order to gain good performance the entire algorithm must be rethought and recast in a dataflow style. Reducing the cost of data movement for all computing devices is critically important, and in this paper we explore the most appropriate techniques for FPGAs. We do this by describing the optimisation of an existing FPGA implementation of an atmospheric model's advection scheme. By taking an FPGA code that was over four times slower than running on the CPU, mainly due to data movement overhead, we describe the profiling and optimisation strategies adopted to significantly reduce the runtime and bring the performance of our FPGA kernels to a much more practical level for real-world use. The result of this work is a set of techniques, steps, and lessons learnt that we have found significantly improves the performance of FPGA based HPC codes and that others can adopt in their own codes to achieve similar results.


title: High level programming abstractions for leveraging hierarchical memories with micro-core architectures

abstract: Micro-core architectures combine many low memory, low power computing cores together in a single package. These are attractive for use as accelerators but due to limited on-chip memory and multiple levels of memory hierarchy, the way in which programmers offload kernels needs to be carefully considered. In this paper we use Python as a vehicle for exploring the semantics and abstractions of higher level programming languages to support the offloading of computational kernels to these devices. By moving to a pass by reference model, along with leveraging memory kinds, we demonstrate the ability to easily and efficiently take advantage of multiple levels in the memory hierarchy, even ones that are not directly accessible to the micro-cores. Using a machine learning benchmark, we perform experiments on both Epiphany-III and MicroBlaze based micro-cores, demonstrating the ability to compute with data sets of arbitrarily large size. To provide context of our results, we explore the performance and power efficiency of these technologies, demonstrating that whilst these two micro-core technologies are competitive within their own embedded class of hardware, there is still a way to go to reach HPC class GPUs.


title: Static and Animated 3D Scene Generation from Free-form Text Descriptions

abstract: Generating coherent and useful image/video scenes from a free-form textual description is technically a very difficult problem to handle. Textual description of the same scene can vary greatly from person to person, or sometimes even for the same person from time to time. As the choice of words and syntax vary while preparing a textual description, it is challenging for the system to reliably produce a consistently desirable output from different forms of language input. The prior works of scene generation have been mostly confined to rigorous sentence structures of text input which restrict the freedom of users to write description. In our work, we study a new pipeline that aims to generate static as well as animated 3D scenes from different types of free-form textual scene description without any major restriction. In particular, to keep our study practical and tractable, we focus on a small subspace of all possible 3D scenes, containing various combinations of cube, cylinder and sphere. We design a two-stage pipeline. In the first stage, we encode the free-form text using an encoder-decoder neural architecture. In the second stage, we generate a 3D scene based on the generated encoding. Our neural architecture exploits state-of-the-art language model as encoder to leverage rich contextual encoding and a new multi-head decoder to predict multiple features of an object in the scene simultaneously. For our experiments, we generate a large synthetic data-set which contains 13,00,000 and 14,00,000 samples of unique static and animated scene descriptions, respectively. We achieve 98.427% accuracy on test data set in detecting the 3D objects features successfully. Our work shows a proof of concept of one approach towards solving the problem, and we believe with enough training data, the same pipeline can be expanded to handle even broader set of 3D scene generation problems.


title: Intermittent Demand Forecasting with Renewal Processes

abstract: Intermittency is a common and challenging problem in demand forecasting. We introduce a new, unified framework for building intermittent demand forecasting models, which incorporates and allows to generalize existing methods in several directions. Our framework is based on extensions of well-established model-based methods to discrete-time renewal processes, which can parsimoniously account for patterns such as aging, clustering and quasi-periodicity in demand arrivals. The connection to discrete-time renewal processes allows not only for a principled extension of Croston-type models, but also for an natural inclusion of neural network based models---by replacing exponential smoothing with a recurrent neural network. We also demonstrate that modeling continuous-time demand arrivals, i.e., with a temporal point process, is possible via a trivial extension of our framework. This leads to more flexible modeling in scenarios where data of individual purchase orders are directly available with granular timestamps. Complementing this theoretical advancement, we demonstrate the efficacy of our framework for forecasting practice via an extensive empirical study on standard intermittent demand data sets, in which we report predictive accuracy in a variety of scenarios that compares favorably to the state of the art.


title: High power, electronically-controlled, source of user-defined vortex and vector light beams based on a few-mode fibre amplifier

abstract: Orbital angular momentum (OAM) based structured light beams provide an additional degree of freedom for practical applications ranging from optical communication to laser-based material processing. Many techniques exist for generating such beams within laser sources and these primarily rely upon the use of specially designed optical components that limit laser power scaling and ready tunability of the topological charge and polarization of the output OAM beams. Here we show that some of these limitations can be overcome by employing a computer controlled reflective phase-only spatial light modulator (SLM) to adaptively tailor the input (and subsequent output) beam wavefront and polarization in a few-mode fibre amplifier. In this way modal-coupling induced beam distortion within the fibre amplifier can be mitigated and we are able to generate at will any desired supported spatial mode guided in the fibre, including conventional LP modes, scalar OAM modes and cylindrical vector modes, at average powers >10 W and with a peak power of >11 kW. Our results pave the way to the realization of practical high-power structured laser sources with tunable chirality and polarization.


title: The umpteen operator and its Lifshitz tails

abstract: As put forth by Kerov in the early 1990s and elucidated in subsequent works, numerous properties of Wigner random matrices are shared by certain linear maps playing an important r\^ole in the representation theory of the symmetric group. We introduce and study an operator of representation-theoretic origin which bears some similarity to discrete random Schr\"odinger operators acting on the $d$-dimensional lattice. In particular, we define its integrated density of states and prove that in dimension $d \geq 2$ it boasts Lifshitz tails similar to those of the Anderson model. The construction is closely related to an infinite-board version of the fifteen puzzle, a popular sliding puzzle from the XIX-th century. We estimate, using a new Peierls argument, the probability that the puzzle returns to its initial state after $n$ random moves. The Lifshitz tail is deduced using an identification of our random operator with the action of the adjacency matrix of the puzzle on a randomly chosen representation of the infinite symmetric group.


title: A critical blow-up exponent for flux limitation in a Keller-Segel system

abstract: The parabolic-elliptic cross-diffusion system \[ \left\{ \begin{array}{l} u_t = \Delta u - \nabla \cdot \Big(uf(|\nabla v|^2) \nabla v \Big), \\[1mm] 0 = \Delta v - \mu + u, \qquad \int_\Omega v=0, \qquad \mu:=\frac{1}{|\Omega|} \int_\Omega u dx, \end{array} \right. \] is considered along with homogeneous Neumann-type boundary conditions in a smoothly bounded domain $\Omega\subset R^n$, $n\ge 1$, where $f$ generalizes the prototype given by \[ f(\xi) = (1+\xi)^{-\alpha}, \qquad \xi\ge 0, \qquad \mbox{for all } \xi\ge 0, \] with $\alpha\in R$. In this framework, the main results assert that if $n\ge 2$, $\Omega$ is a ball and \[ \alpha<\frac{n-2}{2(n-1)}, \] then throughout a considerably large set of radially symmetric initial data, an associated initial value problem admits solutions blowing up in finite time with respect to the $L^\infty$ norm of their first components. This is complemented by a second statement which ensures that in general and not necessarily symmetric settings, if either $n=1$ and $\alpha\in R$ is arbitrary, or $n\ge 2$ and $\alpha>\frac{n-2}{2(n-1)}$, then any explosion is ruled out in the sense that for arbitrary nonnegative and continuous initial data, a global bounded classical solution exists.


title: Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus

abstract: Machine translation has been a major motivation of development in natural language processing. Despite the burgeoning achievements in creating more efficient machine translation systems thanks to deep learning methods, parallel corpora have remained indispensable for progress in the field. In an attempt to create parallel corpora for the Kurdish language, in this paper, we describe our approach in retrieving potentially-alignable news articles from multi-language websites and manually align them across dialects and languages based on lexical similarity and transliteration of scripts. We present a corpus containing 12,327 translation pairs in the two major dialects of Kurdish, Sorani and Kurmanji. We also provide 1,797 and 650 translation pairs in English-Kurmanji and English-Sorani. The corpus is publicly available under the CC BY-NC-SA 4.0 license.


title: Entangled photon pairs from quantum dots embedded in a self-aligned cavity

abstract: We introduce a scalable photonic platform that enables efficient generation of entangled photon pairs from a semiconductor quantum dot. Our system, which is based on a self-aligned quantum dot-micro-cavity structure, erases the need for complex steps of lithography and nanofabrication. We experimentally show collection efficiency of 0.17 combined with a Purcell enhancement of up to 1.7 in the pair emission process. We harness the potential of our device to generate photon pairs entangled in time bin, reaching a fidelity of 0.84(5) with the maximally entangled state. The achieved pair collection efficiency is 4 times larger than the state-of-the art. The device, which theoretically supports pair extraction efficiencies of nearly 0.5 is a promising candidate for the implementation of bright sources of time-bin, polarization- and hyper entangled photon pairs in a straightforward manner.


title: Reverse Operation based Data Augmentation for Solving Math Word Problems

abstract: Automatically solving math word problems is a critical task in the field of natural language processing. Recent models have reached their performance bottleneck and require more high-quality data for training. We propose a novel data augmentation method that reverses the mathematical logic of math word problems to produce new high-quality math problems and introduce new knowledge points that can benefit learning the mathematical reasoning logic. We apply the augmented data on two SOTA math word problem solving models and compare our results with a strong data augmentation baseline. Experimental results show the effectiveness of our approach. We release our code and data at https://github.com/yiyunya/RODA.


title: The FaceChannelS: Strike of the Sequences for the AffWild 2 Challenge

abstract: Predicting affective information from human faces became a popular task for most of the machine learning community in the past years. The development of immense and dense deep neural networks was backed by the availability of numerous labeled datasets. These models, most of the time, present state-of-the-art results in such benchmarks, but are very difficult to adapt to other scenarios. In this paper, we present one more chapter of benchmarking different versions of the FaceChannel neural network: we demonstrate how our little model can predict affective information from the facial expression on the novel AffWild2 dataset.