title: Distinction inside L-packets of SL(n)

abstract: If $E/F$ is a quadratic extension $p$-adic fields, we first prove that the $\mathrm{SL}_n(F)$-distinguished representations inside a distinguished unitary L-packet of $\mathrm{SL}_n(E)$ are precisely those admitting a degenerate Whittaker model with respect to a degenerate character of $N(E)/N(F)$. Then we establish a global analogue of this result. For this, let $E/F$ be a quadratic extension of number fields and let $\pi$ be an $\mathrm{SL}_n(\mathbb{A}_F)$-distinguished square integrable automorphic representation of $\mathrm{SL}_n(\mathbb{A}_E)$. Let $(\sigma,d)$ be the unique pair associated to $\pi$, where $\sigma$ is a cuspidal representation of $\mathrm{GL}_r(\mathbb{A}_E)$ with $n=dr$. Using an unfolding argument, we prove that an element of the L-packet of $\pi$ is distinguished with respect to $\mathrm{SL}_n(\mathbb{A}_F)$ if and only if it has a degenerate Whittaker model for a degenerate character $\psi$ of type $r^d:=(r,\dots,r)$ of $N_n(\mathbb{A}_E)$ which is trivial on $N_n(E+\mathbb{A}_F)$, where $N_n$ is the group of unipotent upper triangular matrices of $\mathrm{SL}_n$. As a first application, under the assumptions that $E/F$ splits at infinity and $r$ is odd, we establish a local-global principle for $\mathrm{SL}_n(\mathbb{A}_F)$-distinction inside the L-packet of $\pi$. As a second application we construct examples of distinguished cuspidal automorphic representations $\pi$ of $\mathrm{SL}_n(\mathbb{A}_E)$ such that the period integral vanishes on some canonical copy of $\pi$, and of everywhere locally distinguished representations of $\mathrm{SL}_n(\mathbb{A}_E)$ such that their L-packets do not contain any distinguished representation.


title: Impermeable Inorganic Walls Sandwiching Photoactive Layer toward Inverted Perovskite Solar and Indoor-Photovoltaic Devices

abstract: Interfaces between the perovskite active layer and the charge-transport layers (CTLs) play a critical role in both efficiency and stability of halide-perovskite photovoltaics. One of the major concerns is that surface defects of perovskite could cause detrimental nonradiative recombination and material degradation. In this work, we addressed this challenging problem by inserting ultrathin alkali-fluoride (AF) films between the tri-cation lead-iodide perovskite layer and both CTLs. This bilateral inorganic walls strategy makes use of both physical-blocking and chemical-anchoring functionalities of the continuous, uniform and compact AF framework: on the one hand, the uniformly distributed alkali-iodine coordination at the perovskite-AF interfaces effectively suppresses the formation of iodine-vacancy defects at the surfaces and grain boundaries of the whole perovskite film, thus reducing the trap-assisted recombination at the perovskite-CTL interfaces and therewith the open-voltage loss; on the other hand, the impermeable AF buffer layers effectively prevent the bidirectional ion migration at the perovskite-CTLs interfaces even under harsh working conditions. As a result, a power-conversion efficiency (PCE) of 22.02% (certified efficiency 20.4%) with low open-voltage deficit (< 0.4V) was achieved for the low-temperature processed inverted planar perovskite solar cells. Exceptional operational stability (500 h, ISOS-L-2) and thermal stability (1000 h, ISOS-D-2) were obtained. Meanwhile, a 35.7% PCE was obtained under dim-light source (1000 lux white LED light) with the optimized device, which is among the best records in perovskite indoor photovoltaics.


title: TurboTransformers: An Efficient GPU Serving System For Transformer Models

abstract: The transformer is the most critical algorithm innovation of the Nature Language Processing (NLP) field in recent years. Unlike the Recurrent Neural Network (RNN) models, Transformers can process on dimensions of sequence lengths in parallel, therefore leading to better accuracy on long sequences. However, efficient deployments of them for online services in data centers equipped with GPUs are not easy. First, more computation introduced by transformer structures makes it more challenging to meet the latency and throughput constraints of serving. Second, NLP tasks take in sentences of variable length. The variability of input dimensions brings a severe problem to efficient memory management and serving optimization. This paper designed a transformer serving system called TurboTransformers, which consists of a computing runtime and a serving framework to solve the above challenges. Three innovative features make it stand out from other similar works. An efficient parallel algorithm is proposed for GPU-based batch reduction operations, like Softmax and LayerNorm, major hot spots besides BLAS routines. A memory allocation algorithm, which better balances the memory footprint and allocation/free efficiency, is designed for variable-length input situations. A serving framework equipped with a new batch scheduler using dynamic programming achieves the optimal throughput on variable-length requests. The system can achieve the state-of-the-art transformer model serving performance on GPU platforms and can be seamlessly integrated into your PyTorch code with a few lines of code.


title: From Time Series to Euclidean Spaces: On Spatial Transformations for Temporal Clustering

abstract: Unsupervised clustering of temporal data is both challenging and crucial in machine learning. In this paper, we show that neither traditional clustering methods, time series specific or even deep learning-based alternatives generalise well when both varying sampling rates and high dimensionality are present in the input data. We propose a novel approach to temporal clustering, in which we (1) transform the input time series into a distance-based projected representation by using similarity measures suitable for dealing with temporal data,(2) feed these projections into a multi-layer CNN-GRU autoencoder to generate meaningful domain-aware latent representations, which ultimately (3) allow for a natural separation of clusters beneficial for most important traditional clustering algorithms. We evaluate our approach on time series datasets from various domains and show that it not only outperforms existing methods in all cases, by up to 32%, but is also robust and incurs negligible computation overheads.


title: Integrated intelligent Jaya Runge-Kutta method for solving Falkner-Skan equations for Various Wedge Angles

abstract: In this work, the hybrid intelligent computing method, which combines efficient Jaya algorithm with classical Runge-Kutta method is applied to solve the Falkner-Skan equations with various wedge angles, which is the fundamental equation for a variety of computational fluid mechanical problems. With some coordinate transformation, the Falkner-Skan boundary layer problem is then converted into a free boundary problem defined on a finite interval. Then using higher order reduction strategies, the whole problem can be boiled down to a solving of coupled differential equations with prescribed initial and boundary conditions. The hybrid Jaya Runge-Kutta method is found to yield stable and accurate results and able to extract those unknown parameters. The sensitivity of classical shooting method to the guess of initial values can be easily overcome by an integrated robust optimization method. In addition, the Jaya algorithm, without the need for tuning the algorithm-specific parameters, is proved to be effective and stable for minimizing the fitness function in application. By comparing the solutions using the Jaya method with PSO (particle swarm optimization), Genetic algorithm (GA), Hyperband, and the classical analytical methods, the hybrid Jaya Runge-Kutta method yields more stable and accurate results, which shows great potential for solving more complicated multi-field and multiphase flow problems.


title: Cybersecurity Dynamics: A Foundation for the Science of Cybersecurity

abstract: Cybersecurity Dynamics is new concept that aims to achieve the modeling, analysis, quantification, and management of cybersecurity from a holistic perspective, rather than from a building-blocks perspective. It is centered at modeling and analyzing the attack-defense interactions in cyberspace, which cause a ``natural'' phenomenon -- the evolution of the global cybersecurity state. In this Chapter, we systematically introduce and review the Cybersecurity Dynamics foundation for the Science of Cybersecurity. We review the core concepts, technical approaches, research axes, and results that have been obtained in this endeavor. We outline a research roadmap towards the ultimate research goal, including a systematic set of technical barriers.


title: The implications of outcome truncation in reproductive medicine RCTs: a simulation platform for trialists and simulation study

abstract: Randomised controlled trials in reproductive medicine are often subject to outcome truncation, where study outcomes are only defined in a subset of participants. Examples include birthweight (measurable only in the subgroup of participants who give birth) and miscarriage (which can only occur in participants who become pregnant). These are typically analysed by making a comparison between treatment arms within the subgroup (comparing birthweights in the subgroup who gave birth, or miscarriages in the subgroup who became pregnant). However, this approach does not represent a randomised comparison when treatment influences the probability of being observed (i.e. survival). The practical implications of this for reproductive trials are unclear. We developed a simulation platform to investigate the implications of outcome truncation for reproductive medicine trials. We used this to perform a simulation study, in which we considered the bias, Type 1 error, coverage, and precision of standard statistical analyses for truncated continuous and binary outcomes. Increasing treatment effect on the intermediate variable, strength of confounding between the intermediate and outcome variables, and interactions between treatment and confounder were found to adversely affect performance. However, within parameter ranges we would consider to be more realistic, the adverse effects were generally not drastic. For binary outcomes, the study highlighted that outcome truncation may lead to none of the participants in a study arm experiencing the outcome event. This was found to have severe consequences for inferences, and this may have implications for meta-analysis.


title: Algebras of quotients and Martindale-like quotients of Leibniz algebras

abstract: In this paper, the definitions of algebras of quotients and Martandale-like qoutients of Leibniz algebras are introduced and the interactions between the two quotients are determined. Firstly, some important properties which not only hold for a Leibniz algebras but also can been lifted to its algebras of quotients are investigated. Secondly, for any semiprime Leibniz algebra, its maximal algebra of quotients is constucted and a Passman-like characterization of the maximal algebra is described. Thirdly, the relationship between a Leibniz algebra and the associative algebra which is generated by left and right multiplication operators of the corresponding Leibniz algebras of quotients are examined. Finally, the definition of dense extensions and some vital properties about Leibnia algebras via dense extensions are introduced.


title: How the Far-Right Polarises Twitter: 'Highjacking' Hashtags in Times of COVID-19

abstract: Twitter influences political debates. Phenomena like fake news and hate speech show that political discourse on micro-blogging can become strongly polarised by algorithmic enforcement of selective perception. Some political actors actively employ strategies to facilitate polarisation on Twitter, as past contributions show, via strategies of 'hashjacking'. For the example of COVID-19 related hashtags and their retweet networks, we examine the case of partisan accounts of the German far-right party Alternative f\"ur Deutschland (AfD) and their potential use of 'hashjacking' in May 2020. Our findings indicate that polarisation of political party hashtags has not changed significantly in the last two years. We see that right-wing partisans are actively and effectively polarising the discourse by 'hashjacking' COVID-19 related hashtags, like #CoronaVirusDE or #FlattenTheCurve. This polarisation strategy is dominated by the activity of a limited set of heavy users. The results underline the necessity to understand the dynamics of discourse polarisation, as an active political communication strategy of the far-right, by only a handful of very active accounts.


title: Semantic Change Detection with Asymmetric Siamese Networks

abstract: Given two multi-temporal aerial images, semantic change detection aims to locate the land-cover variations and identify their change types with pixel-wise boundaries. This problem is vital in many earth vision related tasks, such as precise urban planning and natural resource management. Existing state-of-the-art algorithms mainly identify the changed pixels by applying homogeneous operations on each input image and comparing the extracted features. However, in changed regions, totally different land-cover distributions often require heterogeneous features extraction procedures w.r.t each input. In this paper, we present an asymmetric siamese network (ASN) to locate and identify semantic changes through feature pairs obtained from modules of widely different structures, which involve areas of various sizes and apply different quantities of parameters to factor in the discrepancy across different land-cover distributions. To better train and evaluate our model, we create a large-scale well-annotated SEmantic Change detectiON Dataset (SECOND), while an Adaptive Threshold Learning (ATL) module and a Separated Kappa (SeK) coefficient are proposed to alleviate the influences of label imbalance in model training and evaluation. The experimental results demonstrate that the proposed model can stably outperform the state-of-the-art algorithms with different encoder backbones.


title: Signatures of the $\pi$-mode anomaly in (1+1) dimensional periodically-driven topological/normal insulator heterostructures

abstract: Akin to zero-mode anomalies, such as the chiral anomaly of edge states in quantum Hall effect, in this work, a pi-mode anomaly is proposed in a 1+1 dimensional periodically-driven topological/normal insulator (TI/NI) heterostructure. Usually, when coupling in a background gauge field, the zero modes on domain walls would provide an anomalous current term that is eventually canceled by additional boundary contributions from the topological bulk, via the Callan-Harvey mechanism. This anomaly cancellation associated with the generalization of bulk-boundary correspondence is called anomaly inflow. Through our photonic modeling and setup of the Floquet TI/NI heterostructure, for the first time, we experimentally observed the $\pi$-mode domain wall in certain driven frequencies, which is always attached to the reminiscent Floquet gauge that plays the vital role of an emergent background field. Indeed, due to the possible emergence of Floquet gauge anomaly from the driven topological bulk, the resultant $\pi$-mode anomaly can be matched on the driven interface between Floquet domains. Prospectively, we believe our prediction and observation could pave a new avenue on exploring anomalies in both periodically-driven classical and quantum systems.

categories: cond-mat.mes-hall cond-mat.mtrl-sci hep-th physics.optics quant-ph


title: Continuous Safety Verification of Neural Networks

abstract: Deploying deep neural networks (DNNs) as core functions in autonomous driving creates unique verification and validation challenges. In particular, the continuous engineering paradigm of gradually perfecting a DNN-based perception can make the previously established result of safety verification no longer valid. This can occur either due to the newly encountered examples (i.e., input domain enlargement) inside the Operational Design Domain or due to the subsequent parameter fine-tuning activities of a DNN. This paper considers approaches to transfer results established in the previous DNN safety verification problem to the modified problem setting. By considering the reuse of state abstractions, network abstractions, and Lipschitz constants, we develop several sufficient conditions that only require formally analyzing a small part of the DNN in the new problem. The overall concept is evaluated in a $1/10$-scaled vehicle that equips a DNN controller to determine the visual waypoint from the perceived image.


title: COVID-19 Classification Using Staked Ensembles: A Comprehensive Analysis

abstract: The issue of COVID-19, increasing with a massive mortality rate. This led to the WHO declaring it as a pandemic. In this situation, it is crucial to perform efficient and fast diagnosis. The reverse transcript polymerase chain reaction (RTPCR) test is conducted to detect the presence of SARS-CoV-2. This test is time-consuming and instead chest CT (or Chest X-ray) can be used for a fast and accurate diagnosis. Automated diagnosis is considered to be important as it reduces human effort and provides accurate and low-cost tests. The contributions of our research are three-fold. First, it is aimed to analyse the behaviour and performance of variant vision models ranging from Inception to NAS networks with the appropriate fine-tuning procedure. Second, the behaviour of these models is visually analysed by plotting CAMs for individual networks and determining classification performance with AUCROC curves. Thirdly, stacked ensembles techniques are imparted to provide higher generalisation on combining the fine-tuned models, in which six ensemble neural networks are designed by combining the existing fine-tuned networks. Implying these stacked ensembles provides a great generalization to the models. The ensemble model designed by combining all the fine-tuned networks obtained a state-of-the-art accuracy score of 99.17%. The precision and recall for the COVID-19 class are 99.99% and 89.79% respectively, which resembles the robustness of the stacked ensembles.


title: Special Functions and HHL Quantum Algorithm for Solving Moving Boundary Value Problems Occurring in Electric Contact Phenomena

abstract: This is a series of studies devoted to modeling and solving heat and mass transfer problems occurring in electric contacts where we employ and develop mathematical apparatus along with quantum algorithms for solving moving boundary value problems. In this particular study we utilize special functions and demonstrate the use of Harrow-Hassidim-Lloyd (HHL) quantum algorithm for finding exact and approximate solutions of Generalized Heat Equation with moving boundaries and as examples we consider plane and spherical cases. In spherical case the Generalized Heat Equation is reduced to linear moving boundary value problem with discontinuous coefficients and solved exactly. In plane case we use collocation method for approximate solution of Inverse Two-Phase Stefan problem.


title: On the Security of Group Communication Schemes

abstract: Secure group communications are a mechanism facilitating protected transmission of messages from a sender to multiple receivers, and many emerging applications in both wired and wireless networks need the support of such a mechanism. There have been many secure group communication schemes in wired networks, which can be directly adopted in, or appropriately adapted to, wireless networks such as mobile ad hoc networks (MANETs) and sensor networks. In this paper we show that the popular group communication schemes that we have examined are vulnerable to the following attack: An outside adversary who compromises a certain legitimate group member could obtain {\em all} past and present group keys (and thus all the messages protected by them); this is in sharp contrast to the widely-accepted belief that a such adversary can only obtain the present group key (and thus the messages protected by it). In order to understand and deal with the attack, we formalize two security models for stateful and stateless group communication schemes. We show that some practical methods can make a {\em subclass} of existing group communication schemes immune to the attack.


title: Hybrid Vehicular and Cloud Distributed Computing: A Case for Cooperative Perception

abstract: In this work, we propose the use of hybrid offloading of computing tasks simultaneously to edge servers (vertical offloading) via LTE communication and to nearby cars (horizontal offloading) via V2V communication, in order to increase the rate at which tasks are processed compared to local processing. Our main contribution is an optimized resource assignment and scheduling framework for hybrid offloading of computing tasks. The framework optimally utilizes the computational resources in the edge and in the micro cloud, while taking into account communication constraints and task requirements. While cooperative perception is the primary use case of our framework, the framework is applicable to other cooperative vehicular applications with high computing demand and significant transmission overhead. The framework is tested in a simulated environment built on top of car traces and communication rates exported from the Veins vehicular networking simulator. We observe a significant increase in the processing rate of cooperative perception sensor frames when hybrid offloading with optimized resource assignment is adopted. Furthermore, the processing rate increases with V2V connectivity as more computing tasks can be offloaded horizontally.


title: Logical Judges Challenge Human Judges on the Strange Case of B.C.-Valjean

abstract: On May 12th, 2020, during the course entitled Artificial Intelligence and Jurisdiction Practice organized by the Italian School of Magistracy, more than 70 magistrates followed our demonstration of a Prolog logical judge reasoning on an armed robbery case. Although the implemented logical judge is just an exercise of knowledge representation and simple deductive reasoning, a practical demonstration of an automated reasoning tool to such a large audience of potential end-users represents a first and unique attempt in Italy and, to the best of our knowledge, in the international panorama. In this paper we present the case addressed by the logical judge - a real case already addressed by a human judge in 2015 - and the feedback on the demonstration collected from the attendees.


title: An Argument for the Non-Arbitrary Existence Hypothesis using Anthropic Reasoning

abstract: This paper uses anthropic reasoning to argue for the Non-Arbitrary Existence Hypothesis (NAEH). Nick Bostrom's Self-Sampling Assumption (SSA) combined with NAEH is compared against SSA without such an assumption and also SSA with the Self-Indication Assumption (SIA). When considered in the light of various thought experiments, including the Incubator Gedanken, the Doomsday Argument, the Presumptuous Philosopher and Bostrom's Adam and Eve thought experiments, SSA with NAEH is found to give the most plausible results. The possibility of principles not explicitly considered in the paper being superior also is discussed but found to have limited plausibility.


title: Deep Adversarial Domain Adaptation Based on Multi-layer Joint Kernelized Distance

abstract: Domain adaptation refers to the learning scenario that a model learned from the source data is applied on the target data which have the same categories but different distribution. While it has been widely applied, the distribution discrepancy between source data and target data can substantially affect the adaptation performance. The problem has been recently addressed by employing adversarial learning and distinctive adaptation performance has been reported. In this paper, a deep adversarial domain adaptation model based on a multi-layer joint kernelized distance metric is proposed. By utilizing the abstract features extracted from deep networks, the multi-layer joint kernelized distance (MJKD) between the $j$th target data predicted as the $m$th category and all the source data of the $m'$th category is computed. Base on MJKD, a class-balanced selection strategy is utilized in each category to select target data that are most likely to be classified correctly and treat them as labeled data using their pseudo labels. Then an adversarial architecture is used to draw the newly generated labeled training data and the remaining target data close to each other. In this way, the target data itself provide valuable information to enhance the domain adaptation. An analysis of the proposed method is also given and the experimental results demonstrate that the proposed method can achieve a better performance than a number of state-of-the-art methods.


title: Thermodynamic phase transition and Joule Thomson adiabatic expansion for dS/AdS Bardeen Black Holes with consistent 4D Gauss-Bonnet gravity

abstract: Instead of the work \cite{1} which in according to the Lovelock theorem it could not applicable for all types of 4D curved spacetimes of Einstein Gauss Bonnet (EGB) gravity, authors of the work \cite{2} applied break of diffeomorphism property to present a consistent EGB gravity theory. In this work we use the latter model by adding a nonlinear electromagnetic field lagrangian density to study affects of GB coupling constant into the thermodynamic phase transition and Joule Thomson (JT) adiabatic expansion of a 4D $dS/AdS$ GB Bardeen black hole.


title: Deep Autoencoder based Energy Method for the Bending, Vibration, and Buckling Analysis of Kirchhoff Plates

abstract: In this paper, we present a deep autoencoder based energy method (DAEM) for the bending, vibration and buckling analysis of Kirchhoff plates. The DAEM exploits the higher order continuity of the DAEM and integrates a deep autoencoder and the minimum total potential principle in one framework yielding an unsupervised feature learning method. The DAEM is a specific type of feedforward deep neural network (DNN) and can also serve as function approximator. With robust feature extraction capacity, the DAEM can more efficiently identify patterns behind the whole energy system, such as the field variables, natural frequency and critical buckling load factor studied in this paper. The objective function is to minimize the total potential energy. The DAEM performs unsupervised learning based on random generated points inside the physical domain so that the total potential energy is minimized at all points. For vibration and buckling analysis, the loss function is constructed based on Rayleigh's principle and the fundamental frequency and the critical buckling load is extracted. A scaled hyperbolic tangent activation function for the underlying mechanical model is presented which meets the continuity requirement and alleviates the gradient vanishing/explosive problems under bending analysis. The DAEM can be easily implemented and we employed the Pytorch library and the LBFGS optimizer. A comprehensive study of the DAEM configuration is performed for several numerical examples with various geometries, load conditions, and boundary conditions.


title: Two- and three-point functions at criticality: Monte Carlo simulations of the three-dimensional $(q+1)$-state clock model

abstract: We simulate the improved $(q+1)$-state clock model on the simple cubic lattice at the critical point on lattices of a linear size up to $L=960$. We compute operator product expansion (OPE) coefficients for the three-dimensional XY universality class. These are compared with highly accurate estimates obtained by using the conformal bootstrap method. We find that the results are consistent.


title: Reformulating Unsupervised Style Transfer as Paraphrase Generation

abstract: Modern NLP defines the task of style transfer as modifying the style of a given sentence without appreciably changing its semantics, which implies that the outputs of style transfer systems should be paraphrases of their inputs. However, many existing systems purportedly designed for style transfer inherently warp the input's meaning through attribute transfer, which changes semantic properties such as sentiment. In this paper, we reformulate unsupervised style transfer as a paraphrase generation problem, and present a simple methodology based on fine-tuning pretrained language models on automatically generated paraphrase data. Despite its simplicity, our method significantly outperforms state-of-the-art style transfer systems on both human and automatic evaluations. We also survey 23 style transfer papers and discover that existing automatic metrics can be easily gamed and propose fixed variants. Finally, we pivot to a more real-world style transfer setting by collecting a large dataset of 15M sentences in 11 diverse styles, which we use for an in-depth analysis of our system.


title: Optimal speed profile on a given road for motion sickness reduction

abstract: Motion Sickness (MS) is an issue of most transportation systems. Several countermeasures for such problem in cars are proposed in the literature, but most of them are qualitative, behavioural or involving complex chassis systems. With the growing interest in self-employed vehicles, the issue of MS may be so important that it undermines their benefits in terms of increased productivity; not addressing such issue may limit the users' acceptance reducing the safety and environmental impact of autonomous vehicles. The present study presents a novel approach to combine minimal travel time with minimal Motion Sickness Incidence (MSI) by optimising the speed profile for a given path. Through simulation, a simple vehicle model is used to compare several strategies evaluating which of them are effective and which not. The optimisation task is formulated as a Non-linear Model Predictive Control (NMPC) and a series of optimisation routines are computed along the path; the strategies are implemented within the cost function of the NMPC problem evaluating their performance and if using a numerical MS model is mandatory to get a significant reduction of the MSI. The results show that not all the cost functions are effective, but it is possible to reduce MS without modelling its dynamics; however, the strategy taking into account the current MSI using a MS model outperforms the other cost functions in term of efficacy and efficiency. Such a quantitative approach can be used during motion planning in autonomous vehicles, to suggest an optimal speed in human-driven vehicles and to improve the comfort for bus-line services or even trains.


title: Simultaneous measurements on the electron and X-ray spectra from laser-irradiated near-critical-density double-layer targets at relativistic intensity

abstract: We report the experimental results of simultaneous measurements on the electron and X-ray spectra from near-critical-density (NCD) double-layer targets irradiated by relativistic femtosecond pulses at the intensity of 5E19 W/cm^2. The dependence of the electron and X-ray spectra on the density and thickness of the NCD layer was studied. For the optimal targets, electrons with temperature of 5.5 MeV and X-rays with critical energy of 5 keV were obtained. 2D particle-in-cell simulations based on the experimental parameters confirm the electrons are accelerated in the plasma channel through direct laser acceleration, resulting in temperature significantly higher than the pondermotive temperature. Bright X-rays are generated from betatron emission and Thomson backscattering before the electrons leave the double-layer targets.


title: Neural Monte Carlo Renormalization Group

abstract: The key idea behind the renormalization group (RG) transformation is that properties of physical systems with very different microscopic makeups can be characterized by a few universal parameters. However, finding the optimal RG transformation remains difficult due to the many possible choices of the weight factors in the RG procedure. Here we show, by identifying the conditional distribution in the restricted Boltzmann machine (RBM) and the weight factor distribution in the RG procedure, an optimal real-space RG transformation can be learned without prior knowledge of the physical system. This neural Monte Carlo RG algorithm allows for direct computation of the RG flow and critical exponents. This scheme naturally generates a transformation that maximizes the real-space mutual information between the coarse-grained region and the environment. Our results establish a solid connection between the RG transformation in physics and the deep architecture in machine learning, paving the way to further interdisciplinary research.


title: Quasicircles and quasiperiodic surfaces in pseudo-hyperbolic spaces

abstract: We study in this paper quasiperiodic maximal surfaces in pseudo-hyperbolic spaces and show that they are characterised by a curvature condition, Gromov hyperbolicity or conformal hyperbolicity. We show that the limit curves of these surfaces in the Einstein Universe admits a canonical quasisymmetric parametrisation, while conversely every quasisymmetric curve in the Einstein Universe bounds a quasiperiodic surface in such a way that the quasisymmetric parametrisation is a continuous extension of the uniformisation; we give applications of these results to asymptotically hyperbolic surfaces, rigidity of Anosov representations and a version of the universal Teichm\"uller space.


title: Ferroelectricity in AlScN: Switching, Imprint and sub-150 nm Films

abstract: The discovery of ferroelectricity in AlScN allowed the first clear observation of the effect in the wurtzite crystal structure, resulting in a material with a previously unprecedented combination of very large coercive fields (2-5 MV/cm) and remnant polarizations (70-110 ${\mu}$C/cm$^2$). We obtained initial insight into the switching dynamics of AlScN, which suggests a domain wall motion limited process progressing from the electrode interfaces. Further, imprint was generally observed in AlScN films and can tentatively be traced to the alignment of charged defects with the internal and external polarization and field, respectively. Potentially crucial from the application point of view, ferroelectricity could be observed in films with thicknesses below 30 nm - as the coercive fields of AlScN were found to be largely independent of thickness between 600 nm and 27 nm.


title: Stringent Search for Precursor Emission in Short GRBs from Fermi/GBM data and Physical Implications

abstract: We perform a stringent search for precursor emission of short gamma-ray bursts (SGRBs) from the Fermi/GBM data and find 16 precursor events with $\gtrsim4.5\sigma$ significance. We find that the durations of the main SGRB emission ($T_{\rm GRB}$) and the precursor emission ($T_{\rm pre}$), as well as the waiting time ($T_{\rm wt}$) in between, are roughly comparable to each other, with $T_{\rm wt}\approx2.8T_{\rm GRB}^{1.2}$ approximately satisfied for most cases except one significant outlier. We also perform spectral analyses to the precursors and SGRBs, and find that the spectra of precursor emission can be fitted with the blackbody, non-thermal cutoff power law and/or power law models. We consider several possible models for precursor emission in SGRBs and find that the luminosity and spectral shape may be explained by the the shock breakout or the photospheric radiation of a fireball launched after the merger for thermal precursors, or magnetospheric interaction between two NSs prior to the merger for non-thermal precursors. For the fireball photospheric model, a matter-dominated jet is preferred and a constraint on the fireball Lorentz factor can be placed as $\Gamma\sim30$. For the magnetospheric interaction model, jet launching mechanism may be constrained. In particular, those events with $T_{\rm wt}/T_{\rm GRB}\gg1$ (e.g. GRB191221802) require the formation of a supramassive or stable neutron star after the merger, with the delay time defined by the timescale for an initially baryon-loaded jet to become magnetically dominated and relativistic.


title: Quantitative stability and numerical analysis of Markovian quadratic BSDEs with reflection

abstract: We study the quantitative stability of the solutions to Markovian quadratic reflected BSDEs with bounded terminal data. By virtue of BMO martingale and change of measure techniques, we obtain stability estimates for the variation of the solutions with different underlying forward processes. In addition, we propose a truncated discrete-time numerical scheme for quadratic reflected BSDEs, and obtain the explicit rate of convergence by applying the quantitative stability result.


title: Rooting Formal Methods within Higher Education Curricula for Computer Science and Software Engineering -- A White Paper

abstract: This white paper argues that formal methods need to be better rooted in higher education curricula for computer science and software engineering programmes of study. To this end, it advocates (i) improved teaching of formal methods; (ii) systematic highlighting of formal methods within existing, `classical' computer science courses; and (iii) the inclusion of a compulsory formal methods course in computer science and software engineering curricula. These recommendations are based on the observations that (a) formal methods are an essential and cost-effective means to increase software quality; however (b) computer science and software engineering programmes typically fail to provide adequate training in formal methods; and thus (c) there is a lack of computer science graduates who are qualified to apply formal methods in industry. This white paper is the result of a collective effort by authors and participants of the 1st International Workshop on "Formal Methods, Fun for Everybody" which was held in Bergen, Norway, 2-3 December 2019. As such, it represents insights based on learning and teaching computer science and software engineering (with or without formal methods) at various universities across Europe.


title: The dimension of Diffusion Limited Aggregates grown on a line

abstract: Diffusion Limited Aggregation (DLA) has served for forty years as a paradigmatic example for the creation of fractal growth patterns. In spite of thousands of references no exact result for the fractal dimension $D$ of DLA is known. In this Letter we announce an exact result for off-lattice DLA grown on a line, $D=3/2$. The result relies on representing DLA with iterated conformal maps, allowing one to prove self-affinity, a proper scaling limit and a well defined fractal dimension. Mathematical proofs of the main results are available in arXiv:2008.05792.


title: HUJI-KU at MRP~2020: Two Transition-based Neural Parsers

abstract: This paper describes the HUJI-KU system submission to the shared task on Cross-Framework Meaning Representation Parsing (MRP) at the 2020 Conference for Computational Language Learning (CoNLL), employing TUPA and the HIT-SCIR parser, which were, respectively, the baseline system and winning system in the 2019 MRP shared task. Both are transition-based parsers using BERT contextualized embeddings. We generalized TUPA to support the newly-added MRP frameworks and languages, and experimented with multitask learning with the HIT-SCIR parser. We reached 4th place in both the cross-framework and cross-lingual tracks.


title: The Greatest Teacher, Failure is: Using Reinforcement Learning for SFC Placement Based on Availability and Energy Consumption

abstract: Software defined networking (SDN) and network functions virtualisation (NFV) are making networks programmable and consequently much more flexible and agile. To meet service level agreements, achieve greater utilisation of legacy networks, faster service deployment, and reduce expenditure, telecommunications operators are deploying increasingly complex service function chains (SFCs). Notwithstanding the benefits of SFCs, increasing heterogeneity and dynamism from the cloud to the edge introduces significant SFC placement challenges, not least adding or removing network functions while maintaining availability, quality of service, and minimising cost. In this paper, an availability- and energy-aware solution based on reinforcement learning (RL) is proposed for dynamic SFC placement. Two policy-aware RL algorithms, Advantage Actor-Critic (A2C) and Proximal Policy Optimisation (PPO2), are compared using simulations of a ground truth network topology based on the Rede Nacional de Ensino e Pesquisa (RNP) Network, Brazil's National Teaching and Research Network backbone. The simulation results showed that PPO2 generally outperformed A2C and a greedy approach both in terms of acceptance rate and energy consumption. A2C outperformed PPO2 only in the scenario where network servers had a greater number of computing resources.


title: Twin Estimates of the Effects of Prenatal Environment, Child Biology, and Parental Bias on Sex Differences in Early Age Mortality

abstract: Sex differences in early age mortality have been explained in prior literature by differences in biological make-up and gender discrimination in the allocation of household resources. Studies estimating the effects of these factors have generally assumed that offspring sex ratio is random, which is implausible in view of recent evidence that the sex of a child is partly determined by prenatal environmental factors. These factors may also affect child health and survival in utero or after birth, which implies that conventional approaches to explaining sex differences in mortality are likely to yield biased estimates. We propose a methodology for decomposing these differences into the effects of prenatal environment, child biology, and parental preferences. Using a large sample of twins, we compare mortality rates in male-female twin pairs in India, a region known for discriminating against daughters, and sub-Saharan Africa, a region where sons and daughters are thought to be valued by their parents about equally. We find that: (1) prenatal environment positively affects the mortality of male children; (2) biological make-up of the latter contributes to their excess mortality, but its effect has been previously overestimated; and (3) parental discrimination against female children in India negatively affects their survival; but failure to control for the effects of prenatal and biological factors leads conventional approaches to underestimating its effect by 237 percent during infancy, and 44 percent during childhood.


title: Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network

abstract: Image-to-Image (I2I) translation is a heated topic in academia, and it also has been applied in real-world industry for tasks like image synthesis, super-resolution, and colorization. However, traditional I2I translation methods train data in two or more domains together. This requires lots of computation resources. Moreover, the results are of lower quality, and they contain many more artifacts. The training process could be unstable when the data in different domains are not balanced, and modal collapse is more likely to happen. We proposed a new I2I translation method that generates a new model in the target domain via a series of model transformations on a pre-trained StyleGAN2 model in the source domain. After that, we proposed an inversion method to achieve the conversion between an image and its latent vector. By feeding the latent vector into the generated model, we can perform I2I translation between the source domain and target domain. Both qualitative and quantitative evaluations were conducted to prove that the proposed method can achieve outstanding performance in terms of image quality, diversity and semantic similarity to the input and reference images compared to state-of-the-art works.


title: On strictly 2-maximal subgroups of finite groups

abstract: We conclude from the results of Hanguang Meng and Xiuyun Guo some corollaries about the existence of strictly 2-maximal subgroups in groups. We give examples of groups that illustrate properties of strictly 2-maximal subgroups.


title: Experimental study of extended timescale dynamics of a plasma wakefield driven by a self-modulated proton bunch

abstract: Plasma wakefield dynamics over timescales up to 800 ps, approximately 100 plasma periods, are studied experimentally at the Advanced Wakefield Experiment (AWAKE). The development of the longitudinal wakefield amplitude driven by a self-modulated proton bunch is measured using the external injection of witness electrons that sample the fields. In simulation, resonant excitation of the wakefield causes plasma electron trajectory crossing, resulting in the development of a potential outside the plasma boundary as electrons are transversely ejected. Trends consistent with the presence of this potential are experimentally measured and their dependence on wakefield amplitude are studied via seed laser timing scans and electron injection delay scans.


title: The pole and screening masses of neutral pion in hot and magnetized medium: a comprehensive study in the Nambu--Jona-Lasinio model

abstract: In this work, we investigate not only the pole masses but also the screening masses of neutral pions at finite temperature and magnetic field by utilizing the random phase approximation (RPA) approach in the framework of the two-flavor Nambu--Jona-Lasinio (NJL) model. And two equivalent formalisms in the presence of a magnetic field, i.e. the Landau level representation (LLR) and the proper-time representation (PTR), are applied to obtain the corresponding analytical expressions of the polarization functions (except the expressions for the pole masses in the PTR). In order to evaluate the applicable region of the low-momentum expansion (LME), we compare the numerical results within the full RPA (FRPA) with those within the reduced RPA (RRPA), i.e. the RPA in the LME. It is confirmed that the pole masses of {\pi}0in the FRPA suffer a sudden mass jump at the Mott transition temperature when in the presence of external magnetic field, and the Mott transition temperature is catalyzed by the magnetic field. And by analyzing the behaviors of the directional sound velocities of {\pi}0, which are associated with the breaking of the Lorentz invariance by the heat bath and the magnetic field, we clarify the two problems existing in previous literatures: one is that the transverse sound velocities in the medium are always larger than unity and thus violate the law of causality on account of the non-covariant regularization scheme, the other is that the longitudinal sound velocities are identically equal unity at finite temperature on account of the limitation of the derivative expansion method used.


title: A compact high-order gas-kinetic scheme on unstructured mesh for acoustic and shock wave computations

abstract: In this paper an even higher-order compact GKS up to sixth order of accuracy will be constructed for the shock and acoustic wave computation on unstructured mesh. The compactness is defined by the physical domain of dependence for an unstructured triangular cell, which may involve the closest neighbors of neighboring cells. The compactness and high-order accuracy of the scheme are coming from the consistency between the high-order initial reconstruction and the high-order gas evolution model under GKS framework. The high-order evolution solution at a cell interface provides not only a time-accurate flux function, but also the time-evolving flow variables. Therefore, the cell-averaged flow variables and their gradients can be explicitly updated at the next time level from the moments of the same time-dependent gas distribution function. Based on the cell averages and cell-averaged derivatives, both linear and nonlinear high-order reconstruction can be obtained for macroscopic flow variables in the evaluation of local equilibrium and non-equilibrium states. The current nonlinear reconstruction is a combination of WENO and ENO methodology. The initial piecewise discontinuous reconstruction is used for the determination non-equilibrium state and an evolved smooth reconstruction for the equilibrium state. The evolution model in gas-kinetic scheme is based on a relaxation process from non-equilibrium to equilibrium state. The accuracy, efficiency, and robustness of the scheme have been validated. The main conclusion of the paper is that beyond the first-order Riemann solver, the use of high-order gas evolution model seems necessary in the development of high-order schemes.


title: Strategies to Enhance ZnO Nanogenerator Performance via Thermal-Annealing and Cryo-Cooling

abstract: Piezoelectric capacitive NanoGenerators (NG) based on vertically grown crystalline zinc oxide nanowires (ZnO-NWs) have been fabricated using a low-cost and scalable hydrothermal method on gold-coated silicon substrates, which served as both a seed layer and a conductive bottom electrode. Morphological and structural characterizations demonstrate that the obtained ZnO NWs are dense, uniformly distributed, vertically well aligned and exhibit good crystal quality. The piezoelectric NG consists of ZnO-NWs grown on a gold-coated silicon substrate, parylene-C matrix, titanium/aluminium top electrode and poly(dimethylsiloxane) (PDMS) encapsulating layer. In order to enhance the NG performances, which is the main goal of this study, two distinctly different post-growth treatments, namely thermal annealing in ambient air and cryo-cooling by immersion in liquid nitrogen, are applied and their effect studied. Achieving the high performance of NG via the combination of high-quality NWs growth and subsequent post-growth treatment is presented. Superior global performance of NG has been observed with a post-treatment of cryo-cooling for an optimum duration compared to the thermal annealing signifies the simplicity and novelty of the work. The proposed strategies highlight the role of post-growth treatments towards the fabrication of high-performance functional NG to be incorporated into future smart objects.


title: Revisiting Neural Architecture Search

abstract: Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells), which have had minor breakthroughs in performance compared to random baselines. They also involve a significant manual expert effort in various components of the NAS pipeline. This raises a natural question - Are the current NAS methods still heavily dependent on manual effort in the search space design and wiring like it was done when building models before the advent of NAS? In this paper, instead of merely chasing slight improvements over state-of-the-art (SOTA) performance, we revisit the fundamental approach to NAS and propose a novel approach called ReNAS that can search for the complete neural network without much human effort and is a step closer towards AutoML-nirvana. Our method starts from a complete graph mapped to a neural network and searches for the connections and operations by balancing the exploration and exploitation of the search space. The results are on-par with the SOTA performance with methods that leverage handcrafted blocks. We believe that this approach may lead to newer NAS strategies for a variety of network types.


title: Assessing the impact of valence sd neutrons and protons on fusion

abstract: Experimental above-barrier fusion cross-sections for $^{17}$F + $^{12}$C are compared to the fusion excitation functions for $^{16,18}$O, $^{19}$F, and $^{20}$Ne ions on a carbon target. In comparing the different systems both the differing static size of the incident ions and changes in fusion barrier are accounted for by examining the reduced fusion cross-section. Remaining trends of the fusion cross-section above the barrier which reflect the sensitive interplay of the sd protons and neutrons are observed. The experimental data are also compared to both a widely-used analytical model of near-barrier fusion, as well as a time-dependent Hartree-Fock model. Both models fail to describe the trends observed.


title: Depths and cores in the light of DS-functors

abstract: The Dulfo-Serganova functors DS are tensor functors relating representations of different Lie superalgebras. In this paper we study the behaviour of various invariants, such as the defect, the dual Coxeter number, the atypicality and the cores, under the DS-functor. We introduce a notion of depth playing the role of defect for algebras and atypicality for modules. We mainly concentrate on examples of symmetrizable Kac-Moody and Q-type superalgebras.


title: Direct products, overlapping actions, and critical regularity

abstract: We address the problem of computing the critical regularity of groups of homeomorphisms of the interval. Our main result is that if $H$ and $K$ are two non-solvable groups then a faithful $C^{1,\tau}$ action of $H\times K$ on a compact interval $I$ is {\em not overlapping} for all $\tau>0$, which by definition means that there must be non-trivial $h\in H$ and $k\in K$ with disjoint support. As a corollary we prove that the right-angled Artin group $(F_2\times F_2)*\mathbb{Z}$ has critical regularity one, which is to say that it admits a faithful $C^1$ action on $I$, but no faithful $C^{1,\tau}$ action. This is the first explicit example of a group of exponential growth which is without nonabelian subexponential growth subgroups, whose critical regularity is finite, achieved, and known exactly. Another corollary we get is that Thompson's group $F$ does not admit a faithful $C^1$ overlapping action on $I$, so that $F*\mathbb{Z}$ is a new example of a locally indicable group admitting no faithful $C^1$--action on $I$.


title: Characterizing the Quality of Insight by Interactions: A Case Study

abstract: Understanding the quality of insight has become increasingly important with the trend of allowing users to post comments during visual exploration, yet approaches for qualifying insight are rare. This paper presents a case study to investigate the possibility of characterizing the quality of insight via the interactions performed. To do this, we devised the interaction of a visualization tool-MediSyn-for insight generation. MediSyn supports five types of interactions: selecting, connecting, elaborating, exploring, and sharing. We evaluated MediSyn with 14 participants by allowing them to freely explore the data and generate insights. We then extracted seven interaction patterns from their interaction logs and correlated the patterns to four aspects of insight quality. The results show the possibility of qualifying insights via interactions. Among other findings, exploration actions can lead to unexpected insights; the drill-down pattern tends to increase the domain values of insights. A qualitative analysis shows that using domain knowledge to guide exploration can positively affect the domain value of derived insights. We discuss the study's implications, lessons learned, and future research opportunities.


title: Cascaded Generation of a Sub-10-Attosecond Half-Cycle Pulse

abstract: Sub-10-attosecond pulses with half-cycle electric fields provide exceptional options to detect and manipulate electrons in the atomic timescale. However, the availability of such pulses is still challenging. Here, we propose a method to generate isolated sub-10-attosecond half-cycle pulses based on a cascade process naturally happening in plasma. A 100s-attosecond pulse is first generated by shooting a moderate overdense plasma with a one-cycle femtosecond pulse. After that, the generated attosecond pulse cascadedly produce a sub-10-attosecond half-cycle pulse in the transmission direction by unipolarly perturbing a nanometer-thin relativistic electron sheet naturally form in the plasma. Two-dimensional particle-in-cell simulations indicate that an isolated half-cycle pulse with the duration of 8.3 attoseconds can be produced. Apart from one-cycle driving pulse, such a scheme also can be realized with a commercial 100-TW 25-fs driving laser by shaping the pulse with a relativistic plasma lens in advance.


title: Structural Supervision Improves Few-Shot Learning and Syntactic Generalization in Neural Language Models

abstract: Humans can learn structural properties about a word from minimal experience, and deploy their learned syntactic representations uniformly in different grammatical contexts. We assess the ability of modern neural language models to reproduce this behavior in English and evaluate the effect of structural supervision on learning outcomes. First, we assess few-shot learning capabilities by developing controlled experiments that probe models' syntactic nominal number and verbal argument structure generalizations for tokens seen as few as two times during training. Second, we assess invariance properties of learned representation: the ability of a model to transfer syntactic generalizations from a base context (e.g., a simple declarative active-voice sentence) to a transformed context (e.g., an interrogative sentence). We test four models trained on the same dataset: an n-gram baseline, an LSTM, and two LSTM-variants trained with explicit structural supervision (Dyer et al.,2016; Charniak et al., 2016). We find that in most cases, the neural models are able to induce the proper syntactic generalizations after minimal exposure, often from just two examples during training, and that the two structurally supervised models generalize more accurately than the LSTM model. All neural models are able to leverage information learned in base contexts to drive expectations in transformed contexts, indicating that they have learned some invariance properties of syntax.


title: On a notion of averaged operators in CAT(0) spaces

abstract: Averaged operators have played an important role in fixed point theory in Hilbert spaces. They emerged as a necessity to obtain solutions to fixed point problems where the underlying operator is not contractive and thus renders Banach fixed point theorem inaccessible. We introduce a notion of averaged operator in the broader class of $\text{CAT}(0)$ spaces. We call these operators $\alpha$-firmly nonexpansive and develop basic calculus rules for the quasi $\alpha$-firmly nonexpansive operators. In particular compositions of quasi $\alpha$-firmly nonexpansive operators is quasi $\alpha$-firmly nonexpansive and convex combination of a finite family of quasi $\alpha$-firmly nonexpansive operators is again quasi $\alpha$-firmly nonexpansive. For a nonexpansive operator $T:X\to X$ acting on a $\text{CAT}(0)$ space $X$ we show that the iterates $x_n:=Tx_{n-1}$ converge weakly to some element in the fixed point set $\text{Fix} T$ whenever $T$ is quasi $\alpha$-firmly nonexpansive. Moreover under a certain regularity condition the projections $P_{\text{Fix} T}x_n$ converge strongly to this weak limit. Our theory is illustrated with two classical examples of cyclic and averaged projections.


title: Some local properties of subsolutons and supersolutions for a doubly nonlinear nonlocal parabolic $p$-Laplace equation

abstract: We establish a local boundedness estimate for weak subsolutions to a doubly nonlinear parabolic fractional $p$-Laplace equation. Our argument relies on energy estimates and a parabolic nonlocal version of De Giorgi's method. Furthermore, by means of a new algebraic inequality, we show that positive weak supersolutions satisfy a reverse H\"older inequality. Finally, we also prove a logarithmic decay estimate for positive supersolutions.


title: Periodic multi-pulses and spectral stability in Hamiltonian PDEs with symmetry

abstract: We consider the existence and spectral stability of periodic multi-pulse solutions in Hamiltonian systems which are translation invariant and reversible, for which the fifth-order Korteweg-de Vries equation is a prototypical example. We use Lin's method to construct multi-pulses on a periodic domain, and in particular demonstrate a pitchfork bifurcation structure for periodic double pulses. We also use Lin's method to reduce the spectral problem for periodic multi-pulses to computing the determinant of a block matrix, which encodes both eigenvalues resulting from interactions between neighboring pulses and eigenvalues associated with the essential spectrum. We then use this matrix to compute the spectrum associated with periodic single and double pulses. Most notably, we prove that brief instability bubbles form when eigenvalues collide on the imaginary axis as the periodic domain size is altered. These analytical results are all in good agreement with numerical computations, and numerical timestepping experiments demonstrate that these instability bubbles correspond to oscillatory instabilities.


title: Almost Linear Time Algorithms for Minsum $k$-Sink Problems on Dynamic Flow Path Networks

abstract: We address the facility location problems on dynamic flow path networks. A dynamic flow path network consists of an undirected path with positive edge lengths, positive edge capacities, and positive vertex weights. A path can be considered as a road, an edge length as the distance along the road and a vertex weight as the number of people at the site. An edge capacity limits the number of people that can enter the edge per unit time. In the dynamic flow network, given particular points on edges or vertices, called sinks, all the people evacuate from the vertices to the sinks as quickly as possible. The problem is to find the location of sinks on a dynamic flow path network in such a way that the aggregate evacuation time (i.e., the sum of evacuation times for all the people) to sinks is minimized. We consider two models of the problem: the confluent flow model and the non-confluent flow model. In the former model, the way of evacuation is restricted so that all the people at a vertex have to evacuate to the same sink, and in the latter model, there is no such restriction. In this paper, for both the models, we develop algorithms which run in almost linear time regardless of the number of sinks. It should be stressed that for the confluent flow model, our algorithm improves upon the previous result by Benkoczi et al. [Theoretical Computer Science, 2020], and one for the non-confluent flow model is the first polynomial time algorithm.


title: Decorated one-dimensional cobordisms and tensor envelopes of noncommutative recognizable power series

abstract: The paper explores the relation between noncommutative power series and topological theories of one-dimensional cobordisms decorated by labelled zero-dimensional submanifolds. These topological theories give rise to several types of tensor envelopes of noncommutative recognizable power series, including the categories built from the syntactic algebra and syntactic ideals of the series and the analogue of the Deligne category.


title: Probing Pretrained Language Models for Lexical Semantics

abstract: The success of large pretrained language models (LMs) such as BERT and RoBERTa has sparked interest in probing their representations, in order to unveil what types of knowledge they implicitly capture. While prior research focused on morphosyntactic, semantic, and world knowledge, it remains unclear to which extent LMs also derive lexical type-level knowledge from words in context. In this work, we present a systematic empirical analysis across six typologically diverse languages and five different lexical tasks, addressing the following questions: 1) How do different lexical knowledge extraction strategies (monolingual versus multilingual source LM, out-of-context versus in-context encoding, inclusion of special tokens, and layer-wise averaging) impact performance? How consistent are the observed effects across tasks and languages? 2) Is lexical knowledge stored in few parameters, or is it scattered throughout the network? 3) How do these representations fare against traditional static word vectors in lexical tasks? 4) Does the lexical information emerging from independently trained monolingual LMs display latent similarities? Our main results indicate patterns and best practices that hold universally, but also point to prominent variations across languages and tasks. Moreover, we validate the claim that lower Transformer layers carry more type-level lexical knowledge, but also show that this knowledge is distributed across multiple layers.


title: On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling

abstract: We demonstrate the complementary natures of neural knowledge graph embedding, fine-grain entity type prediction, and neural language modeling. We show that a language model-inspired knowledge graph embedding approach yields both improved knowledge graph embeddings and fine-grain entity type representations. Our work also shows that jointly modeling both structured knowledge tuples and language improves both.


title: Graph Square Roots of Small Distance from Degree One Graphs

abstract: Given a graph class $\mathcal{H}$, the task of the $\mathcal{H}$-Square Root problem is to decide, whether an input graph $G$ has a square root $H$ from $\mathcal{H}$. We are interested in the parameterized complexity of the problem for classes $\mathcal{H}$ that are composed by the graphs at vertex deletion distance at most $k$ from graphs of maximum degree at most one, that is, we are looking for a square root $H$ such that there is a modulator $S$ of size $k$ such that $H-S$ is the disjoint union of isolated vertices and disjoint edges. We show that different variants of the problems with constraints on the number of isolated vertices and edges in $H-S$ are FPT when parameterized by $k$ by demonstrating algorithms with running time $2^{2^{O(k)}}\cdot n^{O(1)}$. We further show that the running time of our algorithms is asymptotically optimal and it is unlikely that the double-exponential dependence on $k$ could be avoided. In particular, we prove that the VC-$k$ Root problem, that asks whether an input graph has a square root with vertex cover of size at most $k$, cannot be solved in time $2^{2^{o(k)}}\cdot n^{O(1)}$ unless Exponential Time Hypothesis fails. Moreover, we point out that VC-$k$ Root parameterized by $k$ does not admit a subexponential kernel unless $P=NP$.


title: The arrow of time in operational formulations of quantum theory

abstract: The operational formulations of quantum theory are drastically time oriented. However, to the best of our knowledge, microscopic physics is time-symmetric. We address this tension by showing that the asymmetry of the operational formulations does not reflect a fundamental time-orientation of physics. Instead, it stems from built-in assumptions about the $users$ of the theory. In particular, these formalisms are designed for predicting the future based on information about the past, and the main mathematical objects contain implicit assumption about the past, but not about the future. The main asymmetry in quantum theory is the difference between knowns and unknowns.


title: Powers of paths in tournaments

abstract: In this short note we prove that every tournament contains the $k$-th power of a directed path of linear length. This improves upon recent results of Yuster and of Gir\~ao. We also give a complete solution for this problem when $k=2$, showing that there is always a square of a directed path of length $\lceil 2n/3 \rceil-1$, which is best possible.


title: EFSG: Evolutionary Fooling Sentences Generator

abstract: Large pre-trained language representation models (LMs) have recently collected a huge number of successes in many NLP tasks. In 2018 BERT, and later its successors (e.g. RoBERTa), obtained state-of-the-art results in classical benchmark tasks, such as GLUE benchmark. After that, works about adversarial attacks have been published to test their generalization proprieties and robustness. In this work, we design Evolutionary Fooling Sentences Generator (EFSG), a model- and task-agnostic adversarial attack algorithm built using an evolutionary approach to generate false-positive sentences for binary classification tasks. We successfully apply EFSG to CoLA and MRPC tasks, on BERT and RoBERTa, comparing performances. Results prove the presence of weak spots in state-of-the-art LMs. We finally test adversarial training as a data augmentation defence approach against EFSG, obtaining stronger improved models with no loss of accuracy when tested on the original datasets.


title: High-Pressure Crystal Growth, Superconducting Properties, and Electronic Band Structure of Nb2P5

abstract: Orthorhombic (space group: Pnma) Nb2P5 is a high-pressure phase that is quenchable to ambient pressure, which could viewed as the zigzag infinite P chain-inserted NbP2. We report herein the high-pressure crystal growth of Nb2P5 and the discovery of its superconducting transition at Tc ~ 2.6 K. The electrical resistivity, magnetization, and specific heat capacity measurements on the high-quality crystal unveiled a conventional type-II weakly coupled s-wave nature of the superconductivity, with the upper critical field Hc2(0) ~ 0.5 T, the electron-phonon coupling strength {\lambda}ep ~ 0.5 - 0.8, and the Ginzburg-Landau parameter \k{appa} ~ 100. The ab initio calculations on the electronic band structure unveiled nodal-line structures protected by different symmetries. The one caused by band inversion, for example, on the {\Gamma}-X and U-R paths of the Brillouin zone, likely could bring nontrivial topology and hence possible nontrivial surface state on the surface. The surface states on the (100), (010) and (110) surfaces were also calculated and discussed. The discovery of the phosphorus-rich Nb2P5 superconductor would be instructive for the design of more metal phosphides superconductors which might host unconventional superconductivity or potential technical applications.


title: Using Type Information to Improve Entity Coreference Resolution

abstract: Coreference resolution (CR) is an essential part of discourse analysis. Most recently, neural approaches have been proposed to improve over SOTA models from earlier paradigms. So far none of the published neural models leverage external semantic knowledge such as type information. This paper offers the first such model and evaluation, demonstrating modest gains in accuracy by introducing either gold standard or predicted types. In the proposed approach, type information serves both to (1) improve mention representation and (2) create a soft type consistency check between coreference candidate mentions. Our evaluation covers two different grain sizes of types over four different benchmark corpora.


title: Flagellar length control in monoflagellates by motorized transport: growth kinetics and correlations of length fluctuations

abstract: How does a cell self-organize so that its appendages attain specific lengths that are convenient for their respective functions? What kind of 'rulers' does a cell use to measure the length of these appendages? How does a cell transport structure building materials between the cell body and distal tips of these appendages so as to regulate their dynamic lengths during various stages of its lifetime? Some of these questions are addressed here in the context of a specific cell appendage called flagellum (also called cilium). A "time of flight" (ToF) mechanism, adapted from the pioneering idea of Galileo, has been used successfully very recently to explain the length control of flagella by a biflagellate green algae. Using the same ToF mechanism, here we develop a stochastic model for the dynamics of flagella in two different types of monoflagellate unicellular organisms. A unique feature of these monoflagellates is that these become transiently multi-flagellated during a short span of their life time. The mean length of the flagella in our model reproduce the trend of their temporal variation observed in experiments. Moreover, for probing the intracellular molecular communication between the dynamic flagella of a given cell, we have computed the correlation in the fluctuations of their lengths during the multiflagellated stage of the cell cycle by Monte Carlo simulation.


title: Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems

abstract: Incorporating knowledge bases (KB) into end-to-end task-oriented dialogue systems is challenging, since it requires to properly represent the entity of KB, which is associated with its KB context and dialogue context. The existing works represent the entity with only perceiving a part of its KB context, which can lead to the less effective representation due to the information loss, and adversely favor KB reasoning and response generation. To tackle this issue, we explore to fully contextualize the entity representation by dynamically perceiving all the relevant entities} and dialogue history. To achieve this, we propose a COntext-aware Memory Enhanced Transformer framework (COMET), which treats the KB as a sequence and leverages a novel Memory Mask to enforce the entity to only focus on its relevant entities and dialogue history, while avoiding the distraction from the irrelevant entities. Through extensive experiments, we show that our COMET framework can achieve superior performance over the state of the arts.


title: Predicting Short-term Mobile Internet Traffic from Internet Activity using Recurrent Neural Networks

abstract: Mobile network traffic prediction is an important input in to network capacity planning and optimization. Existing approaches may lack the speed and computational complexity to account for bursting, non-linear patterns or other important correlations in time series mobile network data. We compare the performance of two deep learning architectures - Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) - for predicting mobile Internet traffic using two months of Telecom Italia data for the metropolitan area of Milan. K-Means clustering was used a priori to group cells based on Internet activity and the Grid Search method was used to identify the best configurations for each model. The predictive quality of the models was evaluated using root mean squared error. Both Deep Learning algorithms were effective in modeling Internet activity and seasonality, both within days and across two months. We find variations in performance across clusters within the city. Overall, the LSTM outperformed the GRU in our experiments.


title: Scaling Entropy of Unstable Systems

abstract: In this work, we study the slow entropy type invariant of a dynamical system proposed by A. M. Vershik. We provide an explicit construction of a system whose class of scaling entropy sequences is empty. For this unstable case, we introduce an upgraded notion of the invariant, generalize subadditivity results, and provide a complete series of examples.


title: The Adaptive Shift Method in Full Configuration Interaction Quantum Monte Carlo: Development and Applications

abstract: In a recent paper, we proposed the adaptive shift method for correcting the undersampling bias of the initiator-FCIQMC. The method allows faster convergence with the number of walkers to the FCI limit than the normal initiator method, particularly for large systems. In its application to strongly correlated molecules, however, the method is prone to overshooting the FCI energy at intermediate walker numbers, with convergence to the FCI limit from below. In this paper, we present a solution to the overshooting problem in strongly correlated molecules, as well as further accelerating convergence to the FCI energy. This is achieved by offsetting the reference energy to a value typically below the Hartree-Fock energy but above the exact energy. This offsetting procedure does not change the exactness property of the algorithm, namely convergence to the exact FCI solution in the large-walker limit, but at its optimal value greatly accelerates convergence. There is no overhead cost associated with this offsetting procedure, and is therefore a pure and substantial computational gain. We illustrate the behavior of this offset adaptive shift method by applying it to the N$_2$ molecule, the ozone molecule at three different geometries (equilibrium open minimum, a hypothetical ring minimum, and a transition state) in three basis sets (cc-pV$X$Z, $X$=D,T,Q), and the chromium dimer in cc-pVDZ basis set, correlating 28 electrons in 76 orbitals. We show that in most cases the offset adaptive shift method converges much faster than both the normal initiator method and the original adaptive shift method.


title: On Feature Selection Using Anisotropic General Regression Neural Network

abstract: The presence of irrelevant features in the input dataset tends to reduce the interpretability and predictive quality of machine learning models. Therefore, the development of feature selection methods to recognize irrelevant features is a crucial topic in machine learning. Here we show how the General Regression Neural Network used with an anisotropic Gaussian Kernel can be used to perform feature selection. A number of numerical experiments are conducted using simulated data to study the robustness of the proposed methodology and its sensitivity to sample size. Finally, a comparison with four other feature selection methods is performed on several real world datasets.


title: Variable exponent Bochner-Lebesgue spaces with symmetric gradient structure

abstract: We introduce function spaces for the treatment of non-linear parabolic equations with variable $\log$-H\"older continuous exponents, which only incorporate information of the symmetric part of a gradient. As an analogue of Korn's inequality for these functions spaces is not available, the construction of an appropriate smoothing method proves itself to be difficult. To this end, we prove a point-wise Poincar\'e inequality near the boundary of a bounded Lipschitz domain involving only the symmetric gradient. Using this inequality, we construct a smoothing operator with convenient properties. In particular, this smoothing operator leads to several density results, and therefore to a generalized formula of integration by parts with respect to time. Using this formula and the theory of maximal monotone operators, we prove an abstract existence result.


title: Nonuniform Multiresolution Analysis Associated with Linear Canonical Transform

abstract: The linear canonical transform (LCT) has attained respectable status within a short span and is being broadly employed across several disciplines of science and engineering including signal processing, optical and radar systems, electrical and communication systems, quantum physics etc, mainly due to the extra degrees of freedom and simple geometrical manifestation. In this article, we introduce a novel multiresolution analysis (LCT-NUMRA) on the spectrum $\Omega = \big\{0,{r}/{N}\big\}+2\mathbb{Z},$ where $N \geqq 1$ is an integer and $r$ is an odd integer with $ 1 \leqq r \leqq 2N-1,$ such that $r$ and $N$ are relatively prime, by intertwining the ideas of nonuniform MRA and linear canonical transforms. We first develop nonuniform multiresolution analysis associated with the LCT and then drive an algorithm to construct an LCT-NUMRA starting from a linear canonical low-pass filter $\Lambda_{0}^{M}(\omega)$ with suitable conditions. Nevertheless, to extend the scope of the present study, we construct the associated wavelet packets for such an MRA and investigate their properties by means of the linear canonical transforms.


title: DynamiTe: Dynamic Termination and Non-termination Proofs

abstract: There is growing interest in termination reasoning for non-linear programs and, meanwhile, recent dynamic strategies have shown they are able to infer invariants for such challenging programs. These advances led us to hypothesize that perhaps such dynamic strategies for non-linear invariants could be adapted to learn recurrent sets (for non-termination) and/or ranking functions (for termination). In this paper, we exploit dynamic analysis and draw termination and non-termination as well as static and dynamic strategies closer together in order to tackle non-linear programs. For termination, our algorithm infers ranking functions from concrete transitive closures, and, for non-termination, the algorithm iteratively collects executions and dynamically learns conditions to refine recurrent sets. Finally, we describe an integrated algorithm that allows these algorithms to mutually inform each other, taking counterexamples from a failed validation in one endeavor and crossing both the static/dynamic and termination/non-termination lines, to create new execution samples for the other one.


title: Untilts of fundamental groups: construction of labeled isomorphs of fundamental groups

abstract: I show that one can explicitly construct topologically/geometrically distinguishable data which provide isomorphic copies (i.e. \emph{isomorphs}) of the tempered fundamental group of a geometrically connected, smooth, quasi-projective variety over $p$-adic fields.


title: Detecting the skewness of data from the five-number summary and its application in meta-analysis

abstract: For clinical studies with continuous outcomes, when the data are potentially skewed, researchers may choose to report the whole or part of the five-number summary (the sample median, the first and third quartiles, and the minimum and maximum values) rather than the sample mean and standard deviation. In the recent literature, it is often suggested to transform the five-number summary back to the sample mean and standard deviation, which can be subsequently used in a meta-analysis. However, if a study contains skewed data, this transformation and hence the conclusions from the meta-analysis are unreliable. Therefore, we introduce a novel method for detecting the skewness of data using only the five-number summary and the sample size, and meanwhile propose a new flow chart to handle the skewed studies in a different manner. We further show by simulations that our skewness tests are able to control the type I error rates and provide good statistical power, followed by a simulated meta-analysis and a real data example that illustrate the usefulness of our new method in meta-analysis and evidence-based medicine.


title: Polarimetric analysis of STEREO observations of sungrazing Kreutz comet C/2010 E6 (STEREO)

abstract: Twin STEREO spacecraft pre-perihelion photometric and polarimetric observations of the sungrazing Kreutz comet C/2010 E6 (STEREO) in March 2010 at heliocentric distances $3-28~R_{\odot}$ were investigated using a newly-created set of analysis routines. The comet fully disintegrated during its perihelion passage. Prior to that, a broadening and an increase of the intensity peak with decreasing heliocentric distance was accompanied by a drop to zero polarisation at high phase angles (~105-135{\deg}, STEREO-B) and the emergence of negative polarisation at low phase angles (~25-35{\deg}, STEREO-A). Outside the near-comet region, the tail exhibited a steep slope of increasing polarisation with increasing cometocentric distance, with the slope becoming less prominent as the comet approached the Sun. The steep slope may be attributed to sublimation of refractory organic matrix and the processing of dust grains, or to presence of amorphous carbon. The change in slope with proximity to the Sun is likely caused by the gradual sublimation of all refractory material. The polarisation signatures observed at both sets of phase angles closer to the comet photocentre as the comet approached the Sun are best explained by fragmentation of the nucleus, exposing fresh Mg-rich silicate particles, followed by their gradual sublimation. The need for further studies of such comets, both observational and theoretical, is highlighted, as well as the benefit of the analysis routines created for this work.


title: An Algorithm for the Factorization of Split Quaternion Polynomials

abstract: We present an algorithm to compute all factorizations into linear factors of univariate polynomials over the split quaternions, provided such a factorization exists. Failure of the algorithm is equivalent to non-factorizability for which we present also geometric interpretations in terms of rulings on the quadric of non-invertible split quaternions. However, suitable real polynomial multiples of split quaternion polynomials can still be factorized and we describe how to find these real polynomials. Split quaternion polynomials describe rational motions in the hyperbolic plane. Factorization with linear factors corresponds to the decomposition of the rational motion into hyperbolic rotations. Since multiplication with a real polynomial does not change the motion, this decomposition is always possible. Some of our ideas can be transferred to the factorization theory of motion polynomials. These are polynomials over the dual quaternions with real norm polynomial and they describe rational motions in Euclidean kinematics. We transfer techniques developed for split quaternions to compute new factorizations of certain dual quaternion polynomials.


title: An Adaptive Multivariable Smooth Second-Order Sliding Mode Approach

abstract: This paper presents a novel adaptive multivariable smooth second-order sliding mode approach with the features of fast finite-time convergence, adaptation to disturbances and smooth. This approach can be directly applied to the controller design of multi-input and multi-output (MIMO) systems. In addition, a novel adaptive multivariable smooth disturbance observer is proposed based on this structure. In terms of the types of disturbances, the fast finite-time convergence and the fast finite-time uniformly ultimately boundedness of the systems are proved with the corresponding fast finite-time Lyapunov stability theory. Finally, the effectiveness of the proposed approach is validated by comparative numerical simulations.


title: An extended sampling-ensemble Kalman filter approach for partial data inverse elastic problems

abstract: Inverse problems are more challenging when only partial data are available in general. In this paper, we propose a two-step approach combining the extended sampling method and the ensemble Kalman filter to reconstruct an elastic rigid obstacle using partial data. In the first step, the approximate location of the unknown obstacle is obtained by the extended sampling method. In the second step, the ensemble Kalman filter is employed to reconstruct the shape. The location obtained in the first step guides the construction of the initial particles of the ensemble Kalman filter, which is critical to the performance of the second step. Both steps are based on the same physical model and use the same scattering data. Numerical examples are shown to illustrate the effectiveness of the proposed method.


title: DESCNet: Developing Efficient Scratchpad Memories for Capsule Network Hardware

abstract: Deep Neural Networks (DNNs) have been established as the state-of-the-art algorithm for advanced machine learning applications. Recently proposed by the Google Brain's team, the Capsule Networks (CapsNets) have improved the generalization ability, as compared to DNNs, due to their multi-dimensional capsules and preserving the spatial relationship between different objects. However, they pose significantly high computational and memory requirements, making their energy-efficient inference a challenging task. This paper provides, for the first time, an in-depth analysis to highlight the design and management related challenges for the (on-chip) memories deployed in hardware accelerators executing fast CapsNets inference. To enable an efficient design, we propose an application-specific memory hierarchy, which minimizes the off-chip memory accesses, while efficiently feeding the data to the hardware accelerator. We analyze the corresponding on-chip memory requirements and leverage it to propose a novel methodology to explore different scratchpad memory designs and their energy/area trade-offs. Afterwards, an application-specific power-gating technique is proposed to further reduce the energy consumption, depending upon the utilization across different operations of the CapsNets. Our results for a selected Pareto-optimal solution demonstrate no performance loss and an energy reduction of 79% for the complete accelerator, including computational units and memories, when compared to a state-of-the-art design executing Google's CapsNet model for the MNIST dataset.


title: Shadow, deflection angle and quasinormal modes of Born-Infeld charged black holes

abstract: In this paper, we consider black holes in the consistent Aoki-Gorji-Mukohyama theory of the four-dimensional Einstein-Gauss-Bonnet (4D EGB) gravity in the presence of Born-Infeld (BI) nonlinear electrodynamics. We study several optical features of these black holes such as the shadow radius, energy emission rate and deflection angle, and analyse the effect of the coupling constants, the electric charge and cosmological constant on the considered optical quantities. Furthermore, we also employ the connection between the shadow radius and quasinormal modes (QNMs) and investigate small scalar perturbations around the black hole solution. We show that the variation of the parameters of the theory provide specific signatures on the optical features of the BI charged black hole solution, thus leading to the possibility of directly testing this consistent Aoki-Gorji-Mukohyama 4D EGB black hole model by using astrophysical observations.


title: Generalized groups and module groupoids

abstract: In this paper we discuss generalized group, provides some interesting examples. Further we introduce a generalized module as a module like structure obtained from a generalized group and discuss some of its properties and we also describes generalized module groupoids.


title: Extracting Angina Symptoms from Clinical Notes Using Pre-Trained Transformer Architectures

abstract: Anginal symptoms can connote increased cardiac risk and a need for change in cardiovascular management. This study evaluated the potential to extract these symptoms from physician notes using the Bidirectional Encoder from Transformers language model fine-tuned on a domain-specific corpus. The history of present illness section of 459 expert annotated primary care physician notes from consecutive patients referred for cardiac testing without known atherosclerotic cardiovascular disease were included. Notes were annotated for positive and negative mentions of chest pain and shortness of breath characterization. The results demonstrate high sensitivity and specificity for the detection of chest pain or discomfort, substernal chest pain, shortness of breath, and dyspnea on exertion. Small sample size limited extracting factors related to provocation and palliation of chest pain. This study provides a promising starting point for the natural language processing of physician notes to characterize clinically actionable anginal symptoms.


title: Shadows of Cube Vertices

abstract: Suppose that a finite-dimensional cube is orthogonally projected onto a central section of itself by a subspace of one dimension less. Up to dimension $9$, at least one vertex is projected onto the section, but for dimension $10$ or larger, there are orthogonal projections for which all the vertices are projected outside the section. In fact, this is the case for "most" orthogonal projections, as the dimension tends to infinity.


title: Explaining Clinical Decision Support Systems in Medical Imaging using Cycle-Consistent Activation Maximization

abstract: Clinical decision support using deep neural networks has become a topic of steadily growing interest. While recent work has repeatedly demonstrated that deep learning offers major advantages for medical image classification over traditional methods, clinicians are often hesitant to adopt the technology because its underlying decision-making process is considered to be intransparent and difficult to comprehend. In recent years, this has been addressed by a variety of approaches that have successfully contributed to providing deeper insight. Most notably, additive feature attribution methods are able to propagate decisions back into the input space by creating a saliency map which allows the practitioner to "see what the network sees." However, the quality of the generated maps can become poor and the images noisy if only limited data is available - a typical scenario in clinical contexts. We propose a novel decision explanation scheme based on CycleGAN activation maximization which generates high-quality visualizations of classifier decisions even in smaller data sets. We conducted a user study in which we evaluated our method on the LIDC dataset for lung lesion malignancy classification, the BreastMNIST dataset for ultrasound image breast cancer detection, as well as two subsets of the CIFAR-10 dataset for RBG image object recognition. Within this user study, our method clearly outperformed existing approaches on the medical imaging datasets and ranked second in the natural image setting. With our approach we make a significant contribution towards a better understanding of clinical decision support systems based on deep neural networks and thus aim to foster overall clinical acceptance.


title: Video Quality Enhancement Using Deep Learning-Based Prediction Models for Quantized DCT Coefficients in MPEG I-frames

abstract: Recent works have successfully applied some types of Convolutional Neural Networks (CNNs) to reduce the noticeable distortion resulting from the lossy JPEG/MPEG compression technique. Most of them are built upon the processing made on the spatial domain. In this work, we propose a MPEG video decoder that is purely based on the frequency-to-frequency domain: it reads the quantized DCT coefficients received from a low-quality I-frames bitstream and, using a deep learning-based model, predicts the missing coefficients in order to recompose the same frames with enhanced quality. In experiments with a video dataset, our best model was able to improve from frames with quantized DCT coefficients corresponding to a Quality Factor (QF) of 10 to enhanced quality frames with QF slightly near to 20.


title: The Risks of Invariant Risk Minimization

abstract: Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain constant. Recently, Arjovsky et al. (2019) proposed Invariant Risk Minimization (IRM), an objective based on this idea for learning deep, invariant features of data which are a complex function of latent variables; many alternatives have subsequently been suggested. However, formal guarantees for all of these works are severely lacking. In this paper, we present the first analysis of classification under the IRM objective--as well as these recently proposed alternatives--under a fairly natural and general model. In the linear case, we show simple conditions under which the optimal solution succeeds or, more often, fails to recover the optimal invariant predictor. We furthermore present the very first results in the non-linear regime: we demonstrate that IRM can fail catastrophically unless the test data are sufficiently similar to the training distribution--this is precisely the issue that it was intended to solve. Thus, in this setting we find that IRM and its alternatives fundamentally do not improve over standard Empirical Risk Minimization.


title: Hierarchical Attention Learning of Scene Flow in 3D Point Clouds

abstract: Scene flow represents the 3D motion of every point in the dynamic environments. Like the optical flow that represents the motion of pixels in 2D images, 3D motion representation of scene flow benefits many applications, such as autonomous driving and service robot. This paper studies the problem of scene flow estimation from two consecutive 3D point clouds. In this paper, a novel hierarchical neural network with double attention is proposed for learning the correlation of point features in adjacent frames and refining scene flow from coarse to fine layer by layer. The proposed network has a new more-for-less hierarchical architecture. The more-for-less means that the number of input points is greater than the number of output points for scene flow estimation, which brings more input information and balances the precision and resource consumption. In this hierarchical architecture, scene flow of different levels is generated and supervised respectively. A novel attentive embedding module is introduced to aggregate the features of adjacent points using a double attention method in a patch-to-patch manner. The proper layers for flow embedding and flow supervision are carefully considered in our network designment. Experiments show that the proposed network outperforms the state-of-the-art performance of 3D scene flow estimation on the FlyingThings3D and KITTI Scene Flow 2015 datasets. We also apply the proposed network to realistic LiDAR odometry task, which is an key problem in autonomous driving. The experiment results demonstrate that our proposed network can outperform the ICP-based method and shows the good practical application ability.


title: Layer-wise Guided Training for BERT: Learning Incrementally Refined Document Representations

abstract: Although BERT is widely used by the NLP community, little is known about its inner workings. Several attempts have been made to shed light on certain aspects of BERT, often with contradicting conclusions. A much raised concern focuses on BERT's over-parameterization and under-utilization issues. To this end, we propose o novel approach to fine-tune BERT in a structured manner. Specifically, we focus on Large Scale Multilabel Text Classification (LMTC) where documents are assigned with one or more labels from a large predefined set of hierarchically organized labels. Our approach guides specific BERT layers to predict labels from specific hierarchy levels. Experimenting with two LMTC datasets we show that this structured fine-tuning approach not only yields better classification results but also leads to better parameter utilization.