title: Combining No-regret and Q-learning

abstract: Counterfactual Regret Minimization (CFR) has found success in settings like poker which have both terminal states and perfect recall. We seek to understand how to relax these requirements. As a first step, we introduce a simple algorithm, local no-regret learning (LONR), which uses a Q-learning-like update rule to allow learning without terminal states or perfect recall. We prove its convergence for the basic case of MDPs (and limited extensions of them) and present empirical results showing that it achieves last iterate convergence in a number of settings, most notably NoSDE games, a class of Markov games specifically designed to be challenging to learn where no prior algorithm is known to achieve convergence to a stationary equilibrium even on average.


title: Hybrid Sparse Array Beamforming Design for General Rank Signal Models

abstract: The paper considers sparse array design for receive beamforming achieving maximum signal-to-interference plus noise ratio (MaxSINR) for both single point source and multiple point sources, operating in an interference active environment. Unlike existing sparse design methods which either deal with structured environment-independent or non-structured environment-dependent arrays, our method is a hybrid approach and seeks a full augumentable array that optimizes beamformer performance. This approach proves important for limited aperture that constrains the number of possible uniform grid points for sensor placements. The problem is formulated as quadratically constraint quadratic program (QCQP), with the cost function penalized with weighted l_1-norm squared of the beamformer weight vector. Simulation results are presented to show the effectiveness of the proposed algorithms for array configurability in the case of both single and general rank signal correlation matrices. Performance comparisons among the proposed sparse array, the commonly used uniform arrays, arrays obtained by other design methods, and arrays designed without the augmentability constraint are provided.


title: Enhancement of optical coherence in $^{167}$Er:Y$_2$SiO$_5$ crystal at sub-Kelvin temperatures

abstract: Er$^{3+}$:Y$_2$SiO$_5$ crystal is a promising candidate with a great variety of its potential applications in quantum information processing and quantum communications ranging from optical/microwave quantum memories to circuit QED and microwave-to-optics frequency converters. Some of the above listed applications require ultra-low temperature environment, i.e., temperatures $T\lesssim0.1~$K. Most of the experiments with erbium doped crystals have been so far carried out at temperatures above 1.5~K. Therefore, only little information is known about Er$^{3+}$:Y$_2$SiO$_5$ coherence properties at millikelvins. Here, we investigate optical decoherence of $^{167}$Er:Y$_2$SiO$_5$ crystal by performing 2- and 3-pulse echo experiments at millikelvin temperature range and at weak and moderate magnetic fields. We show that the deep freezing of the crystal results in an increase of optical coherence time by one order of magnitude compared to temperature of 1.5 Kelvin and magnetic field of $\sim$0.2~T, taken as a reference point. We further describe the detailed investigation of the decoherence mechanisms in this regime.


title: Generalization of machine-learned turbulent heat flux models applied to film cooling flows

abstract: The design of film cooling systems relies heavily on Reynolds-Averaged Navier-Stokes (RANS) simulations, which solve for mean quantities and model all turbulent scales. Most turbulent heat flux models, which are based on isotropic diffusion with a fixed turbulent Prandtl number ($Pr_t$), fail to accurately predict heat transfer in film cooling flows. In the present work, machine learning models are trained to predict a non-uniform $Pr_t$ field, using various datasets as training sets. The ability of these models to generalize beyond the flows on which they were trained is explored. Furthermore, visualization techniques are employed to compare distinct datasets and to help explain the cross-validation results.


title: S-duality and refined BPS indices

abstract: Whenever available, refined BPS indices provide considerably more information on the spectrum of BPS states than their unrefined version. Extending earlier work on the modularity of generalized Donaldson-Thomas invariants counting D4-D2-D0 brane bound states in type IIA strings on a Calabi-Yau threefold $\mathfrak{Y}$, we construct the modular completion of generating functions of refined BPS indices supported on a divisor class. Although for compact $\mathfrak{Y}$ the refined indices are not protected, switching on the refinement considerably simplifies the construction of the modular completion. Furthermore, it leads to a non-commutative analogue of the TBA equations, which suggests a quantization of the moduli space consistent with S-duality. In contrast, for a local CY threefold given by the total space of the canonical bundle over a complex surface $S$, refined BPS indices are well-defined, and equal to Vafa-Witten invariants of $S$. Our construction provides a modular completion of the generating function of these refined invariants for arbitrary rank. In cases where all reducible components of the divisor class are collinear (which occurs e.g. when $b_2(\mathfrak{Y})=1$, or in the local case), we show that the holomorphic anomaly equation satisfied by the completed generating function truncates at quadratic order. In the local case, it agrees with an earlier proposal by Minahan et al for unrefined invariants, and extends it to the refined level using the afore-mentioned non-commutative structure. Finally, we show that these general predictions reproduce known results for $U(2)$ and $U(3)$ Vafa-Witten theory on $\mathbb{P}^2$, and make them explicit for $U(4)$.


title: Kazarnovskii pseudovolume, a clever use of support function

abstract: The present paper provides a detailed and almost self-contained introduction to Kazarnovskii mixed pseudovolume.


title: Degrees of freedom and Hamiltonian formalism for $f(T)$ gravity

abstract: The existence of an extra degree of freedom (d.o.f.) in $f(T)$ gravity has been recently proved by means of the Dirac formalism for constrained Hamiltonian systems. We will show a toy model displaying the essential feature of $f(T)$ gravity, which is the pseudoinvariance of T under a local symmetry, to understand the nature of the extra d.o.f.


title: Multi-Robot Coordinated Planning in Confined Environments under Kinematic Constraints

abstract: We investigate the problem of multi-robot coordinated planning in environments where the robots may have to operate in close proximity to each other. We seek computationally efficient planners that ensure safe paths and adherence to kinematic constraints. We extend the central planner dRRT* with our variant, fast-dRRT (fdRRT), with the intention being to use in tight environments that lead to a high degree of coupling between robots. Our algorithm is empirically shown to achieve the trade-off between computational time and solution quality, especially in tight environments.


title: Error Probability Analysis and Power Allocation for Interference Exploitation Over Rayleigh Fading Channels

abstract: This paper considers the performance analysis of constructive interference (CI) precoding technique in multi-user multiple-input multiple-output (MU-MIMO) systems with a finite constellation phase-shift keying (PSK) input alphabet. Firstly, analytical expressions for the moment generating function (MGF) and the average of the received signal-to-noise-ratio (SNR) are derived. Then, based on the derived MGF expression the average symbol error probability (SEP) for the CI precoder with PSK signaling is calculated. In this regard, new exact and very accurate asymptotic approximation for the average SEP are provided. Building on the new performance analysis, different power allocation schemes are considered to enhance the achieved SEP. In the first scheme, power allocation based on minimizing the sum symbol error probabilities (Min-Sum) is studied, while in the second scheme the power allocation based on minimizing the maximum SEP (Min-Max) is investigated. Furthermore, new analytical expressions of the throughput and power efficiency of the CI precoding in MU-MIMO systems are also derived. The numerical results in this work demonstrate that, the CI precoding outperforms the conventional interference suppression precoding techniques with an up to 20dB gain in the transmit SNR in terms of SEP, and up to 15dB gain in the transmit SNR in terms of the throughput. In addition, the SEP-based power allocation schemes provide additional up to 13dB gains in the transmit SNR compared to the conventional equal power allocation scheme.


title: Energy-Aware Neural Architecture Optimization with Fast Splitting Steepest Descent

abstract: Designing energy-efficient networks is of critical importance for enabling state-of-the-art deep learning in mobile and edge settings where the computation and energy budgets are highly limited. Recently, Liu et al. (2019) framed the search of efficient neural architectures into a continuous splitting process: it iteratively splits existing neurons into multiple off-springs to achieve progressive loss minimization, thus finding novel architectures by gradually growing the neural network. However, this method was not specifically tailored for designing energy-efficient networks, and is computationally expensive on large-scale benchmarks. In this work, we substantially improve Liu et al. (2019) in two significant ways: 1) we incorporate the energy cost of splitting different neurons to better guide the splitting process, thereby discovering more energy-efficient network architectures; 2) we substantially speed up the splitting process of Liu et al. (2019), which requires expensive eigen-decomposition, by proposing a highly scalable Rayleigh-quotient stochastic gradient algorithm. Our fast algorithm allows us to reduce the computational cost of splitting to the same level of typical back-propagation updates and enables efficient implementation on GPU. Extensive empirical results show that our method can train highly accurate and energy-efficient networks on challenging datasets such as ImageNet, improving a variety of baselines, including the pruning-based methods and expert-designed architectures.


title: Elastic and inelastic scattering of $^{16}$O on $^{27}$Al and $^{28}$Si at 240 MeV

abstract: The nuclear scattering at energies well above the Coulomb barrier allows for a fairly sensitive examination of the parameters of the optical potential when the relevant couplings are included into the calculations. In this work we present experimental angular distribution data for the elastic and inelastic scatterings of $^{16}$O impinging on $^{27}$Al and $^{28}$Si target nuclei at \textit{E}$_{lab}=240$ MeV. The experimental data were measured at $7\degree < \theta_{c.m.} < 16\degree$ with good angular resolution. Experimental data are compared with coupled channel calculations with the inclusion of couplings to excited states in the target and projectile. We show that the shape of angular distributions are sensitive to the mass diffuseness parameter and the best agreement is achieved for $a = 0.62$ fm.


title: Potential kernels for radial Dunkl Laplacians

abstract: We derive two-sided bounds for the Newton and Poisson kernels of the $W$-invariant Dunkl Laplacian in geometric complex case when the multiplicity $k(\alpha)=1$, i.e. for flat complex symmetric spaces. For the invariant Dunkl-Poisson kernel $P^W(x,y)$, the estimates are $$ P^W(x,y)\asymp \frac{P^{{\bf R}^d}(x,y)}{\prod_{\alpha > 0 \ }|x-\sigma_\alpha y|^{2k(\alpha)}},$$ where the $\alpha$'s are the positive roots of a root system acting in ${\bf R}^d$, the $\sigma_\alpha$'s are the corresponding symmetries and $P^{{\bf R}^d}$ is the classical Poisson kernel in ${{\bf R}^d}$. Analogous bounds are proven for the Newton kernel when $d\ge 3$. The same estimates are derived in the rank one direct product case $\mathbb Z_2^N$ and conjectured for general $W$-invariant Dunkl processes. As an application, we get a two-sided bound for the Poisson and Newton kernels of the classical Dyson Brownian motion and of the Brownian motions in any Weyl chamber.


title: Euclid: Reconstruction of Weak Lensing mass maps for non-Gaussianity studies

abstract: Weak lensing, which is the deflection of light by matter along the line of sight, has proven to be an efficient method for constraining models of structure formation and reveal the nature of dark energy. So far, most weak-lensing studies have focused on the shear field that can be measured directly from the ellipticity of background galaxies. However, within the context of forthcoming full-sky weak-lensing surveys such as Euclid, convergence maps (mass maps) offer an important advantage over shear fields in terms of cosmological exploitation. While it carry the same information, the lensing signal is more compressed in the convergence maps than in the shear field. This simplifies otherwise computationally expensive analyses, for instance, non-Gaussianity studies. However, the inversion of the non-local shear field requires accurate control of systematic effects caused by holes in the data field, field borders, shape noise, and the fact that the shear is not a direct observable (reduced shear). We present the two mass-inversion methods that are included in the official Euclid data-processing pipeline: the standard Kaiser & Squires method (KS), and a new mass-inversion method (KS+) that aims to reduce the information loss during the mass inversion. This new method is based on the KS method and includes corrections for mass-mapping systematic effects. The results of the KS+ method are compared to the original implementation of the KS method in its simplest form, using the Euclid Flagship mock galaxy catalogue. In particular, we estimate the quality of the reconstruction by comparing the two-point correlation functions and third- and fourth- order moments obtained from shear and convergence maps, and we analyse each systematic effect independently and simultaneously...


title: Khuri-Treiman equations for $3\pi$ decays of particles with spin

abstract: Khuri-Treiman equations have proven to be a useful theoretical tool in the analysis of 3-body decays, specially into the $3\pi$ final state. In this work we present in full detail the necessary generalization of the formalism to study the decays of particles with arbitrary spin, parity, and charge conjugation. To this extent, we find it most convenient to work with helicity amplitudes instead of the so-called invariant amplitudes, specially when dealing with the unitarity relations. The isobar expansions in the three possible ($s$-, $t$-, and $u$-) final channels are related with the appropriate crossing matrices. We pay special attention to the kinematical singularities and constraints of the helicity amplitudes, showing that these can be derived by means of the crossing matrix.


title: Analysis of the one-neutron transfer to $^{16}$O, $^{28}$Si and $^{64}$Ni induced by ($^{18}$O, $^{17}$O) reaction at 84 MeV

abstract: Background: Recently, a systematic exploration of two-neutron transfer induced by the ($^{18}$O, $^{16}$O) reaction on different targets has been performed. The high resolution data have been collected at the MAGNEX magnetic spectrometer of the INFN-LNS laboratory in Catania and analyzed with the coupled reaction channel (CRC) approach. The simultaneous and sequential transfers of the two neutrons have been considered under the same theoretical framework without the need of adjustable factors in the calculations. Purpose: A detailed analysis of the one-neutron transfer cross sections is important to study the sequential two-neutron transfer. Here, we examine the ($^{18}$O, $^{17}$O) reaction on $^{16}$O, $^{28}$Si and $^{64}$Ni targets. These even-even nuclei allow for investigation of one-neutron transfer in distinct nuclear shell spaces. Method: The MAGNEX spectrometer was used to measure mass spectra of ejectiles and extract differential cross sections of one-neutron transfer to low-lying states. We adopted the same CRC formalism used in the sequential two-neutron transfer, including relevant channels and using spectroscopic amplitudes obtained from shell model calculations. We also compare with one-step distorted wave Born approximation (DWBA). Results: For the $^{18}$O + $^{16}$O and the $^{18}$O + $^{28}$O systems we used two interactions in the shell model. The experimental angular distributions are reasonably well reproduced by the CRC calculations. In the $^{18}$O + $^{64}$Ni system, we considered only one interaction and the theoretical curve describes the shape and order of magnitude observed in the experimental data. Conclusions: Comparisons between experimental, DWBA and CRC angle-integrated cross sections suggest that excitations before or after the transfer of neutron is relevant in the $^{18}$O + $^{16}$O and $^{18}$O + $^{64}$Ni systems.


title: Boosting High Dimensional Predictive Regressions with Time Varying Parameters

abstract: High dimensional predictive regressions are useful in wide range of applications. However, the theory is mainly developed assuming that the model is stationary with time invariant parameters. This is at odds with the prevalent evidence for parameter instability in economic time series, but theories for parameter instability are mainly developed for models with a small number of covariates. In this paper, we present two $L_2$ boosting algorithms for estimating high dimensional models in which the coefficients are modeled as functions evolving smoothly over time and the predictors are locally stationary. The first method uses componentwise local constant estimators as base learner, while the second relies on componentwise local linear estimators. We establish consistency of both methods, and address the practical issues of choosing the bandwidth for the base learners and the number of boosting iterations. In an extensive application to macroeconomic forecasting with many potential predictors, we find that the benefits to modeling time variation are substantial and they increase with the forecast horizon. Furthermore, the timing of the benefits suggests that the Great Moderation is associated with substantial instability in the conditional mean of various economic series.


title: Entropy Decay Rates for Conservative Spectral Schemes Modeling Fokker-Planck-Landau Type Flows in the Mean Field Limit

abstract: The focus of this work is to create benchmark simulations of decay rates to statistical equilibrium in transport plasma models for Coulomb particle interactions given by a coupled Vlasov-Poisson Fokker-Planck-Landau equation, as well as with Maxwell type and hard sphere interactions. The qualitative decay to the equilibrium Maxwell-Boltzmann distribution through relative entropy is studied in detail for all three types of particle interactions by means of a conservative hybrid spectral and discontinuous Galerkin scheme adapted from previous work. More precisely, the Coulomb case shows that there is a degenerate spectrum, with a decay rate close to the law of two thirds predicted by upper estimates in a work of Strain and Guo in 2006, while the Maxwell type and hard sphere examples both exhibit a spectral gap as predicted by Desvillettes and Villani in 2000. Such decay rate behavior indicates that the analytical estimates for the Coulomb case is sharp while, still to this date, there is no analytical proof of sharp degenerate spectral behaviour for the Fokker-Planck-Landau operator. Simulations are presented, both for the space-homogeneous case of just particle potential interactions and the space-inhomogeneous case for the mean field coupling through the Poisson equation for total charges in periodic domains. New explicit derivations of spectral collisional weights are presented in the case of Maxwell type and hard sphere interactions and the stability of all three scenarios, including Coulomb interactions, is investigated.


title: Iodine: Verifying Constant-Time Execution of Hardware

abstract: To be secure, cryptographic algorithms crucially rely on the underlying hardware to avoid inadvertent leakage of secrets through timing side channels. Unfortunately, such timing channels are ubiquitous in modern hardware, due to its labyrinthine fast-paths and optimizations. A promising way to avoid timing vulnerabilities is to devise --- and verify --- conditions under which a hardware design is free of timing variability, i.e., executes in constant-time. In this paper, we present Iodine: a clock precise, constant-time approach to eliminating timing side channels in hardware. Iodine succeeds in verifying various open source hardware designs in seconds and with little developer effort. Iodine also discovered two constant-time violations: one in a floating-point unit and another one in an RSA encryption module.


title: Application of Machine Learning in Forecasting International Trade Trends

abstract: International trade policies have recently garnered attention for limiting cross-border exchange of essential goods (e.g. steel, aluminum, soybeans, and beef). Since trade critically affects employment and wages, predicting future patterns of trade is a high-priority for policy makers around the world. While traditional economic models aim to be reliable predictors, we consider the possibility that Machine Learning (ML) techniques allow for better predictions to inform policy decisions. Open-government data provide the fuel to power the algorithms that can explain and forecast trade flows to inform policies. Data collected in this article describe international trade transactions and commonly associated economic factors. Machine learning (ML) models deployed include: ARIMA, GBoosting, XGBoosting, and LightGBM for predicting future trade patterns, and K-Means clustering of countries according to economic factors. Unlike short-term and subjective (straight-line) projections and medium-term (aggre-gated) projections, ML methods provide a range of data-driven and interpretable projections for individual commodities. Models, their results, and policies are introduced and evaluated for prediction quality.


title: Geometric Regularity Results on $B_{\alpha,\beta}^{k}$-Manifolds, I: Affine Connections

abstract: In this paper we consider existence and multiplicity results concerning affine connections on $C^{k}$-manifolds $M$ whose coefficients are as regular as one needs, following the regularity theory introduced in arXiv:1908.04442. We show that if $M$ admits a $B_{\alpha,\beta}^{k}$-structure, then the existence of such regular connections can be established in terms of properties of the structural presheaf $B$. In other words, we propose a solution to the existence problem in this setting. With regard to the multiplicity problem, we show that the space of regular affine connections is an affine space of the space of regular $\operatorname{End}(TM)$-valued 1-forms, and that if two regular connections are locally additively different, then they are actually locally different. The existence of a topology in which the space of regular connections is a nonempty open dense subset of the space of all regular $\operatorname{End}(TM)$-valued 1-forms is suggested.


title: An Oblivious Ellipsoid Algorithm for Solving a System of (In)Feasible Linear Inequalities

abstract: The ellipsoid algorithm is a fundamental algorithm for computing a solution to the system of $m$ linear inequalities in $n$ variables $(P): A^{\top}x \le u$ when its set of solutions has positive volume. However, when $(P)$ is infeasible, the ellipsoid algorithm has no mechanism for proving that $(P)$ is infeasible. This is in contrast to the other two fundamental algorithms for tackling $(P)$, namely the simplex method and interior-point methods, each of which can be easily implemented in a way that either produces a solution of $(P)$ or proves that $(P)$ is infeasible by producing a solution to the alternative system $\mathrm{({\it Alt})}: A\lambda= 0$, $u^{\top}\lambda < 0$, $\lambda \ge 0$. This paper develops an Oblivious Ellipsoid Algorithm (OEA) that either produces a solution of $(P)$ or produces a solution of $\mathrm{({\it Alt})}$. Depending on the dimensions and on other natural condition measures, the computational complexity of the basic OEA may be worse than, the same as, or better than that of the standard ellipsoid algorithm. We also present two modified versions of OEA, whose computational complexity is superior to that of OEA when $n \ll m$. This is achieved in the first modified version by proving infeasibility without actually producing a solution of $\mathrm{({\it Alt})}$, and in the second modified version by using more memory.


title: Distributed Frequency Regulation for Heterogeneous Microgrids via Steady State Optimal Control

abstract: In this paper, we present a model-based frequency controller for microgrids with nonzero line resistances based on a port-Hamiltonian formulation of the microgrid model and real-time dynamic pricing. The controller is applicable for conventional generation with synchronous machines as well as for power electronics interfaced sources and it is robust against power fluctuations from uncontrollable loads or volatile regenerative sources. The price-based formulation allows additional requirements such as active power sharing to be met. The capability and effectiveness of our procedure is demonstrated by means of an 18-node exemplary grid.


title: Area of Scalar Isosurfaces in Homogeneous Isotropic Turbulence as a Function of Reynolds and Schmidt Numbers

abstract: A fundamental effect of fluid turbulence is turbulent mixing, which results in the stretching and wrinkling of scalar isosurfaces. Thus, the area of isosurfaces is of interest in understanding turbulence in general with specific applications in, e.g., combustion and the identification of turbulent/non-turbulent interfaces. We report measurements of isosurface areas in 28 direct numerical simulations (DNSs) of homogeneous isotropic turbulence with a mean scalar gradient resolved on up to $14256^3$ grid points with Taylor Reynolds number $Re{_\lambda}$ ranging from 24 to 633 and Schmidt number $Sc$ ranging from 0.1 to 7. More precisely, we measure layers with very small but finite thickness. The continuous equation we evaluate converges exactly to the area in the limit of zero layer thickness. We demonstrate a method for numerically integrating this equation that, for a test case with an analytical solution, converges linearly towards the exact solution with decreasing layer width. By applying the technique to DNS data and testing for convergence with resolution of the simulations, we verify the resolution requirements for DNS recently proposed by \citet{yeung18}. We conclude that isosurface areas scale with the square root of the Taylor P\'eclet number $Pe_{\lambda}$ between approximately 50 and 4429 with some departure from power law scaling evident for $2.4 < Pe_{\lambda} < 50$. No independent effect of either $Re_{\lambda}$ or $Sc$ is observed. The excellent scaling of area with $Pe_{\lambda}^{1/2}$ occurs even though the probability density function (p.d.f.) of the scalar gradient is very close to exponential for $Re_{\lambda}=98$ but approximately lognormal when $Re_{\lambda}=633$.


title: Reversals of signal-posterior monotonicity imply a bias of screening

abstract: This note strengthens the main result of Lagziel and Lehrer (2019) (LL) "A bias in screening" using Chambers Healy (2011) (CH) "Reversals of signal-posterior monotonicity for any bounded prior". LL show that the conditional expectation of an unobserved variable of interest, given that a noisy signal of it exceeds a cutoff, may decrease in the cutoff. CH prove that the distribution of a variable conditional on a lower signal may first order stochastically dominate the distribution conditional on a higher signal. The nonmonotonicity result is also extended to the empirically relevant exponential and Pareto distributions, and to a wide range of signals.


title: The Query Translation Landscape: a Survey

abstract: Whereas the availability of data has seen a manyfold increase in past years, its value can be only shown if the data variety is effectively tackled ---one of the prominent Big Data challenges. The lack of data interoperability limits the potential of its collective use for novel applications. Achieving interoperability through the full transformation and integration of diverse data structures remains an ideal that is hard, if not impossible, to achieve. Instead, methods that can simultaneously interpret different types of data available in different data structures and formats have been explored. On the other hand, many query languages have been designed to enable users to interact with the data, from relational, to object-oriented, to hierarchical, to the multitude emerging NoSQL languages. Therefore, the interoperability issue could be solved not by enforcing physical data transformation, but by looking at techniques that are able to query heterogeneous sources using one uniform language. Both industry and research communities have been keen to develop such techniques, which require the translation of a chosen 'universal' query language to the various data model specific query languages that make the underlying data accessible. In this article, we survey more than forty query translation methods and tools for popular query languages, and classify them according to eight criteria. In particular, we study which query language is a most suitable candidate for that 'universal' query language. Further, the results enable us to discover the weakly addressed and unexplored translation paths, to discover gaps and to learn lessons that can benefit future research in the area.


title: ATFaceGAN: Single Face Image Restoration and Recognition from Atmospheric Turbulence

abstract: Image degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and reconstructs a restored image. The disentanglement is achieved by decomposing the distortion due to turbulence into blur and deformation components using deblur generator and deformation correction generator respectively. Two paths of restoration are implemented to regularize the disentanglement and generate two restored images from one degraded image. A fusion function combines the features of the restored images to reconstruct a sharp image with rich details. Adversarial and perceptual losses are added to reconstruct a sharp image and suppress the artifacts respectively. Extensive experiments demonstrate the effectiveness of the proposed restoration algorithm, which achieves satisfactory performance in face restoration and face recognition.


title: Gaussian Process Assisted Active Learning of Physical Laws

abstract: In many areas of science and engineering, discovering the governing differential equations from the noisy experimental data is an essential challenge. It is also a critical step in understanding the physical phenomena and prediction of the future behaviors of the systems. However, in many cases, it is expensive or time-consuming to collect experimental data. This article provides an active learning approach to estimate the unknown differential equations accurately with reduced experimental data size. We propose an adaptive design criterion combining the D-optimality and the maximin space-filling criterion. In contrast to active learning for other regression models, the D-optimality here requires the unknown solution of the differential equations and derivatives of the solution. We estimate the Gaussian process (GP) regression models from the available experimental data and use them as the surrogates of these unknown solution functions. The derivatives of the estimated GP models are derived and used to substitute the derivatives of the solution. Variable selection-based regression methods are used to learn the differential equations from the experimental data. Through multiple case studies, we demonstrate the proposed approach outperforms the D-optimality and the maximin space-filling design alone in terms of model accuracy and data economy.


title: Stable factorization from a fibred algebraic weak factorization system

abstract: We present a construction of stable diagonal factorizations, used to define categorical models of type theory with identity types, from a family of algebraic weak factorization systems on the slices of a category. Inspired by a computational interpretation of indexed inductive types in cubical type theory due to Cavallo and Harper, it can be read as a refactoring of a construction of van den Berg and Garner, and is a new alternative among a variety of approaches to modeling identity types in the literature.


title: Task-Adaptive Incremental Learning for Intelligent Edge Devices

abstract: Convolutional Neural Networks (CNNs) are used for a wide range of image-related tasks such as image classification and object detection. However, a large pre-trained CNN model contains a lot of redundancy considering the task-specific edge applications. Also, the statically pre-trained model could not efficiently handle the dynamic data in the real-world application. The CNN training data and their labels are collected in an incremental manner. To tackle the above two challenges, we proposed TeAM a task-adaptive incremental learning framework for CNNs in intelligent edge devices. Given a pre-trained large model, TeAM can configure it into any specialized model for dedicated edge applications. The specialized model can be quickly fine-tuned with local data to achieve very high accuracy. Also, with our global aggregation and incremental learning scheme, the specialized CNN models can be collaboratively aggregated to an enhanced global model with new training data.


title: Black holes quasinormal modes, Loop Quantum Gravity Immirzi parameter and nonextensive statistics

abstract: It is argued that, using the black hole area entropy law together with the Boltzmann-Gibbs statistical mechanics and the quasinormal modes of the black holes, it is possible to determine univocally the lowest possible value for the spin $j$ in the context of the Loop Quantum Gravity theory which is $j_{min}=1$. Consequently, the value of Immirzi parameter is given by $\gamma = \ln 3/(2\pi\sqrt{2})$. In this paper, we have shown that if we use Tsallis microcanonical entropy rather than Boltzmann-Gibbs framework then the minimum value of the label $j$ depends on the nonextensive $q$-parameter and may have values other than $j_{min}=1$.


title: Optimal Controller and Actuator Design for Nonlinear Parabolic Systems

abstract: Many physical systems are modeled by nonlinear parabolic differential equations, such as the Kuramoto-Sivashinsky (KS) equation. In this paper, the existence of a concurrent optimal controller and actuator design is established for semilinear parabolic systems. Optimality equations are provided. The results are shown to apply to optimal controller/actuator design for the Kuramoto-Sivashinsky equation and also nonlinear diffusion.


title: A quantitative analysis of the chain fountain

abstract: The chain fountain is an entertaining, counter-intuitive phenomenon. When a chain flows up over the edge of a container and then falls to the ground below, it is observed that the top of the chain rises up above the containers edge. Here the steady-state motion of the fountain is analyzed experimentally and theoretically. Measurements are given for the speeds and heights for three different chains and three different distances from the container to the floor. It is shown theoretically that the distance the chain rises above the container is proportional to the force from the container on the chain. The basic physics behind this force is readily understandable and can be illustrated with simple examples. To quantitatively predict the chain's motion a simple model is developed for how the chain interacts with the container. This model shows that a link lifts-off from the container after rotating by a relatively small angle. The model's predictions agree very will with the measurement for the two ball-chains.


title: Improvements to Target-Based 3D LiDAR to Camera Calibration

abstract: The homogeneous transformation between a LiDAR and monocular camera is required for sensor fusion tasks, such as SLAM. While determining such a transformation is not considered glamorous in any sense of the word, it is nonetheless crucial for many modern autonomous systems. Indeed, an error of a few degrees in rotation or a few percent in translation can lead to 20 cm translation errors at a distance of 5 m when overlaying a LiDAR image on a camera image. The biggest impediments to determining the transformation accurately are the relative sparsity of LiDAR point clouds and systematic errors in their distance measurements. This paper proposes (1) the use of targets of known dimension and geometry to ameliorate target pose estimation in face of the quantization and systematic errors inherent in a LiDAR image of a target, and (2) a fitting method for the LiDAR to monocular camera transformation that fundamentally assumes the camera image data is the most accurate information in one's possession.


title: Evaluating Scalable Uncertainty Estimation Methods for DNN-Based Molecular Property Prediction

abstract: Advances in deep neural network (DNN) based molecular property prediction have recently led to the development of models of remarkable accuracy and generalization ability, with graph convolution neural networks (GCNNs) reporting state-of-the-art performance for this task. However, some challenges remain and one of the most important that needs to be fully addressed concerns uncertainty quantification. DNN performance is affected by the volume and the quality of the training samples. Therefore, establishing when and to what extent a prediction can be considered reliable is just as important as outputting accurate predictions, especially when out-of-domain molecules are targeted. Recently, several methods to account for uncertainty in DNNs have been proposed, most of which are based on approximate Bayesian inference. Among these, only a few scale to the large datasets required in applications. Evaluating and comparing these methods has recently attracted great interest, but results are generally fragmented and absent for molecular property prediction. In this paper, we aim to quantitatively compare scalable techniques for uncertainty estimation in GCNNs. We introduce a set of quantitative criteria to capture different uncertainty aspects, and then use these criteria to compare MC-Dropout, deep ensembles, and bootstrapping, both theoretically in a unified framework that separates aleatoric/epistemic uncertainty and experimentally on the QM9 dataset. Our experiments quantify the performance of the different uncertainty estimation methods and their impact on uncertainty-related error reduction. Our findings indicate that ensembling and bootstrapping consistently outperform MC-Dropout, with different context-specific pros and cons. Our analysis also leads to a better understanding of the role of aleatoric/epistemic uncertainty and highlights the challenge posed by out-of-domain uncertainty.


title: Acts: A common tracking software

abstract: The reconstruction of charged particle trajectories is one of the most complex and CPU consuming parts of event processing in high energy experiments. At future hadron colliders such as the High-Luminosity Large Hadron Collider (HL-LHC) or the Future Circular Collider (FCC), the significantly increased number of simultaneous collisions will result in a much more challenging tracking environment. Concurrent algorithms exploiting modern computing architectures with many cores and accelerators are necessary to maintain and improve the tracking performance. Based on the tracking experience at LHC, the ACTS project is an attempt to encapsulate the current ATLAS software into a experiment-independent and framework-independent software designed for modern computing architectures. It provides a set of high-level track reconstruction tools which are agnostic to the details of the detection technologies and magnetic field configuration. The software has been fully tested for thread-safety to support parallel execution of the code and its data structures are optimized for vector operations to speed up linear algebra operations.


title: Maize yield under a changing climate: The hidden role of vapor pressure deficit

abstract: Temperatures over the next century are expected to rise to levels detrimental to crop growth and yield. As the atmosphere warms without additional water vapor input, vapor pressure deficit (VPD) increases as well. Increased temperatures and accompanied elevated VPD levels can both lead to negative impacts on crop yield. The independent importance of VPD, however, is often neglected or conflated with that from temperature due to a tight correlation between the two climate factors. We used a coupled process-based crop (MAIZSIM) and soil (2DSOIL) model to gain a mechanistic understanding of the independent roles temperature and VPD play in crop yield projections, as well as their interactions with rising CO2 levels and changing precipitation patterns. We found that by separating out the VPD effect from rising temperatures, VPD increases had a greater negative impact on yield compared to that from warming. The negative impact of these two factors varied with precipitation levels and influenced yield through separate mechanisms. Warmer temperatures caused yield loss mainly through shortening the growing season, while elevated VPD increased water loss and triggered several water stress responses such as reduced photosynthetic rates, lowered leaf area development, and shortened growing season length. Elevated CO2 concentrations partially alleviated yield loss under warming or increased VPD conditions through water savings, but the impact level varied with precipitation levels and was most pronounced under drier conditions. These results demonstrate the key role VPD plays in crop growth and yield, displaying a magnitude of impact comparative to temperature and CO2. A mechanistic understanding of the function of VPD and its relation with other climate factors and management practices is critical to improving crop yield projections under a changing climate.


title: On the Dust Signatures Induced by Eccentric Super-Earths in Protoplanetary Disks

abstract: We investigate the impact of a highly eccentric 10 $M_{\rm \oplus}$ (where $M_{\rm \oplus}$ is the Earth mass) planet embedded in a dusty protoplanetary disk on the dust dynamics and its observational implications. By carrying out high-resolution 2D gas and dust two-fluid hydrodynamical simulations, we find that the planet's orbit can be circularized at large radii. After the planet's orbit is circularized, partial gap opening and dust ring formation happen close to the planet's circularization radius, which can explain the observed gaps/rings at the outer region of disks. When the disk mass and viscosity become low, we find that an eccentric planet can even open gaps and produce dust rings close to the pericenter and apocenter radii before its circularization. This offers alternative scenarios for explaining the observed dust rings and gaps in protoplanetary disks. A lower disk viscosity is favored to produce brighter rings in observations. An eccentric planet can also potentially slow down the dust radial drift in the outer region of the disk when the disk viscosity is low ($\alpha \lesssim2\times10^{-4}$) and the circularization is faster than the dust radial drift.


title: Generating valid Euclidean distance matrices

abstract: Generating point clouds, e.g., molecular structures, in arbitrary rotations, translations, and enumerations remains a challenging task. Meanwhile, neural networks utilizing symmetry invariant layers have been shown to be able to optimize their training objective in a data-efficient way. In this spirit, we present an architecture which allows to produce valid Euclidean distance matrices, which by construction are already invariant under rotation and translation of the described object. Motivated by the goal to generate molecular structures in Cartesian space, we use this architecture to construct a Wasserstein GAN utilizing a permutation invariant critic network. This makes it possible to generate molecular structures in a one-shot fashion by producing Euclidean distance matrices which have a three-dimensional embedding.


title: Tunable metasurface inverse design for 80% switching efficiencies and 144$^\circ$ angular steering

abstract: Tunable metasurfaces have demonstrated the potential for dramatically enhanced functionality for applications including sensing, ranging and imaging. Liquid crystals (LCs) have fast switching speeds, low cost, and mature technological development, offering a versatile platform for electrical tunability. However, to date, electrically tunable metasurfaces are typically designed at a single operational state using physical intuition, without controlling alternate states and thus leading to limited switching efficiencies ($<30\%$) and small angular steering ($<$25$^\circ$). Here, we use large-scale computational 'inverse design' to discover high-performance designs through adjoint-based local-optimization design iterations within a global-optimization search. We study and explain the physics of these devices, which heavily rely on sophisticated resonator design to fully utilize the very small permittivity change incurred by switching the liquid-crystal voltage. The optimal devices show tunable steering angles ranging from 12$^\circ$ to 144$^\circ$ and switching efficiencies above 80%, exhibiting 6X angular improvements and 6X efficiency improvements compared to the current state-of-the-art.


title: Time-Reversal-Invariance Violation in the $N\!d$ System and Large-$N_C$

abstract: A minimal set of five low energy constants (LECs) for time-reversal and parity violating ($\not{T}\!\!\!\not{P}$) nucleon-nucleon ($N\!N$) interactions at low energies ($E\!<\!m_{\pi}^2/M_N$) is given. Using a large-$N_C$ (number of colors in QCD) analysis we show that one linear combination of LECs is $\mathcal{O}(N_C)$, three LECs are $\mathcal{O}(N_C^{0})$, and one linear combination of LECs is $\mathcal{O}(N_C^{-1})$. We also calculate the $\not{T}\!\!\!\not{P}$ observables of neutron spin rotation through a polarized deuteron target and a spin correlation coefficient in nucleon-deuteron scattering using pionless effective field theory. Using the large-$N_C$ analysis we show that the spin correlation coefficient and the neutron spin rotation are predominantly determined by same two LECs in the large-$N_C$ basis.


title: Partial Separability and Functional Graphical Models for Multivariate Gaussian Processes

abstract: The covariance structure of multivariate functional data can be highly complex, especially if the multivariate dimension is large, making extensions of statistical methods for standard multivariate data to the functional data setting challenging. For example, Gaussian graphical models have recently been extended to the setting of multivariate functional data by applying multivariate methods to the coefficients of truncated basis expansions. However, a key difficulty compared to multivariate data is that the covariance operator is compact, and thus not invertible. The methodology in this paper addresses the general problem of covariance modeling for multivariate functional data, and functional Gaussian graphical models in particular. As a first step, a new notion of separability for the covariance operator of multivariate functional data is proposed, termed partial separability, leading to a novel Karhunen-Lo\`eve-type expansion for such data. Next, the partial separability structure is shown to be particularly useful in order to provide a well-defined functional Gaussian graphical model that can be identified with a sequence of finite-dimensional graphical models, each of identical fixed dimension. This motivates a simple and efficient estimation procedure through application of the joint graphical lasso. Empirical performance of the method for graphical model estimation is assessed through simulation and analysis of functional brain connectivity during a motor task. %Empirical performance of the method for graphical model estimation is assessed through simulation and analysis of functional brain connectivity during a motor task.


title: DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm System

abstract: Teleoperation offers the possibility of imparting robotic systems with sophisticated reasoning skills, intuition, and creativity to perform tasks. However, current teleoperation solutions for high degree-of-actuation (DoA), multi-fingered robots are generally cost-prohibitive, while low-cost offerings usually provide reduced degrees of control. Herein, a low-cost, vision based teleoperation system, DexPilot, was developed that allows for complete control over the full 23 DoA robotic system by merely observing the bare human hand. DexPilot enables operators to carry out a variety of complex manipulation tasks that go beyond simple pick-and-place operations. This allows for collection of high dimensional, multi-modality, state-action data that can be leveraged in the future to learn sensorimotor policies for challenging manipulation tasks. The system performance was measured through speed and reliability metrics across two human demonstrators on a variety of tasks. The videos of the experiments can be found at https://sites.google.com/view/dex-pilot.


title: Capturing Argument Interaction in Semantic Role Labeling with Capsule Networks

abstract: Semantic role labeling (SRL) involves extracting propositions (i.e. predicates and their typed arguments) from natural language sentences. State-of-the-art SRL models rely on powerful encoders (e.g., LSTMs) and do not model non-local interaction between arguments. We propose a new approach to modeling these interactions while maintaining efficient inference. Specifically, we use Capsule Networks: each proposition is encoded as a tuple of \textit{capsules}, one capsule per argument type (i.e. role). These tuples serve as embeddings of entire propositions. In every network layer, the capsules interact with each other and with representations of words in the sentence. Each iteration results in updated proposition embeddings and updated predictions about the SRL structure. Our model substantially outperforms the non-refinement baseline model on all 7 CoNLL-2019 languages and achieves state-of-the-art results on 5 languages (including English) for dependency SRL. We analyze the types of mistakes corrected by the refinement procedure. For example, each role is typically (but not always) filled with at most one argument. Whereas enforcing this approximate constraint is not useful with the modern SRL system, iterative procedure corrects the mistakes by capturing this intuition in a flexible and context-sensitive way.


title: Detecting AI Trojans Using Meta Neural Analysis

abstract: In machine learning Trojan attacks, an adversary trains a corrupted model that obtains good performance on normal data but behaves maliciously on data samples with certain trigger patterns. Several approaches have been proposed to detect such attacks, but they make undesirable assumptions about the attack strategies or require direct access to the trained models, which restricts their utility in practice. This paper addresses these challenges by introducing a Meta Neural Trojan Detection (MNTD) pipeline that does not make assumptions on the attack strategies and only needs black-box access to models. The strategy is to train a meta-classifier that predicts whether a given target model is Trojaned. To train the meta-model without knowledge of the attack strategy, we introduce a technique called jumbo learning that samples a set of Trojaned models following a general distribution. We then dynamically optimize a query set together with the meta-classifier to distinguish between Trojaned and benign models. We evaluate MNTD with experiments on vision, speech, tabular data and natural language text datasets, and against different Trojan attacks such as data poisoning attack, model manipulation attack, and latent attack. We show that MNTD achieves 97% detection AUC score and significantly outperforms existing detection approaches. In addition, MNTD generalizes well and achieves high detection performance against unforeseen attacks. We also propose a robust MNTD pipeline which achieves 90% detection AUC even when the attacker aims to evade the detection with full knowledge of the system.


title: Thermalization and its Breakdown for a Large Nonlinear Spin

abstract: By developing a semi-classical analysis based on the Eigenstate Thermalization Hypothesis, we determine the long time behavior of a large spin evolving with a nonlinear Hamiltonian. Despite integrable classical dynamics, we find the Eigenstate Thermalization Hypothesis for the diagonal matrix elements of observables is satisfied in the majority of eigenstates, and thermalization of long time averaged observables is generic. The exception is a novel mechanism for the breakdown of thermalization based on an unstable fixed point in the classical dynamics. Using the semi-classical analysis we derive how the equilibrium values of observables encode properties of the initial state. This analysis shows an unusual memory effect in which the remembered initial state property is not conserved in the integrable classical dynamics. We conclude with a discussion of relevant experiments and the potential generality of this mechanism for long time memory and the breakdown of thermalization.


title: Voice Packet Performance Estimation through Step Network Using OPNET

abstract: VoIP transfer voice over networks such as LAN. This technology is growing rapidly due to support of existing network infrastructure at low cost. Various simulations have been done and it is observed that by increasing the VoIP client, packet length and traffic arrival rate the performance of step network affected. In the current work packet dropped, packet received, voice traffic sent and end-to-end delay is estimated for various queuing disciplines like PQ, FIFO and WFQ. It is depicted that queuing disciplines effects the applications performance and utilization of resources.


title: On Thermodynamic and Ultraviolet Stability of Bosonic Lattice QCD Models in Euclidean Spacetime Dimensions $d=2,3,4$

abstract: We prove stability bounds for local gauge-invariant scalar QCD quantum models, with multiflavored bosons replacing (anti)quarks. We take a compact, connected gauge Lie group G, and concentrate on G=U(N),SU(N). Let d(N)=N^2,(N^2-1) be their Lie algebra dimensions. We start on a finite hypercubic lattice \Lambda\subset aZ^d, d=2,3,4, a\in(0,1], with L sites on a side, \Lambda_s=L^d sites, and free boundary conditions. The action is a sum of a Bose-gauge part and a Wilson pure-gauge plaquette term. We employ a priori local, scaled scalar bosons with an a-dependent field-strength renormalization: a non-canonical scaling. The Wilson action is a sum over pointwise positive plaquette actions with a pre-factor (a^{d-4}/g^2), and gauge coupling $0<g^2\leq g_0^2<\infty$. Sometimes we use an enhanced temporal gauge. Here, there are \Lambda_r\simeq (d-1)\Lambda_s retained bond variables. The unscaled partition function is $Z^u_{\Lambda,a}\equiv Z^u_{\Lambda,a,\kappa_u^2,m_u,g^2,d}$, where $\kappa_u^2>0$ is the unscaled hopping parameter and m_u are the boson bare masses. Letting $s_B\equiv [a^{d-2}(m_u^2a^2+2d\kappa_u^2)]^{1/2}$, $s_Y\equiv a^{(d-4)/2}/g$, we show that the scaled partition function $Z_{\Lambda,a}=s_B^{N\Lambda_s}s_Y^{d(N)\Lambda_r} Z^u_{\Lambda,a}$ satisfies the stability bounds $e^{c_\ell d(N)\Lambda_s}\leq Z_{\Lambda,a}\leq e^{c_ud(N)\Lambda_s}$ with finite real $c_\ell, c_u$ independent of $L$ and the spacing $a$. We have extracted in $Z^u_{\Lambda,a}$ the dependence on \Lambda and the exact singular behavior of the finite lattice free energy in the continuum limit $a\searrow 0$. For the normalized finite-lattice free energy $f_\Lambda^n=[d(N)\Lambda_s]^{-1}\ln Z_{\Lambda,a}$, we prove the existence of (at least, subsequentials) a thermodynamic limit for f_\Lambda^n and, next, of a continuum limit.


title: The Possible Effects of Personal Income Tax and Value Added Tax on Consumer Behaviors

abstract: In economics literature, it is accepted that all people are rational and they try to maximize their utilities as possible as they can. In addition, economic theories are formed with the assumptions not suitable to real life. For instance, indifference curves are drawn with the assumptions that there are two goods, people are rational, more is preferred to less and so on. Hence, the consumer behaviors are guessed according to this analysis. Nevertheless, these are invalid in real life. And this inconsistencey are examined by behavioral economics and neuroeconomics. Behavioral economics claims that people can behave what they are not expected since people can be irrational, their willpower is limited and altruistic behaviors can be seen and they can give more value to what they own. As a result of these, consumer behaviors become more different than that of economic theory. In addition to behavioral economics, neuroeconomics also examines consumer behaviors more differently than mainstream economic theory. It emphasizes the people using prefrontial cortex of the brain are more rational than the people using hippocampus of the brain. Therefore, people can make illogical choices compared to economic theory. In these cases, levying taxes such as personal income tax or value added tax can be ineffective or effective. In other words, the effect becomes ambigious. Hence,the hypothesis that if government desires to levy personal income tax or value added tax, it makes a detailed research in terms of productivity of taxes forms the fundamental of this study.


title: Asymptotic Analysis of the Elephant Random Walk

abstract: In this work we study asymptotic properties of a long range memory random walk known as elephant random walk. First we prove recurrence and positive recurrence for the elephant random walk. Then, we establish the transience regime of the model. Finally, under the Poisson Hypothesis, we study the replica mean field limit for this random walk and we obtain an upper bound for the expected distance of the walker from the origin.


title: On Polyhedral and Second-Order Cone Decompositions of Semidefinite Optimization Problems

abstract: We study a cutting-plane method for semidefinite optimization problems (SDOs), and supply a proof of the method's convergence, under a boundedness assumption. By relating the method's rate of convergence to an initial outer approximation's diameter, we argue that the method performs well when initialized with a second-order-cone approximation, instead of a linear approximation. We invoke the method to provide bound gaps of 0.5-6.5% for sparse PCA problems with $1000$s of covariates, and solve nuclear norm problems over 500x500 matrices.


title: Tactical Reward Shaping: Bypassing Reinforcement Learning with Strategy-Based Goals

abstract: Deep Reinforcement Learning (DRL) has shown its promising capabilities to learn optimal policies directly from trial and error. However, learning can be hindered if the goal of the learning, defined by the reward function, is "not optimal". We demonstrate that by setting the goal/target of competition in a counter-intuitive but intelligent way, instead of heuristically trying solutions through many hours the DRL simulation can quickly converge into a winning strategy. The ICRA-DJI RoboMaster AI Challenge is a game of cooperation and competition between robots in a partially observable environment, quite similar to the Counter-Strike game. Unlike the traditional approach to games, where the reward is given at winning the match or hitting the enemy, our DRL algorithm rewards our robots when in a geometric-strategic advantage, which implicitly increases the winning chances. Furthermore, we use Deep Q Learning (DQL) to generate multi-agent paths for moving, which improves the cooperation between two robots by avoiding the collision. Finally, we implement a variant A* algorithm with the same implicit geometric goal as DQL and compare results. We conclude that a well-set goal can put in question the need for learning algorithms, with geometric-based searches outperforming DQL in many orders of magnitude.


title: A generalized variational principle with applications to excited state mean field theory

abstract: We present a generalization of the variational principle that is compatible with any Hamiltonian eigenstate that can be specified uniquely by a list of properties. This variational principle appears to be compatible with a wide range of electronic structure methods, including mean-field theory, density functional theory, multi-reference theory, and quantum Monte Carlo. Like the standard variational principle, this generalized variational principle amounts to the optimization of a nonlinear function that, in the limit of an arbitrarily flexible wave function, has the desired Hamiltonian eigenstate as its global minimum. Unlike the standard variational principle, it can target excited states and select individual states in cases of degeneracy or near-degeneracy. As an initial demonstration of how this approach can be useful in practice, we employ it to improve the optimization efficiency of excited state mean field theory by an order of magnitude. With this improved optimization, we are able to demonstrate that the accuracy of the corresponding second-order perturbation theory rivals that of singles-and-doubles equation-of-motion coupled cluster in a substantially broader set of molecules than could be explored by our previous optimization methodology.


title: Artin-Schreier Root Stacks

abstract: We classify stacky curves in characteristic $p > 0$ with cyclic stabilizers of order $p$ using higher ramification data. This approach replaces the local root stack structure of a tame stacky curve, similar to the local structure of a complex orbifold curve, with a more sensitive structure called an Artin-Schreier root stack, allowing us to incorporate this ramification data directly into the stack. As an application, we compute dimensions of Riemann-Roch spaces for some examples of stacky curves in positive characteristic and suggest a program for computing spaces of modular forms in this setting.


title: Vanishing theorems for the mod $p$ cohomology of some simple Shimura varieties

abstract: We show that the mod $p$ cohomology of a simple Shimura variety treated in Harris-Taylor's book vanishes outside a certain nontrivial range after localizing at any non-Eisenstein ideal of the Hecke algebra. In cases of low dimensions, we show the vanishing outside the middle degree.


title: Height estimates for Bianchi groups

abstract: We study the action of Bianchi groups on the hyperbolic $3$-space $\mathbb{H}^3$. Given the standard fundamental domain for this action and any point in $\mathbb{H}^3,$ we show that there exists an element in the group which sends the given point into the fundamental domain such that its height is bounded by a quadratic function on the coordinates of the point. This generalizes and establishes a sharp version of a similar result of Habegger and Pila for the action of the Modular group on the hyperbolic plane. Our main theorem can be applied in the reduction theory of binary Hermitian forms with entries in the ring of integers of quadratic imaginary fields. We also show that the asymptotic behavior of the number of elements in a fixed Bianchi group with height at most $T$ is biquadratic in $T$.


title: Tunable Multifocal THz Metalens Based on Metal-Insulator Transition of VO2 Film

abstract: Recently, metalenses which consist of metasurface arrays, have attracted attention due to their more condensed size in comparison with conventional lenses. In this paper, we propose a reconfigurable coding metasurface hybridized with vanadium dioxide (VO2) for wavefront manipulation at terahertz (THz) frequencies. At room temperature, the unit-cell can reflect as a "1" bit under linearly y polarized illuminated waves. Besides, when the temperature is increased, VO2 would be in a fully metallic state; therefore, unit-cell can act as a "0" reflection phase. Furthermore, by changing the unit-cells arrangements on a metalens surface, the proposed device can focus the incident beam at any position according to a particular design. Numerical simulations demonstrate that the designed VO2-assisted metasurface can generate one and multi-focal spot in reflection mode as expected. Also, theoretical results depict an excellent agreement with obtained simulation results. The presented metalens has notable potential in THz high-resolution imaging and optical coding.


title: Hirota Quadratic Equations for the Gromov--Witten Invariants of $\mathbb{P}_{n-2,2,2}^1$

abstract: Fano orbifold lines are classified by the Dynkin diagrams of type $A,D,$ and $E$. It is known that the corresponding total descendant potential is a tau-function of an appropriate Kac--Wakimoto hierarchy. It is also known that in the A-case the Kac--Wakimoto hierarchies admit an extension and that the total descendant potential is a tau-function of an extended Kac--Wakimoto hierarchy. The goal of this paper is to prove that in the D-case the total descendent potential is also a tau-function of an extended Kac--Wakimoto hierarchy.


title: ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks

abstract: Recently, channel attention mechanism has demonstrated to offer great potential in improving the performance of deep convolutional neural networks (CNNs). However, most existing methods dedicate to developing more sophisticated attention modules for achieving better performance, which inevitably increase model complexity. To overcome the paradox of performance and complexity trade-off, this paper proposes an Efficient Channel Attention (ECA) module, which only involves a handful of parameters while bringing clear performance gain. By dissecting the channel attention module in SENet, we empirically show avoiding dimensionality reduction is important for learning channel attention, and appropriate cross-channel interaction can preserve performance while significantly decreasing model complexity. Therefore, we propose a local cross-channel interaction strategy without dimensionality reduction, which can be efficiently implemented via $1D$ convolution. Furthermore, we develop a method to adaptively select kernel size of $1D$ convolution, determining coverage of local cross-channel interaction. The proposed ECA module is efficient yet effective, e.g., the parameters and computations of our modules against backbone of ResNet50 are 80 vs. 24.37M and 4.7e-4 GFLOPs vs. 3.86 GFLOPs, respectively, and the performance boost is more than 2% in terms of Top-1 accuracy. We extensively evaluate our ECA module on image classification, object detection and instance segmentation with backbones of ResNets and MobileNetV2. The experimental results show our module is more efficient while performing favorably against its counterparts.


title: GetNet: Get Target Area for Image Pairing

abstract: Image pairing is an important research task in the field of computer vision. And finding image pairs containing objects of the same category is the basis of many tasks such as tracking and person re-identification, etc., and it is also the focus of our research. Existing traditional methods and deep learning-based methods have some degree of defects in speed or accuracy. In this paper, we made improvements on the Siamese network and proposed GetNet. The proposed method GetNet combines STN and Siamese network to get the target area first and then perform subsequent processing. Experiments show that our method achieves competitive results in speed and accuracy.


title: High-redshift 21cm Cosmology in Canada

abstract: In the next few years, the 21cm line will enable direct observations of the Dark Ages, Cosmic Dawn, and Reionization, which represent previously unexplored periods in our cosmic history. With a combination of sky-averaged global signal measurements and spatial mapping surveys, the possible science return is enormous. This potentially includes (but is not limited to) constraints on first-generation galaxies (such as their typical masses and luminosities), constraints on cosmological parameters, a measurement of the Hubble parameter at z~15 to 20, the elimination of the optical depth nuisance parameter in the CMB, and searches for exotic phenomena such as baryon-dark matter couplings. To enable continued Canadian leadership in these science opportunities, we recommend 1) continued investments in 21cm experiments at all redshifts, 2) detailed analysis efforts of current data to overcome systematic effects, 3) new investments in preliminary experiments to explore the truly low-frequency sky as a stepping stone towards the Dark Ages, 4) new investments in line-intensity mapping experiments beyond the 21cm line, 5) continued theory support for 21cm cosmology, and 6) continued participation and knowledge transfer to next-generation international efforts such as the Square Kilometre Array.


title: On some combinatorial properties of generalized cluster algebras

abstract: In this paper, we prove some combinatorial results on generalized cluster algebras. To be more precisely, we prove that (i) the seeds of a generalized cluster algebra $\mathcal A(\mathcal S)$ whose clusters contain particular cluster variables form a connected subgraph of the exchange graph of $\mathcal A(\mathcal S)$; (ii) there exists a bijection from the set of cluster variables of a generalized cluster algebra to the set of cluster variables of another generalized cluster algebra, if their initial exchange matrices satisfying a mild condition. Moreover, this bijection preserves the set of clusters of these two generalized cluster algebras. As applications of the second result, we prove some properties of the components of the $d$-vectors of a generalized cluster algebra and we give a characterization for the clusters of a generalized cluster algebra.


title: Sample Elicitation

abstract: It is important to collect credible training samples $(x,y)$ for building data-intensive learning systems (e.g., a deep learning system). Asking people to report complex distribution $p(x)$, though theoretically viable, is challenging in practice. This is primarily due to the cognitive loads required for human agents to form the report of this highly complicated information. While classical elicitation mechanisms apply to eliciting a complex and generative (and continuous) distribution $p(x)$, we are interested in eliciting samples $x_i \sim p(x)$ from agents directly. We coin the above problem "sample elicitation". This paper introduces a deep learning aided method to incentivize credible sample contributions from self-interested and rational agents. We show that with an accurate estimation of a certain $f$-divergence function we can achieve approximate incentive compatibility in eliciting truthful samples. We then present an efficient estimator with theoretical guarantees via studying the variational forms of the $f$-divergence function. We also show a connection between this sample elicitation problem and $f$-GAN, and how this connection can help reconstruct an estimator of the distribution based on collected samples. Experiments on synthetic data, MNIST, and CIFAR-10 datasets demonstrate that our mechanism elicits truthful samples. Our implementation is available at https://github.com/weijiaheng/Credible-sample-elicitation.git.


title: Software Engineering Practice in the Development of Deep Learning Applications

abstract: Deep-Learning(DL) applications have been widely employed to assist in various tasks. They are constructed based on a data-driven programming paradigm that is different from conventional software applications. Given the increasing popularity and importance of DL applications, software engineering practitioners have some techniques specifically for them. However, little research is conducted to identify the challenges and lacks in practice. To fill this gap, in this paper, we surveyed 195 practitioners to understand their insight and experience in the software engineering practice of DL applications. Specifically, we asked the respondents to identify lacks and challenges in the practice of the development life cycle of DL applications. The results present 13 findings that provide us with a better understanding of software engineering practice of DL applications. Further, we distil these findings into 7 actionable recommendations for software engineering researchers and practitioners to improve the development of DL applications.


title: Model-based Behavioral Cloning with Future Image Similarity Learning

abstract: We present a visual imitation learning framework that enables learning of robot action policies solely based on expert samples without any robot trials. Robot exploration and on-policy trials in a real-world environment could often be expensive/dangerous. We present a new approach to address this problem by learning a future scene prediction model solely on a collection of expert trajectories consisting of unlabeled example videos and actions, and by enabling generalized action cloning using future image similarity. The robot learns to visually predict the consequences of taking an action, and obtains the policy by evaluating how similar the predicted future image is to an expert image. We develop a stochastic action-conditioned convolutional autoencoder, and present how we take advantage of future images for robot learning. We conduct experiments in simulated and real-life environments using a ground mobility robot with and without obstacles, and compare our models to multiple baseline methods.


title: Dynamics of several rigid bodies in a two-dimensional ideal fluid and convergence to vortex systems

abstract: We consider the motion of several solids in a bounded cavity filled with a perfect incompressible fluid, in two dimensions. The solids move according to Newton's law, under the influence of the fluid's pressure, and the fluid dynamics is driven by the 2D incompressible Euler equations, which are set on the time-dependent domain corresponding to the cavity deprived of the sets occupied by the solids. We assume that the fluid vorticity is initially bounded and that the circulations around the solids may be non-zero. The existence of a unique corresponding solution, \`a la Yudovich, to this system, up to a possible collision, is known. In this paper we identify the limit dynamics of the system when the radius of some of the solids converge to zero depending on how, for each body, the inertia is scaled with the radius. We obtain in the limit some point vortex systems for the solids converging to particles and a form of Newton's law for the solids that have a fixed radius; for the fluid we obtain an Euler-type system. This extends earlier works to the case of several moving rigid bodies. A crucial point is to understand the interaction, through the fluid, between small moving solids, and for that we use some normal forms of the ODEs driving the motion of the solids in two steps: first we use a normal form for the system coupling the time-evolution of all the solids to obtain a rough estimate of the acceleration of the bodies, then we turn to some normal forms that are specific to each small solid, with an appropriate modulation related to the influence of the other solids and of the fluid vorticity, to obtain some precise uniform a priori estimates of the velocities of the bodies, and then pass to the limit.


title: xYOLO: A Model For Real-Time Object Detection In Humanoid Soccer On Low-End Hardware

abstract: With the emergence of onboard vision processing for areas such as the internet of things (IoT), edge computing and autonomous robots, there is increasing demand for computationally efficient convolutional neural network (CNN) models to perform real-time object detection on resource constraints hardware devices. Tiny-YOLO is generally considered as one of the faster object detectors for low-end devices and is the basis for our work. Our experiments on this network have shown that Tiny-YOLO can achieve 0.14 frames per second(FPS) on the Raspberry Pi 3 B, which is too slow for soccer playing autonomous humanoid robots detecting goal and ball objects. In this paper we propose an adaptation to the YOLO CNN model named xYOLO, that can achieve object detection at a speed of 9.66 FPS on the Raspberry Pi 3 B. This is achieved by trading an acceptable amount of accuracy, making the network approximately 70 times faster than Tiny-YOLO. Greater inference speed-ups were also achieved on a desktop CPU and GPU. Additionally we contribute an annotated Darknet dataset for goal and ball detection.


title: Extraction of the CKM phase $\gamma$ from charmless two-body B meson decays

abstract: Utilizing all the experimental measured charmless $B \to PP$, $PV$ decay modes, where $P(V)$ denotes a light pseudoscalar (vector) meson, we extract the CKM angle $\gamma$ by global fit. All the unknown hadronic parameters are fitted with $\gamma$ together from experimental data, so as to make the approach least model dependent. The different contributions for various decay modes are classified by topological weak Feynman diagram amplitudes, which are to be determined by the global fit. To improve the precision of this approach, we consider flavor SU(3) breaking effects of topological diagram amplitudes among different decay modes by including the form factors and decay constants. The fitted result for CKM angle $\gamma$ is $(69.8 \pm 2.1 \pm 0.9) ^{\degree}$. It is consistent with the current world average with a better precision.


title: Computing oscillatory solutions of the Euler system via $\mathcal{K}$-convergence

abstract: We develop a method to compute effectively the Young measures associated to sequences of numerical solutions of the compressible Euler system. Our approach is based on the concept of $\mathcal{K}$-convergence adapted to sequences of parametrized measures. The convergence is strong in space and time (a.e.~pointwise or in certain $L^q$ spaces) whereas the measures converge narrowly or in the Wasserstein distance to the corresponding limit.


title: A Physics-Based Attack Detection Technique in Cyber-Physical Systems: A Model Predictive Control Co-Design Approach

abstract: In this paper a novel approach to co-design controller and attack detector for nonlinear cyber-physical systems affected by false data injection (FDI) attack is proposed. We augment the model predictive controller with an additional constraint requiring the future---in some steps ahead---trajectory of the system to remain in some time-invariant neighborhood of a properly designed reference trajectory. At any sampling time, we compare the real-time trajectory of the system with the designed reference trajectory, and construct a residual. The residual is then used in a nonparametric cumulative sum (CUSUM) anomaly detector to uncover FDI attacks on input and measurement channels. The effectiveness of the proposed approach is tested with a nonlinear model regarding level control of coupled tanks.


title: Triangle decompositions of $\lambda K_v-\lambda K_w-\lambda K_u$

abstract: Denote by $\lambda K_v$ the complete graph of order $v$ with multiplicity $\lambda$. Let $\lambda K_v-\lambda K_w-\lambda K_u$ be the graph obtained from $\lambda K_v$ by the removal of the edges of two vertex disjoint complete multi-subgraphs with multiplicity $ \lambda $ of orders $ w $ and $ u $, respectively. When $\lambda$ is odd, it is shown that there exists a triangle decomposition of $\lambda K_v-\lambda K_w-\lambda K_u$ if and only if $v\geq w+u+\max\{u,w\}$, $ \lambda \left({v\choose 2}-{u\choose 2}-{w\choose 2}\right) \equiv 0 \pmod 3$ and $\lambda (v-w) \equiv \lambda (v-u) \equiv \lambda (v-1) \equiv 0 \pmod 2$. When $\lambda$ is even, it is shown that for large enough $v$, the elementary necessary conditions for the existence of a triangle decomposition of $\lambda K_v-\lambda K_w-\lambda K_u$ are also sufficient.


title: Potential automorphy of $\mathrm{GSpin}_{2n+1}$-valued Galois representations

abstract: We prove a potentially automorphy theorem for suitable Galois representations $\Gamma_{F^+} \to \mathrm{GSpin}_{2n+1}(\overline{\mathbb{F}}_p)$ and $\Gamma_{F^+} \to \mathrm{GSpin}_{2n+1}(\overline{\mathbb{Q}}_p)$, where $\Gamma_{F^+}$ is the absolute Galois group of a totally real field $F^+$. We also prove results on solvable descent for $\mathrm{GSp}_{2n}(\mathbb{A}_{F^+})$ and use these to put representations $\Gamma_{F^+} \to \mathrm{GSpin}_{2n+1}(\overline{\mathbb{Q}}_p)$ into compatible systems of $\mathrm{GSpin}_{2n+1}(\overline{\mathbb{Q}}_{\ell})$-valued representations.


title: Testing for calibration systematics in the EDGES low-band data using Bayesian model selection

abstract: Cosmic Dawn, when the first stars and proto-galaxies began to form, is commonly expected to be accompanied by an absorption signature at radio frequencies. This feature arises as Lyman-$\alpha$ photons emitted by these first luminous objects couple the 21 cm excitation temperature of intergalactic hydrogen gas to its kinetic temperature, driving it into absorption relative to the CMB. The detailed properties of this absorption profile encode powerful information about the physics of Cosmic Dawn. Recently, Bowman et al. analysed data from the EDGES low-band radio antenna and found an unexpectedly deep absorption profile centred at 78 MHz, which could be a detection of this signature. Their specific analysis fit their measurements using a polynomial foreground model, a flattened Gaussian absorption profile and a white noise model; we argue that a more accurate model, that includes a detailed noise model and accounting for the effects of plausible calibration errors, is essential for describing the EDGES data set. We perform a Bayesian evidence-based comparison of models of the EDGES low-band data set and find that those incorporating these additional components are decisively preferred. The subset of the best fitting models of the data that include a global signal favour an amplitude consistent with standard cosmological assumptions (A < 209 mK). However, there is not strong evidence to favour models of the data including a global 21 cm signal over those without one. Ultimately, we find that the derivation of robust constraints on astrophysics from the data is limited by the presence of systematics.


title: Deep Multiphase Level Set for Scene Parsing

abstract: Recently, Fully Convolutional Network (FCN) seems to be the go-to architecture for image segmentation, including semantic scene parsing. However, it is difficult for a generic FCN to discriminate pixels around the object boundaries, thus FCN based methods may output parsing results with inaccurate boundaries. Meanwhile, level set based active contours are superior to the boundary estimation due to the sub-pixel accuracy that they achieve. However, they are quite sensitive to initial settings. To address these limitations, in this paper we propose a novel Deep Multiphase Level Set (DMLS) method for semantic scene parsing, which efficiently incorporates multiphase level sets into deep neural networks. The proposed method consists of three modules, i.e., recurrent FCNs, adaptive multiphase level set, and deeply supervised learning. More specifically, recurrent FCNs learn multi-level representations of input images with different contexts. Adaptive multiphase level set drives the discriminative contour for each semantic class, which makes use of the advantages of both global and local information. In each time-step of the recurrent FCNs, deeply supervised learning is incorporated for model training. Extensive experiments on three public benchmarks have shown that our proposed method achieves new state-of-the-art performances.


title: On mixed graphs whose Hermitian spectral radii are at most 2

abstract: A mixed graph is a graph with undirected and directed edges. Guo and Mohar in 2017 determined all mixed graphs whose Hermitian spectral radii are less than $2$. In this paper, we give a sufficient condition which can make Hermitian spectral radius of a connected mixed graph strictly decreasing when an edge or a vertex is deleted, and characterize all mixed graphs with Hermitian spectral radii at most $2$ and with no cycle of length $4$ in their underlying graphs.


title: The Triplet Resonating Valence Bond State and Superconductivity in Hund's Metals

abstract: A central idea in strongly correlated systems is that doping a Mott insulator leads to a superconductor by transforming the resonating valence bonds (RVBs) into spin-singlet Cooper pairs. Here, we argue that a spin-triplet RVB (tRVB) state, driven by spatially, or orbitally anisotropic ferromagnetic interactions can provide the parent state for triplet superconductivity. We apply this idea to the iron-based superconductors, arguing that strong onsite Hund's interactions develop intra-atomic tRVBs between the t$_{2g}$ orbitals. On doping, the presence of two iron atoms per unit cell allows these inter-orbital triplets to coherently delocalize onto the Fermi surface, forming a fully gapped triplet superconductor. This mechanism gives rise to a unique staggered structure of onsite pair correlations, detectable as an alternating $\pi$ phase shift in a scanning tunnelling Josephson microscope.


title: Semi-Analytical Model for Design and Analysis of On-Orbit Servicing Architecture

abstract: Robotic on-orbit servicing (OOS) is expected to be a key technology and concept for future sustainable space exploration. This paper develops a semi-analytical model for OOS systems analysis, responding to the growing needs and ongoing trend of robotic OOS. An OOS infrastructure system is considered whose goal is to provide responsive services to the random failures of a set of customer modular satellites distributed in space (e.g., at the geosynchronous equatorial orbit). The considered OOS architecture is comprised of a servicer that travels and provides module-replacement services to the customer satellites, an on-orbit depot to store the spares, and a series of launch vehicles to replenish the depot. The OOS system performance is analyzed by evaluating the mean waiting time before service completion for a given failure and its relationship with the depot capacity. Leveraging the queueing theory and inventory management methods, the developed semi-analytical model is capable of analyzing the OOS system performance without relying on computationally costly simulations. The effectiveness of the proposed model is demonstrated using a case study compared with simulation results. This paper is expected to provide a critical step to push the research frontier of analytical/semi-analytical models development for complex space systems design.


title: A thermal bonding method for manufacturing Micromegas detectors

abstract: For manufacturing Micromegas detectors, the "bulk" method based on photoetching, was successfully developed and widely used in nuclear and particle physics experiments. However, the complexity of the method requires a considerable number of advanced instruments and processing, limiting the accessibility of this method for production of Micromegas detectors. In view of these limitations with the bulk method, a new method based on thermal bonding technique (TBM) has been developed to manufacture Micromegas detectors in a much simplified and efficient way without etching. This paper describes the TBM in detail and presents performance of the Micromegas detectors built with the TBM. The effectiveness of this method was investigated by testing Micromegas detector prototypes built with the method. Both X-rays and electron beams were used to characterize the prototypes in a gas mixture of argon and CO2 (7%). A typical energy resolution of ~16% (full width at half maximum, FWHM) and an absolute gain greater than 10^4 were obtained with 5.9 keV X-rays. Detection efficiency greater than 98% and a spatial resolution of ~65 {\mu}m were achieved using a 5 GeV electron beam at the DESY test-beam facility. The gas gain of a Micromegas detector could reach up to 10^5 with a uniformity of better than 10% when the size of the avalanche gap was optimized thanks to the flexibility of the TBM in defining the gap. Additionally, the TBM facilitates the exploration of new detector structures based on Micromegas owing to the much-simplified operation with the method.


title: Insider Threat Detection via Hierarchical Neural Temporal Point Processes

abstract: Insiders usually cause significant losses to organizations and are hard to detect. Currently, various approaches have been proposed to achieve insider threat detection based on analyzing the audit data that record information of the employee's activity type and time. However, the existing approaches usually focus on modeling the users' activity types but do not consider the activity time information. In this paper, we propose a hierarchical neural temporal point process model by combining the temporal point processes and recurrent neural networks for insider threat detection. Our model is capable of capturing a general nonlinear dependency over the history of all activities by the two-level structure that effectively models activity times, activity types, session durations, and session intervals information. Experimental results on two datasets demonstrate that our model outperforms the models that only consider information of the activity types or time alone.


title: Prediction of the evolution of the stress field of polycrystals undergoing elastic-plastic deformation with a hybrid neural network model

abstract: Crystal plasticity theory is often employed to predict the mesoscopic states of polycrystalline metals, and is well-known to be costly to simulate. Using a neural network with convolutional layers encoding correlations in time and space, we were able to predict the evolution of the stress field given only the initial microstructure and external loading. In comparison to our recent work we were able to predict not only the spatial average of the stress response but the field itself. We show that the stress fields and their rates are in high fidelity with the crystal plasticity data and have no visible artifacts. Furthermore the distribution stress throughout the elastic to fully plastic transition match the truth provided by held out crystal plasticity data. Lastly we demonstrate the efficacy of the trained model in material characterization and optimization tasks.


title: Constant speed penetration into granular materials: drag forces from the quasistatic to inertial regime

abstract: Predicting the force exerted on an object as it penetrates a granular medium is of interest in engineering, locomotive, and geotechnical applications. Current models of granular drag, however, vary widely in applicability and parameterization, and the physical origin of the granular resistive force itself is a subject of debate. Here we perform constant speed penetration experiments, combined with calibrated, large-scale molecular dynamics simulations, at velocities up to 2 m/s to test the effect of impact velocity on the depth dependent `hydrostatic' drag force. We discover that the evolution of the granular flow field around an intruder regulates the presence of depth dependent drag forces. In addition, we find that the observed linear depth dependence is commensurate with the mass of flowing grains. These results suggest that, as the impact speed increases beyond the quasistatic regime, the depth dependent drag term becomes intertwined with inertial effects.


title: Transition Fronts of Fisher-KPP Equations in Locally Spatially Inhomogeneous Patchy Environments I: Existence and Non-existence

abstract: This paper is devoted to the study of spatial propagation dynamics of species in locally spatially inhomogeneous patchy environments or media. For a lattice differential equation with monostable nonlinearity in a discrete homogeneous media, it is well-known that there exists a minimal wave speed such that a traveling front exists if and only if the wave speed is not slower than this minimal wave speed. We shall show that strongly localized spatial inhomogeneous patchy environments may prevent the existence of transition fronts (generalized traveling fronts). Transition fronts may exist in weakly localized spatial inhomogeneous patchy environments but only in a finite range of speeds, which implies that it is plausible to obtain a maximal wave speed of existence of transition fronts.


title: MIM: Mutual Information Machine

abstract: We introduce the Mutual Information Machine (MIM), a probabilistic auto-encoder for learning joint distributions over observations and latent variables. MIM reflects three design principles: 1) low divergence, to encourage the encoder and decoder to learn consistent factorizations of the same underlying distribution; 2) high mutual information, to encourage an informative relation between data and latent variables; and 3) low marginal entropy, or compression, which tends to encourage clustered latent representations. We show that a combination of the Jensen-Shannon divergence and the joint entropy of the encoding and decoding distributions satisfies these criteria, and admits a tractable cross-entropy bound that can be optimized directly with Monte Carlo and stochastic gradient descent. We contrast MIM learning with maximum likelihood and VAEs. Experiments show that MIM learns representations with high mutual information, consistent encoding and decoding distributions, effective latent clustering, and data log likelihood comparable to VAE, while avoiding posterior collapse.


title: SesameBERT: Attention for Anywhere

abstract: Fine-tuning with pre-trained models has achieved exceptional results for many language tasks. In this study, we focused on one such self-attention network model, namely BERT, which has performed well in terms of stacking layers across diverse language-understanding benchmarks. However, in many downstream tasks, information between layers is ignored by BERT for fine-tuning. In addition, although self-attention networks are well-known for their ability to capture global dependencies, room for improvement remains in terms of emphasizing the importance of local contexts. In light of these advantages and disadvantages, this paper proposes SesameBERT, a generalized fine-tuning method that (1) enables the extraction of global information among all layers through Squeeze and Excitation and (2) enriches local information by capturing neighboring contexts via Gaussian blurring. Furthermore, we demonstrated the effectiveness of our approach in the HANS dataset, which is used to determine whether models have adopted shallow heuristics instead of learning underlying generalizations. The experiments revealed that SesameBERT outperformed BERT with respect to GLUE benchmark and the HANS evaluation set.


title: Read, Highlight and Summarize: A Hierarchical Neural Semantic Encoder-based Approach

abstract: Traditional sequence-to-sequence (seq2seq) models and other variations of the attention-mechanism such as hierarchical attention have been applied to the text summarization problem. Though there is a hierarchy in the way humans use language by forming paragraphs from sentences and sentences from words, hierarchical models have usually not worked that much better than their traditional seq2seq counterparts. This effect is mainly because either the hierarchical attention mechanisms are too sparse using hard attention or noisy using soft attention. In this paper, we propose a method based on extracting the highlights of a document; a key concept that is conveyed in a few sentences. In a typical text summarization dataset consisting of documents that are 800 tokens in length (average), capturing long-term dependencies is very important, e.g., the last sentence can be grouped with the first sentence of a document to form a summary. LSTMs (Long Short-Term Memory) proved useful for machine translation. However, they often fail to capture long-term dependencies while modeling long sequences. To address these issues, we have adapted Neural Semantic Encoders (NSE) to text summarization, a class of memory-augmented neural networks by improving its functionalities and proposed a novel hierarchical NSE that outperforms similar previous models significantly. The quality of summarization was improved by augmenting linguistic factors, namely lemma, and Part-of-Speech (PoS) tags, to each word in the dataset for improved vocabulary coverage and generalization. The hierarchical NSE model on factored dataset outperformed the state-of-the-art by nearly 4 ROUGE points. We further designed and used the first GPU-based self-critical Reinforcement Learning model.


title: Extension theory for braided-enriched fusion categories

abstract: For a braided fusion category $\mathcal{V}$, a $\mathcal{V}$-fusion category is a fusion category $\mathcal{C}$ equipped with a braided monoidal functor $\mathcal{F}:\mathcal{V} \to Z(\mathcal{C})$. Given a fixed $\mathcal{V}$-fusion category $(\mathcal{C}, \mathcal{F})$ and a fixed $G$-graded extension $\mathcal{C}\subseteq \mathcal{D}$ as an ordinary fusion category, we characterize the enrichments $\widetilde{\mathcal{F}}:\mathcal{V} \to Z(\mathcal{D})$ of $\mathcal{D}$ which are compatible with the enrichment of $\mathcal{C}$. We show that G-crossed extensions of a braided fusion category $\mathcal{C}$ are G-extensions of the canonical enrichment of $\mathcal{C}$ over itself. As an application, we parameterize the set of $G$-crossed braidings on a fixed $G$-graded fusion category in terms of certain subcategories of its center, extending Nikshych's classification of the braidings on a fusion category.