title: Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning

abstract: Isaac Gym offers a high performance learning platform to train policies for wide variety of robotics tasks directly on GPU. Both physics simulation and the neural network policy training reside on GPU and communicate by directly passing data from physics buffers to PyTorch tensors without ever going through any CPU bottlenecks. This leads to blazing fast training times for complex robotics tasks on a single GPU with 2-3 orders of magnitude improvements compared to conventional RL training that uses a CPU based simulator and GPU for neural networks. We host the results and videos at \url{https://sites.google.com/view/isaacgym-nvidia} and isaac gym can be downloaded at \url{https://developer.nvidia.com/isaac-gym}.


title: A near-ideal degenerate parametric amplifier

abstract: Degenerate parametric amplifiers (DPAs) exhibit the unique property of phase-sensitive gain and can be used to noiselessly amplify small signals or squeeze field fluctuations beneath the vacuum level. In the microwave domain, these amplifiers have been utilized to measure qubits in elementary quantum processors, search for dark matter, facilitate high-sensitivity spin resonance spectroscopy and have even been proposed as the building blocks for a measurement based quantum computer. Until now, microwave DPAs have almost exclusively been made from nonlinear Josephson junctions, which exhibit high-order nonlinearities that limit their dynamic range and squeezing potential. In this work we investigate a new microwave DPA that exploits a nonlinearity engineered from kinetic inductance. The device has a simple design and displays a dynamic range that is four orders of magnitude greater than state-of-the-art Josephson DPAs. We measure phase sensitive gains up to 50 dB and demonstrate a near-quantum-limited noise performance. Additionally, we show that the higher-order nonlinearities that limit other microwave DPAs are almost non-existent for this amplifier, which allows us to demonstrate its exceptional squeezing potential by measuring the deamplification of coherent states by as much as 26 dB.


title: Bayesian Inference for Generalized Linear Model with Linear Inequality Constraints

abstract: Bayesian statistical inference for Generalized Linear Models (GLMs) with parameters lying on a constrained space is of general interest (e.g., in monotonic or convex regression), but often constructing valid prior distributions supported on a subspace spanned by a set of linear inequality constraints can be challenging, especially when some of the constraints might be binding leading to a lower dimensional subspace. For the general case with canonical link, it is shown that a generalized truncated multivariate normal supported on a desired subspace can be used. Moreover, it is shown that such prior distribution facilitates the construction of a general purpose product slice sampling method to obtain (approximate) samples from corresponding posterior distribution, making the inferential method computationally efficient for a wide class of GLMs with an arbitrary set of linear inequality constraints. The proposed product slice sampler is shown to be uniformly ergodic, having a geometric convergence rate under a set of mild regularity conditions satisfied by many popular GLMs (e.g., logistic and Poisson regressions with constrained coefficients). One of the primary advantages of the proposed Bayesian estimation method over classical methods is that uncertainty of parameter estimates is easily quantified by using the samples simulated from the path of the Markov Chain of the slice sampler. Numerical illustrations using simulated data sets are presented to illustrate the superiority of the proposed methods compared to some existing methods in terms of sampling bias and variances. In addition, real case studies are presented using data sets for fertilizer-crop production and estimating the SCRAM rate in nuclear power plants.


title: Collective Dynamics of Lohe type aggregation models

abstract: In this paper, we review state-of-the-art results on the collective behaviors for Lohe type first-order aggregation models. Collective behaviors of classical and quantum many-body systems have received lots of attention from diverse scientific disciplines such as applied mathematics, control theory in engineering, nonlinear dynamics of statistical physics, etc. To model such collective dynamics, several phenomenological models were proposed in literature and their emergent dynamics were extensively studied in recent years. Among them, we present two Lohe type models: the Lohe tensor (LT) model and the Schrodinger-Lohe mode}, and present several sufficient conditions in unified frameworks via the Lyapunov functional approach for state diameters and dynamical systems theory approach for two-point correlation functions. We also present several numerical simulation results for the SL model.


title: The optimal positive operator-valued measure for state discrimination

abstract: Evaluating the amount of information obtained from non-orthogonal quantum states is an important topic in the field of quantum information. The commonly used evaluation method is Holevo bound, which only provides a loose upper bound for quantum measurement. In this paper, we provide a theoretical study of the positive operator-valued measure (POVM) for discriminating nonorthogonal states. We construct a generalized POVM measurement operation, and derive the optimal one for state discrimination by Lagrange multiplier method. With simulation, we find that the optimal POVM measurement provides a tight upper bound for state discrimination, which is significantly lower than that predicted by Holevo bound. The derivation of optimal POVM measurement will play an important role in the security research of quantum key distribution.


title: Non-adiabatic decay of Rydberg-atom-ion molecules

abstract: The decay of Rydberg-atom-ion molecules (RAIMs) due to non-adiabatic couplings between electronic potential energy surfaces is investigated. We employ the Born-Huang representation and perform numerical simulations using a Crank-Nicolson algorithm. The non-adiabatic lifetimes of rubidium RAIMs for the lowest ten vibrational states, $\nu$, are computed for selected Rydberg principal quantum numbers, $n$. The non-adiabatic lifetimes are found to generally exceed the radiative Rydberg-atom lifetimes. We observe and explain a trend of the lifetimes as a function of $\nu$ and $n$, and attribute irregularities to quantum interference arising from a shallow potential well in an inner potential surface. Our results will be useful for future spectroscopic studies of RAIMs.


title: The energy conservation for the Navier-Stokes equations on the Lipschitz domains

abstract: In this paper, we consider the energy conservation of the Leray-Hopf weak solution $u$ to the Navier-Stokes equations on bounded domains $\Omega$ with Lipschitz boundary $\partial\Omega$. We prove that although the boundary effect appears, the Shinbrot's condition $u\in L^q_{loc}((0,T];L^p(\Omega))$ with $\frac{1}{p}+\frac{1}{q}=\frac{1}{2},p\geq 4$ still guarantees the validity of energy conservation of $u$, no boundary layer assumptions are required when dealing with domains with Lipschitz boundary. Compared to the existed methods, our critical strategies are that we first separate the mollification of weak solution from the boundary effect by considering non-standard local energy equality and transform the boundary effects into the estimates of the gradient of the cut-off functions, then by establishing a sharp $L^2L^2$ estimate for pressure $P$ and using the zero boundary condition, we obtain global energy equality by taking suitable cut-off functions. Our result provides a unified method to deal with domains with or without boundary and improves the corresponding results in \cite{C-L,Yu}.


title: Bilayer WSe$_2$ as a natural platform for interlayer exciton condensates in the strong coupling limit

abstract: Exciton condensates (EC) are macroscopic coherent states arising from condensation of electron-hole pairs. Bilayer heterostructures, consisting of two-dimensional electron and hole layers separated by a tunnel barrier, provide a versatile platform to realize and study EC. The tunnel barrier suppresses recombination yielding long-lived excitons. However, this separation also reduces interlayer Coulomb interactions, limiting the exciton binding strength. Here, we report the observation of EC in naturally occurring 2H-stacked bilayer WSe$_2$. In this system, the intrinsic spin-valley structure suppresses interlayer tunneling even when the separation is reduced to the atomic limit, providing access to a previously unattainable regime of strong interlayer coupling. Using capacitance spectroscopy, we investigate magneto-EC, formed when partially filled Landau levels (LL) couple between the layers. We find that the strong-coupling EC show dramatically different behaviour compared with previous reports, including an unanticipated variation of the EC robustness with the orbital number, and find evidence for a transition between two types of low-energy charged excitations. Our results provide a demonstration of tuning EC properties by varying the constituent single-particle wavefunctions.


title: Using Gaia DR2 to make a systematic comparison between two geometric distortion solutions

abstract: Gaia Data Release 2 (Gaia DR2) provides high accuracy and precision astrometric parameters (position, parallax, and proper motion) for more than 1 billion sources and is revolutionizing astrometry. For a fast-moving target such as an asteroid, with many stars in the field of view that are brighter than the faint limit magnitude of Gaia (21 Gmag), its measurement accuracy and precision can be greatly improved by taking advantage of Gaia reference stars. However, if we want to study the relative motions of cluster members, we could cross-match them in different epochs based on pixel positions. For both types of targets, the determination of optical field-angle distortion or called geometric distortion (GD) in this paper is important for image calibration especially when there are few reference stars to build a high-order plate model. For the former, the GD solution can be derived based on the astrometric catalogue's position, while for the latter, a reference system called 'master frame' is constructed from these observations in pixel coordinates, and then the GD solution is derived. But, are the two GD solutions in agreement with each other? In this paper, two types of GD solutions, which are derived either from the Gaia DR2 catalogue or from the self-constructed master frame, are applied respectively for the observations taken by 1-m telescope at Yunnan Observatory. It is found that two GD solutions enable the precision to achieve a comparable level (~10 mas) but their GD patterns are different. Synthetic distorted positions are generated for further investigation into the discrepancy between the two GD solutions. We aim to find the correlation and distinction between the two types of GD solutions and their applicability in high precision astrometry.


title: Energy conservation for the non-resistive MHD equations with physical boundaries

abstract: In this paper, we study the energy equality for weak solutions to the non-resistive MHD equations with physical boundaries. Although the equations of magnetic field $b$ are of hyperbolic type, and the boundary effects are considered, we still prove the global energy equality provided that $ u \in L^{q}_{loc}\left(0, T ; L^{p}(\Omega)\right) \text { for any } \frac{1}{q}+\frac{1}{p} \leq \frac{1}{2}, \text { with } p \geq 4,\text{ and } b \in L^{r}_{loc}\left(0, T ; L^{s}(\Omega)\right) \text { for any } \frac{1}{r}+\frac{1}{s} \leq \frac{1}{2}, \text { with } s \geq 4 $. In particular, compared with the existed results, we do not require any boundary layer assumptions and additional conditions on the pressure $P$. Our result requires the regularity of boundary $\partial\Omega$ is only Lipschitz which is the minimum requirement to make the boundary condition $b\cdot n$ sense. The proof is based on the important properties of weak solutions of the nonstationary Stokes system and the separate mollification of weak solutions from the boundary effect by considering a non-standard local energy equality and transform the boundary effects into the estimates of the gradient of cut-off functions.


title: Fast Evaluation of Smooth Distance Constraints on Co-Dimensional Geometry

abstract: We present a new method for computing a smooth minimum distance function based on the LogSumExp function for point clouds, edge meshes, triangle meshes, and combinations of all three. We derive blending weights and a modified Barnes-Hut acceleration approach that ensure our method approximates the true distance, and is conservative (points outside the zero isosurface are guaranteed to be outside the surface) and efficient to evaluate for all the above data types. This, in combination with its ability to smooth sparsely sampled and noisy data, like point clouds, shortens the gap between data acquisition and simulation, and thereby enables new applications such as direct, co-dimensional rigid body simulation using unprocessed lidar data.


title: Towards optimal boundary integral formulations of the Poisson-Boltzmann equation for molecular electrostatics

abstract: The Poisson-Boltzmann equation offers an efficient way to study electrostatics in molecular settings. Its numerical solution with the boundary element method is widely used, as the complicated molecular surface is accurately represented by the mesh, and the point charges are accounted for explicitly. In fact, there are several well-known boundary integral formulations available in the literature. This work presents a generalized expression of the boundary integral representation of the implicit solvent model, giving rise to new forms to compute the electrostatic potential. Moreover, it proposes a strategy to build efficient preconditioners for any of the resulting systems, improving the convergence of the linear solver. We perform systematic benchmarking of a set of formulations and preconditioners, focusing on the time to solution, matrix conditioning, and eigenvalue spectrum. We see that the eigenvalue clustering is a good indicator of the matrix conditioning, and show that they can be easily manipulated by scaling the preconditioner. Our results suggest that the optimal choice is problem-size dependent, where a simpler direct formulation is the fastest for small molecules, but more involved second-kind equations are better for larger problems. We also present a fast Calder\'on preconditioner for first-kind formulations, which shows promising behavior for future analysis. This work sets the basis towards choosing the most convenient boundary integral formulation of the Poisson-Boltzmann equation for a given problem.


title: "Passive Mechanical Realizations of Bicubic Impedances with No More Than Five Elements for Inerter-Based Control Design" with the Supplementary Material

abstract: This report includes the original manuscript (pp. 2-40) and the supplementary material (pp. 41-48) of "Passive Mechanical Realizations of Bicubic Impedances with No More Than Five Elements for Inerter-Based Control Design".


title: The Global Maximum Principle for Progressive Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Random Jumps

abstract: IIn this paper, we study a partially observed progressive optimal control problem of forward-backward stochastic differential equations with random jumps, where the control domain is not necessarily convex, and the control variable enter into all the coefficients. In our model, the observation equation is not only driven by a Brownian motion but also a Poisson random measure, which also have correlated noises with the state equation. For preparation, we first derive the existence and uniqueness of the solutions to the fully coupled forward-backward stochastic system with random jumps and its estimation in $L^\beta(\beta\geq2)$-space under some assumptions, and the non-linear filtering equation of partially observed stochastic system with random jumps. Then we derive the partially observed global maximum principle with random jumps. To show its applications, a partially observed linear quadratic progressive optimal control problem with random jumps is investigated, by the maximum principle and stochastic filtering. State estimate feedback representation of the optimal control is given in a more explicit form by introducing some ordinary differential equations.


title: Aubin type almost sharp Moser-Trudinger inequality revisited

abstract: We give a new proof of the almost sharp Moser-Trudinger inequality on compact Riemannian manifolds based on the sharp Moser inequality on Euclidean spaces. In particular we can lower the smoothness requirement of the metric and apply the same approach to higher order Sobolev spaces and manifolds with boundary under several boundary conditions.


title: Global Non-ideal Magnetohydrodynamic Simulations of Protoplanetary Disks with Outer Truncation

abstract: It has recently been established that the evolution of protoplanetary disks is primarily driven by magnetized disk winds, requiring large-scale magnetic flux threading the disks. The size of such disks is expected to shrink in time, as opposed to the conventional scenario of viscous expansion. We present the first global 2D non-ideal magnetohydrodynamic (MHD) simulations of protoplanetary disks that are truncated in the outer radius, aiming to understand the interaction of the disk with the interstellar environment, as well as global evolution of the disk and magnetic flux. We find that as the system relaxes, poloidal magnetic field threading the disk beyond the truncation radius collapses towards the midplane, leading to rapid reconnection. This process removes a substantial amount of magnetic flux from the system, and forms closed poloidal magnetic flux loops encircling the outer disk in quasi-steady-state. These magnetic flux loops can drive expansion beyond truncation radius, corresponding to substantial mass loss through magnetized disk outflow beyond truncation radius analogous to a combination of viscous spreading and external photoevaporation. The magnetic flux loops gradually shrink over time whose rates depend on level of disk magnetization and external environments, which eventually governs the long-term disk evolution.


title: Dust Settling and Clumping in MRI Turbulent Outer Protoplanetary Disks

abstract: Planetesimal formation is a crucial yet poorly understood process in planet formation. It is widely believed that planetesimal formation is the outcome of dust clumping by the streaming instability (SI). However, recent analytical and numerical studies have shown that the SI can be damped or suppressed by external turbulence, and at least the outer regions of protoplanetary disks are likely weakly turbulent due to magneto-rotational instability (MRI). We conduct high-resolution local shearing-box simulations of hybrid particle-gas magnetohydrodynamics (MHD), incorporating ambipolar diffusion as the dominant non-ideal MHD effect, applicable to outer disk regions. We first show that dust backreaction enhances dust settling towards the midplane by reducing turbulence correlation time. Under modest level of MRI turbulence, we find that dust clumping is in fact easier than the conventional SI case, in the sense that the threshold of solid abundance for clumping is lower. The key to dust clumping includes dust backreaction and the presence of local pressure maxima, which in our work is formed by the MRI zonal flows overcoming background pressure gradient. Overall, our results support planetesimal formation in the MRI-turbulent outer protoplanetary disks, especially in ring-like substructures.


title: The local characterizations of the singularity formation for the MHD equations

abstract: This paper characterizes the possible blow-up of solutions for the 3D magneto-hydrodynamics (MHD for short) equations. We first establish some $\epsilon$-regularity criteria in $L^{q,\infty}$ spaces for suitable weak solutions, and then together with an embedding theorem from $L^{p,\infty}$ space into a Morrey type space to characterize the local behaviors of solutions near a potential singular point. More precisely, we show that if $z_{0}=\left(t_{0}, x_{0}\right)$ is a singular point, then for any $r>0$ it holds that $$ \limsup _{t \rightarrow t_{0}^{-}}\left(\left\|u(t, x)-u(t)_{x_{0}, r}\right\|_{L^{3, \infty}\left(B_{r}\left(x_{0}\right)\right)}+\left\|b(t, x)-b(t)_{x_{0}, r}\right\|_{L^{3, \infty}\left(B_{r}\left(x_{0}\right)\right)}\right)>\delta^{*}; $$ $$ \limsup\limits _{t \rightarrow t_{0}^{-}}\left(t_{0}-t\right)^{\frac{1}{\mu}} r^{\frac{2}{\nu}-\frac{3}{p}}\|(u,b)(t)\|_{L^{p, \infty}\left(B_{r}\left(x_{0}\right)\right)}>\delta^{*} \text { for } \frac{1}{\mu}+\frac{1}{\nu}=\frac{1}{2},\,2 \leq \nu \leq \frac{2 p}{3},\, 3<p\leq\infty;$$ $$ \limsup\limits _{t \rightarrow t_{0}^{-}}\left(t_{0}-t\right)^{\frac{1}{\mu}} r^{\frac{2}{\nu}-\frac{3}{p}+1}\|(\nabla u,\nabla b)(t)\|_{L^{p}\left(B_{r}\left(x_{0}\right)\right)}>\delta^{*} \text { for } \frac{1}{\mu}+\frac{1}{\nu}=\frac{1}{2},\, \nu \in\left\{\begin{array}{ll} {[2, \infty],} & p\geq 3 {[2, \frac{2p}{3-p}],} & \frac{3}{2}\leq p<3 \end{array}\right. $$ where $\delta^{*}$ is a positive constant independent on $\nu$ and $p$.


title: Swimmer dynamics in externally-driven fluid flows: The role of noise

abstract: We theoretically investigate the effect of random fluctuations on the motion of elongated microswimmers near hydrodynamic transport barriers in externally-driven fluid flows. Focusing on the two-dimensional hyperbolic flow, we consider the effects of translational and rotational diffusion as well as tumbling, i.e. sudden jumps in the swimmer orientation. Regardless of whether diffusion or tumbling are the primary source of fluctuations, we find that noise significantly increases the probability that a swimmer crosses one-way barriers in the flow, which block the swimmer from returning to its initial position. We employ an asymptotic method for calculating the probability density of noisy swimmer trajectories in a given fluid flow, which produces solutions to the time-dependent Fokker-Planck equation in the weak-noise limit. This procedure mirrors the semiclassical approximation in quantum mechanics and similarly involves calculating the least-action paths of a Hamiltonian system derived from the swimmer's Fokker-Planck equation. Using the semiclassical technique, we compute (i) the steady-state orientation distribution of swimmers with rotational diffusion and tumbling and (ii) the probability that a diffusive swimmer crosses a one-way barrier. The semiclassical results compare favorably with Monte Carlo calculations.


title: Infinite Choice and Probability Distributions. An Open Problem: The Real Hotel

abstract: We sketch a process algebra with data and probability distributions. This allows to combine two very powerful abstraction mechanisms namely non-deterministic choice and probabilities. However, it is not clear how to define an appropriate semantics for the generalised choice over data in combination with probability density functions. The real hotel is a puzzle that exemplifies the core of the problem.


title: Separating the Expressive Power of Propositional Dynamic and Modal Fixpoint Logics

abstract: We investigate the expressive power of the two main kinds of program logics for complex, non-regular program properties found in the literature: those extending propositional dynamic logic (PDL), and those extending the modal mu-calculus. This is inspired by the recent discovery of a decidable program logic called Visibly Pushdown Fixpoint Logic with Chop which extends both the modal mu-calculus and PDL over visibly pushdown languages, which, so far, constituted the ends of two pillars of decidable program logics. Here we show that this logic is not only more expressive than either of its two fragments, but in fact even more expressive than their union. Hence, the decidability border amongst program logics has been properly pushed up. We complete the picture by providing results separating all the PDL-based and modal fixpoint logics with regular, visibly pushdown and arbitrary context-free constructions.


title: Control Barrier Functions With Unmodeled Dynamics Using Integral Quadratic Constraints

abstract: This paper presents a control design method that achieves safety for systems with unmodeled dynamics at the plant input. The proposed method combines control barrier functions (CBFs) and integral quadratic constraints (IQCs). Simplified, low-order models are often used in the design of the controller. Parasitic, unmodeled dynamics (e.g. actuator dynamics, time delays, etc) can lead to safety violations. The proposed method bounds the input-output behavior of these unmodeled dynamics in the time-domain using an alpha-IQC. The alpha-IQC is then incorporated into the CBF constraint to ensure safety. The approach is demonstrated with a simple example.


title: A Game Characterization for Contrasimilarity

abstract: We present the first game characterization of contrasimilarity, the weakest form of bisimilarity. The game is finite for finite-state processes and can thus be used for contrasimulation equivalence checking, of which no tool has been capable to date. A machine-checked Isabelle/HOL formalization backs our work and enables further use of contrasimilarity in verification contexts.


title: Language Transformations in the Classroom

abstract: Language transformations are algorithms that take a language specification in input, and return the language specification modified. Language transformations are useful for automatically adding features such as subtyping to programming languages (PLs), and for automatically deriving abstract machines. In this paper, we set forth the thesis that teaching programming languages features with the help of language transformations, in addition to the planned material, can be beneficial for students to help them deepen their understanding of the features being taught. We have conducted a study on integrating language transformations into an undergraduate PL course. We describe our study, the material that we have taught, and the exam submitted to students, and we present the results from this study. Although we refrain from drawing general conclusions on the effectiveness of language transformations, this paper offers encouraging data. We also offer this paper to inspire similar studies.


title: On Decidability of the Bisimilarity on Higher-order Processes with Parameterization

abstract: Higher-order processes with parameterization are capable of abstraction and application (migrated from the lambda-calculus), and thus are computationally more expressive. For the minimal higher-order concurrency, it is well-known that the strong bisimilarity (i.e., the strong bisimulation equality) is decidable in absence of parameterization. By contrast, whether the strong bisimilarity is still decidable for parameterized higher-order processes remains unclear. In this paper, we focus on this issue. There are basically two kinds of parameterization: one on names and the other on processes. We show that the strong bisimilarity is indeed decidable for higher-order processes equipped with both kinds of parameterization. Then we demonstrate how to adapt the decision approach to build an axiom system for the strong bisimilarity. On top of these results, we provide an algorithm for the bisimilarity checking.


title: Controlling higher-orbital quantum phases of ultracold atoms via coupling to optical cavities

abstract: Orbital degree of freedom plays an important role in understanding exotic phenomena of strongly correlated materials. We study strongly correlated ultracold bosonic gases coupled to a high-finesse cavity, pumped by a blue-detuned laser in the transverse direction. Based on an extended Bose-Hubbard model with parameters adapted to recent experiments, we find that by tuning the reflection of pump laser, atoms can be selectively transferred to the odd-parity $p$-orbital, or to even-parity $d$-orbital band of a two-dimensional square lattice, accompanied with cavity-photon excitations. By interacting with cavity field, atoms self-organize to form stable higher-orbital superfluid and Mott-insulating phases with orbital-density waves, as a result of cavity induced orbital-flip processes. Our study opens the route to manipulate orbital degrees of freedom in strongly correlated quantum gases via coupling to optical cavities.


title: The benefits of prefetching for large-scale cloud-based neuroimaging analysis workflows

abstract: To support the growing demands of neuroscience applications, researchers are transitioning to cloud computing for its scalable, robust and elastic infrastructure. Nevertheless, large datasets residing in object stores may result in significant data transfer overheads during workflow execution. Prefetching, a method to mitigate the cost of reading in mixed workloads, masks data transfer costs within processing time of prior tasks. We present an implementation of "Rolling Prefetch", a Python library that implements a particular form of prefetching from AWS S3 object store, and we quantify its benefits. Rolling Prefetch extends S3Fs, a Python library exposing AWS S3 functionality via a file object, to add prefetch capabilities. In measured analysis performance of a 500 GB brain connectivity dataset stored on S3, we found that prefetching provides significant speed-ups of up to 1.86x, even in applications consisting entirely of data loading. The observed speed-up values are consistent with our theoretical analysis. Our results demonstrate the usefulness of prefetching for scientific data processing on cloud infrastructures and provide an implementation applicable to various application domains.


title: STag: Supernova Tagging and Classification

abstract: Supernovae classes have been defined phenomenologically, based on spectral features and time series data, since the specific details of the physics of the different explosions remain unrevealed. However, the number of these classes is increasing as objects with new features are observed, and the next generation of large-surveys will only bring more variety to our attention. We apply the machine learning technique of multi-label classification to the spectra of supernovae. By measuring the probabilities of specific features or `tags' in the supernova spectra, we can compress the information from a specific object down to that suitable for a human or database scan, without the need to directly assign to a reductive `class'. We use logistic regression to assign tag probabilities, and then a feed-forward neural network to filter the objects into the standard set of classes, based solely on the tag probabilities. We present STag, a software package that can compute these tag probabilities and make spectral classifications.


title: A formalism of abstract quantum field theory of summation of fat graphs

abstract: In this work we present a formalism of abstract quantum field theory for fat graphs and its realizations. This is a generalization of an earlier work for stable graphs. We define the abstract correlators $\mathcal F_g^\mu$, abstract free energy $\mathcal F_g$, abstract partition function $\mathcal Z$, and abstract $n$-point functions $\mathcal W_{g,n}$ to be formal summations of fat graphs, and derive quadratic recursions using edge-contraction/vertex-splitting operators, including the abstract Virasoro constraints, an abstract cut-and-join type representation for $\mathcal Z$, and a quadratic recursion for $\mathcal W_{g,n}$ which resembles the Eynard-Orantin topological recursion. When considering the realization by the Hermitian one-matrix models, we obtain the Virasoro constraints, a cut-and-join representation for the partition function $Z_N^{\text{Herm}}$ which proves that $Z_N^{\text{Herm}}$ is a tau-function of KP hierarchy, a recursion for $n$-point functions which is known to be equivalent to the E-O recursion, and a Schr\"odinger type-equation which is equivalent to the quantum spectral curve. We conjecture that in general cases the realization of the quadratic recursion for $\mathcal W_{g,n}$ is the E-O recursion, where the spectral curve and Bergmann kernel are constructed from realizations of $\mathcal W_{0,1}$ and $\mathcal W_{0,2}$ respectively using the framework of emergent geometry.


title: Creating Electronic Oscillator-based Ising Machines without External Injection Locking

abstract: Coupled electronic oscillators have recently been explored as a compact, integrated circuit- and room temperature operation- compatible hardware platform to design Ising machines. However, such implementations presently require the injection of an externally generated second-harmonic signal to impose the phase bipartition among the oscillators. In this work, we experimentally demonstrate a new electronic autaptic oscillator (EAO) that uses engineered feedback to eliminate the need for the generation and injection of the external second harmonic signal to minimize the Ising Hamiltonian. The feedback in the EAO is engineered to effectively generate the second harmonic signal internally. Using this oscillator design, we show experimentally, that a system of capacitively coupled EAOs exhibits the desired bipartition in the oscillator phases, and subsequently, demonstrate its application in solving the computationally hard Maximum Cut (MaxCut) problem. Our work not only establishes a new oscillator design aligned to the needs of the oscillator Ising machine but also advances the efforts to creating application specific analog computing platforms.


title: Loop-Erased Random Walk Branch of Uniform Spanning Tree in Topological Polygons

abstract: We consider uniform spanning tree (UST) in topological polygons with $2N$ marked points on the boundary with alternating boundary conditions. In [LPW21], the authors derive the scaling limit of the Peano curve in the UST. They are variants of SLE$_8$. In this article, we derive the scaling limit of the loop-erased random walk branch (LERW) in the UST. They are variants of SLE$_2$. The conclusion is a generalization of [HLW20,Theorem 1.6] where the authors derive the scaling limit of the LERW branch of UST when $N=2$. When $N=2$, the limiting law is SLE$_2(-1,-1; -1, -1)$. However, the limiting law is nolonger in the family of SLE$_2(\rho)$ process as long as $N\ge 3$.


title: ParamCrop: Parametric Cubic Cropping for Video Contrastive Learning

abstract: The central idea of contrastive learning is to discriminate between different instances and force different views from the same instance to share the same representation. To avoid trivial solutions, augmentation plays an important role in generating different views, among which random cropping is shown to be effective for the model to learn a generalized and robust representation. Commonly used random crop operation keeps the distribution of the difference between two views unchanged along the training process. In this work, we show that adaptively controlling the disparity between two augmented views along the training process enhances the quality of the learned representation. Specifically, we present a parametric cubic cropping operation, ParamCrop, for video contrastive learning, which automatically crops a 3D cubic by differentiable 3D affine transformations. ParamCrop is trained simultaneously with the video backbone using an adversarial objective and learns an optimal cropping strategy from the data. The visualizations show that ParamCrop adaptively controls the center distance and the IoU between two augmented views, and the learned change in the disparity along the training process is beneficial to learning a strong representation. Extensive ablation studies demonstrate the effectiveness of the proposed ParamCrop on multiple contrastive learning frameworks and video backbones. Codes and models will be available.


title: Discrete Fenchel Duality for a Pair of Integrally Convex and Separable Convex Functions

abstract: Discrete Fenchel duality is one of the central issues in discrete convex analysis. The Fenchel-type min-max theorem for a pair of integer-valued M-natural-convex functions generalizes the min-max formulas for polymatroid intersection and valuated matroid intersection. In this paper we establish a Fenchel-type min-max formula for a pair of integer-valued integrally convex and separable convex functions. Integrally convex functions constitute a fundamental function class in discrete convex analysis, including both M-natural-convex functions and L-natural-convex functions, whereas separable convex functions are characterized as those functions which are both M-natural-convex and L-natural-convex. The theorem is proved by revealing a kind of box integrality of subgradients of an integer-valued integrally convex function. The proof is based on the Fourier-Motzkin elimination.


title: Small Object Detection Based on Modified FSSD and Model Compression

abstract: Small objects have relatively low resolution, the unobvious visual features which are difficult to be extracted, so the existing object detection methods cannot effectively detect small objects, and the detection speed and stability are poor. Thus, this paper proposes a small object detection algorithm based on FSSD, meanwhile, in order to reduce the computational cost and storage space, pruning is carried out to achieve model compression. Firstly, the semantic information contained in the features of different layers can be used to detect different scale objects, and the feature fusion method is improved to obtain more information beneficial to small objects; secondly, batch normalization layer is introduced to accelerate the training of neural network and make the model sparse; finally, the model is pruned by scaling factor to get the corresponding compressed model. The experimental results show that the average accuracy (mAP) of the algorithm can reach 80.4% on PASCAL VOC and the speed is 59.5 FPS on GTX1080ti. After pruning, the compressed model can reach 79.9% mAP, and 79.5 FPS in detection speed. On MS COCO, the best detection accuracy (APs) is 12.1%, and the overall detection accuracy is 49.8% AP when IoU is 0.5. The algorithm can not only improve the detection accuracy of small objects, but also greatly improves the detection speed, which reaches a balance between speed and accuracy.


title: Deep Signature FBSDE Algorithm

abstract: We propose a deep signature/log-signature FBSDE algorithm to solve forward-backward stochastic differential equations (FBSDEs) with state and path dependent features. By incorporating the deep signature/log-signature transformation into the recurrent neural network (RNN) model, our algorithm shortens the training time, improves the accuracy, and extends the time horizon comparing to methods in the existing literature. Moreover, our algorithms can be applied to a wide range of applications such as state and path dependent option pricing involving high-frequency data, model ambiguity, and stochastic games, which are linked to parabolic partial differential equations (PDEs), and path-dependent PDEs (PPDEs). Lastly, we also derive the convergence analysis of the deep signature/log-signature FBSDE algorithm.


title: Modulating Intelligent Surfaces for Multi-User MIMO Systems: Beamforming and Modulation Design

abstract: This paper introduces a novel approach of utilizing the reconfigurable intelligent surface (RIS) for joint data modulation and signal beamforming in a multi-user downlink cellular network by leveraging the idea of backscatter communication. We present a general framework in which the RIS, referred to as modulating intelligent surface (MIS) in this paper, is used to: i) beamform the signals for a set of users whose data modulation is already performed by the base station (BS), and at the same time, ii) embed the data of a different set of users by passively modulating the deliberately sent carrier signals from the BS to the RIS. To maximize each user's spectral efficiency, a joint non-convex optimization problem is formulated under the sum minimum mean-square error (MMSE) criterion. Alternating optimization is used to divide the original joint problem into two tasks of: i) separately optimizing the MIS phase-shifts for passive beamforming along with data embedding for the BS- and MIS-served users, respectively, and ii) jointly optimizing the active precoder and the receive scaling factor for the BS- and MIS-served users, respectively. While the solution to the latter joint problem is found in closed-form using traditional optimization techniques, the optimal phase-shifts at the MIS are obtained by deriving the appropriate optimization-oriented vector approximate message passing (OOVAMP) algorithm. Moreover, the original joint problem is solved under both ideal and practical constraints on the MIS phase shifts, namely, the unimodular constraint and assuming each MIS element to be terminated by a variable reactive load. The proposed MIS-assisted scheme is compared against state-of-the-art RIS-assisted wireless communication schemes and simulation results reveal that it brings substantial improvements in terms of system throughput while supporting a much higher number of users.


title: Real-Time Monocular Human Depth Estimation and Segmentation on Embedded Systems

abstract: Estimating a scene's depth to achieve collision avoidance against moving pedestrians is a crucial and fundamental problem in the robotic field. This paper proposes a novel, low complexity network architecture for fast and accurate human depth estimation and segmentation in indoor environments, aiming to applications for resource-constrained platforms (including battery-powered aerial, micro-aerial, and ground vehicles) with a monocular camera being the primary perception module. Following the encoder-decoder structure, the proposed framework consists of two branches, one for depth prediction and another for semantic segmentation. Moreover, network structure optimization is employed to improve its forward inference speed. Exhaustive experiments on three self-generated datasets prove our pipeline's capability to execute in real-time, achieving higher frame rates than contemporary state-of-the-art frameworks (114.6 frames per second on an NVIDIA Jetson Nano GPU with TensorRT) while maintaining comparable accuracy.


title: Surface band segregation and internal convection in rotating sphere densely filled with granular material: Experiments

abstract: While granular segregation in partially filled containers has been studied extensively, granular dynamics in densely filled spheres is not fully understood. Here, surface band segregation and granular convection are reported in a rotating sphere of highly compacted glass beads. Distinct from Rayleigh-Benard convection, granular convection has a butterfly-shaped structure with vortexes of alternating layers of small/large beads, which is stable and independent of the sphere size. Two concentric interfaces at the zero tangential/norm flux are discovered, which divide the sphere into three layers from the surface to the core. The law that governs the jamming dynamics in rotating spheres remains an open question.


title: Neutron Star Persistent Shift Phenomena and Relavant Data Fitting Analysis

abstract: Pulsar glitches are the sudden increase in their spin frequency, most accompanied with a long timescale recovery process. A permanent shift would be remained in the first order derivative of spin frequency with time. Relevant data fitting research about this persistent shift was performed in this essay, we have found a more suitable fitting strategy by choosing a fitting function form $k\ln(ax + b)$ and demonstrated that would be more meaningful in pure mathematical aspect in describe the correlation between the time scale of Delayed-Spin-Up $\tau_{d}$ (so as the persistent shift $\Delta \dot{\nu}_{p}$) and glitch size $\Delta \nu$.Some possible physical ideas about this fitting also have been presented while the clear physical mechanism behind this strategy still remain unknown.


title: Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Clues

abstract: Recently, fake news with text and images have achieved more effective diffusion than text-only fake news, raising a severe issue of multimodal fake news detection. Current studies on this issue have made significant contributions to developing multimodal models, but they are defective in modeling the multimodal content sufficiently. Most of them only preliminarily model the basic semantics of the images as a supplement to the text, which limits their performance on detection. In this paper, we find three valuable text-image correlations in multimodal fake news: entity inconsistency, mutual enhancement, and text complementation. To effectively capture these multimodal clues, we innovatively extract visual entities (such as celebrities and landmarks) to understand the news-related high-level semantics of images, and then model the multimodal entity inconsistency and mutual enhancement with the help of visual entities. Moreover, we extract the embedded text in images as the complementation of the original text. All things considered, we propose a novel entity-enhanced multimodal fusion framework, which simultaneously models three cross-modal correlations to detect diverse multimodal fake news. Extensive experiments demonstrate the superiority of our model compared to the state of the art.


title: Contrastive Learning of User Behavior Sequence for Context-Aware Document Ranking

abstract: Context information in search sessions has proven to be useful for capturing user search intent. Existing studies explored user behavior sequences in sessions in different ways to enhance query suggestion or document ranking. However, a user behavior sequence has often been viewed as a definite and exact signal reflecting a user's behavior. In reality, it is highly variable: user's queries for the same intent can vary, and different documents can be clicked. To learn a more robust representation of the user behavior sequence, we propose a method based on contrastive learning, which takes into account the possible variations in user's behavior sequences. Specifically, we propose three data augmentation strategies to generate similar variants of user behavior sequences and contrast them with other sequences. In so doing, the model is forced to be more robust regarding the possible variations. The optimized sequence representation is incorporated into document ranking. Experiments on two real query log datasets show that our proposed model outperforms the state-of-the-art methods significantly, which demonstrates the effectiveness of our method for context-aware document ranking.


title: CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation

abstract: Practical recommender systems experience a cold-start problem when observed user-item interactions in the history are insufficient. Meta learning, especially gradient based one, can be adopted to tackle this problem by learning initial parameters of the model and thus allowing fast adaptation to a specific task from limited data examples. Though with significant performance improvement, it commonly suffers from two critical issues: the non-compatibility with mainstream industrial deployment and the heavy computational burdens, both due to the inner-loop gradient operation. These two issues make them hard to be applied in practical recommender systems. To enjoy the benefits of meta learning framework and mitigate these problems, we propose a recommendation framework called Contextual Modulation Meta Learning (CMML). CMML is composed of fully feed-forward operations so it is computationally efficient and completely compatible with the mainstream industrial deployment. CMML consists of three components, including a context encoder that can generate context embedding to represent a specific task, a hybrid context generator that aggregates specific user-item features with task-level context, and a contextual modulation network, which can modulate the recommendation model to adapt effectively. We validate our approach on both scenario-specific and user-specific cold-start setting on various real-world datasets, showing CMML can achieve comparable or even better performance with gradient based methods yet with much higher computational efficiency and better interpretability.


title: Another simple reformulation of the four color theorem

abstract: We give a simple reformulation of the four color theorem as a problem on strings over a four letter alphabet.


title: Maximum Likelihood Estimation for Multimodal Learning with Missing Modality

abstract: Multimodal learning has achieved great successes in many scenarios. Compared with unimodal learning, it can effectively combine the information from different modalities to improve the performance of learning tasks. In reality, the multimodal data may have missing modalities due to various reasons, such as sensor failure and data transmission error. In previous works, the information of the modality-missing data has not been well exploited. To address this problem, we propose an efficient approach based on maximum likelihood estimation to incorporate the knowledge in the modality-missing data. Specifically, we design a likelihood function to characterize the conditional distribution of the modality-complete data and the modality-missing data, which is theoretically optimal. Moreover, we develop a generalized form of the softmax function to effectively implement maximum likelihood estimation in an end-to-end manner. Such training strategy guarantees the computability of our algorithm capably. Finally, we conduct a series of experiments on real-world multimodal datasets. Our results demonstrate the effectiveness of the proposed approach, even when 95% of the training data has missing modality.


title: On Some Mathematics Related to the Interpolating Statistics

abstract: Motivated by fractional quantum Hall effects, we introduce a universal space of statistics interpolating Bose-Einstein statistics and Fermi-Dirac statistics. We connect the interpolating statistics to umbral calculus and use it as a bridge to study the interpolation statistics by the principle maximum entropy by deformed entropy functions. On the one hand this connection makes it possible to relate fractional quantum Hall effects to many different mathematical objects, including formal group laws, complex bordism theory, complex genera, operads, counting trees, spectral curves in Eynard-Orantin topological recursions, etc. On the other hand, this also suggests to reexamine umbral calculus from the point of view of quantum mechanics and statistical mechanics.


title: ARShoe: Real-Time Augmented Reality Shoe Try-on System on Smartphones

abstract: Virtual try-on technology enables users to try various fashion items using augmented reality and provides a convenient online shopping experience. However, most previous works focus on the virtual try-on for clothes while neglecting that for shoes, which is also a promising task. To this concern, this work proposes a real-time augmented reality virtual shoe try-on system for smartphones, namely ARShoe. Specifically, ARShoe adopts a novel multi-branch network to realize pose estimation and segmentation simultaneously. A solution to generate realistic 3D shoe model occlusion during the try-on process is presented. To achieve a smooth and stable try-on effect, this work further develop a novel stabilization method. Moreover, for training and evaluation, we construct the very first large-scale foot benchmark with multiple virtual shoe try-on task-related labels annotated. Exhaustive experiments on our newly constructed benchmark demonstrate the satisfying performance of ARShoe. Practical tests on common smartphones validate the real-time performance and stabilization of the proposed approach.


title: Equilibrium of an Arbitrary Bunch Train with Cavity Resonators and Short Range Wake: Enhanced Iterative Solution with Anderson Acceleration

abstract: This paper continues the work of two previous treatments of bunch lengthening by a passive harmonic cavity in an electron storage ring. Such cavities, intended to reduce the effect of Touschek scattering, are a feature of fourth generation synchrotron light sources. The charge densities in the equilibrium state are given by solutions of coupled Ha\"issinski equations, which are nonlinear integral equations. If the only wake fields are from cavity resonators, the unknowns can be the Fourier transforms of bunch densities at the resonator frequencies. The solution scheme based on this choice of unknowns proved to be deficient at the design current when multiple resonators were included. Here we return to the conventional formulation of Ha\"issinski equations in coordinate space, the unknowns being charge densities at mesh points on a fine grid. This system would be awkward to solve by the Newton method used previously, because the Jacobian matrix is very large. Here a new solution is described, which is both Jacobian-free and much simpler. It is based on an elementary fixed point iteration, accelerated by Anderson's method. The scheme is notably fast and robust, accommodating even the case of extreme over-stretching at current far beyond the design value. The Anderson method is promising for many problems in accelerator theory and beyond, since it is quite simple and can be used to attack all kinds of nonlinear and linear integral and differential equations. Results are presented for ALS-U, with updated design parameters. The model includes harmonic and main r.f. cavities, compensation of beam loading of the main cavity by adjustment of the generator voltage, and a realistic short range wake field (rather than the broad-band resonator wake invoked previously).


title: Uncertainty Quantification of the 4th kind; optimal posterior accuracy-uncertainty tradeoff with the minimum enclosing ball

abstract: There are essentially three kinds of approaches to Uncertainty Quantification (UQ): (A) robust optimization, (B) Bayesian, (C) decision theory. Although (A) is robust, it is unfavorable with respect to accuracy and data assimilation. (B) requires a prior, it is generally brittle and posterior estimations can be slow. Although (C) leads to the identification of an optimal prior, its approximation suffers from the curse of dimensionality and the notion of risk is one that is averaged with respect to the distribution of the data. We introduce a 4th kind which is a hybrid between (A), (B), (C), and hypothesis testing. It can be summarized as, after observing a sample $x$, (1) defining a likelihood region through the relative likelihood and (2) playing a minmax game in that region to define optimal estimators and their risk. The resulting method has several desirable properties (a) an optimal prior is identified after measuring the data, and the notion of risk is a posterior one, (b) the determination of the optimal estimate and its risk can be reduced to computing the minimum enclosing ball of the image of the likelihood region under the quantity of interest map (which is fast and not subject to the curse of dimensionality). The method is characterized by a parameter in $ [0,1]$ acting as an assumed lower bound on the rarity of the observed data (the relative likelihood). When that parameter is near $1$, the method produces a posterior distribution concentrated around a maximum likelihood estimate with tight but low confidence UQ estimates. When that parameter is near $0$, the method produces a maximal risk posterior distribution with high confidence UQ estimates. In addition to navigating the accuracy-uncertainty tradeoff, the proposed method addresses the brittleness of Bayesian inference by navigating the robustness-accuracy tradeoff associated with data assimilation.


title: Constraining the Polarization of Gravitational Waves with the Parkes Pulsar Timing Array Second Data Release

abstract: We search for the isotropic stochastic gravitational-wave background, including the nontensorial polarizations that are allowed in general metric theories of gravity, in the Parkes Pulsar Timing Array (PPTA) second data release (DR2). We find no statistically significant evidence that the common-spectrum process reported by the PPTA collaboration has the tensor transverse, scalar transverse, vector longitudinal, or scalar longitudinal correlations in PPTA DR2. Therefore, we place a $95\%$ upper limit on the amplitude of each polarization mode, as $\mathcal{A}_{\mathrm{TT}} \lesssim 3.2\times 10^{-15}$, $\mathcal{A}_{\mathrm{ST}} \lesssim 1.8\times 10^{-15}$, $\mathcal{A}_{\mathrm{VL}}\lesssim 3.5\times 10^{-16}$ and $\mathcal{A}_{\mathrm{SL}}\lesssim 4.2\times 10^{-17}$; or, equivalently, a $95\%$ upper limit on the energy density parameter per logarithm frequency, as $\Omega_{\mathrm{GW}}^{\mathrm{TT}} \lesssim 1.4\times 10^{-8}$, $\Omega_{\mathrm{GW}}^{\mathrm{ST}} \lesssim 4.5\times 10^{-9}$, $\Omega_{\mathrm{GW}}^{\mathrm{VL}} \lesssim 1.7\times 10^{-10}$ and $\Omega_{\mathrm{GW}}^{\mathrm{SL}} \lesssim 2.4\times 10^{-12}$, at a frequency of 1/yr.


title: Kinetic temperature of massive star-forming molecular clumps measured with formaldehyde IV. The ALMA view of N113 and N159W in the LMC

abstract: We mapped the kinetic temperature structure of two massive star-forming regions, N113 and N159W, in the Large Magellanic Cloud (LMC). We have used $\sim$1\hbox{$\,.\!\!^{\prime\prime}$}6\,($\sim$0.4\,pc) resolution measurements of the para-H$_2$CO\,$J_{\rm K_ aK_c}$\,=\,3$_{03}$--2$_{02}$, 3$_{22}$--2$_{21}$, and 3$_{21}$--2$_{20}$ transitions near 218.5\,GHz to constrain RADEX non-LTE models of the physical conditions. The gas kinetic temperatures derived from the para-H$_2$CO line ratios 3$_{22}$--2$_{21}$/3$_{03}$--2$_{02}$ and 3$_{21}$--2$_{20}$/3$_{03}$--2$_{02}$ range from 28 to 105\,K in N113 and 29 to 68\,K in N159W. Distributions of the dense gas traced by para-H$_2$CO agree with those of the 1.3\,mm dust and \emph{Spitzer}\,8.0\,$\mu$m emission, but do not significantly correlate with the H$\alpha$ emission. The high kinetic temperatures ($T_{\rm kin}$\,$\gtrsim$\,50\,K) of the dense gas traced by para-H$_2$CO appear to be correlated with the embedded infrared sources inside the clouds and/or YSOs in the N113 and N159W regions. The lower temperatures ($T_{\rm kin}$\,$<$\,50\,K) are measured at the outskirts of the H$_2$CO-bearing distributions of both N113 and N159W. It seems that the kinetic temperatures of the dense gas traced by para-H$_2$CO are weakly affected by the external sources of the H$\alpha$ emission. The non-thermal velocity dispersions of para-H$_2$CO are well correlated with the gas kinetic temperatures in the N113 region, implying that the higher kinetic temperature traced by para-H$_2$CO is related to turbulence on a $\sim$0.4\,pc scale. The dense gas heating appears to be dominated by internal star formation activity, radiation, and/or turbulence. It seems that the mechanism heating the dense gas of the star-forming regions in the LMC is consistent with that in Galactic massive star-forming regions located in the Galactic plane.


title: Improving Object Detection by Label Assignment Distillation

abstract: Label assignment in object detection aims to assign targets, foreground or background, to sampled regions in an image. Unlike labeling for image classification, this problem is not well defined due to the object's bounding box. In this paper, we investigate the problem from a perspective of distillation, hence we call Label Assignment Distillation (LAD). Our initial motivation is very simple, we use a teacher network to generate labels for the student. This can be achieved in two ways: either using the teacher's prediction as the direct targets (soft label), or through the hard labels dynamically assigned by the teacher (LAD). Our experiments reveal that: (i) LAD is more effective than soft-label, but they are complementary. (ii) Using LAD, a smaller teacher can also improve a larger student significantly, while soft-label can't. We then introduce Co-learning LAD, in which two networks simultaneously learn from scratch and the role of teacher and student are dynamically interchanged. Using PAA-ResNet50 as a teacher, our LAD techniques can improve detectors PAA-ResNet101 and PAA-ResNeXt101 to $46 \rm AP$ and $47.5\rm AP$ on the COCO test-dev set. With a stronger teacher PAA-SwinB, we improve the students PAA-ResNet50 to $43.7\rm AP$ by only 1x schedule training and standard setting, and PAA-ResNet101 to $47.9\rm AP$, significantly surpassing the current methods. Our source code and checkpoints are released at https://git.io/JrDZo.


title: Bag of Tricks for Training Deeper Graph Neural Networks: A Comprehensive Benchmark Study

abstract: Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing, and so on, which limits their potential power for encoding the high-order neighbor structure in large-scale graphs. Although numerous efforts are proposed to address these limitations, such as various forms of skip connections, graph normalization, and random dropping, it is difficult to disentangle the advantages brought by a deep GNN architecture from those "tricks" necessary to train such an architecture. Moreover, the lack of a standardized benchmark with fair and consistent experimental settings poses an almost insurmountable obstacle to gauge the effectiveness of new mechanisms. In view of those, we present the first fair and reproducible benchmark dedicated to assessing the "tricks" of training deep GNNs. We categorize existing approaches, investigate their hyperparameter sensitivity, and unify the basic configuration. Comprehensive evaluations are then conducted on tens of representative graph datasets including the recent large-scale Open Graph Benchmark, with diverse deep GNN backbones. We demonstrate that an organic combo of initial connection, identity mapping, group and batch normalization attains the new state-of-the-art results for deep GNNs on large datasets. Codes are available: https://github.com/VITA-Group/Deep_GCN_Benchmarking.


title: A lowest-degree strictly conservative finite element scheme for incompressible Stokes problem on general triangulations

abstract: In this paper, we propose a finite element pair for incompressible Stokes problem. The pair uses a slightly enriched piecewise linear polynomial space for velocity and piecewise constant space for pressure, and is illustrated to be a lowest-degree conservative stable pair for the Stokes problem on general triangulations.


title: Surface reconstruction of tetragonal methylammonium lead triiodide

abstract: We present a detailed first-principles analysis of the (001) surface of methylammonium lead triiodide (MAPbI3). With density-functional theory we investigate the atomic and electronic structure of the tetragonal (I4cm) phase of MAPbI3. We analysed surfaces models with MAI- (MAI-T) and PbI2-terminations(PbI2-T). For both terminations, we studied the clean-surface and a series of surface reconstructions. We find that the clean MAI-T model is more stable than its PbI2-T counterpart. For the MAI termination,reconstructions with added or removed units of nonpolar MAI and PbI2 are most stable. The corresponding band structures reveal surface states originating from the conduction band. Despite the presence of such additional surface states, our stable reconstructed surface models do not introduce new states within the band gap.


title: High $P_T$ Higgs excess as a signal of non-local QFT at the LHC

abstract: Non-local extensions of the Standard Model with a non-locality scale $\Lambda_{NL}$ have the effect of smearing the pointlike vertices of the Standard Model. At energies significantly lower than $\Lambda_{NL}$ vertices appear pointlike, while beyond this scale all beta functions vanish and all couplings approach a fixed point leading to scale invariance. Non-local SM extensions are ghost free, with the non-locality scale serving as an effective cutoff to radiative corrections of the Higgs mass. We argue that the data expected to be collected at the LHC phase 2 will have a sensitivity to non-local effects originating from a non-locality scale of a few TeV. Using an infinite derivative prescription, we study modifications to heavy vector-boson cross sections that can lead to an enhanced production of boosted Higgs bosons in a region of the kinematic phase space where the SM background is very small.


title: The global structure of the Milky Way's stellar halo based on the orbits of local metal-poor stars

abstract: We analyze the global structure of the Milky Way (MW)'s stellar halo including its dominant subcomponent, Gaia-Sausage-Enceladus (GSE). The method to reconstruct the global distribution of this old stellar component is to employ the superposition of the orbits covering over the large MW's space, where each of the orbit-weighting factor is assigned following the probability that the star is located at its currently observed position. The selected local, metal-poor sample with ${\rm [Fe/H]}<-1$ using {\it Gaia} EDR3 and SDSS DR16 shows that the global shape of the halo is systematically rounder at all radii in more metal-poor ranges, such that an axial ratio, $q$, is nearly 1 for ${\rm [Fe/H]}<-2.2$ and $\sim 0.7$ for $-1.4<{\rm [Fe/H]}<-1.0$. It is also found that a halo in relatively metal-rich range of ${\rm [Fe/H]}>-1.8$ actually shows a boxy/peanut-like shape, suggesting a major merger event. The distribution of azimuthal velocities shows a disk-like flattened structure at $-1.4<{\rm [Fe/H]}<-1.0$, which is thought to be the metal-weak thick disk. For the subsample of stars showing GSE-like kinematics and at ${\rm [Fe/H]}>-1.8$, its global density distribution is more spherical with $q \sim 0.9$ than the general halo sample, having an outer ridge at $r\sim20$~kpc. This spherical shape is consistent with the feature of accreted halo components and the ridge suggests that the orbit of GSE's progenitor has an apocenter of $\sim 20$~kpc. Implications for the formation of the stellar halo are also presented.


title: Shape of the asymptotic maximum sum-free sets in integer lattice grids

abstract: We determine the shape of all sum-free sets in $\{1,2,\ldots,n\}^2$ of size close to the maximum $\frac{3}{5}n^2$, solving a problem of Elsholtz and Rackham. We show that all such asymptotic maximum sum-free sets lie completely in the stripe $\frac{4}{5}n-o(n)\le x+y\le\frac{8}{5}n+ o(n)$. We also determine for any positive integer $p$ the maximum size of a subset $A\subseteq \{1,2,\ldots,n\}^2$ which forbids the triple $(x,y,z)$ satisfying $px+py=z$.


title: Zonal harmonics of solar magnetic field for solar cycle forecast

abstract: According to the scheme of action of the solar dynamo, the poloidal magnetic field can be considered a source of production of the toroidal magnetic field by the solar differential rotation. From the polar magnetic field proxies, it is natural to expect that solar Cycle 25 will be weak as recorded in sunspot data. We suggest that there are parameters of the zonal harmonics of the solar surface magnetic field, such as the magnitude of the $\ell$=3 harmonic or the effective multipole index, that can be used as a reasonable addition to the polar magnetic field proxies. We discuss also some specific features of solar activity indices in Cycles 23 and 24.


title: ShapeConv: Shape-aware Convolutional Layer for Indoor RGB-D Semantic Segmentation

abstract: RGB-D semantic segmentation has attracted increasing attention over the past few years. Existing methods mostly employ homogeneous convolution operators to consume the RGB and depth features, ignoring their intrinsic differences. In fact, the RGB values capture the photometric appearance properties in the projected image space, while the depth feature encodes both the shape of a local geometry as well as the base (whereabout) of it in a larger context. Compared with the base, the shape probably is more inherent and has a stronger connection to the semantics, and thus is more critical for segmentation accuracy. Inspired by this observation, we introduce a Shape-aware Convolutional layer (ShapeConv) for processing the depth feature, where the depth feature is firstly decomposed into a shape-component and a base-component, next two learnable weights are introduced to cooperate with them independently, and finally a convolution is applied on the re-weighted combination of these two components. ShapeConv is model-agnostic and can be easily integrated into most CNNs to replace vanilla convolutional layers for semantic segmentation. Extensive experiments on three challenging indoor RGB-D semantic segmentation benchmarks, i.e., NYU-Dv2(-13,-40), SUN RGB-D, and SID, demonstrate the effectiveness of our ShapeConv when employing it over five popular architectures. Moreover, the performance of CNNs with ShapeConv is boosted without introducing any computation and memory increase in the inference phase. The reason is that the learnt weights for balancing the importance between the shape and base components in ShapeConv become constants in the inference phase, and thus can be fused into the following convolution, resulting in a network that is identical to one with vanilla convolutional layers.


title: The VMC survey -- XLIV: Mapping metallicity trends in the Large Magellanic Cloud using near-infrared passbands

abstract: We have derived high-spatial-resolution metallicity maps covering $\sim$105~deg$^2$ across the Large Magellanic Cloud (LMC) using near-infrared passbands from the VISTA Survey of the Magellanic Clouds. We attempt to understand the metallicity distribution and gradients of the LMC up to a radius of $\sim$ 6~kpc. We identify red giant branch (RGB) stars in spatially distinct $Y, (Y-K_{\rm s})$ colour-magnitude diagrams. In any of our selected subregions, the RGB slope is used as an indicator of the average metallicity, based on calibration to metallicity using spectroscopic data. The mean LMC metallicity is [Fe/H] = $-$0.42~dex ($\sigma$[Fe/H] = 0.04~dex). We find the bar to be mildly metal-rich compared with the outer disc, showing evidence of a shallow gradient in metallicity ($-0.008 \pm 0.001$ dex kpc$^{-1}$) from the galaxy's centre to a radius of 6~kpc. Our results suggest that the LMC's stellar bar is chemically similar to the bars found in large spiral galaxies. The LMC's radial metallicity gradient is asymmetric. It is metal-poor and flatter towards the southwest, in the direction of the Bridge. This hints at mixing and/or distortion of the spatial metallicity distribution, presumably caused by tidal interactions between the Magellanic Clouds.


title: Raman Scattering as the Key Link Between Unidentified Infrared Bands, Diffuse Interstellar Bands, and Extended Red Emission

abstract: This paper calls attention to the relevance of Raman scattering by atomic hydrogen to three optical and near/mid-infrared spectral features of HI clouds: extended red emission (ERE), diffuse interstellar bands (DIBs), and the unidentified infrared bands (UIBs). DIBs, ERE, and UIBs are observed predominantly at the edge of HI clouds, are manifestly related, and remain poorly understood. Their salient properties correspond to two major characteristics of HI Raman scattering: unusual line broadenings and a concentration of the Raman scattered ultraviolet continuum in the vicinity of hydrogen's optical and infrared transitions. Raman scattering by atomic hydrogen has now been detected in several object classes where the spectral features are observed, and I argue that it can account for all three features. I further identify three factors that condition observation of Raman scattering in HI clouds, and thus of DIBs, ERE, and UIBs: the hardness of the radiation field, interstellar dust extinction, and the geometry of the observation. The geometry determines whether complete forward scattering, yielding DIBs, or scattering at large angles, yielding ERE in the vicinity of H{\alpha} and UIBs in the infrared spectrum, will be observed. ERE results from Raman scattering of photons near Ly\b{eta} and UIBs from excitation of hydrogen atoms close to the ionization limit. DIBs, ERE, UIBs are thus different facets of the same interstellar phenomenon: Raman scattering by atomic hydrogen.


title: Unsupervised Depth Completion with Calibrated Backprojection Layers

abstract: We propose a deep neural network architecture to infer dense depth from an image and a sparse point cloud. It is trained using a video stream and corresponding synchronized sparse point cloud, as obtained from a LIDAR or other range sensor, along with the intrinsic calibration parameters of the camera. At inference time, the calibration of the camera, which can be different than the one used for training, is fed as an input to the network along with the sparse point cloud and a single image. A Calibrated Backprojection Layer backprojects each pixel in the image to three-dimensional space using the calibration matrix and a depth feature descriptor. The resulting 3D positional encoding is concatenated with the image descriptor and the previous layer output to yield the input to the next layer of the encoder. A decoder, exploiting skip-connections, produces a dense depth map. The resulting Calibrated Backprojection Network, or KBNet, is trained without supervision by minimizing the photometric reprojection error. KBNet imputes missing depth value based on the training set, rather than on generic regularization. We test KBNet on public depth completion benchmarks, where it outperforms the state of the art by 30.5% indoor and 8.8% outdoor when the same camera is used for training and testing. When the test camera is different, the improvement reaches 62%. Code available at: https://github.com/alexklwong/calibrated-backprojection-network.


title: Nodal quintic surfaces and lines on cubic fourfolds

abstract: We study nodal quintic surfaces with an even set of 16 nodes as analogues of singular Kummer surfaces. The interpretation of the natural double cover of an even 16-nodal quintic as a certain Fano variety of lines could be viewed as a replacement for the additive structure of the cover of a singular Kummer surface by its associated abelian surface. Most of the results in this article can be seen as refinements of known facts and our arguments rely heavily on techniques developed by Beauville, Murre, and Voisin. Results due to Izadi and Shen are particularly close to some of the statements. In this sense, the text is mostly expository (but with complete proofs), although our arguments often differ substantially from the original sources.


title: Entropy-Aware Model Initialization for Effective Exploration in Deep Reinforcement Learning

abstract: Encouraging exploration is a critical issue in deep reinforcement learning. We investigate the effect of initial entropy that significantly influences the exploration, especially at the earlier stage. Our main observations are as follows: 1) low initial entropy increases the probability of learning failure, and 2) this initial entropy is biased towards a low value that inhibits exploration. Inspired by the investigations, we devise entropy-aware model initialization, a simple yet powerful learning strategy for effective exploration. We show that the devised learning strategy significantly reduces learning failures and enhances performance, stability, and learning speed through experiments.


title: Authentication and Access Control in 5G Device-to-Device Communication

abstract: Device-to-device (D2D) communication is one of the most recent advancements in wireless communication technology. It was introduced in cellular communication technology by the 3rd Generation Partnership Project (3GPP) to lay a foundation for the evolving 5G architecture. It has now emerged as a promising technology for proximate devices. It enables proximate devices to communicate directly without the involvement of a third party network infrastructure. Researchers are analysing various methods to facilitate the smooth integration of D2D communication technology into the existing network system architecture. This paper lists all the different possible modes of operation in D2D communication based on the varying use-case scenarios and highlights the security and privacy requirements for D2D communication. Some of the recent authentication proposals for D2D communication technology are further reviewed, and their security and privacy capabilities are analysed. Apart from authentication, we also reviewed some recent proposals of access control in D2D and highlighted the security issues addressed. We then identified the open issues that prevail in implementing D2D technology in a real-world scenario for future researchers, emphasising the existing authentication and access control techniques in D2D communication.


title: Design and Performance Evaluation of Joint Sensing and Communication Integrated System for 5G MmWave Enabled CAVs

abstract: The safety of connected automated vehicles (CAVs) relies on the reliable and efficient raw data sharing from multiple types of sensors. The 5G millimeter wave (mmWave) communication technology can enhance the environment sensing ability of different isolated vehicles. In this paper, a joint sensing and communication integrated system (JSCIS) is designed to support the dynamic frame structure configuration for sensing and communication dual functions based on the 5G New Radio protocol in the mmWave frequency band, which can solve the low latency and high data rate problems of raw sensing data sharing among CAVs. To evaluate the timeliness of raw sensing data transmission, the best time duration allocation ratio of sensing and communication dual functions for one vehicle is achieved by modeling the M/M/1 queuing problem using the age of information (AoI) in this paper. Furthermore, the resource allocation optimization problem among multiple CAVs is formulated as a non-cooperative game using the radar mutual information as a key indicator. And the feasibility and existence of pure strategy Nash equilibrium (NE) are proved theoretically, and a centralized time resource allocation (CTRA) algorithm is proposed to achieve the best feasible pure strategy NE. Finally, both simulation and hardware testbed are designed, and the results show that the proposed CTRA algorithm can improve the radar total mutual information by 26%, and the feasibility of the proposed JSCIS is achieved with an acceptable radar ranging accuracy within 0.25 m, as well as a stable data rate of 2.8 Gbps using the 28 GHz mmWave frequency band.


title: Making Person Search Enjoy the Merits of Person Re-identification

abstract: Person search is an extended task of person re-identification (Re-ID). However, most existing one-step person search works have not studied how to employ existing advanced Re-ID models to boost the one-step person search performance due to the integration of person detection and Re-ID. To address this issue, we propose a faster and stronger one-step person search framework, the Teacher-guided Disentangling Networks (TDN), to make the one-step person search enjoy the merits of the existing Re-ID researches. The proposed TDN can significantly boost the person search performance by transferring the advanced person Re-ID knowledge to the person search model. In the proposed TDN, for better knowledge transfer from the Re-ID teacher model to the one-step person search model, we design a strong one-step person search base framework by partially disentangling the two subtasks. Besides, we propose a Knowledge Transfer Bridge module to bridge the scale gap caused by different input formats between the Re-ID model and one-step person search model. During testing, we further propose the Ranking with Context Persons strategy to exploit the context information in panoramic images for better retrieval. Experiments on two public person search datasets demonstrate the favorable performance of the proposed method.


title: Gradient Flow Structure of a Multidimensional Nonlinear Sixth Order Quantum-Diffusion Equation

abstract: A nonlinear parabolic equation of sixth order is analyzed. The equation arises as a reduction of a model from quantum statistical mechanics, and also as the gradient flow of a second-order information functional with respect to the $L^2$-Wasserstein metric. First, we prove global existence of weak solutions for initial conditions of finite entropy by means of the time-discrete minimizing movement scheme. Second, we calculate the linearization of the dynamics around the unique stationary solution, for which we can explicitly compute the entire spectrum. A key element in our approach is a particular relation between the entropy, the Fisher information and the second order functional that generates the gradient flow under consideration.


title: Fritz John's equation in mechanism design

abstract: We show the role that an important equation first studied by Fritz John plays in mechanism design.


abstract: By providing explanations for users and system designers to facilitate better understanding and decision making, explainable recommendation has been an important research problem. In this paper, we propose Counterfactual Explainable Recommendation (CountER), which takes the insights of counterfactual reasoning from causal inference for explainable recommendation. CountER is able to formulate the complexity and the strength of explanations, and it adopts a counterfactual learning framework to seek simple (low complexity) and effective (high strength) explanations for the model decision. Technically, for each item recommended to each user, CountER formulates a joint optimization problem to generate minimal changes on the item aspects so as to create a counterfactual item, such that the recommendation decision on the counterfactual item is reversed. These altered aspects constitute the explanation of why the original item is recommended. The counterfactual explanation helps both the users for better understanding and the system designers for better model debugging. Another contribution of the work is the evaluation of explainable recommendation, which has been a challenging task. Fortunately, counterfactual explanations are very suitable for standard quantitative evaluation. To measure the explanation quality, we design two types of evaluation metrics, one from user's perspective (i.e. why the user likes the item), and the other from model's perspective (i.e. why the item is recommended by the model). We apply our counterfactual learning algorithm on a black-box recommender system and evaluate the generated explanations on five real-world datasets. Results show that our model generates more accurate and effective explanations than state-of-the-art explainable recommendation models.


title: Making RDBMSs Efficient on Graph Workloads Through Predefined Joins

abstract: Joins in native graph database management systems (GDBMSs) are predefined to the system as edges, which are indexed in adjacency list indices and serve as pointers. This contrasts with and can be more performant than value-based joins in RDBMSs and has lead researchers to investigate ways to integrate predefined joins directly into RDBMSs. Existing approaches adopt a strict separation of graph and relational data and processors, where a graph-specific processor uses left-deep and index nested loop joins for a subset of joins. This may be suboptimal, and may lead to non-sequential scans of data in some queries. We propose a purely relational approach to integrate predefined joins in columnar RDBMSs that uses row IDs (RIDs) of tuples as pointers. Users can predefine equality joins between any two tables, which leads to materializing RIDs in extended tables and optionally in RID indices. Instead of using the RID index to perform the join directly, we use it primarily in hash joins to generate semi-join filters that can be passed to scans using sideways information passing, ensuring sequential scans. In some settings, we also use RID indices to reduce the number of joins in query plans. Our approach does not introduce any graph-specific system components, can execute predefined joins on any join plan, and can improve performance on any workload that contains equality joins that can be predefined. We integrated our approach to DuckDB and call the resulting system {\em GRainDB}. We demonstrate that GRainDB far improves the performance of DuckDB on relational and graph workloads with large many-to-many joins, making it competitive with a state-of-the-art GDBMS, and incurs no major overheads otherwise.


title: Relating derived equivalences for simplices of higher-dimensional flops

abstract: I study a sequence of singularities in dimension 4 and above, each given by a cone of rank 1 tensors of a certain signature, which have crepant resolutions whose exceptional loci are isomorphic to cartesian powers of the projective line. In each dimension n, these resolutions naturally correspond to vertices of an (n-2)-simplex, and flops between them correspond to edges of the simplex. I show that each face of the simplex may then be associated to a certain relation between flop functors.


title: Comparison geometry for integral generalized quasi-Einstein tensor bounds

abstract: The purpose of this paper is to extend the mean curvature comparison and volume comparison estimates by Petersen, Sprouse, and Wei to integral generalized quasi-Einstein tensor. Moreover, we use our comparison results to get global diameter estimate.


title: Joint Learning Architecture for Multiple Object Tracking and Trajectory Forecasting

abstract: This paper introduces a joint learning architecture (JLA) for multiple object tracking (MOT) and trajectory forecasting in which the goal is to predict objects' current and future trajectories simultaneously. Motion prediction is widely used in several state of the art MOT methods to refine predictions in the form of bounding boxes. Typically, a Kalman Filter provides short-term estimations to help trackers correctly predict objects' locations in the current frame. However, the Kalman Filter-based approaches cannot predict non-linear trajectories. We propose to jointly train a tracking and trajectory forecasting model and use the predicted trajectory forecasts for short-term motion estimates in lieu of linear motion prediction methods such as the Kalman filter. We evaluate our JLA on the MOTChallenge benchmark. Evaluations result show that JLA performs better for short-term motion prediction and reduces ID switches by 33%, 31%, and 47% in the MOT16, MOT17, and MOT20 datasets, respectively, in comparison to FairMOT.


title: Current-component independent transition form factors for semileptonic and rare $D\to \pi(K)$ decays in the light-front quark model

abstract: We investigate the exclusive semileptonic and rare $D\to \pi(K)$ decays within the standard model together with the light-front quark model (LFQM) constrained by the variational principle for the QCD-motivated effective Hamiltonian. The form factors are obtained in the $q^+=0$ frame and then analytically continue to the physical timelike region. Together with our recent analysis of the current-component independent form factors $f_\pm(q^2)$ for the semileptonic decays, we present the current-component independent tensor form factor $f_T(q^2)$ for the rare decays to make the complete set of hadronic matrix elements regulating the semileptonic and rare $D\to\pi(K)$ decays in our LFQM. The tensor form factor $f_T(q^2)$ are obtained from two independent sets $(J^{+\perp}_T, J^{+-}_T)$ of the tensor current $J^{\mu\nu}_T$. As in our recent analysis of $f_-(q^2)$, we show that $f_T(q^2)$ obtained from the two different sets of the current components gives the identical result in the valence region of the $q^+=0$ frame without involving the explicit zero modes and the instantaneous contributions. The implications of the zero modes and the instantaneous contributions are also discussed in comparison between the manifestly covariant model and the standard LFQM. In our numerical calculations, we obtain the $q^2$-dependent form factors $(f_\pm, f_T)$ for $D\to\pi(K)$ and branching ratios for the semileptonic $D\to \pi(K)\ell\nu_\ell$ ($\ell=e,\mu$) decays. Our results show in good agreement with the available experimental data as well as other theoretical model predictions.


title: The wave front set correspondence for dual pairs with one member compact

abstract: Let W be a real symplectic space and (G,G') an irreducible dual pair in Sp(W), in the sense of Howe, with G compact. Let $\widetilde{\mathrm{G}}$ be the preimage of G in the metaplectic group $\widetilde{\mathrm{Sp}}(\mathrm{W})$. Given an irreducible unitary representation $\Pi$ of $\widetilde{\mathrm{G}}$ that occurs in the restriction of the Weil representation to $\widetilde{\mathrm{G}}$, let $\Theta_\Pi$ denote its character. We prove that, for the embedding $T$ of $\widetilde{\mathrm{Sp}}(\mathrm{W})$ in the space of tempered distributions on W given by the Weil representation, the distribution $T(\check\Theta_\Pi)$ has an asymptotic limit. This limit is an orbital integral over a nilpotent orbit $\mathcal O_m\subseteq \mathrm{W}$. The closure of the image of $\mathcal O_m$ in $\mathfrak{g}'$ under the moment map is the wave front set of $\Pi'$, the representation of $\widetilde{\mathrm{G}'}$ dual to $\Pi$.


title: NuSTAR and Swift Observations of the Extragalactic Black Hole X-ray Binaries

abstract: We present the results obtained from detailed spectral and timing studies of extra-galactic black hole X-ray binaries LMC~X--1 and LMC~X--3, using simultaneous observations with {\it Nuclear Spectroscopic Telescope Array (NuSTAR)} and {\it Neil Gehrels Swift} observatories. The combined spectra in the $0.5-30$~keV energy range, obtained between 2014 and 2019, are investigated for both sources. We do not find any noticeable variability in $0.5-30$~keV light curves, with $0.1-10$~Hz fractional rms estimated to be $<2$\%. No evidence of quasi-periodic oscillations is found in the power density spectra. The sources are found to be in the high soft state during the observations with disc temperature $T_{\rm in}\sim 1$~keV, photon index, $\Gamma > 2.5$ and thermal emission fraction, $f_{\rm disc}>80$\%. An Fe K$\alpha$ emission line is detected in the spectra of LMC~X--1, though no such feature is observed in the spectra of LMC~X--3. From the spectral modelling, the spins of the black holes in LMC~X--1 and LMC~X--3 are estimated to be in the range of $0.92-0.95$ and $0.19-0.29$, respectively. The accretion efficiency is found to be, $\eta \sim 0.13$ and $\eta \sim 0.04$ for LMC~X--1 and LMC~X--3, respectively.


title: The complexity of testing all properties of planar graphs, and the role of isomorphism

abstract: Consider property testing on bounded degree graphs and let $\varepsilon>0$ denote the proximity parameter. A remarkable theorem of Newman-Sohler (SICOMP 2013) asserts that all properties of planar graphs (more generally hyperfinite) are testable with query complexity only depending on $\varepsilon$. Recent advances in testing minor-freeness have proven that all additive and monotone properties of planar graphs can be tested in $poly(\varepsilon^{-1})$ queries. Some properties falling outside this class, such as Hamiltonicity, also have a similar complexity for planar graphs. Motivated by these results, we ask: can all properties of planar graphs can be tested in $poly(\varepsilon^{-1})$ queries? Is there a uniform query complexity upper bound for all planar properties, and what is the "hardest" such property to test? We discover a surprisingly clean and optimal answer. Any property of bounded degree planar graphs can be tested in $\exp(O(\varepsilon^{-2}))$ queries. Moreover, there is a matching lower bound, up to constant factors in the exponent. The natural property of testing isomorphism to a fixed graph needs $\exp(\Omega(\varepsilon^{-2}))$ queries, thereby showing that (up to polynomial dependencies) isomorphism to an explicit fixed graph is the hardest property of planar graphs. The upper bound is a straightforward adapation of the Newman-Sohler analysis that tracks dependencies on $\varepsilon$ carefully. The main technical contribution is the lower bound construction, which is achieved by a special family of planar graphs that are all mutually far from each other. We can also apply our techniques to get analogous results for bounded treewidth graphs. We prove that all properties of bounded treewidth graphs can be tested in $\exp(O(\varepsilon^{-1}\log \varepsilon^{-1}))$ queries. Moreover, testing isomorphism to a fixed forest requires $\exp(\Omega(\varepsilon^{-1}))$ queries.


title: Bound states in the continuum in periodic structures with structural disorder

abstract: We study the effect of structural disorder on the transition from the bound states in the continuum (BICs) to quasi-BICs by the example of the periodic photonic structure composed of two layers of parallel dielectric rods. We uncover the specificity in the robustness of the symmetry-protected and accidental BICs against various types of structural disorder. We analyze how the spatial mode localization induced by the structural disorder results in an effective reduction of the system length and limits the Q factor of quasi-BICs. Our results are essential for the practical implementation of BICs especially in natural and self-assembled photonic structures, where the structural disorder plays a crucial role.


title: StyleAugment: Learning Texture De-biased Representations by Style Augmentation without Pre-defined Textures

abstract: Recent powerful vision classifiers are biased towards textures, while shape information is overlooked by the models. A simple attempt by augmenting training images using the artistic style transfer method, called Stylized ImageNet, can reduce the texture bias. However, Stylized ImageNet approach has two drawbacks in fidelity and diversity. First, the generated images show low image quality due to the significant semantic gap betweeen natural images and artistic paintings. Also, Stylized ImageNet training samples are pre-computed before training, resulting in showing the lack of diversity for each sample. We propose a StyleAugment by augmenting styles from the mini-batch. StyleAugment does not rely on the pre-defined style references, but generates augmented images on-the-fly by natural images in the mini-batch for the references. Hence, StyleAugment let the model observe abundant confounding cues for each image by on-the-fly the augmentation strategy, while the augmented images are more realistic than artistic style transferred images. We validate the effectiveness of StyleAugment in the ImageNet dataset with robustness benchmarks, such as texture de-biased accuracy, corruption robustness, natural adversarial samples, and occlusion robustness. StyleAugment shows better generalization performances than previous unsupervised de-biasing methods and state-of-the-art data augmentation methods in our experiments.


title: A generative adversarial approach to facilitate archival-quality histopathologic diagnoses from frozen tissue sections

abstract: In clinical diagnostics and research involving histopathology, formalin fixed paraffin embedded (FFPE) tissue is almost universally favored for its superb image quality. However, tissue processing time (more than 24 hours) can slow decision-making. In contrast, fresh frozen (FF) processing (less than 1 hour) can yield rapid information but diagnostic accuracy is suboptimal due to lack of clearing, morphologic deformation and more frequent artifacts. Here, we bridge this gap using artificial intelligence. We synthesize FFPE-like images ,virtual FFPE, from FF images using a generative adversarial network (GAN) from 98 paired kidney samples derived from 40 patients. Five board-certified pathologists evaluated the results in a blinded test. Image quality of the virtual FFPE data was assessed to be high and showed a close resemblance to real FFPE images. Clinical assessments of disease on the virtual FFPE images showed a higher inter-observer agreement compared to FF images. The nearly instantaneously generated virtual FFPE images can not only reduce time to information but can facilitate more precise diagnosis from routine FF images without extraneous costs and effort.


title: Lossless Image Compression Using a Multi-Scale Progressive Statistical Model

abstract: Lossless image compression is an important technique for image storage and transmission when information loss is not allowed. With the fast development of deep learning techniques, deep neural networks have been used in this field to achieve a higher compression rate. Methods based on pixel-wise autoregressive statistical models have shown good performance. However, the sequential processing way prevents these methods to be used in practice. Recently, multi-scale autoregressive models have been proposed to address this limitation. Multi-scale approaches can use parallel computing systems efficiently and build practical systems. Nevertheless, these approaches sacrifice compression performance in exchange for speed. In this paper, we propose a multi-scale progressive statistical model that takes advantage of the pixel-wise approach and the multi-scale approach. We developed a flexible mechanism where the processing order of the pixels can be adjusted easily. Our proposed method outperforms the state-of-the-art lossless image compression methods on two large benchmark datasets by a significant margin without degrading the inference speed dramatically.