title: Controlled Mather-Thurston theorems

abstract: Classical results of Milnor, Wood, Mather, and Thurston produce flat connections in surprising places. The Milnor-Wood inequality is for circle bundles over surfaces, whereas the Mather-Thurston Theorem is about cobording general manifold bundles to ones admitting a flat connection. The surprise comes from the close encounter with obstructions from Chern-Weyl theory and other smooth obstructions such as the Bott classes and the Godbillion-Vey invariant. Contradiction is avoided because the structure groups for the positive results are larger than required for the obstructions, e.g. $\operatorname{PSL}(2,\mathbb{R})$ versus $\operatorname{U}(1)$ in the former case and $C^1$ versus $C^2$ in the latter. This paper adds two types of control strengthening the positive results: In many cases we are able to (1) refine the Mather-Thurston cobordism to a semi-$s$-cobordism (ssc) and (2) provide detail about how, and to what extent, transition functions must wander from an initial, small, structure group into a larger one. The motivation is to lay mathematical foundations for a physical program. The philosophy is that living in the IR we cannot expect to know, for a given bundle, if it has curvature or is flat, because we can't resolve the fine scale topology which may be present in the base, introduced by a ssc, nor minute symmetry violating distortions of the fiber. Small scale, UV, "distortions" of the base topology and structure group allow flat connections to simulate curvature at larger scales. The goal is to find a duality under which curvature terms, such as Maxwell's $F \wedge F^\ast$ and Hilbert's $\int R\ dvol$ are replaced by an action which measures such "distortions." In this view, curvature results from renormalizing a discrete, group theoretic, structure.


title: True{\AE}dapt: Learning Smooth Online Trajectory Adaptation with Bounded Jerk, Acceleration and Velocity in Joint Space

abstract: We present True{\AE}dapt, a model-free method to learn online adaptations of robot trajectories based on their effects on the environment. Given sensory feedback and future waypoints of the original trajectory, a neural network is trained to predict joint accelerations at regular intervals. The adapted trajectory is generated by linear interpolation of the predicted accelerations, leading to continuously differentiable joint velocities and positions. Bounded jerks, accelerations and velocities are guaranteed by calculating the range of valid accelerations at each decision step and clipping the network's output accordingly. A deviation penalty during the training process causes the adapted trajectory to follow the original one. Smooth movements are encouraged by penalizing high accelerations and jerks. We evaluate our approach by training a simulated KUKA iiwa robot to balance a ball on a plate while moving and demonstrate that the balancing policy can be directly transferred to a real robot.


title: Lower Bounds for Caching with Delayed Hits

abstract: Caches are a fundamental component of latency-sensitive computer systems. Recent work of [ASWB20] has initiated the study of delayed hits: a phenomenon in caches that occurs when the latency between the cache and backing store is much larger than the time between new requests. We present two results for the delayed hits caching model. (1) Competitive ratio lower bound. We prove that the competitive ratio of the algorithm in [ASWB20], and more generally of any deterministic online algorithm for delayed hits, is at least Omega(kZ), where k is the cache size and Z is the delay parameter. (2) Antimonotonicity of the delayed hits latency. Antimonotonicity is a naturally desirable property of cache latency: having a cache hit instead of a cache miss should result in lower overall latency. We prove that the latency of the delayed hits model is not antimonotone by exhibiting a scenario where having a cache hit instead of a miss results in an increase in overall latency. We additionally present a modification of the delayed hits model that makes the latency antimonotone.


title: Linguistic Features for Readability Assessment

abstract: Readability assessment aims to automatically classify text by the level appropriate for learning readers. Traditional approaches to this task utilize a variety of linguistically motivated features paired with simple machine learning models. More recent methods have improved performance by discarding these features and utilizing deep learning models. However, it is unknown whether augmenting deep learning models with linguistically motivated features would improve performance further. This paper combines these two approaches with the goal of improving overall model performance and addressing this question. Evaluating on two large readability corpora, we find that, given sufficient training data, augmenting deep learning models with linguistically motivated features does not improve state-of-the-art performance. Our results provide preliminary evidence for the hypothesis that the state-of-the-art deep learning models represent linguistic features of the text related to readability. Future research on the nature of representations formed in these models can shed light on the learned features and their relations to linguistically motivated ones hypothesized in traditional approaches.


title: The connection between Jackson and Hausdorff derivatives in the context of generalized statistical mechanics

abstract: In literature one can find many generalizations of the usual Leibniz derivative, such as Jackson derivative, Tsallis derivative and Hausdorff derivative. In this article we present a connection between Jackson derivative and recently proposed Hausdorff derivative. On one hand, the Hausdorff derivative has been previously associated with non-extensivity in systems presenting fractal aspects. On the other hand, the Jackson derivative has a solid mathematical basis because it is the $\overline{q}$-analog of the ordinary derivative and it also arises in quantum calculus. From a quantum deformed $\overline{q}$-algebra we obtain the Jackson derivative and then address the problem of $N$ non-interacting quantum oscillators. We perform an expansion in the quantum grand partition function from which we obtain a relationship between the parameter $\overline{q}$, related to Jackson derivative, and the parameters $\zeta$ and $q$ related to Hausdorff derivative and Tsallis derivative, respectively.


title: Numerical simulation of solitary gravity waves on deep water with constant vorticity

abstract: We present a numerical study of essentially nonlinear dynamics of surface gravity waves on deep water with constant vorticity using governing equations in conformal coordinates. The dispersion relation of surface gravity waves on shear flow is known to have two branches, one of which is weakly dispersive for long waves. Weakly nonlinear evolution of the waves of this branch can be described by the Benjamin-Ono equation, which is integrable and has soliton and multi-soliton solutions. Currently, the extent to which the properties of such solitary waves obtained within the weakly nonlinear model are preserved in the exact Euler equations is unknown. We investigate the behaviour of this class of solitary waves without the restrictive assumption of weak nonlinearity by using the exact Euler equations. The evolution of localized initial perturbations leading to the formation of single or multiple solitary waves is modeled, and the properties of finite-amplitude solitary waves are discussed. We show that within the framework of the exact equations, two-soliton collisions are almost elastic, but in contrast to solutions of the Benjamin-Ono equation the waves receive a phase shift as a result of the interaction.


title: Memory virtualization in virtualized systems: segmentation is better than paging

abstract: The utilization of paging for virtual machine (VM) memory management is the root cause of memory virtualization overhead. This paper shows that paging is not necessary in the hypervisor. In fact, memory fragmentation, which explains paging utilization, is not an issue in virtualized datacenters thanks to VM memory demand patterns. Our solution Compromis, a novel Memory Management Unit, uses direct segment for VM memory management combined with paging for VM's processes. The paper presents a systematic methodology for implementing Compromis in the hardware, the hypervisor and the datacenter scheduler. Evaluation results show that Compromis outperforms the two popular memory virtualization solutions: shadow paging and Extended Page Table by up to 30% and 370% respectively.


title: Prospect of the Electroweak Scale Right-handed neutrino model in the Lifetime Frontier

abstract: Motivated by the null results of the BSM searches in the post-Higgs era of the LHC, our current approach is to look for new physics shifting from theory driven search strategies to signature driven ones. One possible direction might come from investigating the long-lived particles (LLPs) present in various theoretical scenarios through the newly formed Lifetime frontier. In this talk, I discuss a non-sterile right-handed neutrino model consisting of EW-scale Majorana masses, having signals with large displaced vertices arising in both the fermion and scalar sectors. The characteristic features in this model, the displaced vertices, i.e. several charged tracks originating from a position separated from the proton interaction point has to be greater than a mm and can be as long as order of centimeters. These events originating from the decays of the mirror fermions produce promising signatures at the LHC environment due to the low associated backgrounds. We discuss the experimental implications and possible search strategies in this framework and LHCs potential to unravel these underlying events.


title: Dynamics of the family $\lambda$ tangent $z^2$

abstract: This article discusses some topological properties of the dynamical plane ($z$-plane) of the holomorphic family of meromorphic maps $\lambda \tan z^2$ for $ \lambda \in \mathbb C^*$. In the dynamical plane, I prove that there is no Herman ring and the Julia set is a Cantor set for the maps when the parameter is in the hyperbolic component containing the origin. Julia set is connected for the maps when the parameters are in other hyperbolic components in the parameter plane.


title: Inference tools for Markov Random Fields on lattices: The R package mrf2d

abstract: Markov random fields on two-dimensional lattices are behind many image analysis methodologies. mrf2d provides tools for statistical inference on a class of discrete stationary Markov random field models with pairwise interaction, which includes many of the popular models such as the Potts model and texture image models. The package introduces representations of dependence structures and parameters, visualization functions and efficient (C++ based) implementations of sampling algorithms, common estimation methods and other key features of the model, providing a useful framework to implement algorithms and working with the model in general. This paper presents a description and details of the package, as well as some reproducible examples of usage.


title: Comment on: "Development of the perturbation theory using polynomial solutions" J. Math. Phys. 60, 012103 (2019)

abstract: The purpose of this comment is to present the perturbation approach proposed by Maiz J. Math. Phys. 60, 012103 (2019) in a clearer way. The results of our straightforward procedure agree with those obtained by that author except for one case in which we obtain the exact result while he obtained an approximate one. In addition to it, we show that for sufficiently deep double-well potentials the perturbation approach deteriorates considerably.


title: An Empirical Study of Software Exceptions in the Field using Search Logs

abstract: Software engineers spend a substantial amount of time using Web search to accomplish software engineering tasks. Such search tasks include finding code snippets, API documentation, seeking help with debugging, etc. While debugging a bug or crash, one of the common practices of software engineers is to search for information about the associated error or exception traces on the internet. In this paper, we analyze query logs from a leading commercial general-purpose search engine (GPSE) such as Google, Yahoo! or Bing to carry out a large scale study of software exceptions. To the best of our knowledge, this is the first large scale study to analyze how Web search is used to find information about exceptions. We analyzed about 1 million exception related search queries from a random sample of 5 billion web search queries. To extract exceptions from unstructured query text, we built a novel and high-performance machine learning model with a F1-score of 0.82. Using the machine learning model, we extracted exceptions from raw queries and performed popularity, effort, success, query characteristic and web domain analysis. We also performed programming language-specific analysis to give a better view of the exception search behavior. These techniques can help improve existing methods, documentation and tools for exception analysis and prediction. Further, similar techniques can be applied for APIs, frameworks, etc.


title: Scheduling in the Random-Order Model

abstract: Makespan minimization on identical machines is a fundamental problem in online scheduling. The goal is to assign a sequence of jobs to $m$ identical parallel machines so as to minimize the maximum completion time of any job. Already in the 1960s, Graham showed that Greedy is $(2-1/m)$-competitive. The best deterministic online algorithm currently known achieves a competitive ratio of 1.9201. No deterministic online strategy can obtain a competitiveness smaller than 1.88. In this paper, we study online makespan minimization in the popular random-order model, where the jobs of a given input arrive as a random permutation. It is known that Greedy does not attain a competitive factor asymptotically smaller than 2 in this setting. We present the first improved performance guarantees. Specifically, we develop a deterministic online algorithm that achieves a competitive ratio of 1.8478. The result relies on a new analysis approach. We identify a set of properties that a random permutation of the input jobs satisfies with high probability. Then we conduct a worst-case analysis of our algorithm, for the respective class of permutations. The analysis implies that the stated competitiveness holds not only in expectation but with high probability. Moreover, it provides mathematical evidence that job sequences leading to higher performance ratios are extremely rare, pathological inputs. We complement the results by lower bounds, for the random-order model. We show that no deterministic online algorithm can achieve a competitive ratio smaller than 4/3. Moreover, no deterministic online algorithm can attain a competitiveness smaller than 3/2 with high probability.


title: Exploring Model Robustness with Adaptive Networks and Improved Adversarial Training

abstract: Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build more robust models, it is common practice to train on widened networks with more parameters. To boost robustness, we propose a conditional normalization module to adapt networks when conditioned on input samples. Our adaptive networks, once adversarially trained, can outperform their non-adaptive counterparts on both clean validation accuracy and robustness. Our method is objective agnostic and consistently improves both the conventional adversarial training objective and the TRADES objective. Our adaptive networks also outperform larger widened non-adaptive architectures that have 1.5 times more parameters. We further introduce several practical ``tricks'' in adversarial training to improve robustness and empirically verify their efficiency.


title: mTOF performance during mCBM beam time at GSI

abstract: The future Facility for Anti-proton and Ion Research (FAIR), currently in construction in Darmstadt, Germany, is one of the largest research projects worldwide. The Compressed Baryonic Matter (CBM) experiment is one of the main pillars at FAIR, studying the quantum chromodynamics (QCD) phase diagram at high baryon densities with unprecedented interaction rate in heavy ion collisions up to 10 MHz. This requires new data-driven readout chain, new data analysis methods and high-rate capable detector systems. The task of the CBM Time of Flight wall (CBM-TOF) is the charged particle identification. Multi-gap Resistive Plate Chambers (MRPCs) with different rate capabilities will be used at CBM-TOF corresponding regions. To reduce the commissioning time for CBM, a CBM full system test-setup called mini-CBM (mCBM) had been installed and tested with beams at GSI SIS18 facility in 2019. The high-rate MRPC prototypes developed at Tsinghua University, called MRPC2, were selected to be implemented in mTOF modules for mCBM. Additional thin float glass MRPCs from USTC called MRPC3, foreseen for the CBM lower rate region, were also tested in the mCBM experiment. Performance results of the two kinds of MRPCs analyzed by the so called tracking method will be shown.


title: Search for the rare decays $\pi^+ \to \mu^+\nu_\mu\nu\bar\nu$ and $\pi^+ \to e^+\nu_e\nu\bar\nu$

abstract: The rare pion decays ${\pi}^+{\rightarrow}{\mu}^+{\nu}_{\mu}{\nu}\bar{\nu}$ and ${\pi}^+{\rightarrow}e^+{\nu}_{e}{\nu}\bar{\nu}$ are allowed in the Standard Model but highly suppressed. These decays were searched for using data from the PIENU experiment. A first result for ${\Gamma}({\pi}^+{\rightarrow}{\mu}^+{\nu}_{\mu}{\nu}\bar{\nu})/{\Gamma}({\pi}^+{\rightarrow}{\mu}^+{\nu}_{\mu})<8.6{\times}10^{-6}$, and an improved measurement ${\Gamma}({\pi}^+{\rightarrow}{e}^+{\nu}_{e}{\nu}\bar{\nu})/{\Gamma}({\pi}^+{\rightarrow}{\mu}^+{\nu}_{\mu})<1.6{\times}10^{-7}$ were obtained.


title: Centralized and Decentralized Non-Cooperative Load-Balancing Games among Federated Cloudlets

abstract: Edge computing servers like cloudlets from different service providers compensate scarce computational, memory, and energy resources of mobile devices, are distributed across access networks. However, depending on the mobility pattern and dynamically varying computational requirements of associated mobile devices, cloudlets at different parts of the network become either overloaded or under-loaded. Hence, load balancing among neighboring cloudlets appears to be an essential research problem. Nonetheless, the existing load balancing frameworks are unsuitable for low-latency applications. Thus, in this paper, we propose an economic and non-cooperative load balancing game for low-latency applications among federated neighboring cloudlets from the same as well as different service providers and heterogeneous classes of job requests. Firstly, we propose a centralized incentive mechanism to compute the pure strategy Nash equilibrium load balancing strategies of the cloudlets under the supervision of a neutral mediator. With this mechanism, we ensure that the truthful revelation of private information to the mediator is a weakly-dominant strategy for all the federated cloudlets. Secondly, we propose a continuous-action reinforcement learning automata-based algorithm, which allows each cloudlet to independently compute the Nash equilibrium in a completely distributed network setting. We critically study the convergence properties of the designed learning algorithm, scaffolding our understanding of the underlying load balancing game for faster convergence. Furthermore, through extensive simulations, we study the impacts of exploration and exploitation on learning accuracy. This is the first study to show the effectiveness of reinforcement learning algorithms for load balancing games among neighboring cloudlets.


title: Langevin equation with nonlocal boundary conditions involving a $\psi$--Caputo fractional operator

abstract: This paper studies Langevin equation with nonlocal boundary conditions involving a $\psi$--Caputo fractional derivatives operator. By the aide of fixed point techniques of Krasnoselskii and Banach, we derive new results on existence and uniqueness of the problem at hand. Further, the $\psi $-fractional Gronwall inequality and $\psi $--fractional integration by parts are employed to prove Ulam--Hyers and Ulam--Hyers--Rassias stability for the solutions. Examples are gifted to demonstrate the advantage of our major results. The proposed results here are more general than the existing results in the literature and obtain them as particular cases.


title: The Expressive Power of a Class of Normalizing Flow Models

abstract: Normalizing flows have received a great deal of recent attention as they allow flexible generative modeling as well as easy likelihood computation. While a wide variety of flow models have been proposed, there is little formal understanding of the representation power of these models. In this work, we study some basic normalizing flows and rigorously establish bounds on their expressive power. Our results indicate that while these flows are highly expressive in one dimension, in higher dimensions their representation power may be limited, especially when the flows have moderate depth.


title: On the maximum Zagreb indices of bipartite graphs with given connectivity

abstract: The first Zagreb index $M_{1}$ of a graph is defined as the sum of the square of every vertex degree, and the second Zagreb index $M_{2}$ of a graph is defined as the sum of the product of vertex degrees of each pair of adjacent vertices. In this paper, we study the Zagreb indices of bipartite graphs of order $n$ with $\kappa(G)=k$ (resp. $\kappa'(G)=s$) and sharp upper bounds are obtained for $M_1(G)$ and $M_2(G)$ for $G\in \mathcal{V}^k_n$ (resp. $\mathcal{E}^s_n$), where $\mathcal{V}^k_n$ is the set of bipartite graphs of order $n$ with $\kappa(G)=k$, and $\mathcal{E}^s_n$ is the set of bipartite graphs of order $n$ with $\kappa'(G)=s$.


title: Normal state of Nd$_{1-x}$Sr$_x$NiO$_2$ from self-consistent $GW$+EDMFT

abstract: The recent discovery of superconductivity in hole-doped NdNiO$_2$ thin films has captivated the condensed matter physics community. Such compounds with a formal Ni$^+$ valence have been theoretically proposed as possible analogues of the cuprates, and the exploration of their electronic structure and pairing mechanism may provide important insights into the phenomenon of unconventional superconductivity. At the modeling level, there are however fundamental issues that need to be resolved. While it is generally agreed that the low-energy properties of cuprates can to a large extent be captured by a single-band model, there has been a controversy in the recent literature about the importance of a multi-band description of the nickelates. The origin of this controversy is that studies based entirely on density functional theory (DFT) calculations miss important correlation and multi-orbital effects induced by Hund coupling, while model calculations or simulations based on the combination of DFT and (extended) dynamical mean field theory ((E)DMFT) involve ad-hoc parameters and double counting corrections that substantially affect the results. Here we use a multi-site extension of the recently developed $GW$+EDMFT method, which is free of adjustable parameters, to self-consistently compute the interaction parameters and electronic structure of hole-doped NdNiO$_2$. This full ab-initio simulation demonstrates the importance of a multi-orbital description, even for the undoped compound, and produces results for the resistivity and Hall conductance in qualitative agreement with experiment.


title: Regular ideals of graph algebras

abstract: Let $C^*(E)$ be the graph C$^*$-algebra of a row-finite graph $E$. We give a complete description of the vertex sets of the gauge-invariant regular ideals of $C^*(E)$. It is shown that when $E$ satisfies Condition (L) the regular ideals $C^*(E)$ are a class of gauge-invariant ideals which preserve Condition (L) under quotients. That is, we show that if $E$ satisfies Condition (L) then a regular ideal $J \unlhd C^*(E)$ is necessarily gauge-invariant. Further, if $J \unlhd C^*(E)$ is a regular ideal, it is shown that $C^*(E)/J \simeq C^*(F)$ where $F$ satisfies Condition (L).


title: Twisting and satellite operations on P-fibered braids

abstract: A geometric braid $B$ can be interpreted as a loop in the space of monic complex polynomials with distinct roots. This loop defines a function $g:\mathbb{C}\times S^1\to\mathbb{C}$ that vanishes on $B$. We define the set of P-fibered braids as those braids that can be represented by loops of polynomials such that the corresponding function $g$ induces a fibration $\arg g:(\mathbb{C}\times S^1)\backslash B\to S^1$. We show that a certain satellite operation produces new P-fibered braids from known ones. We also prove that any braid $B$ with $n$ strands, $k_-$ negative and $k_+$ positive crossings can be turned into a P-fibered braid (and hence also into a braid whose closure is fibered) by adding at least $\tfrac{k_-+1}{n}$ negative or $\tfrac{k_+ +1}{n}$ positive full twists to it.


title: A Finite Population Destroys a Traveling Wave in Spatial Replicator Dynamics

abstract: We derive both the finite and infinite population spatial replicator dynamics as the fluid limit of a stochastic cellular automaton. The infinite population spatial replicator is identical to the model used by Vickers and our derivation justifies the addition of a diffusion to the replicator. The finite population form generalizes the results by Durett and Levin on finite spatial replicator games. We study the differences in the two equations as they pertain to a one-dimensional rock-paper-scissors game.


title: Prevalence Threshold and the Geometry of Screening Curves

abstract: The relationship between a screening tests' positive predictive value, $\rho$, and its target prevalence, $\phi$, is proportional - though not linear in all but a special case. In consequence, there is a point of local extrema of curvature defined only as a function of the sensitivity $a$ and specificity $b$ beyond which the rate of change of a test's $\rho$ drops precipitously relative to $\phi$. Herein, we show the mathematical model exploring this phenomenon and define the $prevalence$ $threshold$ ($\phi_e$) point where this change occurs as: $\phi_e=\frac{\sqrt{a\left(-b+1\right)}+b-1}{(\varepsilon-1)}$ where $\varepsilon$ = $a$+$b$. Using its radical conjugate, we obtain a simplified version of the equation: $\frac{\sqrt{1-b}}{\sqrt{a}+\sqrt{1-b}}$. From the prevalence threshold we deduce a more generalized relationship between prevalence and positive predictive value as a function of $\varepsilon$, which represents a fundamental theorem of screening, herein defined as: $\displaystyle\lim_{\varepsilon \to 2}{\displaystyle \int_{0}^{1}}{\rho(\phi)d\phi} = 1$ Understanding the concepts described in this work can help contextualize the validity of screening tests in real time, and help guide the interpretation of different clinical scenarios in which screening is undertaken.


title: Twisted Trilayer Graphene: a Precisely Tunable Platform for Correlated Electrons

abstract: We introduce twisted trilayer graphene (tTLG) with two independent twist angles as an ideal system for the precise tuning of the electronic interlayer coupling to maximize the effect of correlated behaviors. As established by experiment and theory in the related twisted bilayer graphene system, van Hove singularities (VHS) in the density of states can be used as a proxy of the tendency for correlated behaviors. To explore the evolution of VHS in the twist-angle phase space of tTLG, we present a general low-energy electronic structure model for any pair of twist angles. We show that the basis of the model has infinite dimensions even at a finite energy cutoff and that no Brillouin zone exists even in the continuum limit. Using this model, we demonstrate that the tTLG system exhibits a wide range of magic angles at which VHS merge and the density of states has a sharp peak at the charge-neutrality point through two distinct mechanisms: the incommensurate perturbation of twisted bilayer graphene's flat bands or the equal hybridization between two bilayer moir\'e superlattices.


title: Stanley's conjectures on the Stern poset

abstract: The Stern poset $\mathcal{S}$ is a graded infinite poset naturally associated to Stern's triangle, which was defined by Stanley analogously to Pascal's triangle. Let $P_n$ denote the interval of $\mathcal{S}$ from the unique element of row $0$ of Stern's triangle to the $n$-th element of row $r$ for sufficiently large $r$. For $n\geq 1$ let \begin{align*} L_n(q)&=2\cdot\left(\sum_{k=1}^{2^n-1}A_{P_k}(q)\right)+A_{P_{2^n}}(q), \end{align*} where $A_{P}(q)$ represents the corresponding $P$-Eulerian polynomial. For any $n\geq 1$ Stanley conjectured that $L_n(q)$ has only real zeros and $L_{4n+1}(q)$ is divisible by $L_{2n}(q)$. In this paper we obtain a simple recurrence relation satisfied by $L_n(q)$ and affirmatively solve Stanley's conjectures. We also establish the asymptotic normality of the coefficients of $L_n(q)$.


title: Optimal decay rates of the compressible Euler equations with time-dependent damping in $\mathbb R^n$: (I) under-damping case

abstract: This paper is concerned with the multi-dimensional compressible Euler equations with time-dependent damping of the form $-\frac{\mu}{(1+t)^\lambda}\rho\boldsymbol u$ in $\mathbb R^n$, where $n\ge2$, $\mu>0$, and $\lambda\in[0,1)$. When $\lambda>0$ is bigger, the damping effect time-asymptotically gets weaker, which is called under-damping. We show the optimal decay estimates of the solutions such that $\|\partial_x^\alpha (\rho-1)\|_{L^2(\mathbb R^n)}\approx (1+t)^{-\frac{1+\lambda}{2}(\frac{n}{2}+|\alpha|)}$, and $\|\partial_x^\alpha \boldsymbol u\|_{L^2(\mathbb R^n)}\approx (1+t)^{-\frac{1+\lambda}{2}(\frac{n}{2}+|\alpha|)-\frac{1-\lambda}{2}}$, and see how the under-damping effect influences the structure of the Euler system. Different from the traditional view that the stronger damping usually makes the solutions decaying faster, here surprisingly we recognize that the weaker damping with $0\le\lambda<1$ enhances the faster decay for the solutions. The adopted approach is the technical Fourier analysis and the Green function method. The main difficulties caused by the time-dependent damping lie in twofold: non-commutativity of the Fourier transform of the linearized operator precludes explicit expression of the fundamental solution; time-dependent evolution implies that the Green matrix $G(t,s)$ is not translation invariant, i.e., $G(t,s)\ne G(t-s,0)$. We formulate the exact decay behavior of the Green matrices $G(t,s)$ with respect to $t$ and $s$ for both linear wave equations and linear hyperbolic system, and finally derive the optimal decay rates for the nonlinear Euler system.


title: Doubly-Stochastic Normalization of the Gaussian Kernel is Robust to Heteroskedastic Noise

abstract: A fundamental step in many data-analysis techniques is the construction of an affinity matrix describing similarities between data points. When the data points reside in Euclidean space, a widespread approach is to from an affinity matrix by the Gaussian kernel with pairwise distances, and to follow with a certain normalization (e.g. the row-stochastic normalization or its symmetric variant). We demonstrate that the doubly-stochastic normalization of the Gaussian kernel with zero main diagonal (i.e., no self loops) is robust to heteroskedastic noise. That is, the doubly-stochastic normalization is advantageous in that it automatically accounts for observations with different noise variances. Specifically, we prove that in a suitable high-dimensional setting where heteroskedastic noise does not concentrate too much in any particular direction in space, the resulting (doubly-stochastic) noisy affinity matrix converges to its clean counterpart with rate $m^{-1/2}$, where $m$ is the ambient dimension. We demonstrate this result numerically, and show that in contrast, the popular row-stochastic and symmetric normalizations behave unfavorably under heteroskedastic noise. Furthermore, we provide examples of simulated and experimental single-cell RNA sequence data with intrinsic heteroskedasticity, where the advantage of the doubly-stochastic normalization for exploratory analysis is evident.


title: Optimal decay rates of the compressible Euler equations with time-dependent damping in $\mathbb R^n$: (II) over-damping case

abstract: This paper is concerned with the multi-dimensional compressible Euler equations with time-dependent over-damping of the form $-\frac{\mu}{(1+t)^\lambda}\rho\boldsymbol u$ in $\mathbb R^n$, where $n\ge2$, $\mu>0$, and $\lambda\in[-1,0)$. This continues our previous work dealing with the under-damping case for $\lambda\in[0,1)$. We show the optimal decay estimates of the solutions such that for $\lambda\in(-1,0)$ and $n\ge2$, $\|\rho-1\|_{L^2(\mathbb R^n)}\approx(1+t)^{-\frac{1+\lambda}{4}n}$ and $\|\boldsymbol u\|_{L^2(\mathbb R^n)}\approx (1+t)^{-\frac{1+\lambda}{4}n-\frac{1-\lambda}{2}}$, which indicates that a stronger damping gives rise to solutions decaying optimally slower. For the critical case of $\lambda=-1$, we prove the optimal logarithmical decay of the perturbation of density for the damped Euler equations such that $\|\rho-1\|_{L^2(\mathbb R^n)}\approx |\ln(e+t)|^{-\frac{n}{4}}$ and $\|\boldsymbol u\|_{L^2(\mathbb R^n)}\approx (1+t)^{-1}\cdot|\ln(e+t)|^{-\frac{n}{4}-\frac{1}{2}}$ for $n\ge7$. The over-damping effect reduces the decay rates of the solutions to be slow, which causes us some technical difficulty in obtaining the optimal decay rates by the Fourier analysis method and the Green function method. Here, we propose a new idea to overcome such a difficulty by artfully combining the Green function method and the time-weighted energy method.


title: Generalized Hamiltonian Dynamics and Chaos in Evolutionary Games on Networks

abstract: We study the network replicator equation and characterize its fixed points on arbitrary graph structures for $2 \times 2$ symmetric games. We show a relationship between the asymptotic behavior of the network replicator and the existence of an independent vertex set in the graph and also show that complex behavior cannot emerge in $2 \times 2$ games. This links a property of the dynamical system with a combinatorial graph property. We contrast this by showing that ordinary rock-paper-scissors (RPS) exhibits chaos on the 3-cycle and that on general graphs with $\geq 3$ vertices the network replicator with RPS is a generalized Hamiltonian system. This stands in stark contrast to the established fact that RPS does not exhibit chaos in the standard replicator dynamics or the bimatrix replicator dynamics, which is equivalent to the network replicator on a graph with one edge and two vertices ($K_2$).


title: A model for Dansgaard-Oeschger events and millennial-scale abrupt climate change without external forcing

abstract: We propose a conceptual model which generates abrupt climate changes akin to Dansgaard-Oeschger events. In the model these abrupt climate changes are not triggered by external perturbations but rather emerge in a dynamic self-consistent model through complex interactions of the ocean, the atmosphere and an intermittent process. The abrupt climate changes are caused in our model by intermittencies in the sea-ice cover. The ocean is represented by a Stommel two-box model, the atmosphere by a Lorenz-84 model and the sea-ice cover by a deterministic approximation of correlated additive and multiplicative noise (CAM) process. The key dynamical ingredients of the model are given by stochastic limits of deterministic multi-scale systems and recent results in deterministic homogenisation theory. The deterministic model reproduces statistical features of actual ice-core data such as non-Gaussian $\alpha$-stable behaviour. The proposed mechanism for abrupt millenial-scale climate change only relies on the existence of a quantity, which exhibits intermittent dynamics on an intermediate time scale. We consider as a particular mechanism intermittent sea-ice cover where the intermittency is generated by emergent atmospheric noise. However, other mechanisms such as freshwater influxes may also be formulated within the proposed framework.


title: Lyapunov exponents everywhere and rigidity

abstract: In the present work we obtain rigidity results analysing the set of regular points, in the sense of Oseledec's Theorem. It is presented a study on the possibility of an Anosov diffeomorphisms having all Lyapunov exponents defined everywhere. We prove that this condition implies local rigidity of an Anosov automorphism of the torus $\mathbb{T}^d, d \geq 3,$ $C^1-$close to a linear automorphism diagonalizable over $\mathbb{R}$ and such that its characteristic polynomial is irreducible over $\mathbb{Q}.$


title: Rigidity for Some Cases of Anosov Endomorphisms of Torus

abstract: We obtain smooth conjugacy between non-necessarily special Anosov endomorphisms in the conservative case. Among other results, we prove that a strongly special $C^{\infty}-$Anosov endomorphism of $\mathbb{T}^2$ and its linearization are smoothly conjugated since they have the same periodic data. Assuming that for a strongly special $C^{\infty}-$Anosov endomorphism of $\mathbb{T}^2$ every point is regular (in Oseledec's Theorem sense), then we obtain again smooth conjugacy with its linearization. We also obtain some results on local rigidity of linear Anosov endomorphisms of $d-$torus, where $d \geq 3,$ under periodic data assumption. The study of differential equations defined on invariant leaves plays an important role in rigidity problems such as those treated here.


title: Introducing Latent Timbre Synthesis

abstract: We present the Latent Timbre Synthesis (LTS), a new audio synthesis method using Deep Learning. The synthesis method allows composers and sound designers to interpolate and extrapolate between the timbre of multiple sounds using the latent space of audio frames. We provide the details of two Variational Autoencoder architectures for LTS, and compare their advantages and drawbacks. The implementation includes a fully working application with graphical user interface, called \textit{interpolate\_two}, which enables practitioners to explore the timbre between two audio excerpts of their selection using interpolation and extrapolation in the latent space of audio frames. Our implementation is open-source, and we aim to improve the accessibility of this technology by providing a guide for users with any technical background.


title: DANR: Discrepancy-aware Network Regularization

abstract: Network regularization is an effective tool for incorporating structural prior knowledge to learn coherent models over networks, and has yielded provably accurate estimates in applications ranging from spatial economics to neuroimaging studies. Recently, there has been an increasing interest in extending network regularization to the spatio-temporal case to accommodate the evolution of networks. However, in both static and spatio-temporal cases, missing or corrupted edge weights can compromise the ability of network regularization to discover desired solutions. To address these gaps, we propose a novel approach---{\it discrepancy-aware network regularization} (DANR)---that is robust to inadequate regularizations and effectively captures model evolution and structural changes over spatio-temporal networks. We develop a distributed and scalable algorithm based on the alternating direction method of multipliers (ADMM) to solve the proposed problem with guaranteed convergence to global optimum solutions. Experimental results on both synthetic and real-world networks demonstrate that our approach achieves improved performance on various tasks, and enables interpretation of model changes in evolving networks.


title: A Virtual Obstacle Course within Diverse Sensory Environments

abstract: We developed a novel assessment platform with untethered virtual reality, 3-dimensional sounds, and pressure sensing floor mat to help assess the walking balance and negotiation of obstacles given diverse sensory load and/or cognitive load. The platform provides an immersive 3D city-like scene with anticipated/unanticipated virtual obstacles. Participants negotiate the obstacles with perturbations of: auditory load by spatial audio, cognitive load by a memory task, and visual flow by generated by avatars movements at various amounts and speeds. A VR headset displays the scenes while providing real-time position and orientation of the participant's head. A pressure-sensing walkway senses foot pressure and visualizes it in a heatmap. The system helps to assess walking balance via pressure dynamics per foot, success rate of crossing obstacles, available response time as well as head kinematics in response to obstacles and multitasking. Based on the assessment, specific balance training and fall prevention program can be prescribed.


title: Superconducting Nanowire Single-Photon Detectors for Quantum Information

abstract: The superconducting nanowire single-photon detector (SNSPD) is a quantum-limit superconducting optical detector based on the Cooper-pair breaking effect by a single photon, which exhibits a higher detection efficiency, lower dark count rate, higher counting rate, and lower timing jitter when compared with those exhibited by its counterparts. SNSPDs have been extensively applied in quantum information processing, including quantum key distribution and optical quantum computation. In this review, we present the requirements of single-photon detectors from quantum information, as well as the principle, key metrics, latest performance issues and other issues associated with SNSPD. The representative applications of SNSPDs with respect to quantum information will also be covered.


title: Attribute-Induced Bias Eliminating for Transductive Zero-Shot Learning

abstract: Transductive Zero-shot learning (ZSL) targets to recognize the unseen categories by aligning the visual and semantic information in a joint embedding space. There exist four kinds of domain biases in Transductive ZSL, i.e., visual bias and semantic bias between two domains and two visual-semantic biases in respective seen and unseen domains, but existing work only focuses on the part of them, which leads to severe semantic ambiguity during the knowledge transfer. To solve the above problem, we propose a novel Attribute-Induced Bias Eliminating (AIBE) module for Transductive ZSL. Specifically, for the visual bias between two domains, the Mean-Teacher module is first leveraged to bridge the visual representation discrepancy between two domains with unsupervised learning and unlabelled images. Then, an attentional graph attribute embedding is proposed to reduce the semantic bias between seen and unseen categories, which utilizes the graph operation to capture the semantic relationship between categories. Besides, to reduce the semantic-visual bias in the seen domain, we align the visual center of each category, instead of the individual visual data point, with the corresponding semantic attributes, which further preserves the semantic relationship in the embedding space. Finally, for the semantic-visual bias in the unseen domain, an unseen semantic alignment constraint is designed to align visual and semantic space in an unsupervised manner. The evaluations on several benchmarks demonstrate the effectiveness of the proposed method, e.g., obtaining the 82.8%/75.5%, 97.1%/82.5%, and 73.2%/52.1% for Conventional/Generalized ZSL settings for CUB, AwA2, and SUN datasets, respectively.


title: Two-stage short-term wind power forecasting algorithm using different feature-learning models

abstract: Two-stage ensemble-based forecasting methods have been studied extensively in the wind power forecasting field. However, deep learning-based wind power forecasting studies have not investigated two aspects. In the first stage, different learning structures considering multiple inputs and multiple outputs have not been discussed. In the second stage, the model extrapolation issue has not been investigated. Therefore, we develop four deep neural networks for the first stage to learn data features considering the input-and-output structure. We then explore the model extrapolation issue in the second stage using different modeling methods. Considering the overfitting issue, we propose a new moving window-based algorithm using a validation set in the first stage to update the training data in both stages with two different moving window processes.Experiments were conducted at three wind farms, and the results demonstrate that the model with single input multiple output structure obtains better forecasting accuracy compared to existing models. In addition, the ridge regression method results in a better ensemble model that can further improve forecasting accuracy compared to existing machine learning methods. Finally, the proposed two-stage forecasting algorithm can generate more accurate and stable results than existing algorithms.


title: DC-UNet: Rethinking the U-Net Architecture with Dual Channel Efficient CNN for Medical Images Segmentation

abstract: Recently, deep learning has become much more popular in computer vision area. The Convolution Neural Network (CNN) has brought a breakthrough in images segmentation areas, especially, for medical images. In this regard, U-Net is the predominant approach to medical image segmentation task. The U-Net not only performs well in segmenting multimodal medical images generally, but also in some tough cases of them. However, we found that the classical U-Net architecture has limitation in several aspects. Therefore, we applied modifications: 1) designed efficient CNN architecture to replace encoder and decoder, 2) applied residual module to replace skip connection between encoder and decoder to improve based on the-state-of-the-art U-Net model. Following these modifications, we designed a novel architecture--DC-UNet, as a potential successor to the U-Net architecture. We created a new effective CNN architecture and build the DC-UNet based on this CNN. We have evaluated our model on three datasets with tough cases and have obtained a relative improvement in performance of 2.90%, 1.49% and 11.42% respectively compared with classical U-Net. In addition, we used the Tanimoto similarity to replace the Jaccard similarity for gray-to-gray image comparisons.


title: Exact solutions to planar emittance growth problems

abstract: This paper is the first in a series which develops the theory of emittance dynamics based on simple statistical reasoning. Emittance is a central quantity used to characterize the quality of electron microscopes, photon sources and particle beams. Emittance growth in high intensity charged particle beams is a particularly challenging non-equilibrium statistical physics problem in which effects such as disordered-induced heating and charge reorganization can lead to very rapid degradation of emittance and beam quality. The concepts of free energy and entropy have been utilized to improve conceptual understanding of emittance dynamics. Here we develop a theory based on the second order cumulant of particle distributions and use this formulation to exactly solve several one dimensional problems. These solutions are important extensions of the existing results for the free expansion dynamics of pancake bunches used in ultrafast electron microscopy, which at short times are known to expand quadratically with time[1-3]. Here we show that the squared emittance of a strictly planar expanding bunch increases as a quadratic polynomial of time. We compare theories based on individual particle trajectories with theories based on distributions and expand the foundations of theories based on individual particle trajectories, which we call the "sample picture". Our later work uses this formulation to derive generalized envelope equations which capture emittance growth effects in two and three dimensional systems. 1. B. J. Siwick, J. R. Dwyer, R. E. Jordan, and R. J. Dwayne Miller, Journal of Applied Physics 92, 1643 (2002). 2. B. W. Reed, Journal of Applied Physics 100, 034916 (2006). 3. B. Zerbe, X. Xiang, C.-Y. Ruan, S. Lund, and P. Duxbury, Physical Review Accelerators and Beams 21, 064201 (2018).


title: Adaptive Digital PID Control of a Quadcopter with Unknown Dynamics

abstract: This paper develops an adaptive autopilot for quadcopters with unknown dynamics. To do this, the PX4 autopilot architecture is modified so that the feedback and feedforward controllers are replaced by adaptive control laws based on retrospective cost adaptive control (RCAC). The present paper provides a numerical investigation of the performance of the adaptive autopilot on a quadcopter with unknown dynamics. In order to reflect the absence of prior modeling information, all of the adaptive digital controllers are initialized at zero gains. In addition, moment-of-inertia of the quadcopter is varied to test the robustness of the adaptive autopilot. In all test cases, the vehicle is commanded to follow a given trajectory, and the resulting performance is examined.


title: Variational Reward Estimator Bottleneck: Learning Robust Reward Estimator for Multi-Domain Task-Oriented Dialog

abstract: Despite its notable success in adversarial learning approaches to multi-domain task-oriented dialog system, training the dialog policy via adversarial inverse reinforcement learning often fails to balance the performance of the policy generator and reward estimator. During optimization, the reward estimator often overwhelms the policy generator and produces excessively uninformative gradients. We proposes the Variational Reward estimator Bottleneck (VRB), which is an effective regularization method that aims to constrain unproductive information flows between inputs and the reward estimator. The VRB focuses on capturing discriminative features, by exploiting information bottleneck on mutual information. Empirical results on a multi-domain task-oriented dialog dataset demonstrate that the VRB significantly outperforms previous methods.


title: Learning to refer informatively by amortizing pragmatic reasoning

abstract: A hallmark of human language is the ability to effectively and efficiently convey contextually relevant information. One theory for how humans reason about language is presented in the Rational Speech Acts (RSA) framework, which captures pragmatic phenomena via a process of recursive social reasoning (Goodman & Frank, 2016). However, RSA represents ideal reasoning in an unconstrained setting. We explore the idea that speakers might learn to amortize the cost of RSA computation over time by directly optimizing for successful communication with an internal listener model. In simulations with grounded neural speakers and listeners across two communication game datasets representing synthetic and human-generated data, we find that our amortized model is able to quickly generate language that is effective and concise across a range of contexts, without the need for explicit pragmatic reasoning.


title: The Coarea Inequality

abstract: The aim of this paper is to provide a self-contained proof of a general case of the coarea inequality, also known as the Eilenberg inequality. The result is known, but we are not aware of any place that a proof would be written with all details. The known proof is based on a difficult result of Davies. Our proof is elementary and does not use Davies' theorem. Instead we use an elegant argument that we learned from Nazarov through MathOverflow. We also obtain some generalizations of the coarea inequality.


title: VIR-SLAM: Visual, Inertial, and Ranging SLAM for single and multi-robot systems

abstract: Monocular cameras coupled with inertial measurements generally give high performance visual inertial odometry. However, drift can be significant with long trajectories, especially when the environment is visually challenging. In this paper, we propose a system that leverages ultra-wideband ranging with one static anchor placed in the environment to correct the accumulated error whenever the anchor is visible. We also use this setup for collaborative SLAM: different robots use mutual ranging (when available) and the common anchor to estimate the transformation between each other, facilitating map fusion Our system consists of two modules: a double layer ranging, visual, and inertial odometry for single robots, and a transformation estimation module for collaborative SLAM. We test our system on public datasets by simulating an ultra-wideband sensor as well as on real robots. Experiments show our method can outperform state-of-the-art visual-inertial odometry by more than 20%. For visually challenging environments, our method works even the visual-inertial odometry has significant drift Furthermore, we can compute the collaborative SLAM transformation matrix at almost no extra computation cost.


title: Analyzing Student Strategies In Blended Courses Using Clickstream Data

abstract: Educational software data promises unique insights into students' study behaviors and drivers of success. While much work has been dedicated to performance prediction in massive open online courses, it is unclear if the same methods can be applied to blended courses and a deeper understanding of student strategies is often missing. We use pattern mining and models borrowed from Natural Language Processing (NLP) to understand student interactions and extract frequent strategies from a blended college course. Fine-grained clickstream data is collected through Diderot, a non-commercial educational support system that spans a wide range of functionalities. We find that interaction patterns differ considerably based on the assessment type students are preparing for, and many of the extracted features can be used for reliable performance prediction. Our results suggest that the proposed hybrid NLP methods can provide valuable insights even in the low-data setting of blended courses given enough data granularity.


title: EBBINNOT: A Hardware Efficient Hybrid Event-Frame Tracker for Stationary Dynamic Vision Sensors

abstract: As an alternative sensing paradigm, dynamic vision sensors (DVS) have been recently explored to tackle scenarios where conventional sensors result in high data rate and processing time. This paper presents a hybrid event-frame approach for detecting and tracking objects recorded by a stationary neuromorphic sensor, thereby exploiting the sparse DVS output in a low-power setting for traffic monitoring. Specifically, we propose a hardware efficient processing pipeline that optimizes memory and computational needs that enable long-term battery powered usage for IoT applications. To exploit the background removal property of a static DVS, we propose an event-based binary image creation that signals presence or absence of events in a frame duration. This reduces memory requirement and enables usage of simple algorithms like median filtering and connected component labeling for denoise and region proposal respectively. To overcome the fragmentation issue, a YOLO inspired neural network based detector and classifier to merge fragmented region proposals has been proposed. Finally, a new overlap based tracker was implemented, exploiting overlap between detections and tracks is proposed with heuristics to overcome occlusion. The proposed pipeline is evaluated with more than 5 hours of traffic recording spanning three different locations on two different neuromorphic sensors (DVS and CeleX) and demonstrate similar performance. Compared to existing event-based feature trackers, our method provides similar accuracy while needing approx 6 times less computes. To the best of our knowledge, this is the first time a stationary DVS based traffic monitoring solution is extensively compared to simultaneously recorded RGB frame-based methods while showing tremendous promise by outperforming state-of-the-art deep learning solutions.


title: A New Accelerated Stochastic Gradient Method with Momentum

abstract: In this paper, we propose a novel accelerated stochastic gradient method with momentum, which momentum is the weighted average of previous gradients. The weights decays inverse proportionally with the iteration times. Stochastic gradient descent with momentum (Sgdm) use weights that decays exponentially with the iteration times to generate an momentum term. Using exponentially decaying weights, variants of Sgdm with well designed and complicated formats have been proposed to achieve better performance. The momentum update rules of our method is as simple as that of Sgdm. We provide theoretical convergence properties analyses for our method, which show both the exponentially decay weights and our inverse proportionally decay weights can limit the variance of the moving direction of parameters to be optimized to a region. Experimental results empirically show that our method works well with practical problems and outperforms Sgdm, and it outperforms Adam in convolutional neural networks.


title: HMPO: Human Motion Prediction in Occluded Environments for Safe Motion Planning

abstract: We present a novel approach to generate collision-free trajectories for a robot operating in close proximity with a human obstacle in an occluded environment. The self-occlusions of the robot can significantly reduce the accuracy of human motion prediction, and we present a novel deep learning-based prediction algorithm. Our formulation uses CNNs and LSTMs and we augment human-action datasets with synthetically generated occlusion information for training. We also present an occlusion-aware planner that uses our motion prediction algorithm to compute collision-free trajectories. We highlight performance of the overall approach (HMPO) in complex scenarios and observe upto 68% performance improvement in motion prediction accuracy, and 38% improvement in terms of error distance between the ground-truth and the predicted human joint positions.


title: Momentum-based variance-reduced proximal stochastic gradient method for composite nonconvex stochastic optimization

abstract: Stochastic gradient methods (SGMs) have been extensively used for solving stochastic problems or large-scale machine learning problems. Recent works employ various techniques to improve the convergence rate of SGMs for both convex and nonconvex cases. Most of them require a large number of samples in some or all iterations of the improved SGMs. In this paper, we propose a new SGM, named PStorm, for solving nonconvex nonsmooth stochastic problems. With a momentum-based variance reduction technique, PStorm can achieve the optimal complexity result $O(\varepsilon^{-3})$ to produce a stochastic $\varepsilon$-stationary solution, if a mean-squared smoothness condition holds. Different from existing optimal methods, PStorm can achieve the ${O}(\varepsilon^{-3})$ result by using only one or $O(1)$ samples in every update. With this property, PStorm can be applied to online learning problems that favor real-time decisions based on one or $O(1)$ new observations. In addition, for large-scale machine learning problems, PStorm can generalize better by small-batch training than other optimal methods that require large-batch training and the vanilla SGM, as we demonstrate on training a sparse fully-connected neural network and a sparse convolutional neural network.


title: Fisher's combined probability test for high-dimensional covariance matrices

abstract: Testing large covariance matrices is of fundamental importance in statistical analysis with high-dimensional data. In the past decade, three types of test statistics have been studied in the literature: quadratic form statistics, maximum form statistics, and their weighted combination. It is known that quadratic form statistics would suffer from low power against sparse alternatives and maximum form statistics would suffer from low power against dense alternatives. The weighted combination methods were introduced to enhance the power of quadratic form statistics or maximum form statistics when the weights are appropriately chosen. In this paper, we provide a new perspective to exploit the full potential of quadratic form statistics and maximum form statistics for testing high-dimensional covariance matrices. We propose a scale-invariant power enhancement test based on Fisher's method to combine the p-values of quadratic form statistics and maximum form statistics. After carefully studying the asymptotic joint distribution of quadratic form statistics and maximum form statistics, we prove that the proposed combination method retains the correct asymptotic size and boosts the power against more general alternatives. Moreover, we demonstrate the finite-sample performance in simulation studies and a real application.


title: Improved bounds for the eigenvalues of prolate spheroidal wave functions and discrete prolate spheroidal sequences

abstract: The discrete prolate spheroidal sequences (DPSSs) are a set of orthonormal sequences in $\ell_2(\mathbb{Z})$ which are strictly bandlimited to a frequency band $[-W,W]$ and maximally concentrated in a time interval $\{0,\ldots,N-1\}$. The timelimited DPSSs (sometimes referred to as the Slepian basis) are an orthonormal set of vectors in $\mathbb{C}^N$ whose discrete time Fourier transform (DTFT) is maximally concentrated in a frequency band $[-W,W]$. Due to these properties, DPSSs have a wide variety of signal processing applications. The DPSSs are the eigensequences of a timelimit-then-bandlimit operator and the Slepian basis vectors are the eigenvectors of the so-called prolate matrix. The eigenvalues in both cases are the same, and they exhibit a particular clustering behavior -- slightly fewer than $2NW$ eigenvalues are very close to $1$, slightly fewer than $N-2NW$ eigenvalues are very close to $0$, and very few eigenvalues are not near $1$ or $0$. This eigenvalue behavior is critical in many of the applications in which DPSSs are used. There are many asymptotic characterizations of the number of eigenvalues not near $0$ or $1$. In contrast, there are very few non-asymptotic results, and these don't fully characterize the clustering behavior of the DPSS eigenvalues. In this work, we establish two novel non-asymptotic bounds on the number of DPSS eigenvalues between $\epsilon$ and $1-\epsilon$. Also, we obtain bounds detailing how close the first $\approx 2NW$ eigenvalues are to $1$ and how close the last $\approx N-2NW$ eigenvalues are to $0$. Furthermore, we extend these results to the eigenvalues of the prolate spheroidal wave functions (PSWFs), which are the continuous-time version of the DPSSs. Finally, we present numerical experiments demonstrating the quality of our non-asymptotic bounds on the number of DPSS eigenvalues between $\epsilon$ and $1-\epsilon$.


title: Sparse Network Optimization for Synchronization

abstract: We propose new mathematical optimization models for generating sparse dynamical graphs, or networks, that can achieve synchronization. The synchronization phenomenon is studied using the Kuramoto model, defined in terms of the adjacency matrix of the graph and the coupling strength of the network, modelling the so-called coupled oscillators. Besides sparsity, we aim to obtain graphs which have good connectivity properties, resulting in small coupling strength for synchronization. We formulate three mathematical optimization models for this purpose. Our first model is a mixed integer optimization problem, subject to ODE constraints, reminiscent of an optimal control problem. As expected, this problem is computationally very challenging, if not impossible, to solve, not only because it involves binary variables but also some of its variables are functions. The second model is a continuous relaxation of the first one, and the third is a discretization of the second, which is computationally tractable by employing standard optimization software. We design dynamical graphs that synchronize, by solving the relaxed problem and applying a practical algorithm for various graph sizes, with randomly generated intrinsic natural frequencies and initial phase variables. We test robustness of these graphs by carrying out numerical simulations with random data and constructing the expected value of the network's order parameter and its variance under this random data, as a guide for assessment.


title: Pseudo-Representation Labeling Semi-Supervised Learning

abstract: In recent years, semi-supervised learning (SSL) has shown tremendous success in leveraging unlabeled data to improve the performance of deep learning models, which significantly reduces the demand for large amounts of labeled data. Many SSL techniques have been proposed and have shown promising performance on famous datasets such as ImageNet and CIFAR-10. However, some exiting techniques (especially data augmentation based) are not suitable for industrial applications empirically. Therefore, this work proposes the pseudo-representation labeling, a simple and flexible framework that utilizes pseudo-labeling techniques to iteratively label a small amount of unlabeled data and use them as training data. In addition, our framework is integrated with self-supervised representation learning such that the classifier gains benefits from representation learning of both labeled and unlabeled data. This framework can be implemented without being limited at the specific model structure, but a general technique to improve the existing model. Compared with the existing approaches, the pseudo-representation labeling is more intuitive and can effectively solve practical problems in the real world. Empirically, it outperforms the current state-of-the-art semi-supervised learning methods in industrial types of classification problems such as the WM-811K wafer map and the MIT-BIH Arrhythmia dataset.


title: Extensions of Rosenblatt's results on the asymptotic behavior of the prediction error for deterministic stationary sequences

abstract: One of the main problem in prediction theory of discrete-time second-order stationary processes $X(t)$ is to describe the asymptotic behavior of the best linear mean squared prediction error in predicting $X(0)$ given $ X(t),$ $-n\le t\le-1$, as $n$ goes to infinity. This behavior depends on the regularity (deterministic or non-deterministic) of the process $X(t)$. In his seminal paper {\it "Some purely deterministic processes" (J. of Math. and Mech.,} 6(6), 801-810, 1957), M. Rosenblatt has described the asymptotic behavior of the prediction error for discrete-time deterministic processes in the following two cases: (a) the spectral density $f(\lambda)$ of $X(t)$ is continuous and vanishes on an interval, (b) the spectral density $f(\lambda)$ has a very high order contact with zero. He showed that in the case (a) the prediction error variance behaves exponentially, while in the case (b), it behaves hyperbolically as $n\to\infty$. In this paper, using a new approach, we describe extensions of Rosenblatt's results to broader classes of spectral densities. Examples illustrate the obtained results.


title: Crossover from BKT-Rough to KPZ-Rough Surfaces for Interface-Limited Crystal Growth/Recession

abstract: The crossover from a Berezinskii--Kosterlitz--Thouless (BKT) rough surface to a Kardar--Parisi--Zhang (KPZ) rough surface on a vicinal surface is studied using the Monte Carlo method in the non-equilibrium steady state in order to address discrepancies between theoretical results and experiments. The model used is a restricted solid-on-solid (RSOS) model with a discrete Hamiltonian without surface or volume diffusion (interface limited growth/recession). The temperature, driving force for growth, system size, and surface slope dependences of the surface width are calculated for vicinal surfaces tilted between the (001) and (111) surfaces. The surface velocity, kinetic coefficient of the surface, and mean height of the locally merged steps are also calculated. In contrast to the accepted theory for (2+1) surfaces, we found that the crossover point from a BKT (logarithmic) rough surface to a KPZ (algebraic) rough surface is different from the kinetic roughening point for the (001) surface. The driving force for crystal growth was found to be a relevant parameter for determining whether the system is in the BKT class or the KPZ class. It was also determined that ad-atoms, ad-holes, islands, and negative-islands block surface fluctuations, which contributes to making a BKT-rough surface.


title: Participatory Design to build better contact- and proximity-tracing apps

abstract: With the push for contact- and proximity-tracing solutions as a means to manage the spread of the pandemic, there is a distrust between the citizens and authorities that are deploying these solutions. The efficacy of the solutions relies on meeting a minimum uptake threshold which is hitting a barrier because of a lack of trust and transparency in how these solutions are being developed. We propose participatory design as a mechanism to evoke trust and explore how it might be applied to co-create technological solutions that not only meet the needs of the users better but also expand their reach to underserved and high-risk communities. We also highlight the role of the bazaar model of development and complement that with quantitative and qualitative metrics for evaluating the solutions and convincing policymakers and other stakeholders in the value of this approach with empirical evidence.


title: The nonequilibrium back-reaction of Hawking radiation to a Schwarzschild black hole

abstract: We investigate the nonequilibrium back reaction on the Schwarzschild black hole from the radiation field. The back reactions are characterized by the membrane close to the black hole. When the membrane is thin, we found that larger temperature difference can lead to more significant negative surface tension, larger thermodynamic dissipation cost and back reaction in energy and entropy as well as larger black hole area. This may be relevant to the primordial black holes in early universe. Moreover, our nonequilibrium model can resolve the inconsistency issue of the black hole back reaction under zero mass limit in the equilibrium case. In the thick membrane case, the nonequilibrium back reaction is found to be more significant than that in the thin membrane case. The nonequilibrium temperature difference can increase the energy and entropy loss as well as the thermodynamic dissipation of the black hole and the membrane back reactions. The nonequilibrium dissipation cost characterized by the entropy production rate appears to be significant compared to the entropy rate radiated by the black hole under finite temperature difference. This may shed light on the black hole information paradox due to the information loss from the entropy production rate in the nonequilibirum cases. The nonequilibrium thermodynamic fluctuations can also reflect the effects of the back-reactions of the Hawking radiation on the evolution of a black hole.


title: Microscopic pairing theory of a binary Bose mixture with interspecies attractions: bosonic BEC-BCS crossover and ultradilute low-dimensional quantum droplets

abstract: Ultradilute quantum droplets are intriguing new state of matter, in which the attractive mean-field force can be balanced by the repulsive force from quantum fluctuations to avoid collapse. Here, we present a microscopic theory of ultradilute quantum droplets in three-, one- and two-dimensional two-component Bose-Bose mixtures, by generalizing the conventional Bogoliubov theory to include the bosonic pairing arising from the interspecies attraction. Our pairing theory is fully equivalent to a variational approach and hence gives an upper bound for the energy of quantum droplets. In three dimensions, we predict the existence of a strongly interacting Bose droplet at the crossover from Bose-Einstein condensates (BEC) to Bardeen--Cooper--Schrieffer (BCS) superfluids and map out the bosonic BEC-BCS crossover phase diagram. In one dimension, we find that the energy of the one-dimensional Bose droplet calculated by the pairing theory is in an excellent agreement with the latest diffusion Monte Carlo simulation {[}Phys. Rev. Lett. \textbf{122}, 105302 (2019){]}, for nearly all the interaction strengths at which quantum droplets exist. In two dimensions, we show that Bose droplets disappear and may turn into a soliton-like many-body bound state, when the interspecies attraction exceeds a critical value. Below the threshold, the pairing theory predicts more or less the same results as the Bogoliubov theory derived by Petrov and Astrakharchik {[}Phys. Rev. Lett. \textbf{117}, 100401 (2016){]}. The predicted energies from both theories are higher than the diffusion Monte Carlo results, due to the weak interspecies attraction and the increasingly important role played by the beyond-Bogoliubov-approximation effect in two dimensions.


title: Equal higher order analysis of an unfitted discontinuous Galerkin method for Stokes flow systems

abstract: In this work, we analyze an unfitted discontinuous Galerkin discretization for the numerical solution of the Stokes system based on equal higher-order discontinuous velocities and pressures. This approach combines the best from both worlds, firstly the advantages of a piece-wise discontinuous high-order accurate approximation and secondly the advantages of an unfitted to the true geometry grid around possibly complex objects and/or geometrical deformations. Utilizing a fictitious domain framework, the physical domain of interest is embedded in an unfitted background mesh and the geometrically unfitted discretization is built upon symmetric interior penalty discontinuous Galerkin formulation. To enhance stability we enrich the discrete variational formulation with a pressure stabilization term. Moreover, the present contribution adopts high order ghost penalty strategies to address the ill conditioning of the system matrix caused by small truncated elements with respect to the unfitted boundary. Motivated by continuous unfitted FEM [21,74,75] along with other unfitted mesh surveys grounded on discontinuous spaces [10,44,45,73], we use proper velocity and pressure ghost penalties defined on faces of cut cells to establish a robust high-order method, in spite of the cell agglomeration technique usually applied on dG methods. The current presentation should prove valuable in engineering applications where special emphasis is placed on the optimal effective approximation attaining much smaller relative errors in coarser meshes. Inf-sup stability, the optimal order of convergence, and the condition number sensitivity with respect to cut configuration are investigated. Numerical examples verify the theoretical results.


title: Estimation of the number of spiked eigenvalues in a covariance matrix by bulk eigenvalue matching analysis

abstract: The spiked covariance model has gained increasing popularity in high-dimensional data analysis. A fundamental problem is determination of the number of spiked eigenvalues, $K$. For estimation of $K$, most attention has focused on the use of $top$ eigenvalues of sample covariance matrix, and there is little investigation into proper ways of utilizing $bulk$ eigenvalues to estimate $K$. We propose a principled approach to incorporating bulk eigenvalues in the estimation of $K$. Our method imposes a working model on the residual covariance matrix, which is assumed to be a diagonal matrix whose entries are drawn from a gamma distribution. Under this model, the bulk eigenvalues are asymptotically close to the quantiles of a fixed parametric distribution. This motivates us to propose a two-step method: the first step uses bulk eigenvalues to estimate parameters of this distribution, and the second step leverages these parameters to assist the estimation of $K$. The resulting estimator $\hat{K}$ aggregates information in a large number of bulk eigenvalues. We show the consistency of $\hat{K}$ under a standard spiked covariance model. We also propose a confidence interval estimate for $K$. Our extensive simulation studies show that the proposed method is robust and outperforms the existing methods in a range of scenarios. We apply the proposed method to analysis of a lung cancer microarray data set and the 1000 Genomes data set.


title: Light control in a hemicylindrical whispering gallery microcavity-parallel plate waveguide system

abstract: We have shown that a structure composed of a semiconductor hemicylinder and a dielectric waveguide separated by a thin metal layer permits efficient and easy light control. In such a system, it is possible to ensure matching between TE and TM modes of a low refractive index waveguide with the corresponding whispering gallery modes of the hemicylinder of a higher refractive index, a circumstance that allows one to reduce the resonator sizes to the order of the exciting wavelength in the vacuum still having rather high Q-factor around 2*10^4. Due to pronounced electro-optical properties of the resonator medium, one is able to effectively control the output light intensity by varying the refractive index of the hemicylinder in the order of 10^(-4).


title: Will LISA Detect Harmonic Gravitational Waves from Galactic Cosmic String Loops?

abstract: Rapid advancement in the observation of cosmic strings has been made in recent years placing increasingly stringent constraints on their properties, with $G\mu\lesssim 10^{-11}$ from Pulsar Timing Array (PTA). Cosmic string loops with low string tension clump in the Galaxy due to slow loop decay and low gravitational recoil, resulting in great enhancement to loop abundance in the Galaxy. With an average separation of down to just a fraction of a kpc, and the total power of gravitational wave (GW) emission dominated by harmonic modes spanning a wide angular scale, resolved loops located in proximity are powerful, persistent, and highly monochromatic sources of GW with a harmonic signature not replicated by any other sources, making them prime targets for direct detection by the upcoming Laser Interferometer Space Antenna (LISA), whose frequency range is well-matched. Unlike detection of bursts where the detection rate scales with loop abundance, the detection rate for harmonic signal is the result of a complex interplay between the strength of GW emission, loop abundance, and other sources of noise, and is most suitably studied through numerical simulations. We develop a robust and flexible framework for simulating loops in the Galaxy for predicting direct detection of harmonic signal from resolved loops by LISA. Our simulation reveals that the most accessible region in the parameter space consists of large loops $\alpha=0.1$ with low tension $10^{-21}\lesssim G\mu\lesssim 10^{-19}$. Direct detection of field theory cosmic strings is unlikely, with the detection probability $p_{\mathrm{det}}\lesssim 2\%$ for a 1-year mission. An extension suggests that direct detection of cosmic superstrings with a low intercommutation probability is very promising. Searching for harmonic GW signal from resolved loops through LISA observations will potentially place physical constraints on string theory.


title: Fast Enhancement for Non-Uniform Illumination Images using Light-weight CNNs

abstract: This paper proposes a new light-weight convolutional neural network (5k parameters) for non-uniform illumination image enhancement to handle color, exposure, contrast, noise and artifacts, etc., simultaneously and effectively. More concretely, the input image is first enhanced using Retinex model from dual different aspects (enhancing under-exposure and suppressing over-exposure), respectively. Then, these two enhanced results and the original image are fused to obtain an image with satisfactory brightness, contrast and details. Finally, the extra noise and compression artifacts are removed to get the final result. To train this network, we propose a semi-supervised retouching solution and construct a new dataset (82k images) contains various scenes and light conditions. Our model can enhance 0.5 mega-pixel (like 600*800) images in real time (50 fps), which is faster than existing enhancement methods. Extensive experiments show that our solution is fast and effective to deal with non-uniform illumination images.


title: The complex conjugate invariants of Clifford groups

abstract: Nebe, Rains and Sloane studied the polynomial invariants for real and complex Clifford groups and they relate the invariants to the space of complete weight enumerators of certain self-dual codes. The purpose of this paper is to show that very similar results can be obtained for the invariants of the complex Clifford group $\mathcal{X}_m$ acting on the space of conjugate polynomials in $2^m$ variables of degree $N_1$ in $x_f$ and of degree $N_2$ in their complex conjugates $\overline{x_f}$. In particular, we show that the dimension of this space is $2$, for $(N_1,N_2)=(5,5)$. This solves the Conjecture 2 given in Zhu, Kueng, Grassl and Gross affirmatively. In other words if an orbit of the complex Clifford group is a projective $4$-design, then it is automatically a projective $5$-design.


title: DaSGD: Squeezing SGD Parallelization Performance in Distributed Training Using Delayed Averaging

abstract: The state-of-the-art deep learning algorithms rely on distributed training systems to tackle the increasing sizes of models and training data sets. Minibatch stochastic gradient descent (SGD) algorithm requires workers to halt forward/back propagations, to wait for gradients aggregated from all workers, and to receive weight updates before the next batch of tasks. This synchronous execution model exposes the overheads of gradient/weight communication among a large number of workers in a distributed training system. We propose a new SGD algorithm, DaSGD (Local SGD with Delayed Averaging), which parallelizes SGD and forward/back propagations to hide 100% of the communication overhead. By adjusting the gradient update scheme, this algorithm uses hardware resources more efficiently and reduces the reliance on the low-latency and high-throughput inter-connects. The theoretical analysis and the experimental results show its convergence rate O(1/sqrt(K)), the same as SGD. The performance evaluation demonstrates it enables a linear performance scale-up with the cluster size.


title: Evaluations and Methods for Explanation through Robustness Analysis

abstract: Feature based explanations, that provide importance of each feature towards the model prediction, is arguably one of the most intuitive ways to explain a model. In this paper, we establish a novel set of evaluation criteria for such feature based explanations by robustness analysis. In contrast to existing evaluations which require us to specify some way to "remove" features that could inevitably introduces biases and artifacts, we make use of the subtler notion of smaller adversarial perturbations. By optimizing towards our proposed evaluation criteria, we obtain new explanations that are loosely necessary and sufficient for a prediction. We further extend the explanation to extract the set of features that would move the current prediction to a target class by adopting targeted adversarial attack for the robustness analysis. Through experiments across multiple domains and a user study, we validate the usefulness of our evaluation criteria and our derived explanations.


title: A Systematic Review of Mutations Associated with Isoniazid Resistance Points to Lower Diagnostic Sensitivity for Common Mutations and Increased Incidence of Uncommon Mutations in Clinical Strains of Mycobacterium tuberculosis

abstract: Molecular testing is rapidly becoming integral to the global tuberculosis (TB) control effort. Uncommon mechanisms of resistance can escape detection by these platforms and lead to the development of Multi-Drug Resistant (MDR) strains. This article is a systematic review of published articles that reported isoniazid (INH) resistance-conferring mutations between September-2013 and December-2019. The aims were to catalogue mutations associated with INH resistance, estimate their global prevalence and co-occurrence, and their utility in molecular diagnostics. The genes commonly associated with INH resistance, katG, inhA, fabG1, and the intergenic region oxyR-ahpC were considered in this review. In total, 52 articles were included describing 5,632 INHR clinical isolates from 31 countries. The three most frequently mutated loci continue to be katG315 (4,100), inhA-15 (786), and inhA-8 (105). However, the diagnostic value of inhA-8 is far lower than previously thought, only appearing in 25 (0.4%) INHR isolates that lacked a mutation at the first two loci. Importantly, of the four katG loci recommended by the previous systematic review for diagnostics, only katG315 was observed in our INHR isolates. This indicates continued evolution and regional differences in INH resistance. We have identified 58 loci (common to both systematic reviews) in three genomic regions as a reliable basis for molecular diagnostics. We also report 49 new loci associated with INH resistance. Including all observed mutations provides a cumulative sensitivity of 85.1%. The most disconcerting is the remaining 14.9% of isolates that harbor an unknown mechanism of resistance, will escape molecular detection, and likely convert to MDR-TB, further complicating treatment. Integrating the information cataloged in this and other similar studies into current diagnostic tools is essential for combating the emergence of MDR-TB.


title: Learning to Recognize Actionable Static Code Warnings (is Intrinsically Easy)

abstract: Static code warning tools often generate warnings that programmers ignore. Such tools can be made more useful via data mining algorithms that select the "actionable" warnings; i.e. the warnings that are usually not ignored. In this paper, we look for actionable warnings within a sample of 5,675 actionable warnings seen in 31,058 static code warnings from FindBugs. We find that data mining algorithms can find actionable warnings with remarkable ease. Specifically, a range of data mining methods (deep learners, random forests, decision tree learners, and support vector machines) all achieved very good results (recalls and AUC (TRN, TPR) measures usually over 95% and false alarms usually under 5%). Given that all these learners succeeded so easily, it is appropriate to ask if there is something about this task that is inherently easy. We report that while our data sets have up to 58 raw features, those features can be approximated by less than two underlying dimensions. For such intrinsically simple data, many different kinds of learners can generate useful models with similar performance. Based on the above, we conclude that learning to recognize actionable static code warnings is easy, using a wide range of learning algorithms, since the underlying data is intrinsically simple. If we had to pick one particular learner for this task, we would suggest linear SVMs (since, at least in our sample, that learner ran relatively quickly and achieved the best median performance) and we would not recommend deep learning (since this data is intrinsically very simple).


title: Coherent generation of the complete high-dimensional Bell basis by adaptive pump modulation

abstract: The Bell basis, a set of maximally entangled biphoton state, is a critical prerequisite towards quantum information processing, and many quantum applications have highlighted the requirement for the manipulation of high-dimensional Bell basis. While the Bell states can be created by using ingenious single-photon quantum gates, its implementation complexity in higher dimensions is significantly increased. Here we present an elaborate approach to show that the adaptive pump modulation enable the efficient preparation of Bell basis in arbitrary-dimensional Hilbert space. A complete set of four-dimensional orbital angular momentum Bell states are experimentally created, yielding high fidelities for certifying the entanglement dimensionality. Our strategy can be simply generalized to prepare more complex forms of quantum states even exploiting other physical degrees of freedom. Also, it can facilitate the use of high-dimensional entanglement in a variety of quantum protocols, in particular those requiring quantum dense coding.


title: A nonlocal physics-informed deep learning framework using the peridynamic differential operator

abstract: The Physics-Informed Neural Network (PINN) framework introduced recently incorporates physics into deep learning, and offers a promising avenue for the solution of partial differential equations (PDEs) as well as identification of the equation parameters. The performance of existing PINN approaches, however, may degrade in the presence of sharp gradients, as a result of the inability of the network to capture the solution behavior globally. We posit that this shortcoming may be remedied by introducing long-range (nonlocal) interactions into the network's input, in addition to the short-range (local) space and time variables. Following this ansatz, here we develop a nonlocal PINN approach using the Peridynamic Differential Operator (PDDO)---a numerical method which incorporates long-range interactions and removes spatial derivatives in the governing equations. Because the PDDO functions can be readily incorporated in the neural network architecture, the nonlocality does not degrade the performance of modern deep-learning algorithms. We apply nonlocal PDDO-PINN to the solution and identification of material parameters in solid mechanics and, specifically, to elastoplastic deformation in a domain subjected to indentation by a rigid punch, for which the mixed displacement--traction boundary condition leads to localized deformation and sharp gradients in the solution. We document the superior behavior of nonlocal PINN with respect to local PINN in both solution accuracy and parameter inference, illustrating its potential for simulation and discovery of partial differential equations whose solution develops sharp gradients.


title: Cox Point Process Regression

abstract: Point processes in time have a wide range of applications that include the claims arrival process in insurance or the analysis of queues in operations research. Due to advances in technology, such samples of point processes are increasingly encountered. A key object of interest is the local intensity function. It has a straightforward interpretation that allows to understand and explore point process data. We consider functional approaches for point processes, where one has a sample of repeated realizations of the point process. This situation is inherently connected with Cox processes, where the intensity functions of the replications are modeled as random functions. Here we study a situation where one records covariates for each replication of the process, such as the daily temperature for bike rentals. For modeling point processes as responses with vector covariates as predictors we propose a novel regression approach for the intensity function that is intrinsically nonparametric. While the intensity function of a point process that is only observed once on a fixed domain cannot be identified, we show how covariates and repeated observations of the process can be utilized to make consistent estimation possible, and we also derive asymptotic rates of convergence without invoking parametric assumptions.


title: Cotangent bundle and micro-supports in mixed characteristic case

abstract: For a regular scheme and a prime number $p$, we define the FW-cotangent bundle as a vector bundle on the closed subscheme defined by $p=0$, under a certain finiteness condition. For a constructible complex on the etale site of the scheme, we introduce the condition to be micro-supported on a closed conical subset in the FW-cotangent bundle. At the end of the article, we compute the singular supports in some cases.


title: OzDES multi-object fibre spectroscopy for the Dark Energy Survey: Results and second data release

abstract: We present a description of the Australian Dark Energy Survey (OzDES) and summarise the results from its six years of operations. Using the 2dF fibre positioner and AAOmega spectrograph on the 3.9-metre Anglo-Australian Telescope, OzDES has monitored 771 AGN, classified hundreds of supernovae, and obtained redshifts for thousands of galaxies that hosted a transient within the 10 deep fields of the Dark Energy Survey. We also present the second OzDES data release, containing the redshifts of almost 30,000 sources, some as faint as $r_{\mathrm AB}=24$ mag, and 375,000 individual spectra. These data, in combination with the time-series photometry from the Dark Energy Survey, will be used to measure the expansion history of the Universe out to $z\sim1.2$ and the masses of hundreds of black holes out to $z\sim4$. OzDES is a template for future surveys that combine simultaneous monitoring of targets with wide-field imaging cameras and wide-field multi-object spectrographs.


title: Centralizers of derived-from-Anosov systems on $\mathbb{T}^3$: rigidity versus triviality

abstract: In this paper, we study the centralizer of a partially hyperbolic diffeomorphism on $\mathbb{T}^3$ which is homotopic to an Anosov automorphism, and we show that either its centralizer is virtually trivial or such diffeomorphism is smoothly conjugate to its linear part.


title: Lusztig conjectures on S-cells in affine Weyl groups

abstract: We apply the dimension theory developed in [BKV] to establish some of Lusztig's conjectures [Lu].


title: Crossed-Time Delay Neural Network for Speaker Recognition

abstract: Time Delay Neural Network (TDNN) is a well-performing structure for DNN-based speaker recognition systems. In this paper we introduce a novel structure Crossed-Time Delay Neural Network (CTDNN) to enhance the performance of current TDNN. Inspired by the multi-filters setting of convolution layer from convolution neural network, we set multiple time delay units each with different context size at the bottom layer and construct a multilayer parallel network. The proposed CTDNN gives significant improvements over original TDNN on both speaker verification and identification tasks. It outperforms in VoxCeleb1 dataset in verification experiment with a 2.6% absolute Equal Error Rate improvement. In few shots condition CTDNN reaches 90.4% identification accuracy, which doubles the identification accuracy of original TDNN. We also compare the proposed CTDNN with another new variant of TDNN, FTDNN, which shows that our model has a 36% absolute identification accuracy improvement under few shots condition and can better handle training of a larger batch in a shorter training time, which better utilize the calculation resources. The code of the new model is released at https://github.com/chenllliang/CTDNN


title: When Does MAML Objective Have Benign Landscape?

abstract: The paper studies the complexity of the optimization problem behind the Model-Agnostic Meta-Learning (MAML) algorithm. The goal of the study is to determine the global convergence of MAML on sequential decision-making tasks possessing a common structure. We are curious to know when, if at all, the benign landscape of the underlying tasks results in a benign landscape of the corresponding MAML objective. For illustration, we analyze the landscape of the MAML objective on LQR tasks to determine what types of similarities in their structures enable the algorithm to converge to the globally optimal solution.


title: On the fluidic behavior of an over-expanded planar plug nozzle under lateral confinement

abstract: The present work aims to study the fluidic behavior on lateral confinement by placing side-walls on the planar plug nozzle through experiments. The study involves two cases of nozzle pressure ratio (NPR=3, 6), which correspond to over-expanded nozzle operating conditions. Steady-state pressure measurements, together with schlieren and surface oil flow visualization, reveal the presence of over-expansion shock and subsequent interaction and modification of the flow field on the plug surface. The flow remains attached to the plug surface for NPR=3; whereas, for NPR=6, a separated flow field with a recirculation bubble is observed. Spectral analysis of the unsteady pressure signals illustrates a clear difference between the attached and the separated flow. Besides, other flow features with a distinct temporal mode associated with and without lateral confinement are observed. The absence of lateral confinement reduces the intensity of low-frequency unsteadiness; however, on the contrary, the interaction region is relatively reduced under lateral confinement.


title: Mechanical design of apertures and the infolding of pollen grain

abstract: When pollen grains become exposed to the environment, they rapidly desiccate. To protect themselves until rehydration, the grains undergo characteristic infolding with the help of special structures in the grain wall---apertures---where the otherwise thick exine shell is absent or reduced in thickness. Recent theoretical studies have highlighted the importance of apertures for the elastic response and the folding of the grain. Experimental observations show that different pollen grains sharing the same number and type of apertures can nonetheless fold in quite diverse fashion. Using thin-shell theory of elasticity, we show how both the absolute elastic properties of the pollen wall as well as the relative elastic differences between the exine wall and the apertures play an important role in determining pollen folding upon desiccation. Focusing primarily on colpate pollen, we delineate the regions of pollen elastic parameters where desiccation leads to a regular, complete closing of all apertures and thus to an infolding which protects the grain against water loss. Phase diagrams of pollen folding pathways indicate that an increase in the number of apertures leads to a reduction of the region of elastic parameters where the apertures close in a regular fashion. The infolding also depends on the details of the aperture shape and size, and our study explains how the features of the mechanical design of apertures influence the pollen folding patterns. Understanding the mechanical principles behind pollen folding pathways should also prove useful for the design of the elastic response of artificial inhomogeneous shells.