title: (Faster) Multi-Sided Boundary Labelling

abstract: A 1-bend boundary labelling problem consists of an axis-aligned rectangle $B$, $n$ points (called sites) in the interior, and $n$ points (called ports) on the labels along the boundary of $B$. The goal is to find a set of $n$ axis-aligned curves (called leaders), each having at most one bend and connecting one site to one port, such that the leaders are pairwise disjoint. A 1-bend boundary labelling problem is $k$-sided ($1\leq k\leq 4$) if the ports appear on $k$ different sides of $B$. Kindermann et al. ["Multi-Sided Boundary Labeling", Algorithmica, 76(1): 225-258, 2016] showed that the 1-bend three-sided and four-sided boundary labelling problems can be solved in $O(n^4)$ and $O(n^9)$ time, respectively. Bose et al. [SWAT, 12:1-12:14, 2018] improved the latter running time to $O(n^6)$ by reducing the problem to computing maximum independent set in an outerstring graph. In this paper, we improve both previous results by giving new algorithms with running times $O(n^3\log n)$ and $O(n^5)$ to solve the 1-bend three-sided and four-sided boundary labelling problems, respectively.


title: VFlow: More Expressive Generative Flows with Variational Data Augmentation

abstract: Generative flows are promising tractable models for density modeling that define probabilistic distributions with invertible transformations. However, tractability imposes architectural constraints on generative flows, making them less expressive than other types of generative models. In this work, we study a previously overlooked constraint that all the intermediate representations must have the same dimensionality with the original data due to invertibility, limiting the width of the network. We tackle this constraint by augmenting the data with some extra dimensions and jointly learning a generative flow for augmented data as well as the distribution of augmented dimensions under a variational inference framework. Our approach, VFlow, is a generalization of generative flows and therefore always performs better. Combining with existing generative flows, VFlow achieves a new state-of-the-art 2.98 bits per dimension on the CIFAR-10 dataset and is more compact than previous models to reach similar modeling quality.


title: The density of the $(\alpha,\beta)$-superprocess and singular solutions to a fractional non-linear PDE

abstract: We consider the density $X_t(x)$ of the critical $(\alpha,\beta)$-superprocess in $R^d$ with $\alpha\in (0,2)$ and $\beta<\frac \alpha d$. A recent result from PDE implies a dichotomy for the density: for fixed $x$, $X_t(x)>0$ a.s. on $\{X_t\neq 0\}$ if and only if $\beta \leq \beta^*(\alpha) = \frac{\alpha}{d+\alpha}$. We strengthen this and show that in the continuous density regime, $\beta < \beta^*(\alpha)$ implies that the density function is strictly positive a.s. on $\{X_t\neq 0\}$. We then give close to sharp conditions on a measure $\mu$ such that $\mu(X_t):=\int X_t(x)\mu(dx)>0$ a.s. on $\{X_t\neq 0 \}$. Our characterization is based on the size of $supp(\mu)$, in the sense of Hausdorff measure and dimension. For $s \in [0,d]$, if $\beta \leq \beta^*(\alpha,s)=\frac{\alpha}{d-s+\alpha}$ and $supp(\mu)$ has positive $x^s$-Hausdorff measure, then $\mu(X_t)>0$ a.s. on $\{X_t\neq 0\}$; and when $\beta > \beta^*(\alpha,s)$, if $\mu$ satisfies a uniform lower density condition which implies $dim(supp(\mu)) < s$, then $P(\mu(X_t)=0|X_t\neq 0)>0$. We also give new result for the fractional PDE $\partial_t u(t,x) = -(-\Delta)^{\alpha/2}u(t,x)-u(t,x)^{1+\beta}$ with domain $(t,x)\in (0,\infty)\times R^d$. The initial trace of a solution $u_t(x)$ is a pair $(S,\nu)$, where the singular set $S$ is a closed set around which local integrals of $u_t(x)$ diverge as $t \to 0$, and $\nu$ is a Radon measure which gives the limiting behaviour of $u_t(x)$ on $S^c$ as $t\to 0$. We characterize the existence of solutions with initial trace $(S,0)$ in terms of a parameter called the saturation dimension, $d_{sat}=d+\alpha(1-\beta^{-1})$. For $S\neq R^d$ with $dim(S)> d_{sat}$ (and in some cases $dim(S)=d_{sat}$) we prove that no such solution exists. When $dim(S)<d_{sat}$ and $S$ is the compact support of a measure satisfying a uniform lower density condition, we prove that a solution exists.


title: Generalized Adaptive Partition-based Method for Two-Stage Stochastic Programs with Fixed Recourse

abstract: We present a method to solve two-stage stochastic problems with fixed recourse when the uncertainty space can have either discrete or continuous distributions. Given a partition of the uncertainty space, the method is addressed to solve a discrete problem with one scenario for each element of the partition (sub-regions of the uncertainty space). Fixing first stage variables, we formulate a second stage subproblem for each element, and exploiting information from the dual of these problems, we provide conditions that the partition must satisfy to obtain the optimal solution. These conditions provide guidance on how to refine the partition, converging iteratively to the optimal solution. Results from computational experiments show how the method automatically refines the partition of the uncertainty space in the regions of interest for the problem. Our algorithm is a generalization of the adaptive partition-based method presented by Song & Luedtke (2015) for discrete distributions, extending its applicability to more general cases.


title: Controllability results for the rolling of $2$-dim. against $3$-dim. Riemannian Manifolds

abstract: In this article, we consider the rolling (or development) of two Riemannian connected manifolds $(M,g)$ and $(\hat{M},\hat{g})$ of dimensions $2$ and $3$ respectively, with the constraints of no-spinning and no-slipping. The present work is a continuation of \cite{MortadaKokkonenChitour}, which modelled the general setting of the rolling of two Riemannian connected manifolds with different dimensions as a driftless control affine system on a fibered space $Q$, with an emphasis on understanding the local structure of the rolling orbits, i.e., the reachable sets in $Q$. In this paper, the state space $Q$ has dimension eight and we show that the possible dimensions of non open rolling orbits belong to the set $\{2,5,6,7\}$. We describe the structures of orbits of dimension $2$, the possible local structures of rolling orbits of dimension $5$ and some of dimension $7$.


title: Differentially Private Set Union

abstract: We study the basic operation of set union in the global model of differential privacy. In this problem, we are given a universe $U$ of items, possibly of infinite size, and a database $D$ of users. Each user $i$ contributes a subset $W_i \subseteq U$ of items. We want an ($\epsilon$,$\delta$)-differentially private algorithm which outputs a subset $S \subset \cup_i W_i$ such that the size of $S$ is as large as possible. The problem arises in countless real world applications; it is particularly ubiquitous in natural language processing (NLP) applications as vocabulary extraction. For example, discovering words, sentences, $n$-grams etc., from private text data belonging to users is an instance of the set union problem. Known algorithms for this problem proceed by collecting a subset of items from each user, taking the union of such subsets, and disclosing the items whose noisy counts fall above a certain threshold. Crucially, in the above process, the contribution of each individual user is always independent of the items held by other users, resulting in a wasteful aggregation process, where some item counts happen to be way above the threshold. We deviate from the above paradigm by allowing users to contribute their items in a $\textit{dependent fashion}$, guided by a $\textit{policy}$. In this new setting ensuring privacy is significantly delicate. We prove that any policy which has certain $\textit{contractive}$ properties would result in a differentially private algorithm. We design two new algorithms, one using Laplace noise and other Gaussian noise, as specific instances of policies satisfying the contractive properties. Our experiments show that the new algorithms significantly outperform previously known mechanisms for the problem.


title: Quasi-static and propagating modes in three-dimensional THz circuits

abstract: We provide an analysis of the electromagnetic modes of three-dimensional metamaterial resonators in the THz frequency range. The fundamental resonance of the structures is fully described by an analytical circuit model, which not only reproduces the resonant frequencies but also the coupling of the metamaterial with an incident THz radiation. We also evidence the contribution of the propagation effects, and show how they can be reduced by design. In the optimized design the electric field energy is lumped into ultra-subwavelength ($\lambda$/100) capacitors, where we insert semiconductor absorber based on the collective electronic excitation in a two dimensional electron gas. The optimized electric field confinement is evidenced by the observation of the ultra-strong light-matter coupling regime, and opens many possible applications for these structures for detectors, modulators and sources of THz radiation.


title: The Role of Long-lived Excitons in the Dynamics of Strongly Coupled Molecular Polaritons

abstract: The concept of modifying molecular dynamics in strongly coupled exciton-polariton systems is an emerging topic in photonics due to its potential to produce customized chemical systems with tailored photophysical properties. However, before such systems can be realized, it is essential to address the open questions concerning the nature and strength of electronic interactions between exciton-polaritons and localized excited states in chemical system as well as the proper way to measure such interactions. Here, we use transient optical spectroscopy to investigate dynamical interactions between exciton-polaritons, singlet excitons, and triplet excitons in a molecular singlet fission system that is strongly coupled to an optical microcavity. We identify some of the major limitations to modify molecular dynamics in the strong coupling regime. Simultaneous excitation of cavity polaritons and 'reservoir' states, defined as dark polaritons and dark excitons (e.g. triplets) from coupled molecules and excitons from uncoupled molecules, always occurs. In addition, slow conversion from reservoir states to cavity polaritons results in minimal changes to the overall population dynamics. Furthermore, we demonstrate how in addition to the usual population dynamics, transient optical measurements on microcavities reveal information pertaining to modification of the exciton-polariton transition energies due to changes in the population of molecular excited states and the exciton-photon coupling conditions. As a consequence of weak interactions between reservoir states and cavity polaritons, judicious design considerations are required to achieve modified chemical dynamics, necessitating the use of molecular systems with long excited-state lifetimes or strong coupling approaches that require a small number of molecules.


title: DECIBEL: Improving Audio Chord Estimation for Popular Music by Alignment and Integration of Crowd-Sourced Symbolic Representations

abstract: Automatic Chord Estimation (ACE) is a fundamental task in Music Information Retrieval (MIR) and has applications in both music performance and MIR research. The task consists of segmenting a music recording or score and assigning a chord label to each segment. Although it has been a task in the annual benchmarking evaluation MIREX for over 10 years, ACE is not yet a solved problem, since performance has stagnated and modern systems have started to tune themselves to subjective training data. We propose DECIBEL, a new ACE system that exploits widely available MIDI and tab representations to improve ACE from audio only. From an audio file and a set of MIDI and tab files corresponding to the same popular music song, DECIBEL first estimates chord sequences. For audio, state-of-the-art audio ACE methods are used. MIDI files are aligned to the audio, followed by a MIDI chord estimation step. Tab files are transformed into untimed chord sequences and then aligned to the audio. Next, DECIBEL uses data fusion to integrate all estimated chord sequences into one final output sequence. DECIBEL improves all tested state-of-the-art ACE methods by over 3 percent on average. This result shows that the integration of musical knowledge from heterogeneous symbolic music representations is a suitable strategy for addressing challenging MIR tasks such as ACE.


title: Cluster Frustration in the Breathing Pyrochlore Magnet LiGaCr4S8

abstract: We present a comprehensive neutron scattering study of the breathing pyrochlore magnet LiGaCr4S8. We observe an unconventional magnetic excitation spectrum with a separation of high and low-energy spin dynamics in the correlated paramagnetic regime above a spin-freezing transition at 12(2) K. By fitting to magnetic diffuse-scattering data, we parameterize the spin Hamiltonian. We find that interactions are ferromagnetic within the large and small tetrahedra of the breathing pyrochlore lattice, but antiferromagnetic further-neighbor interactions are also essential to explain our data, in qualitative agreement with density-functional theory predictions [Ghoshet al.,npj Quantum Mater.4, 63 (2019)]. We explain the origin of geometrical frustration in LiGaCr4S8 interms of net antiferromagnetic coupling between emergent tetrahedral spin clusters that occupy a face-centered lattice. Our results provide insight into the emergence of frustration in the presence of strong further-neighbor couplings, and a blueprint for the determination of magnetic interactions in classical spin liquids.


title: On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations

abstract: We propose novel connections between several neural network architectures and viscosity solutions of some Hamilton--Jacobi (HJ) partial differential equations (PDEs) whose Hamiltonian is convex and only depends on the spatial gradient of the solution. To be specific, we prove that under certain assumptions, the two neural network architectures we proposed represent viscosity solutions to two sets of HJ PDEs with zero error. We also implement our proposed neural network architectures using Tensorflow and provide several examples and illustrations. Note that these neural network representations can avoid curve of dimensionality for certain HJ PDEs, since they do not involve neither grids nor discretization. Our results suggest that efficient dedicated hardware implementation for neural networks can be leveraged to evaluate viscosity solutions of certain HJ PDEs.


title: Automatic Decoupling and Index-aware Model-Order Reduction for Nonlinear Differential-Algebraic Equations

abstract: We extend the index-aware model-order reduction method to systems of nonlinear differential-algebraic equations with a special nonlinear term f(Ex), where E is a singular matrix. Such nonlinear differential-algebraic equations arise, for example, in the spatial discretization of the gas flow in pipeline networks. In practice, mathematical models of real-life processes pose challenges when used in numerical simulations, due to complexity and system size. Model-order reduction aims to eliminate this problem by generating reduced-order models that have lower computational cost to simulate, yet accurately represent the original large-scale system behavior. However, direct reduction and simulation of nonlinear differential-algebraic equations is difficult due to hidden constraints which affect the choice of numerical integration methods and model-order reduction techniques. We propose an extension of index-aware model-order reduction methods to nonlinear differential-algebraic equations without any kind of linearization. The proposed model-order reduction approach involves automatic decoupling of nonlinear differential-algebraic equations into nonlinear ordinary differential equations and algebraic equations. This allows applying standard model-order reduction techniques to both parts without worrying about the index. The same procedure can also be used to simulate nonlinear differential-algebraic equations using standard integration schemes. We illustrate the performance of our proposed method for nonlinear differential-algebraic equations arising from gas flow models in pipeline networks.


title: Accelerating longitudinal expansion of resistive relativistic-magneto-hydrodynamics in heavy ion collisions

abstract: We study the evolution of the longitudinal expansion of an ideal fluid with finite electrical conductivity, which is subject to the EM fields. In the framework of resistive relativistic-magneto-hydrodynamic, we find an exact analytical solution for the EM fields and for the acceleration of the fluid.


title: Asymptotic theory for regression models with fractional local to unity root errors

abstract: This paper develops the asymptotic theory for parametric and nonparametric regression models when the errors have a fractional local to unity root (FLUR) model structure. FLUR models are stationary time series with semi-long range dependence property in the sense that their covariance function resembles that of a long memory model for moderate lags but eventually diminishes exponentially fast according to the presence of a decay factor governed by a noncentrality parameter. When this parameter is sample size dependent, the asymptotic normality for these regression models admit a wide range of stochastic processes with behavior that includes long, semi-long, and short memory processes.


title: Sampling for Deep Learning Model Diagnosis (Technical Report)

abstract: Deep learning (DL) models have achieved paradigm-changing performance in many fields with high dimensional data, such as images, audio, and text. However, the black-box nature of deep neural networks is a barrier not just to adoption in applications such as medical diagnosis, where interpretability is essential, but also impedes diagnosis of under performing models. The task of diagnosing or explaining DL models requires the computation of additional artifacts, such as activation values and gradients. These artifacts are large in volume, and their computation, storage, and querying raise significant data management challenges. In this paper, we articulate DL diagnosis as a data management problem, and we propose a general, yet representative, set of queries to evaluate systems that strive to support this new workload. We further develop a novel data sampling technique that produce approximate but accurate results for these model debugging queries. Our sampling technique utilizes the lower dimension representation learned by the DL model and focuses on model decision boundaries for the data in this lower dimensional space. We evaluate our techniques on one standard computer vision and one scientific data set and demonstrate that our sampling technique outperforms a variety of state-of-the-art alternatives in terms of query accuracy.


title: BAD to the Bone: Big Active Data at its Core

abstract: Virtually all of today's Big Data systems are passive in nature, responding to queries posted by their users. Instead, we are working to shift Big Data platforms from passive to active. In our view, a Big Active Data (BAD) system should continuously and reliably capture Big Data while enabling timely and automatic delivery of relevant information to a large pool of interested users, as well as supporting retrospective analyses of historical information. While various scalable streaming query engines have been created, their active behavior is limited to a (relatively) small window of the incoming data. To this end we have created a BAD platform that combines ideas and capabilities from both Big Data and Active Data (e.g., Publish/Subscribe, Streaming Engines). It supports complex subscriptions that consider not only newly arrived items but also their relationships to past, stored data. Further, it can provide actionable notifications by enriching the subscription results with other useful data. Our platform extends an existing open-source Big Data Management System, Apache AsterixDB, with an active toolkit. The toolkit contains features to rapidly ingest semistructured data, share execution pipelines among users, manage scaled user data subscriptions, and actively monitor the state of the data to produce individualized information for each user. This paper describes the features and design of our current BAD data platform and demonstrates its ability to scale without sacrificing query capabilities or result individualization.


title: Dual-Phase High-Entropy Ultra-High Temperature Ceramics

abstract: A series of dual-phase high-entropy ultrahigh temperature ceramics (DPHE-UHTCs) are fabricated starting from N binary borides and (5-N) binary carbides powders. >~99% relative densities have been achieved with virtually no native oxides. These DPHE-UHTCs consist of a hexagonal high-entropy boride (HEB) phase and a cubic high-entropy carbide (HEC) phase. A thermodynamic relation that governs the compositions of the HEB and HEC phases in equilibrium is discovered and a thermodynamic model is proposed. These DPHE-UHTCs exhibit tunable grain size, Vickers microhardness, Young' and shear moduli, and thermal conductivity. The DPHE-UHTCs have higher hardness than the weighted linear average of the two single-phase HEB and HEC, which are already harder than the rule-of-mixture averages of individual binary borides and carbides. This study extends the state of the art by introducing dual-phase high-entropy ceramics (DPHECs), which provide a new platform to tailor various properties via changing the phase fraction and microstructure.


title: Ultrarelativistic quark-nucleus scattering in a light-front Hamiltonian approach

abstract: We investigate the scattering of a quark on a heavy nucleus at high energies using the time-dependent basis light-front quantization (tBLFQ) formalism, which is the first application of the tBLFQ formalism in QCD. We present the real-time evolution of the quark wave function in a strong classical color field of the relativistic nucleus, described as the Color Glass Condensate. The quark and the nucleus color field are simulated in the QCD SU(3) color space. We calculate the total and the differential cross sections, and the quark distribution in coordinate and color spaces using the tBLFQ approach. We recover the eikonal cross sections in the eikonal limit. We find that the differential cross section from the tBLFQ simulation is in agreement with a perturbative calculation at large $p_\perp$, and it deviates from the perturbative calculation at small $p_\perp$ due to higher-order contributions. In particular, we relax the eikonal limit by letting the quark carry realistic finite longitudinal momenta. We study the sub-eikonal effect on the quark through the transverse coordinate distribution of the quark with different longitudinal momentum, and we find the sub-eikonal effect to be sizable. Our results can significantly reduce the theoretical uncertainties in small $p_\perp$ region which has important implications to the phenomenology of the hadron-nucleus and deep inelastic scattering at high energies.


title: Unsupervised Question Decomposition for Question Answering

abstract: We aim to improve question answering (QA) by decomposing hard questions into simpler sub-questions that existing QA systems are capable of answering. Since labeling questions with decompositions is cumbersome, we take an unsupervised approach to produce sub-questions, also enabling us to leverage millions of questions from the internet. Specifically, we propose an algorithm for One-to-N Unsupervised Sequence transduction (ONUS) that learns to map one hard, multi-hop question to many simpler, single-hop sub-questions. We answer sub-questions with an off-the-shelf QA model and give the resulting answers to a recomposition model that combines them into a final answer. We show large QA improvements on HotpotQA over a strong baseline on the original, out-of-domain, and multi-hop dev sets. ONUS automatically learns to decompose different kinds of questions, while matching the utility of supervised and heuristic decomposition methods for QA and exceeding those methods in fluency. Qualitatively, we find that using sub-questions is promising for shedding light on why a QA system makes a prediction.


title: Block-Term Tensor Decomposition: Model Selection and Computation

abstract: The so-called block-term decomposition (BTD) tensor model has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{blocks} of rank higher than one, a scenario encountered in numerous and diverse applications. Its uniqueness and approximation have thus been thoroughly studied. Nevertheless, the challenging problem of estimating the BTD model structure, namely the number of block terms and their individual ranks, has only recently started to attract significant attention. In this paper, a novel method of BTD model selection and computation is proposed, based on the idea of imposing column sparsity \emph{jointly} on the factors and in a \emph{hierarchical} manner and estimating the ranks as the numbers of factor columns of non-negligible magnitude. Following a block successive upper bound minimization (BSUM) approach for the proposed optimization problem is shown to result in an alternating hierarchical iteratively reweighted least squares (HIRLS) algorithm, which is fast converging and enjoys high computational efficiency, as it relies in its iterations on small-sized sub-problems with closed-form solutions. Simulation results for both synthetic examples and a hyper-spectral image de-noising application are reported, which demonstrate the superiority of the proposed scheme over the state-of-the-art in terms of success rate in rank estimation as well as computation time and rate of convergence.


title: Nielsen realization for infinite-type surfaces

abstract: Given a finite subgroup G of the mapping class group of a surface S, the Nielsen realization problem asks whether G can be realized as a finite group of homeomorphisms of S. In 1983, Kerckhoff showed that for S a finite-type surface, any finite subgroup G may be realized as a group of isometries of some hyperbolic metric on S. We extend Kerckhoff's result to orientable, infinite-type surfaces. As applications, we classify torsion elements in the mapping class group of the plane minus a Cantor set, and also show that topological groups containing sequences of torsion elements limiting to the identity do not embed continuously into the mapping class group of S. Finally, we show that compact subgroups of the mapping class group of S are finite, and locally compact subgroups are discrete.


title: Ultraviolet Photostability Improvement for Autofluorescence Correlation Spectroscopy on Label-Free Proteins

abstract: The poor photostability and low brightness of protein autofluorescence have been major limitations preventing the detection of label-free proteins at the single molecule level. Overcoming these issues, we report here a strategy to promote the photostability of proteins and use their natural tryptophan autofluorescence in the ultraviolet (UV) for fluorescence correlation spectroscopy (FCS). Combining enzymatic oxygen scavengers with antioxidants and triplet state quenchers greatly promotes the protein photostability, reduces the photobleaching probability and improves the net autofluorescence detection rate. Our results show that the underlying photochemical concepts initially derived for organic visible fluorescent dyes are quite general. Using this approach, we achieved UV fluorescence correlation spectroscopy on label-free streptavidin proteins containing only 24 tryptophan residues, 6.5x less than the current state-of-the-art. This strategy greatly extends the possibility to detect single label-free proteins with the versatility of single molecule fluorescence without requiring the presence of a potentially disturbing external fluorescent marker. It also opens new perspectives to improve the UV durability of organic devices.


title: Short retractions of CAT(1) spaces

abstract: We construct short retractions of a CAT(1) space to its small convex subsets. This construction provides an alternative geometric description of an analytic tool introduced by Wilfrid Kendall. Our construction uses a tractrix flow which can be defined as a gradient flow for a family of functions of certain type. In an appendix we prove a general existence result for gradient flows of time-dependent locally Lipschitz semiconcave functions, which is of independent interest.


title: Longitudinal Support Vector Machines for High Dimensional Time Series

abstract: We consider the problem of learning a classifier from observed functional data. Here, each data-point takes the form of a single time-series and contains numerous features. Assuming that each such series comes with a binary label, the problem of learning to predict the label of a new coming time-series is considered. Hereto, the notion of {\em margin} underlying the classical support vector machine is extended to the continuous version for such data. The longitudinal support vector machine is also a convex optimization problem and its dual form is derived as well. Empirical results for specified cases with significance tests indicate the efficacy of this innovative algorithm for analyzing such long-term multivariate data.


title: On the law of the iterated logarithm and strong invariance principles in stochastic geometry

abstract: We study the law of the iterated logarithm (Khinchin (1924), Kolmogorov (1929)) and related strong invariance principles in stochastic geometry. As potential applications, we think of well-known functionals such as functionals defined on the $k$-nearest neighbors graph and important functionals in topological data analysis such as the Euler characteristic and persistent Betti numbers.


title: Predictive refinement methodology for compressed sensing imaging

abstract: The weak-$\ell^p$ norm can be used to define a measure $s$ of sparsity. When we compute $s$ for the discrete cosine transform coefficients of a signal, the value of $s$ is related to the information content of said signal. We use this value of $s$ to define a reference-free index $\mathcal{E}$, called the sparsity index, that we can use to predict with high accuracy the quality of signal reconstruction in the setting of compressed sensing imaging. That way, when compressed sensing is framed in the context of sampling theory, we can use $\mathcal{E}$ to decide when to further partition the sampling space and increase the sampling rate to optimize the recovery of an image when we use compressed sensing techniques.


title: Improving the Tightness of Convex Relaxation Bounds for Training Certifiably Robust Classifiers

abstract: Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide tight bounds if the solution to the relaxed problem is feasible for the original non-convex problem. We propose two regularizers that can be used to train neural networks that yield tighter convex relaxation bounds for robustness. In all of our experiments, the proposed regularizers result in higher certified accuracy than non-regularized baselines.


title: Comparison theorems for closed geodesics on negatively curved surfaces

abstract: In this note we present new asymptotic estimates comparing the word length and geodesic length of closed geodesics on surfaces with (variable) negative sectional curvatures. In particular, we provide an averaged comparison of these two important quantities and obtain precise statistical results, including a central limit theorem and a local limit theorem. Further, as a corollary we also improve an asymptotic formula of R. Sharp and the second author. Finally, we relate our results to recent work of Gekhtman, Taylor and Tiozzo.


title: Sounds of Leidenfrost drops

abstract: We show that when a drop of water is maintained in its Leidenfrost regime, a sound in the form of periodic beats emits from the drop. The process of beat emission involves two distinct frequencies. One component is the frequency of beats itself and second is the frequency of sound in every beat which is emitted when one oscillation in the drop occurs. Experiments have been performed by placing a drop of water over a concave metallic surface and the beats of the drop were recorded by fixing a microphone above the drop. A video camera was also fixed above the drop to record its oscillations. Simple analytical techniques like Fourier and wavelet transforms of the audio signals and image processing of the videos of the drop have been used to gain insight about mechanism of beat emission process. This analysis also helped us in studying the dependence of frequencies, if any, on the radius of the drop and the substrate temperature.


title: Optimistic bounds for multi-output prediction

abstract: We investigate the challenge of multi-output learning, where the goal is to learn a vector-valued function based on a supervised data set. This includes a range of important problems in Machine Learning including multi-target regression, multi-class classification and multi-label classification. We begin our analysis by introducing the self-bounding Lipschitz condition for multi-output loss functions, which interpolates continuously between a classical Lipschitz condition and a multi-dimensional analogue of a smoothness condition. We then show that the self-bounding Lipschitz condition gives rise to optimistic bounds for multi-output learning, which are minimax optimal up to logarithmic factors. The proof exploits local Rademacher complexity combined with a powerful minoration inequality due to Srebro, Sridharan and Tewari. As an application we derive a state-of-the-art generalization bound for multi-class gradient boosting.


title: Allotaxonometry and rank-turbulence divergence: A universal instrument for comparing complex systems

abstract: Complex systems often comprise many kinds of components which vary over many orders of magnitude in size: Populations of cities in countries, individual and corporate wealth in economies, species abundance in ecologies, word frequency in natural language, and node degree in complex networks. Here, we introduce `allotaxonometry' along with `rank-turbulence divergence' (RTD), a tunable instrument for comparing any two ranked lists of components. We analytically develop our rank-based divergence in a series of steps, and then establish a rank-based allotaxonograph which pairs a map-like histogram for rank-rank pairs with an ordered list of components according to divergence contribution. We explore the performance of rank-turbulence divergence, which we view as an instrument of `type calculus', for a series of distinct settings including: Language use on Twitter and in books, species abundance, baby name popularity, market capitalization, performance in sports, mortality causes, and job titles. We provide a series of supplementary flipbooks which demonstrate the tunability and storytelling power of rank-based allotaxonometry.


title: Creating Spatial Flatness by Combining String Gas Cosmology and Power Law Inflation

abstract: We show that it is possible to combine an early phase of String Gas Cosmology which can explain the origin of the observed structures on cosmological scales with a short later period of power law inflation which creates spatial flatness. The resulting model is consistent with the ``swampland criteria'' and the constraints coming from the {\it Trans-Planckian Censorship Conjecture}. Such a construction is not possible using only canonical slow-roll inflation, but it can emerge in the warm inflation scenario or in cold inflation with an exponential potential. The resulting cosmology is non-singular. We discuss the spectrum of cosmological perturbations resulting in our scenario. On large scales (scales which remain larger than the Hubble radius after the initial string gas phase) the spectrum is determined by the thermal string gas fluctuations set up in the primordial phase, and it is almost scale-invariant with a slight red tilt. On small scales, the perturbations produced during the inflationary phase dominate. On these scales, the spectrum is once again nearly scale-invariant. There is an intermediate range (scales which enter the Hubble radius during the period of inflation) where the string gas fluctuations are damped but continue to dominate over those produced during the period of inflation. On these scales the spectrum has a sharp red spectral index of $n_s - 1 \sim -2$.


title: Non-Intrusive Detection of Adversarial Deep Learning Attacks via Observer Networks

abstract: Recent studies have shown that deep learning models are vulnerable to specifically crafted adversarial inputs that are quasi-imperceptible to humans. In this letter, we propose a novel method to detect adversarial inputs, by augmenting the main classification network with multiple binary detectors (observer networks) which take inputs from the hidden layers of the original network (convolutional kernel outputs) and classify the input as clean or adversarial. During inference, the detectors are treated as a part of an ensemble network and the input is deemed adversarial if at least half of the detectors classify it as so. The proposed method addresses the trade-off between accuracy of classification on clean and adversarial samples, as the original classification network is not modified during the detection process. The use of multiple observer networks makes attacking the detection mechanism non-trivial even when the attacker is aware of the victim classifier. We achieve a 99.5% detection accuracy on the MNIST dataset and 97.5% on the CIFAR-10 dataset using the Fast Gradient Sign Attack in a semi-white box setup. The number of false positive detections is a mere 0.12% in the worst case scenario.


title: Revealing the Structure of Deep Neural Networks via Convex Duality

abstract: We study regularized deep neural networks (DNNs) and introduce a convex analytic framework to characterize the structure of the hidden layers. We show that a set of optimal hidden layer weights for a norm regularized DNN training problem can be explicitly found as the extreme points of a convex set. For the special case of deep linear networks, we prove that each optimal weight matrix aligns with the previous layers via duality. More importantly, we apply the same characterization to deep ReLU networks with whitened data and prove the same weight alignment holds. As a corollary, we also prove that norm regularized deep ReLU networks yield spline interpolation for one-dimensional datasets which was previously known only for two-layer networks. Furthermore, we provide closed-form solutions for the optimal layer weights when data is rank-one or whitened. The same analysis also applies to architectures with batch normalization even for arbitrary data. Therefore, we obtain a complete explanation for a recent empirical observation termed Neural Collapse where class means collapse to the vertices of a simplex equiangular tight frame.


title: Set-Convergence and Its Application: A Tutorial

abstract: Optimization problems, generalized equations, and the multitude of other variational problems invariably lead to the analysis of sets and set-valued mappings as well as their approximations. We review the central concept of set-convergence and explain its role in defining a notion of proximity between sets, especially for epigraphs of functions and graphs of set-valued mappings. The development leads to an approximation theory for optimization problems and generalized equations with profound consequences for the construction of algorithms. We also introduce the role of set-convergence in variational geometry and subdifferentiability with applications to optimality conditions. Examples illustrate the importance of set-convergence in stability analysis, error analysis, construction of algorithms, statistical estimation, and probability theory.


title: The derivative of global surface-holonomy for a non-abelian gerbe

abstract: Starting with a non-abelian gerbe represented by a non-abelian differential cocycle, with values in a given crossed-module, this paper explicitly calculates a formula for the derivative of the associated surface holonomy of squares mapped into the base manifold; with spheres later considered as a special case. While the definitions in this paper used for gerbes, their connections, and the induced holonomy will initially be simplicial, translations into a cubical setting will be provided to aide in explicit coordinate-based calculations. While there are many previously published results on the properties of these non-abelian gerbes, including some calculations of the derivative over a single open set, this paper endeavors to take these local calculations and glue them together across multiple open sets in order to obtain a single expression for the change in surface holonomy with respect to a one-parameter family of squares.


title: On the logarithmic profile of temperature in the atmospheric convective boundary layers

abstract: Wall-bounded turbulent flows are widely observed in natural and engineering systems, such as air flows near the Earth's surface, water flows in rivers, and flows around a car or a plane. The universal logarithmic velocity profile in wall-bounded turbulent flows proposed by von K\'arm\'an in 1930 is one of the few exact physical descriptions of turbulence. However, the mean velocity and temperature profiles cannot be adequately described by this universal log law when buoyancy effects are present. Monin-Obukhov similarity theory (MOST), proposed in 1954, has been the cornerstone theory to account for these buoyancy effects and to describe the atmospheric boundary layer. MOST has been used in almost all global weather, climate and hydrological models to describe the dependence of the mean velocity, temperature and scalar profiles on buoyancy. According to MOST, the logarithmic temperature profile breaks down as buoyancy effects become important. In contrast, here we show that this long-standing MOST theory does not apply for temperature. We propose a new theory for the logarithmic profile of near-wall temperature, which corrects MOST pitfalls and is supported by both high-resolution direct numerical simulations and field observations of the convective atmospheric boundary layer. Buoyancy effects do not modify the logarithmic nature but instead modulate the slope of the temperature profile compared to the universal von K\'arm\'an slope. The new formulation has widespread applications such as in climate models, where the proposed new temperature log law should lead to more realistic continental surface temperature, which are strongly impacted by buoyancy.


title: Bose-Einstein Condensation of Nonequilibrium Magnons in Confined Systems

abstract: We study the formation of a room temperature magnon Bose-Einstein condensate (BEC) in nanoscopic systems and demonstrate that its lifetime is influenced by the spatial confinement. We predict how dipolar interactions and nonlinear magnon scattering assist in the generation of a metastable magnon BEC in energy-quantized nanoscopic devices. We verify our prediction by a full numerical simulation of the Landau-Lifshitz-Gilbert equation and demonstrate the generation of magnon BEC in confined insulating magnets of yttrium iron garnet. We directly map out the nonlinear magnon scattering processes behind this phase transition to show how fast quantized thermalization channels allow the BEC formation in confined structures. Based on our results, we discuss a new mechanism to manipulate the BEC lifetime in nanoscaled systems. Our study greatly extends the freedom to study the dynamics of magnon BEC in realistic systems and to design integrated circuits for BEC-based applications at room temperature.


title: Propagation of slow electromagnetic disturbances in plasma

abstract: Electromagnetic (EM) waves/disturbances are typically the best means to understand and analyze an ionized medium like plasma. However, the propagation of electromagnetic waves with frequency lower than the plasma frequency is prohibited by the freely moving charges of the plasma. In dense plasmas though the plasma frequency can be typically quite high, EM sources at such higher frequency are not easily available. It is, therefore, of interest to seek possibilities wherein a low frequency (lower than the plasma frequency) EM disturbance propagates inside a plasma. This is possible in the context of magnetized plasmas. However, in order to have a magnetized plasma response one requires a strong external magnetic field. In this manuscript we demonstrate that the nonlinearity of the plasma medium can also aid the propagation of a slow EM wave inside plasma. Certain interesting applications of the propagation of such slow electromagnetic pulse through plasma is also discussed.


title: Stochasticity in Neural ODEs: An Empirical Study

abstract: Stochastic regularization of neural networks (e.g. dropout) is a wide-spread technique in deep learning that allows for better generalization. Despite its success, continuous-time models, such as neural ordinary differential equation (ODE), usually rely on a completely deterministic feed-forward operation. This work provides an empirical study of stochastically regularized neural ODE on several image-classification tasks (CIFAR-10, CIFAR-100, TinyImageNet). Building upon the formalism of stochastic differential equations (SDEs), we demonstrate that neural SDE is able to outperform its deterministic counterpart. Further, we show that data augmentation during the training improves the performance of both deterministic and stochastic versions of the same model. However, the improvements obtained by the data augmentation completely eliminate the empirical gains of the stochastic regularization, making the difference in the performance of neural ODE and neural SDE negligible.


title: Excitation and breaking of relativistic electron beam driven longitudinal electron-ion modes in a cold plasma

abstract: The excitation and breaking of relativistically intense electron-ion modes in a cold plasma is studied using 1D-fluid simulation techniques. To excite the mode, we have used a relativistic rigid homogeneous electron beam propagating inside a plasma with a velocity close to the speed of light. It is observed that the wake wave excited by the electron beam is identical to the corresponding Khachatryan mode, a relativistic electron-ion mode in a cold plasma. It is also seen in the simulation that the numerical profile of the excited electron-ion mode gradually modifies with time and eventually breaks after several plasma periods exhibiting explosive behavior in the density profile. This is an well known phenomena, known as wave breaking. It is found that the numerical wave breaking limit of these modes lies much below than their analytical breaking limit. The discrepancy between the numerical and analytical wave breaking limit has been understood in terms of phase-mixing process of the mode. The phase mixing time (or wave breaking time) obtained from the simulations has also been scaled as a function of beam parameters and found to follow the analytical scaling.


title: An Optimization and Generalization Analysis for Max-Pooling Networks

abstract: Max-Pooling operations are a core component of deep learning architectures. In particular, they are part of most convolutional architectures used in machine vision, since pooling is a natural approach to pattern detection problems. However, these architectures are not well understood from a theoretical perspective. For example, we do not understand when they can be globally optimized, and what is the effect of over-parameterization on generalization. Here we perform a theoretical analysis of a convolutional max-pooling architecture, proving that it can be globally optimized, and can generalize well even for highly over-parameterized models. Our analysis focuses on a data generating distribution inspired by pattern detection problem, where a "discriminative" pattern needs to be detected among "spurious" patterns. We empirically validate that CNNs significantly outperform fully connected networks in our setting, as predicted by our theoretical results.


title: Narrowing the parameter space of collapse models with ultracold layered force sensors

abstract: Despite the unquestionable empirical success of quantum theory, witnessed by the recent uprising of quantum technologies, the debate on how to reconcile the theory with the macroscopic classical world is still open. Spontaneous collapse models are one of the few testable solutions so far proposed. In particular, the continuous spontaneous localization (CSL) model has become subject of an intense experimental research. Experiments looking for the universal force noise predicted by CSL in ultrasensitive mechanical resonators have recently set the strongest unambiguous bounds on CSL; further improving these experiments by direct reduction of mechanical noise is technically challenging. Here, we implement a recently proposed alternative strategy, that aims at enhancing the CSL noise by exploiting a multilayer test mass attached on a high quality factor microcantilever. The test mass is specifically designed to enhance the effect of CSL noise at the characteristic length $r_c=10^{-7}$ m. The measurements are in good agreement with pure thermal motion for temperatures down to 100 mK. From the absence of excess noise we infer a new bound on the collapse rate at the characteristic length $r_c=10^{-7}$ m, which improves over previous mechanical experiments by more than one order of magnitude. Our results are explicitly challenging a well-motivated region of the CSL parameter space proposed by Adler.


title: Optimality Study of Existing Quantum Computing Layout Synthesis Tools

abstract: Layout synthesis, an important step in quantum computing, processes quantum circuits to satisfy device layout constraints. In this paper, we construct QUEKO benchmarks for this problem, which have known optimal depths and gate counts. We use QUEKO to evaluate the optimality of current layout synthesis tools, including Cirq from Google, Qiskit from IBM, $\mathsf{t}|\mathsf{ket}\rangle$ from Cambridge Quantum Computing, and recent academic work. To our surprise, despite over a decade of research and development by academia and industry on compilation and synthesis for quantum circuits, we are still able to demonstrate large optimality gaps: 1.5-12x on average on a smaller device and 5-45x on average on a larger device. This suggests substantial room for improvement of the efficiency of quantum computer by better layout synthesis tools. Finally, we also prove the NP-completeness of the layout synthesis problem for quantum computing. We have made the QUEKO benchmarks open-source.


title: Uniform Interpolants in EUF: Algorithms using DAG-representations

abstract: The concept of uniform interpolant for a quantifier-free formula from a given formula with a list of symbols, while well-known in the logic literature, has been unknown to the formal methods and automated reasoning community for a long time. This concept is precisely defined. Two algorithms for computing quantifier-free uniform interpolants in the theory of equality over uninterpreted symbols (EUF) endowed with a list of symbols to be eliminated are proposed. The first algorithm is non-deterministic and generates a uniform interpolant expressed as a disjunction of conjunctions of literals, whereas the second algorithm gives a compact representation of a uniform interpolant as a conjunction of Horn clauses. Both algorithms exploit efficient dedicated DAG representations of terms. Correctness and completeness proofs are supplied, using arguments combining rewrite techniques with model theory.


title: Electron irradiation on multilayer PdSe$_2$ field effect transistors

abstract: Palladium diselenide (PdSe2) is a recently isolated layered material that has attracted a lot of interest for the pentagonal structure, the air stability and the electrical properties largely tunable by the number of layers. In this work, PdSe2 is used in the form of multilayer as the channel of back-gate field-effect transistors, which are studied under repeated electron irradiations. Source-drain Pd leads enable contacts with resistance below 350 kOhm um. The transistors exhibit a prevailing n-type conduction in high vacuum, which reversibly turns into ambipolar electric transport at atmospheric pressure. Irradiation by 10 keV electrons suppresses the channel conductance and promptly transforms the device from n-type to p-type. An electron fluence as low as 160 e-/nm2 dramatically change the transistor behavior demonstrating a high sensitivity of PdSe2 to electron irradiation. The sensitivity is lost after few exposures, that is a saturation condition is reached for fluence higher than 4000 e-/nm2. The damage induced by high electron fluence is irreversible as the device persist in the radiation-modified state for several hours, if kept in vacuum and at room temperature. With the support of numerical simulation, we explain such a behavior by electron-induced Se atom vacancy formation and charge trapping in slow trap states at the Si/SiO_2 interface.


title: HarDNN: Feature Map Vulnerability Evaluation in CNNs

abstract: As Convolutional Neural Networks (CNNs) are increasingly being employed in safety-critical applications, it is important that they behave reliably in the face of hardware errors. Transient hardware errors may percolate undesirable state during execution, resulting in software-manifested errors which can adversely affect high-level decision making. This paper presents HarDNN, a software-directed approach to identify vulnerable computations during a CNN inference and selectively protect them based on their propensity towards corrupting the inference output in the presence of a hardware error. We show that HarDNN can accurately estimate relative vulnerability of a feature map (fmap) in CNNs using a statistical error injection campaign, and explore heuristics for fast vulnerability assessment. Based on these results, we analyze the tradeoff between error coverage and computational overhead that the system designers can use to employ selective protection. Results show that the improvement in resilience for the added computation is superlinear with HarDNN. For example, HarDNN improves SqueezeNet's resilience by 10x with just 30% additional computations.


title: Photoacoustic Identification of Laser-induced Microbubbles as Light Scattering Centers for Optical Limiting in Liquid Suspension of Graphene Nanosheets

abstract: Liquid suspensions of carbon nanotubes, graphene and transition metal dichalcogenides have exhibited excellent performance in optical limiting. However, the underlying mechanism has remained elusive and is generally ascribed to their superior nonlinear optical properties such as nonlinear absorption or nonlinear scattering. Using graphene as an example, we show that photo-thermal microbubbles are responsible for the optical limiting as strong light scattering centers: graphene sheets absorb incident light and become heated up above the boiling point of water, resulting in vapor and microbubble generation. This conclusion is based on direct observation of bubbles above the laser beam as well as a strong correlation between laser-induced ultrasound and optical limiting. In-situ Raman scattering of graphene further confirms that the temperature of graphene under laser pulses rises above the boiling point of water but still remains too low to vaporize graphene and create graphene plasma bubbles. Photo-thermal bubble scattering is not a nonlinear optical process and requires very low laser intensity. This understanding helps us to design more efficient optical limiting materials and understand the intrinsic nonlinear optical properties of nanomaterials.


title: Lifting for Simplicity: Concise Descriptions of Convex Sets

abstract: This paper presents a selected tour through the theory and applications of lifts of convex sets. A lift of a convex set is a higher-dimensional convex set that projects onto the original set. Many convex sets have lifts that are dramatically simpler to describe than the original set. Finding such simple lifts has significant algorithmic implications, particularly for optimization problems. We consider both the classical case of polyhedral lifts, described by linear inequalities, as well as spectrahedral lifts, defined by linear matrix inequalities, with a focus on recent developments related to spectrahedral lifts. Given a convex set, ideally we would either like to find a (low-complexity) polyhedral or spectrahedral lift, or find an obstruction proving that no such lift is possible. To this end, we explain the connection between the existence of lifts of a convex set and certain structured factorizations of its associated slack operator. Based on this characterization, we describe a uniform approach, via sums of squares, to the construction of spectrahedral lifts of convex sets and illustrate the method on several families of examples. Finally, we discuss two flavors of obstruction to the existence of lifts: one related to facial structure, and the other related to algebraic properties of the set in question. Rather than being exhaustive, our aim is to illustrate the richness of the area. We touch on a range of different topics related to the existence of lifts, and present many examples of lifts from different areas of mathematics and its applications.


title: New Self-Dual Codes from 2x2 Block Circulant Matrices, Group Rings and Neighbours of Neighbours

abstract: In this paper, we construct self-dual codes from a construction that involves 2x2 block circulant matrices, group rings and a reverse circulant matrix. We provide conditions whereby this construction can yield self-dual codes. We construct self-dual codes of various lengths over F2, F2 + uF2 and F4 + uF4. Using extensions, neighbours and neighbours of neighbours, we construct 32 new self-dual codes of length 68.


title: Shallow2Deep: Indoor Scene Modeling by Single Image Understanding

abstract: Dense indoor scene modeling from 2D images has been bottlenecked due to the absence of depth information and cluttered occlusions. We present an automatic indoor scene modeling approach using deep features from neural networks. Given a single RGB image, our method simultaneously recovers semantic contents, 3D geometry and object relationship by reasoning indoor environment context. Particularly, we design a shallow-to-deep architecture on the basis of convolutional networks for semantic scene understanding and modeling. It involves multi-level convolutional networks to parse indoor semantics/geometry into non-relational and relational knowledge. Non-relational knowledge extracted from shallow-end networks (e.g. room layout, object geometry) is fed forward into deeper levels to parse relational semantics (e.g. support relationship). A Relation Network is proposed to infer the support relationship between objects. All the structured semantics and geometry above are assembled to guide a global optimization for 3D scene modeling. Qualitative and quantitative analysis demonstrates the feasibility of our method in understanding and modeling semantics-enriched indoor scenes by evaluating the performance of reconstruction accuracy, computation performance and scene complexity.


title: Self-similarity and spectral dynamics

abstract: For a tuple $A= (A_0, A_1, \ldots , A_n)$ of elements in a unital Banach algebra $\mathcal{B}$, its \textit{projective (joint) spectrum} $p(A)$ is the collection of $z\in\mathbb{P}^{n}$ such that $A(z)=z_0A_0+z_1 A_1 + \ldots z_n A_n$ is not invertible. If the tuple $A$ is associated with the generators of a finitely generated group, then $p(A)$ is simply called the projective spectrum of the group. This paper investigates a connection between self-similar group representations and an induced polynomial map on the projective space that preserves the projective spectrum of the group. The focus is on two groups: the infinite dihedral group $D_\infty$ and the Grigorchuk group ${\mathcal G}$ of intermediate growth. The main theorem shows that for $D_\infty$ the Julia set of the induced rational map $F$ is equal to the union of the projective spectrum with the extended indeterminacy set. Moreover, the limit function of the iteration sequence $\{F^{\circ n}\}$ on the Fatou set is determined explicitly. The result has an application to the group ${\mathcal G}$ and gives rise to a conjecture about its associated Julia set.


title: Real-Time Detectors for Digital and Physical Adversarial Inputs to Perception Systems

abstract: Deep neural network (DNN) models have proven to be vulnerable to adversarial digital and physical attacks. In this paper, we propose a novel attack- and dataset-agnostic and real-time detector for both types of adversarial inputs to DNN-based perception systems. In particular, the proposed detector relies on the observation that adversarial images are sensitive to certain label-invariant transformations. Specifically, to determine if an image has been adversarially manipulated, the proposed detector checks if the output of the target classifier on a given input image changes significantly after feeding it a transformed version of the image under investigation. Moreover, we show that the proposed detector is computationally-light both at runtime and design-time which makes it suitable for real-time applications that may also involve large-scale image domains. To highlight this, we demonstrate the efficiency of the proposed detector on ImageNet, a task that is computationally challenging for the majority of relevant defenses, and on physically attacked traffic signs that may be encountered in real-time autonomy applications. Finally, we propose the first adversarial dataset, called AdvNet that includes both clean and physical traffic sign images. Our extensive comparative experiments on the MNIST, CIFAR10, ImageNet, and AdvNet datasets show that VisionGuard outperforms existing defenses in terms of scalability and detection performance. We have also evaluated the proposed detector on field test data obtained on a moving vehicle equipped with a perception-based DNN being under attack.


title: Morse index versus radial symmetry for fractional Dirichlet problems

abstract: In this work, we provide an estimate of the Morse index of radially symmetric sign changing bounded weak solutions $u$ to the semilinear fractional Dirichlet problem $$ (-\Delta)^su = f(u)\qquad \text{ in $\mathcal{B}$},\qquad \qquad u = 0\qquad \text{in $\quad\mathbb{R}^{N}\setminus \mathcal{B}$,} $$ where $s\in(0,1)$, $\mathcal{B}\subset \mathbb{R}^N$ is the unit ball centred at zero and the nonlinearity $f$ is of class $C^1$. We prove that for $s\in(1/2,1)$ any radially symmetric sign changing solution of the above problem has a Morse index greater than or equal to $N+1$. If $s\in (0,1/2],$ the same conclusion holds under additional assumption on $f$. In particular, our results apply to the Dirichlet eigenvalue problem for the operator $(-\Delta)^s$ in $\mathcal{B}$ for all $s\in (0,1)$, and it implies that eigenfunctions corresponding to the second Dirichlet eigenvalue in $\mathcal{B}$ are antisymmetric. This resolves a conjecture of Ba\~{n}uelos and Kulczycki.


title: PoET-BiN: Power Efficient Tiny Binary Neurons

abstract: The success of neural networks in image classification has inspired various hardware implementations on embedded platforms such as Field Programmable Gate Arrays, embedded processors and Graphical Processing Units. These embedded platforms are constrained in terms of power, which is mainly consumed by the Multiply Accumulate operations and the memory accesses for weight fetching. Quantization and pruning have been proposed to address this issue. Though effective, these techniques do not take into account the underlying architecture of the embedded hardware. In this work, we propose PoET-BiN, a Look-Up Table based power efficient implementation on resource constrained embedded devices. A modified Decision Tree approach forms the backbone of the proposed implementation in the binary domain. A LUT access consumes far less power than the equivalent Multiply Accumulate operation it replaces, and the modified Decision Tree algorithm eliminates the need for memory accesses. We applied the PoET-BiN architecture to implement the classification layers of networks trained on MNIST, SVHN and CIFAR-10 datasets, with near state-of-the art results. The energy reduction for the classifier portion reaches up to six orders of magnitude compared to a floating point implementations and up to three orders of magnitude when compared to recent binary quantized neural networks.


title: Periodic Q-Learning

abstract: The use of target networks is a common practice in deep reinforcement learning for stabilizing the training; however, theoretical understanding of this technique is still limited. In this paper, we study the so-called periodic Q-learning algorithm (PQ-learning for short), which resembles the technique used in deep Q-learning for solving infinite-horizon discounted Markov decision processes (DMDP) in the tabular setting. PQ-learning maintains two separate Q-value estimates - the online estimate and target estimate. The online estimate follows the standard Q-learning update, while the target estimate is updated periodically. In contrast to the standard Q-learning, PQ-learning enjoys a simple finite time analysis and achieves better sample complexity for finding an epsilon-optimal policy. Our result provides a preliminary justification of the effectiveness of utilizing target estimates or networks in Q-learning algorithms.


title: A Hierarchical Optimization Architecture for Large-Scale Power Networks

abstract: We present a hierarchical optimization architecture for large-scale power networks that overcomes limitations of fully centralized and fully decentralized architectures. The architecture leverages principles of multigrid computing schemes, which are widely used in the solution of partial differential equations on massively parallel computers. The top layer of the architecture uses a coarse representation of the entire network while the bottom layer is composed of a family of decentralized optimization agents each operating on a network subdomain at full resolution. We use an alternating direction method of multipliers (ADMM) framework to drive coordination of the decentralized agents. We show that state and dual information obtained from the top layer can be used to accelerate the coordination of the decentralized optimization agents and to recover optimality for the entire system. We demonstrate that the hierarchical architecture can be used to manage large collections of microgrids.


title: Reliable Fidelity and Diversity Metrics for Generative Models

abstract: Devising indicative evaluation metrics for the image generation task remains an open problem. The most widely used metric for measuring the similarity between real and generated images has been the Fr\'echet Inception Distance (FID) score. Because it does not differentiate the fidelity and diversity aspects of the generated images, recent papers have introduced variants of precision and recall metrics to diagnose those properties separately. In this paper, we show that even the latest version of the precision and recall metrics are not reliable yet. For example, they fail to detect the match between two identical distributions, they are not robust against outliers, and the evaluation hyperparameters are selected arbitrarily. We propose density and coverage metrics that solve the above issues. We analytically and experimentally show that density and coverage provide more interpretable and reliable signals for practitioners than the existing metrics. Code: https://github.com/clovaai/generative-evaluation-prdc.


title: Dynamical height growth: left, right, and total orbits

abstract: Let $S$ be a set of dominant rational self-maps on $\mathbb{P}^N$. We study the arithmetic and dynamical degrees of infinite sequences of $S$ obtained by sequentially composing elements of $S$ on the right and left. We then apply this insight to dynamical Galois theory.


title: Sample Debiasing in the Themis Open World Database System (Extended Version)

abstract: Open world database management systems assume tuples not in the database still exist and are becoming an increasingly important area of research. We present Themis, the first open world database that automatically rebalances arbitrarily biased samples to approximately answer queries as if they were issued over the entire population. We leverage apriori population aggregate information to develop and combine two different approaches for automatic debiasing: sample reweighting and Bayesian network probabilistic modeling. We build a prototype of Themis and demonstrate that Themis achieves higher query accuracy than the default AQP approach, an alternative sample reweighting technique, and a variety of Bayesian network models while maintaining interactive query response times. We also show that \name is robust to differences in the support between the sample and population, a key use case when using social media samples.


title: Yielding, Rigidity, and Tensile Stress in Sheared Columns of Hexapod Granules

abstract: Granular packings of non-convex or elongated particles can form free-standing structures like walls or arches. For some particle shapes, such as staples, the rigidity arises from interlocking of pairs of particles, but the origins of rigidity for non-interlocking particles remains unclear. We report on experiments and numerical simulations of sheared columns of "hexapods," particles consisting of three mutually orthogonal sphero-cylinders whose centers coincide. We vary the length-to-diameter aspect ratio, $\alpha$, of the sphero-cylinders and subject the packings to quasistatic direct shear. For small $\alpha$, we observe a finite yield stress. For large $\alpha$, however, the column becomes rigid when sheared, supporting stresses that increase sharply with increasing strain. Analysis of X-ray micro-computed tomography (Micro-CT) data collected during the shear reveals that the stiffening is associated with a tilted, oblate cluster of hexapods near the nominal shear plane in which particle deformation and average contact number both increase. Simulation results show that the particles are collectively under tension along one direction even though they do not interlock pairwise. These tensions comes from contact forces carrying large torques, and they are perpendicular to the compressive stresses in the packing. They counteract the tendency to dilate, thus stabilize the particle cluster.


title: High-order Methods for a Pressure Poisson Equation Reformulation of the Navier-Stokes Equations with Electric Boundary Conditions

abstract: Pressure Poisson equation (PPE) reformulations of the incompressible Navier-Stokes equations (NSE) replace the incompressibility constraint by a Poisson equation for the pressure and a suitable choice of boundary conditions. This yields a time-evolution equation for the velocity field only, with the pressure gradient acting as a nonlocal operator. Thus, numerical methods based on PPE reformulations, in principle, have no limitations in achieving high order. In this paper, it is studied to what extent high-order methods for the NSE can be obtained from a specific PPE reformulation with electric boundary conditions (EBC). To that end, implicit-explicit (IMEX) time-stepping is used to decouple the pressure solve from the velocity update, while avoiding a parabolic time-step restriction; and mixed finite elements are used in space, to capture the structure imposed by the EBC. Via numerical examples, it is demonstrated that the methodology can yield at least third order accuracy in space and time.


title: Computing Economic-Optimal and Stable Equilibria for Droop-Controlled Microgrids

abstract: We consider the problem of computing equilibria (steady-states) for droop-controlled, islanded, AC microgrids that are both economic-optimal and dynamically stable. This work is motivated by the observation that classical optimal power flow (OPF) formulations used for economic optimization might provide equilibria that are not reachable by low-level controllers (i.e., closed-loop unstable). This arises because OPF problems only enforce steady-state conditions and do not capture the dynamics. We explain this behavior by using a port-Hamiltonian microgrid representation. To overcome the limitations of OPF, the port-Hamiltonian representation can be exploited to derive a bilevel OPF formulation that seeks to optimize economics while enforcing stability. Unfortunately, bilevel optimization with a nonconvex inner problem is difficult to solve in general. As such, we propose an alternative approach (that we call probing OPF), which identifies an economic-optimal and stable equilibrium by probing a neighborhood of equilibria using random perturbations. The probing OPF is advantageous in that it is formulated as a standard nonlinear program, in that it is compatible with existing OPF frameworks, and in that it is applicable to diverse microgrid models. Experiments with the IEEE 118-bus system reveal that few probing points are required to enforce stability.


title: Author Name Disambiguation on Heterogeneous Information Network with Adversarial Representation Learning

abstract: Author name ambiguity causes inadequacy and inconvenience in academic information retrieval, which raises the necessity of author name disambiguation (AND). Existing AND methods can be divided into two categories: the models focusing on content information to distinguish whether two papers are written by the same author, the models focusing on relation information to represent information as edges on the network and to quantify the similarity among papers. However, the former requires adequate labeled samples and informative negative samples, and are also ineffective in measuring the high-order connections among papers, while the latter needs complicated feature engineering or supervision to construct the network. We propose a novel generative adversarial framework to grow the two categories of models together: (i) the discriminative module distinguishes whether two papers are from the same author, and (ii) the generative module selects possibly homogeneous papers directly from the heterogeneous information network, which eliminates the complicated feature engineering. In such a way, the discriminative module guides the generative module to select homogeneous papers, and the generative module generates high-quality negative samples to train the discriminative module to make it aware of high-order connections among papers. Furthermore, a self-training strategy for the discriminative module and a random walk based generating algorithm are designed to make the training stable and efficient. Extensive experiments on two real-world AND benchmarks demonstrate that our model provides significant performance improvement over the state-of-the-art methods.


title: Flat bands and chiral optical response of moir\'e insulators

abstract: We present a low-energy model describing the reconstruction of the electronic spectrum in twisted bilayers of honeycomb crystals with broken sublattice symmetry. The resulting moir\'e patterns are classified into two families with different symmetry. In both cases, flat bands appear at relatively large angles, without any magic angle condition. Transitions between them give rise to sharp resonances in the optical absorption spectrum at frequencies well below the gap of the monolayer. Owing to their chiral symmetry, twisted bilayers display circular dichroism, i.e., different absorption of left and right circularly-polarized light. This optical activity is a nonlocal property determined by the stacking. In hexagonal boron nitride, sensitivity to the stacking leads to strikingly different circular dichroism in the two types of moir\'es. Our calculations exemplify how subtle properties of the electronic wavefunctions encoded in current correlations between the layers control physical observables of moir\'e materials.


title: Risk-Aware Optimization of Age of Information in the Internet of Things

abstract: Minimization of the expected value of age of information (AoI) is a risk-neutral approach, and it thus cannot capture rare, yet critical, events with potentially large AoI. In order to capture the effect of these events, in this paper, the notion of conditional value-at-risk (CVaR) is proposed as an effective coherent risk measure that is suitable for minimization of AoI for real-time IoT status updates. In the considered monitoring system, an IoT device monitors a physical process and sends the status updates to a remote receiver with an updating cost. The optimal status update process is designed to jointly minimize the AoI at the receiver, the CVaR of the AoI at the receiver, and the energy cost. This stochastic optimization problem is formulated as an infinite horizon discounted risk-aware Markov decision process (MDP), which is computationally intractable due to the time inconsistency of the CVaR. By exploiting the special properties of coherent risk measures, the risk-aware MDP is reduced to a standard MDP with an augmented state space, for which we derive the optimal stationary policy using dynamic programming. In particular, the optimal history-dependent policy of the risk-aware MDP is shown to depend on the history only through the augmented system states and can be readily constructed using the optimal stationary policy of the augmented MDP. The proposed solution is shown to be computationally tractable and able to minimize the AoI in real-time IoT monitoring systems in a risk-aware manner.


title: Finite-Time Last-Iterate Convergence for Multi-Agent Learning in Games

abstract: In this paper, we consider multi-agent learning via online gradient descent in a class of games called $\lambda$-cocoercive games, a fairly broad class of games that admits many Nash equilibria and that properly includes unconstrained strongly monotone games. We characterize the finite-time last-iterate convergence rate for joint OGD learning on $\lambda$-cocoercive games; further, building on this result, we develop a fully adaptive OGD learning algorithm that does not require any knowledge of problem parameter (e.g. cocoercive constant $\lambda$) and show, via a novel double-stopping time technique, that this adaptive algorithm achieves same finite-time last-iterate convergence rate as non-adaptive counterpart. Subsequently, we extend OGD learning to the noisy gradient feedback case and establish last-iterate convergence results -- first qualitative almost sure convergence, then quantitative finite-time convergence rates -- all under non-decreasing step-sizes. To our knowledge, we provide the first set of results that fill in several gaps of the existing multi-agent online learning literature, where three aspects -- finite-time convergence rates, non-decreasing step-sizes, and fully adaptive algorithms have been unexplored before.


title: Online Stochastic Max-Weight Matching: prophet inequality for vertex and edge arrival models

abstract: We provide prophet inequality algorithms for online weighted matching in general (non-bipartite) graphs, under two well-studied arrival models, namely edge arrival and vertex arrival. The weight of each edge is drawn independently from an a-priori known probability distribution. Under edge arrival, the weight of each edge is revealed upon arrival, and the algorithm decides whether to include it in the matching or not. Under vertex arrival, the weights of all edges from the newly arriving vertex to all previously arrived vertices are revealed, and the algorithm decides which of these edges, if any, to include in the matching. To study these settings, we introduce a novel unified framework of batched prophet inequalities that captures online settings where elements arrive in batches; in particular it captures matching under the two aforementioned arrival models. Our algorithms rely on the construction of suitable online contention resolution scheme (OCRS). We first extend the framework of OCRS to batched-OCRS, we then establish a reduction from batched prophet inequality to batched OCRS, and finally we construct batched OCRSs with selectable ratios of 0.337 and 0.5 for edge and vertex arrival models, respectively. Both results improve the state of the art for the corresponding settings. For the vertex arrival, our result is tight. Interestingly, a pricing-based prophet inequality with comparable competitive ratios is unknown.


title: My Fair Bandit: Distributed Learning of Max-Min Fairness with Multi-player Bandits

abstract: Consider N cooperative but non-communicating players where each plays one out of M arms for T turns. Players have different utilities for each arm, representable as an NxM matrix. These utilities are unknown to the players. In each turn players select an arm and receive a noisy observation of their utility for it. However, if any other players selected the same arm that turn, all colliding players will all receive zero utility due to the conflict. No other communication or coordination between the players is possible. Our goal is to design a distributed algorithm that learns the matching between players and arms that achieves max-min fairness while minimizing the regret. We present an algorithm and prove that it is regret optimal up to a $\log\log T$ factor. This is the first max-min fairness multi-player bandit algorithm with (near) order optimal regret.


title: Random Bundle: Brain Metastases Segmentation Ensembling through Annotation Randomization

abstract: We introduce a novel ensembling method, Random Bundle (RB), that improves performance for brain metastases segmentation. We create our ensemble by training each network on our dataset with 50% of our annotated lesions censored out. We also apply a lopsided bootstrap loss to recover performance after inducing an in silico 50% false negative rate and make our networks more sensitive. We improve our network detection of lesions's mAP value by 39% and more than triple the sensitivity at 80% precision. We also show slight improvements in segmentation quality through DICE score. Further, RB ensembling improves performance over baseline by a larger margin than a variety of popular ensembling strategies. Finally, we show that RB ensembling is computationally efficient by comparing its performance to a single network when both systems are constrained to have the same compute.


title: Hypothesis testing for eigenspaces of covariance matrix

abstract: Eigenspaces of covariance matrices play an important role in statistical machine learning, arising in variety of modern algorithms. Quantitatively, it is convenient to describe the eigenspaces in terms of spectral projectors. This work focuses on hypothesis testing for the spectral projectors, both in one- and two-sample scenario. We present new tests, based on a specific matrix norm developed in order to utilize the structure of the spectral projectors. A new resampling technique of independent interest is introduced and analyzed: it serves as an alternative to the well-known multiplier bootstrap, significantly reducing computational complexity of bootstrap-based methods. We provide theoretical guarantees for the type-I error of our procedures, which remarkably improve the previously obtained results in the field. Moreover, we analyze power of our tests. Numerical experiments illustrate good performance of the proposed methods compared to previously developed ones.


title: Learning Interpretable Error Functions for Combinatorial Optimization Problem Modeling

abstract: In Constraint Programming, constraints are usually represented as predicates allowing or forbidding combinations of values. However, some algorithms exploit a finer representation: error functions. Their usage comes with a price though: it makes problem modeling significantly harder. Here, we propose a method to automatically learn an error function corresponding to a constraint, given a function deciding if assignments are valid or not. This is, to the best of our knowledge, the first attempt to automatically learn error functions for hard constraints. Our method uses a variant of neural networks we named Interpretable Compositional Networks, allowing us to get interpretable results, unlike regular artificial neural networks. Experiments on 5 different constraints show that our system can learn functions that scale to high dimensions, and can learn fairly good functions over incomplete spaces.


title: Sketching Transformed Matrices with Applications to Natural Language Processing

abstract: Suppose we are given a large matrix $A=(a_{i,j})$ that cannot be stored in memory but is in a disk or is presented in a data stream. However, we need to compute a matrix decomposition of the entry-wisely transformed matrix, $f(A):=(f(a_{i,j}))$ for some function $f$. Is it possible to do it in a space efficient way? Many machine learning applications indeed need to deal with such large transformed matrices, for example word embedding method in NLP needs to work with the pointwise mutual information (PMI) matrix, while the entrywise transformation makes it difficult to apply known linear algebraic tools. Existing approaches for this problem either need to store the whole matrix and perform the entry-wise transformation afterwards, which is space consuming or infeasible, or need to redesign the learning method, which is application specific and requires substantial remodeling. In this paper, we first propose a space-efficient sketching algorithm for computing the product of a given small matrix with the transformed matrix. It works for a general family of transformations with provable small error bounds and thus can be used as a primitive in downstream learning tasks. We then apply this primitive to a concrete application: low-rank approximation. We show that our approach obtains small error and is efficient in both space and time. We complement our theoretical results with experiments on synthetic and real data.


title: Integrality structures in topological strings and quantum $2$-functions

abstract: In this article, we first prove the integrality of open string BPS numbers for a class of toric Calabi-Yau manifolds named generalized conifolds, by applying the method introduced in our previous work \cite{LZ} to the explicit disk counting formula obtained in \cite{PS}. Then, motivated by the integrality structures in open topological string theory, we introduce a mathematical notion of ``quantum 2-function'' which can be viewed as the quantization of the notion of ``2-function'' introduced in \cite{SVW1}. Finally, we provide a basic example of quantum 2-function and discuss the quantization of 2-functions.


title: Survey Bandits with Regret Guarantees

abstract: We consider a variant of the contextual bandit problem. In standard contextual bandits, when a user arrives we get the user's complete feature vector and then assign a treatment (arm) to that user. In a number of applications (like healthcare), collecting features from users can be costly. To address this issue, we propose algorithms that avoid needless feature collection while maintaining strong regret guarantees.


title: Neuron Shapley: Discovering the Responsible Neurons

abstract: We develop Neuron Shapley as a new framework to quantify the contribution of individual neurons to the prediction and performance of a deep network. By accounting for interactions across neurons, Neuron Shapley is more effective in identifying important filters compared to common approaches based on activation patterns. Interestingly, removing just 30 filters with the highest Shapley scores effectively destroys the prediction accuracy of Inception-v3 on ImageNet. Visualization of these few critical filters provides insights into how the network functions. Neuron Shapley is a flexible framework and can be applied to identify responsible neurons in many tasks. We illustrate additional applications of identifying filters that are responsible for biased prediction in facial recognition and filters that are vulnerable to adversarial attacks. Removing these filters is a quick way to repair models. Enabling all these applications is a new multi-arm bandit algorithm that we developed to efficiently estimate Neuron Shapley values.


title: Estimating red noise in quasi-periodic signals with MCMC-based Bayesian

abstract: Multi-parameter Bayesian inferences based on Markov chain Monte Carlo (MCMC) samples have been widely used to estimate red noise in solar period-periodic signals. To MCMC, proper priors and sufficient iterations are prerequisites ensuring the accuracy of red noise estimation. We used MCMC-based Bayesian inferences to estimate 100 groups of red noise synthesized randomly for evaluating its accuracy. At the same time, the Brooks-Gelman algorithm was employed to precisely diagnose the convergence of the Markov chains generated by MCMC. The root-mean-square error of parameter inferences to the synthetic data is only 1.14. Furthermore, we applied the algorithm to analyze the oscillation modes in a sunspot and a flare. A 70 s period is detected in the sunspot umbra in addition to 3- and 5-minute periods, and a 40 s period is detected in the flare. The results prove that estimating red noise with MCMC-based Bayesian has more high accuracy in the case of proper priors and convergence. We also find that the number of iterations increases dramatically to achieve convergence as the number of parameters grows. Therefore, we strongly recommend that when estimating red noise with MCMC-based Bayesian, different initial values must be selected to ensure that the entire posterior distribution is covered.


title: Asymptotic behavior for the 1-D stochastic Landau Lifshitz Bloch equation

abstract: The stochastic Landau-Lifshitz-Bloch equation describes the phase spins in a ferromagnetic material and has significant role in simulating heat-assisted magnetic recording. In this paper, we consider the deviation of the solution to the 1-D stochastic Landau-Lifshitz-Bloch equation, that is, we give the asymptotic behavior of the trajectory $\frac{u_\varepsilon-u_0}{\sqrt{\varepsilon}\lambda(\varepsilon)}$ as $\varepsilon\rightarrow 0+$, for $\lambda(\varepsilon)=\frac{1}{\sqrt{\varepsilon}}$ and $1$ respectively. In other words, the large deviation principle and the central limit theorem are established respectively.


title: Assembling Semantically-Disentangled Representations for Predictive-Generative Models via Adaptation from Synthetic Domain

abstract: Deep neural networks can form high-level hierarchical representations of input data. Various researchers have demonstrated that these representations can be used to enable a variety of useful applications. However, such representations are typically based on the statistics within the data, and may not conform with the semantic representation that may be necessitated by the application. Conditional models are typically used to overcome this challenge, but they require large annotated datasets which are difficult to come by and costly to create. In this paper, we show that semantically-aligned representations can be generated instead with the help of a physics based engine. This is accomplished by creating a synthetic dataset with decoupled attributes, learning an encoder for the synthetic dataset, and augmenting prescribed attributes from the synthetic domain with attributes from the real domain. It is shown that the proposed (SYNTH-VAE-GAN) method can construct a conditional predictive-generative model of human face attributes without relying on real data labels.


title: Eisenstein series whose Fourier coefficients are zeta functions of binary Hermitian forms

abstract: In this paper we investigate a result of Ueno on the modularity of generating series associated to the zeta functions of binary Hermitian forms previously studied by Elstrodt et al. We improve his result by showing that the generating series are Eisenstein series. As a consequence we obtain an explicit formula for the special values of zeta functions associated with binary Hermitian forms.


title: Deep Reinforcement Learning with Linear Quadratic Regulator Regions

abstract: Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even such simulated policies can still fail to perform stably enough to acquire experience in real environments. In this paper we propose a novel method that guarantees a stable region of attraction for the output of a policy trained in simulation, even for highly nonlinear systems. Our core technique is to use "bias-shifted" neural networks for constructing the controller and training the network in the simulator. The modified neural networks not only capture the nonlinearities of the system but also provably preserve linearity in a certain region of the state space and thus can be tuned to resemble a linear quadratic regulator that is known to be stable for the real system. We have tested our new method by transferring simulated policies for a swing-up inverted pendulum to real systems and demonstrated its efficacy.


title: A Multi-view CNN-based Acoustic Classification System for Automatic Animal Species Identification

abstract: Automatic identification of animal species by their vocalization is an important and challenging task. Although many kinds of audio monitoring system have been proposed in the literature, they suffer from several disadvantages such as non-trivial feature selection, accuracy degradation because of environmental noise or intensive local computation. In this paper, we propose a deep learning based acoustic classification framework for Wireless Acoustic Sensor Network (WASN). The proposed framework is based on cloud architecture which relaxes the computational burden on the wireless sensor node. To improve the recognition accuracy, we design a multi-view Convolution Neural Network (CNN) to extract the short-, middle-, and long-term dependencies in parallel. The evaluation on two real datasets shows that the proposed architecture can achieve high accuracy and outperforms traditional classification systems significantly when the environmental noise dominate the audio signal (low SNR). Moreover, we implement and deploy the proposed system on a testbed and analyse the system performance in real-world environments. Both simulation and real-world evaluation demonstrate the accuracy and robustness of the proposed acoustic classification system in distinguishing species of animals.


title: Thermal Casimir interactions for higher derivative field Lagrangians: generalized Brazovskii models

abstract: We examine the Casimir effect for free statistical field theories which have Hamiltonians with second order derivative terms. Examples of such Hamiltonians arise from models of non-local electrostatics, membranes with non-zero bending rigidities and field theories of the Brazovskii type that arise for polymer systems. The presence of a second derivative term means that new types of boundary conditions can be imposed, leading to a richer phenomenology of interaction phenomena. In addition zero modes can be generated that are not present in standard first derivative models, and it is these zero modes which give rise to long range Casimir forces. Two physically distinct cases are considered: (i) unconfined fields, usually considered for finite size embedded inclusions in an infinite fluctuating medium, here in a two plate geometry the fluctuating field exists both inside and outside the plates, (ii) confined fields, where the field is absent outside the slab confined between the two plates. We show how these two physically distinct cases are mathematically related and discuss a wide range of commonly applied boundary conditions. We concentrate our analysis to the critical region where the underlying bulk Hamiltonian has zero modes and show that very exotic Casimir forces can arise, characterised by very long range effects and oscillatory behavior that can lead to strong metastability in the system.


title: A divergent volume for black holes calls for no "firewall"

abstract: The presumption that Hawking radiations are thermally distributed can be considered to result from their entanglement with the internal degrees of freedom for a black hole. This leads to the "firewall" paradox if unitary evolution continues into Page's time when a black hole evaporates away half of its initial entropy. However, if the interior of a black hole houses sufficient degrees of freedom to maintain entanglement with the outside at all times, unitarity can be preserved during the complete radiation process and no firewall will be required. This paper proposes a scenario that rescinds firewall by introducing the concept of volume for a black hole. Based on the operational definition by Christodoulou and Rovelli [1], we show that the volume and its associated entropy for a collapsed black hole diverges if the final evaporation stage is treated using noncommutative space. This implicates the interior of a black hole possesses adequate space to store information for a black hole of any mass, like the inside of a "magician's bag".