title: Submillimeter imaging of the Galactic Center starburst Sgr B2. Warm molecular, atomic, and ionized gas far from massive star-forming cores

abstract: We present 168 arcmin^2 spectral images of the Sgr B2 complex taken with Herschel/SPIRE-FTS. We detect ubiquitous emission from CO (up to J=12-11), H2O, [CI]492, 809 GHz, and [NII] 205 um lines. We also present maps of the SiO, N2H+, HCN, and HCO+ emission obtained with the IRAM30m telescope. The cloud environment dominates the emitted FIR (80%), H2O 752 GHz (60 %) mid-J CO (91%), and [CI] (93 %) luminosity. The region shows very extended [NII] emission (spatially correlated with the 24 and 70 um dust emission). The observed FIR luminosities imply G_0~10^3. The extended [CI] emission arises from a pervasive component of neutral gas with n_H~10^3 cm-3. The high ionization rates, produced by enhanced cosmic-ray (CR) fluxes, drive the gas heating to Tk~40-60 K. The mid-J CO emission arises from a similarly extended but more pressurized gas component (P_th~10^7 K cm-3). Specific regions of enhanced SiO emission and high CO-to-FIR intensity ratios (>10^-3) show mid-J CO emission compatible with shock models. A major difference compared to more quiescent star-forming clouds in the disk of our Galaxy is the extended nature of the SiO and N2H+ emission in Sgr B2. This can be explained by the presence of cloud-scale shocks, induced by cloud-cloud collisions and stellar feedback, and the much higher CR ionization rate (>10^-15 s-1) leading to overabundant H3+ and N2H+. Hence, Sgr B2 hosts a more extreme environment than star-forming regions in the disk of the Galaxy. As a usual template for extragalactic comparisons, Sgr B2 shows more similarities to ultra luminous infrared galaxies such as Arp 220, including a "deficit" in the [CI]/FIR and [NII]/FIR intensity ratios, than to pure starburst galaxies such as M82. However, it is the extended cloud environment, rather than the cores, that serves as a useful template when telescopes do not resolve such extended regions in galaxies.


title: Efficient Exploration of Interesting Aggregates in RDF Graphs

abstract: As large Open Data are increasingly shared as RDF graphs today, there is a growing demand to help users discover the most interesting facets of a graph, which are often hard to grasp without automatic tools. We consider the problem of automatically identifying the k most interesting aggregate queries that can be evaluated on an RDF graph, given an integer k and a user-specified interestingness function. Our problem departs from analytics in relational data warehouses in that (i) in an RDF graph we are not given but we must identify the facts, dimensions, and measures of candidate aggregates; (ii) the classical approach to efficiently evaluating multiple aggregates breaks in the face of multi-valued dimensions in RDF data. In this work, we propose an extensible end-to-end framework that enables the identification and evaluation of interesting aggregates based on a new RDF-compatible one-pass algorithm for efficiently evaluating a lattice of aggregates and a novel early-stop technique (with probabilistic guarantees) that can prune uninteresting aggregates. Experiments using both real and synthetic graphs demonstrate the ability of our framework to find interesting aggregates in a large search space, the efficiency of our algorithms (with up to 2.9x speedup over a similar pipeline based on existing algorithms), and scalability as the data size and complexity grow.


title: Structured light engineering using a photonic nanojet

abstract: In this letter, we present the photonic nanojet as a phenomenon in a structured light generator system that is implemented to modify the source focal spot size and emission angle. The optical system comprises a microlens array that is illuminated by a focused Gaussian beam to generate a structured pattern in the far-field. By introducing a spheroid with different aspect ratios in the focus of the Gaussian beam, the source optical characteristics change and a photonic nanojet is generated which will engineer the far-field distribution. To probe the light fields we implement a high-resolution interferometry setup to extract both the phase and intensity at different planes. We both numerically and experimentally demonstrate that the pattern distribution in the far-field can be engineered by photonic nanojet. As an example, we examine prolate, sphere, and ablate geometries. An interesting finding is that depending on the spheroid geometry, a smaller transverse FWHM of a photonic nanojet with a higher diverges angle produces an increased pattern field of view at the same physical size of the optical system.


title: Parking functions: From combinatorics to probability

abstract: Suppose that $m$ drivers each choose a preferred parking space in a linear car park with $n$ spots. In order, each driver goes to their chosen spot and parks there if possible, and otherwise takes the next available spot if it exists. If all drivers park successfully, the sequence of choices is called a parking function. Classical parking functions correspond to the case $m=n$; we study here combinatorial and probabilistic aspects of this generalized case. We construct a family of bijections between parking functions $\text{PF}(m, n)$ with $m$ cars and $n$ spots and spanning forests $\mathscr{F}(n+1, n+1-m)$ with $n+1$ vertices and $n+1-m$ distinct trees having specified roots. This leads to a bijective correspondence between $\text{PF}(m, n)$ and monomial terms in the associated Tutte polynomial of a disjoint union of $n-m+1$ complete graphs. We present an identity between the "inversion enumerator" of spanning forests with fixed roots and the "displacement enumerator" of parking functions. The displacement is then related to the number of graphs on $n+1$ labeled vertices with a fixed number of edges, where the graph has $n+1-m$ disjoint rooted components with specified roots. We investigate various probabilistic properties of a uniform parking function, giving a formula for the law of a single coordinate. As a side result we obtain a recurrence relation for the displacement enumerator. Adapting known results on random linear probes, we further deduce the covariance between two coordinates when $m=n$.


title: Globally Distributed Development during COVID-19

abstract: Due to the global pandemic, in March 2020 we in academia and industry were abruptly forced into working from home. Yet teaching never stopped, and neither did developing software, fixing software, and expanding into new markets. Demands for flexible ways of working, responding to new requirements, have never been so high. How did we manage to continue working, when we had to suddenly switch all communication to online and virtual forms of contact? In this short paper we describe how Ocuco Ltd., a medium-sized organization headquartered in Ireland, managed our software development teams--distributed throughout Ireland, Europe, Asia and America during the COVID-19 pandemic. We describe how we expanded, kept our customers happy, and our teams motivated. We made changes, some large, such as providing emergency financial support; others small, like implementing regular online social pizza evenings. Technology and process changes were minor, an advantage of working in globally distributed teams since 2016, when development activities were coordinated according to the Scaled Agile Framework (SAFe). The results of implementing the changes were satisfying; productivity went up, we gained new customers, and preliminary results from our wellness survey indicate that everyone feels extremely well-supported by management to achieve their goals. However, the anonymised survey responses did show some developers' anxiety levels were slightly raised, and many are working longer hours. Administering this survey is very beneficial, as now we know, so we can act.


title: Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization

abstract: It is well-known that stochastic gradient noise (SGN) acts as implicit regularization for deep learning and is essentially important for both optimization and generalization of deep networks. Some works attempted to artificially simulate SGN by injecting random noise to improve deep learning. However, it turned out that the injected simple random noise cannot work as well as SGN, which is anisotropic and parameter-dependent. For simulating SGN at low computational costs and without changing the learning rate or batch size, we propose the Positive-Negative Momentum (PNM) approach that is a powerful alternative to conventional Momentum in classic optimizers. The introduced PNM method maintains two approximate independent momentum terms. Then, we can control the magnitude of SGN explicitly by adjusting the momentum difference. We theoretically prove the convergence guarantee and the generalization advantage of PNM over Stochastic Gradient Descent (SGD). By incorporating PNM into the two conventional optimizers, SGD with Momentum and Adam, our extensive experiments empirically verified the significant advantage of the PNM-based variants over the corresponding conventional Momentum-based optimizers.


title: Solid state phase transformation kinetics in Zr-base alloys

abstract: We present a kinetic model for solid state phase transformation (alpha<-->beta) of common zirconium alloys used as fuel cladding material in light water reactors. The model computes the relative amounts of beta or alpha phase fraction as a function of time or temperature in the alloys. The model accounts for the influence of excess oxygen (due to oxidation) and hydrogen concentration (due to hydrogen pickup) on phase transformation kinetics. Two variants of the model denoted by A and B are presented. Model A is suitable for simulation of laboratory experiments in which the heating/cooling rate is constant and is prescribed. Model B is more generic. We compare the results of our model computations, for both A and B variants, with accessible experimental data reported in the literature covering heating/cooling rates of up to 100 K/s. The results of our comparison are satisfactory, especially for model A. Our model B is intended for implementation in fuel rod behavior computer programs, applicable to a reactor accident situation, in which the Zr-based fuel cladding may go through alpha<-->beta phase transformation.


title: Equilibria and their Stability in Networks with Steep Sigmoidal Nonlinearities

abstract: In this paper we investigate equilibria of continuous differential equation models of network dynamics. The motivation comes from gene regulatory networks where each directed edge represents either down- or up-regulation, and is modeled by a sigmoidal nonlinear function. We show that the existence and stability of equilibria of a sigmoidal system is determined by a combinatorial analysis of the limiting switching system with piece-wise constant non-linearities. In addition, we describe a local decomposition of a switching system into a product of simpler cyclic feedback systems, where the cycles in each decomposition correspond to a particular subset of network loops.


title: Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes

abstract: There have been many successful implementations of neural style transfer in recent years. In most of these works, the stylization process is confined to the pixel domain. However, we argue that this representation is unnatural because paintings usually consist of brushstrokes rather than pixels. We propose a method to stylize images by optimizing parameterized brushstrokes instead of pixels and further introduce a simple differentiable rendering mechanism. Our approach significantly improves visual quality and enables additional control over the stylization process such as controlling the flow of brushstrokes through user input. We provide qualitative and quantitative evaluations that show the efficacy of the proposed parameterized representation.


title: Intersecting defects in gauge theory, quantum spin chains, and Knizhnik-Zamolodchikov equations

abstract: We propose an interesting BPS/CFT correspondence playground: the correlation function of two intersecting half-BPS surface defects in four-dimensional $\mathcal{N}=2$ supersymmetric $SU(N)$ gauge theory with $2N$ fundamental hypermultiplets. We show it satisfies a difference equation, the fractional quantum T-Q relation. Its Fourier transform is the $5$-point conformal block of the $\widehat{\mathfrak{sl}}_N$ current algebra with one of the vertex operators corresponding to the $N$-dimensional $\mathfrak{sl}_N$ representation, which we demonstrate with the help of the Knizhnik-Zamolodchikov equation. We also identify the correlator with a state of the $XXX_{\mathfrak{sl}_2}$ spin chain of $N$ Heisenberg-Weyl modules over $Y(\mathfrak{sl}_2)$. We discuss the associated quantum Lax operators, and connections to isomonodromic deformations.

categories: hep-th math-ph math.AG math.MP math.QA math.RT


title: On Concavity of Solutions of the Nonlinear Poisson Equation

abstract: We consider the nonlinear Poisson equation $-\Delta u = f(u)$ in domains $\Omega \subset \mathbb{R}^n$ with Dirichlet boundary conditions on $\partial \Omega$. We show (for monotonically increasing concave $f$ with small Lipschitz constant) that if $D^2 u$ is negative semi-definite on the boundary, then $u$ is concave. A conjecture of Saint Venant from 1856 (proven by Polya in 1948) is that among all domains $\Omega$ of fixed measure, the solution of $-\Delta u =1$ assumes its largest maximum when $\Omega$ is a ball. We extend this to $-\Delta u =f(u)$ for monotonically increasing $f$ with small Lipschitz constant.


title: Radio-frequency evaporation in an optical dipole trap

abstract: We present an evaporative cooling technique for atoms trapped in an optical dipole trap that benefits from narrow optical transitions. For an appropriate choice of wavelength and polarization, a single laser beam leads to opposite light-shifts in two internal states of the lowest energy manifold. Radio-frequency coupling between these two states results in evaporative cooling at a constant trap stiffness. The evaporation protocol is well adapted to several atomic species, in particular to the case of Lanthanides such as Er, Dy, and fermionic Yb, but also to alkali-earth metals such as fermionic Sr. We derive the dimensionless expressions that allow us to estimate the evaporation efficiency. As a concrete example, we consider the case of $^{162}$Dy and present a numerical analysis of the evaporation in a dipole trap near the $J'=J$ optical transition at 832 nm. We show that this technique can lead to runaway evaporation in a minimalist experimental setup.


title: Y$^2$-Net FCRN for Acoustic Echo and Noise Suppression

abstract: In recent years, deep neural networks (DNNs) were studied as an alternative to traditional acoustic echo cancellation (AEC) algorithms. The proposed models achieved remarkable performance for the separate tasks of AEC and residual echo suppression (RES). A promising network topology is a fully convolutional recurrent network (FCRN) structure, which has already proven its performance on both noise suppression and AEC tasks, individually. However, the combination of AEC, postfiltering, and noise suppression to a single network typically leads to a noticeable decline in the quality of the near-end speech component due to the lack of a separate loss for echo estimation. In this paper, we propose a two-stage model (Y$^2$-Net) which consists of two FCRNs, each with two inputs and one output (Y-Net). The first stage (AEC) yields an echo estimate, which - as a novelty for a DNN AEC model - is further used by the second stage to perform RES and noise suppression. While the subjective listening test of the Interspeech 2021 AEC Challenge mostly yielded results close to the baseline, the proposed method scored an average improvement of 0.46 points over the baseline on the blind testset in double-talk on the instrumental metric DECMOS, provided by the challenge organizers.


title: Quartic metal: Spontaneous breaking of time-reversal symmetry due to four-fermion correlations in Ba$_{1-x}$K$_x$Fe$_2$As$_2$

abstract: Discoveries of ordered quantum states of matter are of great fundamental interest, and often lead to unique applications. The most well known example -- superconductivity -- is caused by the formation and condensation of pairs of electrons. A key property of superconductors is diamagnetism: magnetic fields are screened by dissipationless currents. Fundamentally, what distinguishes superconducting states from normal states is a spontaneously broken symmetry corresponding to long-range coherence of fermion pairs. Here we report a set of experimental observations in hole doped Ba$_{1-x}$K$_x$Fe$_2$As$_2$ which are not consistent with conventional superconducting behavior. Our specific-heat measurements indicate the formation of fermionic bound states when the temperature is lowered from the normal state. However, for $x \sim 0.8$, instead of the standard for superconductors, zero resistance and diamagnetic screening, for a range of temperatures, we observe the opposite effect: the generation of self-induced magnetic fields measured by spontaneous Nernst effect and muon spin rotation experiments. The finite resistance and the lack of any detectable diamagnetic screening in this state exclude the spontaneously broken symmetry associated with superconducting two-fermion correlations. Instead, combined evidence from transport and thermodynamic measurements indicates that the formation of fermionic bound states leads to spontaneous breaking of time-reversal symmetry above the superconducting transition temperature. These results demonstrate the existence of a broken-time-reversal-symmetry bosonic metal state. In the framework of a multiband theory, such a state is characterized by quartic correlations: the long-range order exists only for {\it pairs} of fermion pairs.


title: Modeling Users and Online Communities for Abuse Detection: A Position on Ethics and Explainability

abstract: Abuse on the Internet is an important societal problem of our time. Millions of Internet users face harassment, racism, personal attacks, and other types of abuse across various platforms. The psychological effects of abuse on individuals can be profound and lasting. Consequently, over the past few years, there has been a substantial research effort towards automated abusive language detection in the field of NLP. In this position paper, we discuss the role that modeling of users and online communities plays in abuse detection. Specifically, we review and analyze the state of the art methods that leverage user or community information to enhance the understanding and detection of abusive language. We then explore the ethical challenges of incorporating user and community information, laying out considerations to guide future research. Finally, we address the topic of explainability in abusive language detection, proposing properties that an explainable method should aim to exhibit. We describe how user and community information can facilitate the realization of these properties and discuss the effective operationalization of explainability in view of the properties.


title: Exploring the pulsational properties of two ZZ Ceti stars

abstract: Context. We continued our ground-based observing project with the season-long observations of ZZ Ceti stars at Konkoly Observatory. Our present targets are the newly discovered PM J22299+3024, and the already known LP 119-10 variables. LP 119-10 was also observed by the TESS (Transiting Exoplanet Survey Satellite) space telescope in 120-second cadence mode. Methods. We performed standard Fourier analysis of the daily, weekly, and the whole data sets, together with test data of different combinations of weekly observations. We then performed asteroseismic fits utilising the observed and the calculated pulsation periods. For the calculations of model grids necessary for the fits, we applied the 2018 version of the White Dwarf Evolution Code. Results. We derived six possible pulsation modes for PM J22299+3024, and five plus two TESS pulsation frequencies for LP 119-10. Note that further pulsation frequencies may be present in the data sets, but we found their detection ambiguous, so we omitted them from the final frequency list. Our asteroseismic fits of PM J22299+3024 give 11 400 K and 0.46 Msun for the effective temperature and the stellar mass. The temperature is ~800 K higher, while the mass of the model star is exactly the same as it was earlier derived by spectroscopy. Our model fits of LP~119-10 put the effective temperature in the range of 11 800 - 11 900 K, which is again higher than the spectroscopic 11 290 K value, while our best model solutions give M* = 0.70 Msun mass for this target, near to the spectroscopic value of 0.65 Msun, likewise in the case of PM J22299+3024. The seismic distances of our best-fitting model stars agree with the Gaia astrometric distances of PM J22299+3024 and LP 119-10 within the errors, validating our model results.


title: QPack: Quantum Approximate Optimization Algorithms as universal benchmark for quantum computers

abstract: In this paper, we present QPack, a universal benchmark for Noisy Intermediate-Scale Quantum (NISQ) computers based on Quantum Approximate Optimization Algorithms (QAOA). Unlike other evaluation metrics in the field, this benchmark evaluates not only one, but multiple important aspects of quantum computing hardware: the maximum problem size a quantum computer can solve, the required runtime, as well as the achieved accuracy. The applications MaxCut, dominating set and traveling salesman are included to provide variation in resource requirements. This will allow for a diverse benchmark that promotes optimal design considerations, avoiding hardware implementations for specific applications. We also discuss the design aspects that are taken in consideration for the QPack benchmark, with critical quantum benchmark requirements in mind. An implementation is presented, providing practical metrics. QPack is presented as a hardware agnostic benchmark by making use of the XACC library. We demonstrate the application of the benchmark on various IBM machines, as well as a range of simulators.


title: Execution of Partial State Machine Models

abstract: The iterative and incremental nature of software development using models typically makes a model of a system incomplete (i.e., partial) until a more advanced and complete stage of development is reached. Existing model execution approaches (interpretation of models or code generation) do not support the execution of partial models. Supporting the execution of partial models at the early stages of software development allows early detection of defects, which can be fixed more easily and at a lower cost. This paper proposes a conceptual framework for the execution of partial models, which consists of three steps: static analysis, automatic refinement, and input-driven execution. First, a static analysis that respects the execution semantics of models is applied to detect problematic elements of models that cause problems for the execution. Second, using model transformation techniques, the models are refined automatically, mainly by adding decision points where missing information can be supplied. Third, refined models are executed, and when the execution reaches the decision points, it uses inputs obtained either interactively or by a script that captures how to deal with partial elements. We created an execution engine called PMExec for the execution of partial models of UML-RT (i.e., a modeling language for the development of soft real-time systems) that embodies our proposed framework. We evaluated PMExec based on several use-cases that show that the static analysis, refinement, and application of user input can be carried out with reasonable performance and that the overhead of approach, which is mostly due to the refinement and the increase in model complexity it causes, is manageable. We also discuss the properties of the refinement formally and show how the refinement preserves the original behaviors of the model.


title: A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detection

abstract: CNN-based generative modelling has evolved to produce synthetic images indistinguishable from real images in the RGB pixel space. Recent works have observed that CNN-generated images share a systematic shortcoming in replicating high frequency Fourier spectrum decay attributes. Furthermore, these works have successfully exploited this systematic shortcoming to detect CNN-generated images reporting up to 99% accuracy across multiple state-of-the-art GAN models. In this work, we investigate the validity of assertions claiming that CNN-generated images are unable to achieve high frequency spectral decay consistency. We meticulously construct a counterexample space of high frequency spectral decay consistent CNN-generated images emerging from our handcrafted experiments using DCGAN, LSGAN, WGAN-GP and StarGAN, where we empirically show that this frequency discrepancy can be avoided by a minor architecture change in the last upsampling operation. We subsequently use images from this counterexample space to successfully bypass the recently proposed forensics detector which leverages on high frequency Fourier spectrum decay attributes for CNN-generated image detection. Through this study, we show that high frequency Fourier spectrum decay discrepancies are not inherent characteristics for existing CNN-based generative models--contrary to the belief of some existing work--, and such features are not robust to perform synthetic image detection. Our results prompt re-thinking of using high frequency Fourier spectrum decay attributes for CNN-generated image detection. Code and models are available at https://keshik6.github.io/Fourier-Discrepancies-CNN-Detection/


title: Analytical computation of boundary integrals for the Helmholtz equation in three dimensions

abstract: A key issue in the solution of partial differential equations via integral equation methods is the evaluation of possibly singular integrals involving the Green's function and its derivatives multiplied by simple functions over discretized representations of the boundary. For the Helmholtz equation, while many authors use numerical quadrature to evaluate these boundary integrals, we present analytical expressions for such integrals over flat polygons in the form of infinite series. These can be efficiently truncated based on the accurate error bounds, which is key to their integration in methods such as the Fast Multipole Method.


title: Visual Analysis of Two-Phase Flow Displacement Processes in Porous Media

abstract: We present the visual analysis of our novel parameter study of porous media experiments, focusing on gaining a better understanding of drainage processes on the micro-scale. We analyze the temporal evolution of extracted characteristic values, and discuss how to directly compare experiments that exhibit processes at different temporal scales due to varying boundary and physical conditions. To enable spatio-temporal analysis, we introduce a new abstract visual representation showing which paths through the porous media were occupied to what extent, e.g., allowing for classification into viscous and capillary regimes. This joint work of porous media experts and visualization researchers yields new insights regarding immiscible two-phase flow on the micro-scale toward the overarching goal of characterizing flow based on boundary conditions and physical fluid properties.


title: The Swapland

abstract: All the news that's (un)fit to publish.


title: Generalized solutions to a chemotaxis-Navier-Stokes system with arbitrary superlinear degradation

abstract: In this work, we study a chemotaxis-Navier-Stokes model in a two-dimensional setting as below, \begin{eqnarray} \left\{ \begin{array}{llll} \displaystyle n_{t}+\mathbf{u}\cdot\nabla n=\Delta n-\nabla \cdot(n\nabla c)+f(n), &&x\in\Omega,\,t>0,\\ \displaystyle c_{t}+\mathbf{u}\cdot\nabla c=\Delta c - c+ n, &&x\in\Omega,\,t>0,\\ \displaystyle \mathbf{u}_{t}+\kappa(\mathbf{u}\cdot\nabla)\mathbf{u}=\Delta \mathbf{u} +\nabla P+ n\nabla\phi, &&x\in\Omega,\,t>0,\\ \displaystyle \nabla\cdot\mathbf{u}=0,&&x\in\Omega,\,t>0.\\ \end{array} \right. \end{eqnarray} Motivated by a recent work due to Winkler, we aim at investigating generalized solvability for the model the without imposing a critical superlinear exponent restriction on the logistic source function $f$. Specifically, it is proven in the present work that there exists a triple of integrable functions $(n,c,\mathbf{u})$ solving the system globally in a generalized sense provided that $f\in C^1([0,\infty))$ satisfies $f(0)\ge0$ and $f(n)\le rn-\mu n^{\gamma}$ ($n\ge0$) with any $\gamma>1$. Our result indicates that persistent Dirac-type singularities can be ruled out in our model under the aforementioned mild assumption on $f$. After giving the existence result for the system, we also show that the generalized solution exhibits eventual smoothness as long as $\mu/r$ is sufficiently large.


title: Critical recurrence in the real quadratic family

abstract: We study recurrence in the real quadratic family and give a sufficient condition on the recurrence rate $(\delta_n)$ of the critical orbit such that, for almost every nonregular parameter $a$, the set of $n$ such that $\vert F^n(0;a) \vert < \delta_n$ is infinite. In particular, when $\delta_n = n^{-1}$, this extends an earlier result of Avila and Moreira.


title: Toward the existence of odderon as a three-gluon bound state

abstract: Inspired by the evidence of the odderon exchange recently observed by the D0 and TOTEM Collaborations, a QCD sum rule investigation is performed to study the odderon as a three-gluon bound state. There may exist six lowest-lying three-gluon odderons with the quantum numbers $J^{PC} = 1/2/3^{\pm-}$. We systematically construct their interpolating currents, and calculate their mass spectra. To verify their existence, we propose to search for the spin-3 odderons in their $VVV$ and $VVP$ decay channels directly at LHC, with $V$ and $P$ light vector and pseudoscalar mesons respectively.


title: GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detection

abstract: Modern 3D object detectors have immensely benefited from the end-to-end learning idea. However, most of them use a post-processing algorithm called Non-Maximal Suppression (NMS) only during inference. While there were attempts to include NMS in the training pipeline for tasks such as 2D object detection, they have been less widely adopted due to a non-mathematical expression of the NMS. In this paper, we present and integrate GrooMeD-NMS -- a novel Grouped Mathematically Differentiable NMS for monocular 3D object detection, such that the network is trained end-to-end with a loss on the boxes after NMS. We first formulate NMS as a matrix operation and then group and mask the boxes in an unsupervised manner to obtain a simple closed-form expression of the NMS. GrooMeD-NMS addresses the mismatch between training and inference pipelines and, therefore, forces the network to select the best 3D box in a differentiable manner. As a result, GrooMeD-NMS achieves state-of-the-art monocular 3D object detection results on the KITTI benchmark dataset performing comparably to monocular video-based methods. Code and models at https://github.com/abhi1kumar/groomed_nms


title: Universal Prediction Band via Semi-Definite Programming

abstract: We propose a computationally efficient method to construct nonparametric, heteroscedastic prediction bands for uncertainty quantification, with or without any user-specified predictive model. Our approach provides an alternative to the now-standard conformal prediction for uncertainty quantification, with novel theoretical insights and computational advantages. The data-adaptive prediction band is universally applicable with minimal distributional assumptions, has strong non-asymptotic coverage properties, and is easy to implement using standard convex programs. Our approach can be viewed as a novel variance interpolation with confidence and further leverages techniques from semi-definite programming and sum-of-squares optimization. Theoretical and numerical performances for the proposed approach for uncertainty quantification are analyzed.

categories: stat.ML cs.LG econ.EM math.OC math.ST stat.TH


title: Long-Term Temporally Consistent Unpaired Video Translation from Simulated Surgical 3D Data

abstract: Research in unpaired video translation has mainly focused on short-term temporal consistency by conditioning on neighboring frames. However for transfer from simulated to photorealistic sequences, available information on the underlying geometry offers potential for achieving global consistency across views. We propose a novel approach which combines unpaired image translation with neural rendering to transfer simulated to photorealistic surgical abdominal scenes. By introducing global learnable textures and a lighting-invariant view-consistency loss, our method produces consistent translations of arbitrary views and thus enables long-term consistent video synthesis. We design and test our model to generate video sequences from minimally-invasive surgical abdominal scenes. Because labeled data is often limited in this domain, photorealistic data where ground truth information from the simulated domain is preserved is especially relevant. By extending existing image-based methods to view-consistent videos, we aim to impact the applicability of simulated training and evaluation environments for surgical applications. Code and data: http://opencas.dkfz.de/video-sim2real.


title: Augmenting Poetry Composition with Verse by Verse

abstract: We describe Verse by Verse, our experiment in augmenting the creative process of writing poetry with an AI. We have created a group of AI poets, styled after various American classic poets, that are able to offer as suggestions generated lines of verse while a user is composing a poem. In this paper, we describe the underlying system to offer these suggestions. This includes a generative model, which is tasked with generating a large corpus of lines of verse offline and which are then stored in an index, and a dual-encoder model that is tasked with recommending the next possible set of verses from our index given the previous line of verse.


title: The power of microscopic nonclassical states to amplify the precision of macroscopic optical metrology

abstract: It is well-known that the precision of a phase measurement with a Mach-Zehnder interferometer employing strong (macroscopic) classic light can be greatly enhanced with the addition of a weak (microscopic) light field in a non-classical state. The resulting precision is much greater than that possible with either the macroscopic classical or microscopic quantum states alone. In the context of quantifying non-classicality, the amount by which a non-classical state can enhance precision in this way has been termed its "metrological power". Given the technological difficulty of producing high-amplitude non-classical states of light, this use of non-classical light is likely to provide a technological advantage much sooner than the Heisenberg scaling employing much stronger non-classical states. To date, the enhancement provided by weak nonclassical states has been calculated only for specific measurement configurations. Here we are able to optimize over all measurement configurations to obtain the maximum enhancement that can be achieved by any single or multi-mode nonclassical state together with strong classical states, for local and distributed quantum metrology employing any linear or nonlinear single-mode unitary transformation. Our analysis reveals that the quantum Fisher information for \textit{quadrature displacement sensing} is the sole property that determines the maximum achievable enhancement in all of these different scenarios, providing a unified quantification of the metrological power. It also reveals that the Mach-Zehnder interferometer is an optimal network for phase sensing for an arbitrary single-mode nonclassical input state, and how the Mach-Zehnder interferometer can be extended to make optimal use of any multi-mode nonclassical state for metrology.


title: State-Dependent Processing in Payment Channel Networks for Throughput Optimization

abstract: Payment channel networks (PCNs) have emerged as a scalability solution for blockchains built on the concept of a payment channel: a setting that allows two nodes to safely transact between themselves in high frequencies based on pre-committed peer-to-peer balances. Transaction requests in these networks may be declined because of unavailability of funds due to temporary uneven distribution of the channel balances. In this paper, we investigate how to alleviate unnecessary payment blockage via proper prioritization of the transaction execution order. Specifically, we consider the scheduling problem in PCNs: as transactions continuously arrive on both sides of a channel, nodes need to decide which ones to process and when in order to maximize their objective, which in our case is the channel throughput. We introduce a stochastic model to capture the dynamics of a payment channel under random arrivals, and propose that channels can hold incoming transactions in buffers up to some deadline in order to enable more elaborate processing decisions. We describe a policy that maximizes the channel success rate/throughput for uniform transaction requests of fixed amounts, both in the presence and absence of buffering capabilities, and formally prove its optimality. We also develop a discrete event simulator of a payment channel, and evaluate different heuristic scheduling policies in the more general heterogeneous amounts case, with the results showing superiority of the heuristic extension of our policy in this case as well. Our work opens the way for more formal research on improving PCN performance via joint consideration of routing and scheduling decisions.


title: Density Fluctuations Associated with Turbulence and Waves: First Observations by Solar Orbiter

abstract: We use the plasma density based on measurements of the probe-to-spacecraft potential in combination with magnetic field measurements by MAG to study fields and density fluctuations in the solar wind observed by Solar Orbiter during the first perihelion encounter ($\sim$0.5~AU away from the Sun). In particular we use the polarization of the wave magnetic field, the phase between the compressible magnetic field and density fluctuations and the compressibility ratio (the ratio of the normalized density fluctuations to the normalized compressible fluctuations of B) to characterize the observed waves and turbulence. We find that the density fluctuations are out-of-phase with the compressible component of magnetic fluctuations for intervals of turbulence, while they are in phase for the circular-polarized waves around the proton cyclotron frequency. We analyze in detail two specific events with simultaneous presence of left- and right-handed waves at different frequencies. We compare observed wave properties to a prediction of the three-fluid (electrons, protons and alphas) model. We find a limit on the observed wavenumbers, $10^{-6} < k < 7 \times 10^{-6}$~m$^{-1}$, which corresponds to wavelength $7 \times 10^6 >\lambda > 10^6$~m. We conclude that most likely both the left- and right-handed waves correspond to the low-wavenumber part (close to the cut-off at $\Omega_{c\mathrm{He}++}$) proton-band electromagnetic ion cyclotron (left-handed wave in the plasma frame confined to the frequency range $\Omega_{c\mathrm{He}++} < \omega < \Omega_{c\mathrm{H}+}$) waves propagating in the outwards and inwards directions respectively. The fact that both wave polarizations are observed at the same time and the identified wave mode has a low group velocity suggests that the double-banded events occur in the source regions of the waves.


title: Sensitive single-photon test of extended quantum theory with 2D hexagonal boron nitride

abstract: Quantum theory is the foundation of modern physics. Some of its basic principles, such as Born's rule, however, are based on postulates which require experimental testing. Any deviation from Born's rule would result in higher-order interference and can thus be tested in an experiment. Here, we report on such a test with a quantum light source based on a color center in hexagonal boron nitride (hBN) coupled to a microcavity. Our room temperature photon source features a narrow linewidth, high efficiency, high purity, and on-demand single-photon generation. With the single-photon source we can increase the interferometric sensitivity of our three-path interferometer compared to conventional laser-based light sources by fully suppressing the detector nonlinearity. We thereby obtain a tight bound on the third-order interference term of $3.96(523)\times 10^{-4}$. We also measure an interference visibility of 98.58% for our single-photons emitted from hBN at room temperature, which provides a promising route for using the hBN platform as light source for phase-encoding schemes in quantum key distribution.

categories: quant-ph cond-mat.other physics.app-ph physics.optics


title: Fundamental Bounds on the Performance of Monochromatic Passive Cloaks

abstract: Fundamental bounds on the performance of monochromatic scattering-cancellation and field-zeroing cloaks made of prescribed linear passive materials occupying a predefined design region are formulated by projecting field quantities onto a sub-sectional basis and applying quadratically constrained quadratic programming. Formulations are numerically tested revealing key physical trends as well as advantages and disadvantages between the two classes of cloaks. Results show that the use of low-loss materials with high dielectric contrast affords the highest potential for effective cloaking.


title: On the geometric Ramanujan conjecture

abstract: In this paper we prove two results pertaining to the (unramified and global) geometric Langlands program. The first result is an analogue of the Ramanujan conjecture: any cuspidal D-module on Bun_G is tempered. We actually prove a more general statement: any D-module that is *-extended from a quasi-compact open substack of Bun_G is tempered. Then the assertion about cuspidal objects is an immediate consequence of a theorem of Drinfeld-Gaitsgory. Building up on this, we prove our second main result, the automorphic gluing theorem for the group SL_2: it states that any D-module on Bun_{SL_2} is determined by its tempered part and its constant term. This theorem (vaguely speaking, an analogue of Langlands' classification for the group SL_2(R)) corresponds under geometric Langlands to the spectral gluing theorem of Arinkin-Gaitsgory and the author.


title: Convergence analysis of oversampled collocation boundary element methods in 2D

abstract: Collocation boundary element methods for integral equations are easier to implement than Galerkin methods because the elements of the discretization matrix are given by lower-dimensional integrals. For that same reason, the matrix assembly also requires fewer computations. However, collocation methods typically yield slower convergence rates and less robustness, compared to Galerkin methods. We explore the extent to which oversampled collocation can improve both robustness and convergence rates. We show that in some cases convergence rates can actually be higher than the corresponding Galerkin method, although this requires oversampling at a faster than linear rate. In most cases of practical interest, oversampling at least lowers the error by a constant factor. This can still be a substantial improvement: we analyze an example where linear oversampling by a constant factor $J$ (leading to a rectangular system of size $JN \times N$) improves the error at a cubic rate in the constant $J$. Furthermore, the oversampled collocation method is much less affected by a poor choice of collocation points, as we show how oversampling can lead to guaranteed convergence. Numerical experiments are included for the two-dimensional Helmholtz equation.


title: An effective and friendly tool for seed image analysis

abstract: Image analysis is an essential field for several topics in the life sciences, such as biology or botany. In particular, the analysis of seeds (e.g. fossil research) can provide significant information on their evolution, the history of agriculture, plant domestication and knowledge of diets in ancient times. This work aims to present software that performs image analysis for feature extraction and classification from images containing seeds through a novel and unique framework. In detail, we propose two plugins \emph{ImageJ}, one able to extract morphological, textual and colour features from seed images, and another to classify seeds into categories using the extracted features. The experimental results demonstrated the correctness and validity of both the extracted features and the classification predictions. The proposed tool is easily extendable to other fields of image analysis.


title: Polynomially Convex Arcs in Polynomially Convex Simple Closed Curves

abstract: We prove that every polynomially convex arc is contained in a polynomially convex simple closed curve. We also establish results about polynomial hulls of arcs and curves that are locally rectifiable outside a polynomially convex subset.


title: The inverse scattering of the Zakharov-Shabat system solves the weak noise theory of the Kardar-Parisi-Zhang equation

abstract: We solve the large deviations of the Kardar-Parisi-Zhang (KPZ) equation in one dimension at short time by introducing an approach which combines field theoretical, probabilistic and integrable techniques. We expand the program of the weak noise theory, which maps the large deviations onto a non-linear hydrodynamic problem, and unveil its complete solvability through a connection to the integrability of the Zakharov-Shabat system. Exact solutions, depending on the initial condition of the KPZ equation, are obtained using the inverse scattering method and a Fredholm determinant framework recently developed. These results, explicit in the case of the droplet geometry, open the path to obtain the complete large deviations for general initial conditions.

categories: cond-mat.stat-mech math-ph math.DS math.MP math.PR nlin.SI


title: Finite groups can be generated by a pi-subgroup and a pi'-subgroup

abstract: Answering a question of Dan Haran and generalizing some results of Aschbacher-Guralnick and Suzuki, we prove that given a set of primes pi, any finite group can be generated by a pi-subgroup and a pi'-subgroup. This gives a free product description of a countably generated free profinite group.


title: Mechanical properties of DNA and DNA nanostructures: comparison of atomistic, martini and oxDNA

abstract: The flexibility and stiffness of small DNA play a fundamental role ranging from several biophysical processes to nano-technological applications. Here, we estimate the mechanical properties of short double-stranded DNA (dsDNA) having length ranging from 12 base-pairs (bps) to 56 bps, paranemic crossover (PX) DNA, and hexagonal DNA nanotubes (DNTs) using two widely used coarse-grain models $-$ Martini and oxDNA. To calculate the persistence length ($L_p$) and the stretch modulus ($\gamma$) of the dsDNA, we incorporate the worm-like chain and elastic rod model, while for DNT, we implement our previously developed theoretical framework. We compare and contrast all the results with previously reported all-atom molecular dynamics (MD) simulation and experimental results. The mechanical properties of dsDNA ($L_p$ $\sim$ 50nm, $\gamma \sim$ 800-1500 pN), PX DNA ($\gamma \sim$ 1600-2000 pN) and DNTs ($L_p \sim 1-10\ \mu$m, $\gamma \sim$ 6000-8000 pN) estimated using Martini soft elastic network and oxDNA are in very good agreement with the all-atom MD and experimental values, while the stiff elastic network Martini reproduces order of magnitude higher values of $L_p$ and $\gamma$. The high flexibility of small dsDNA is also depicted in our calculations. However, Martini models proved inadequate to capture the salt concentration effects on the mechanical properties with increasing salt molarity. OxDNA captures the salt concentration effect on small dsDNA mechanics. But it is found to be ineffective to reproduce the salt-dependent mechanical properties of DNTs. Also, unlike Martini, the time evolved PX DNA and DNT structures from the oxDNA models are comparable to the all-atom MD simulated structures. Our findings provide a route to study the mechanical properties of DNA nanostructures with increased time and length scales and has a remarkable implication in the context of DNA nanotechnology.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.chem-ph q-bio.BM


title: Note on the pragmatic mode-sum regularization method: translational-splitting in a cosmological background

abstract: The point-splitting renormalization method offers a prescription to calculate finite expectation values of quadratic operators constructed from quantum fields in a general curved spacetime. It has been recently shown by Levi and Ori that when the background metric possesses an isometry, like stationary or spherically symmetric black holes, the method can be upgraded into a pragmatic procedure of renormalization that produces efficient numerical calculations. In this note we show that when the background enjoys three-dimensional spatial symmetries, like homogeneous expanding universes, the above pragmatic regularization technique reduces to the well established adiabatic regularization method.


title: Fano 3-folds and double covers by half elephants

abstract: We construct a deformation family for each of the 34 Hilbert series of index 2 Fano 3-folds. In 18 cases we construct two different families, distinguished by the topology of their general members.


title: Scale-aware Automatic Augmentation for Object Detection

abstract: We propose Scale-aware AutoAug to learn data augmentation policies for object detection. We define a new scale-aware search space, where both image- and box-level augmentations are designed for maintaining scale invariance. Upon this search space, we propose a new search metric, termed Pareto Scale Balance, to facilitate search with high efficiency. In experiments, Scale-aware AutoAug yields significant and consistent improvement on various object detectors (e.g., RetinaNet, Faster R-CNN, Mask R-CNN, and FCOS), even compared with strong multi-scale training baselines. Our searched augmentation policies are transferable to other datasets and box-level tasks beyond object detection (e.g., instance segmentation and keypoint estimation) to improve performance. The search cost is much less than previous automated augmentation approaches for object detection. It is notable that our searched policies have meaningful patterns, which intuitively provide valuable insight for human data augmentation design. Code and models will be available at https://github.com/Jia-Research-Lab/SA-AutoAug.


title: Static and Dynamic Failure Localization through Progressive Network Tomography

abstract: We aim at assessing the states of the nodes in a network by means of end-to-end monitoring paths. The contribution of this paper is twofold. First, we consider a static failure scenario. In this context, we aim at minimizing the number of probes to obtain failure identification. To face this problem, we propose a progressive approach to failure localization based on stochastic optimization, whose solution is the optimal sequence of monitoring paths to probe. We address the complexity of the problem by proposing a greedy strategy in two variants: one considers exact calculation of posterior probabilities of node failures, given the observation, whereas the other approximates these values by means of a novel failure centrality metric. Secondly, we adapt these two strategies to a dynamic failure scenario where nodes states can change throughout a monitoring period. By means of numerical experiments conducted on real network topologies, we demonstrate the practical applicability of our approach. Our performance evaluation evidences the superiority of our algorithms with respect to state of the art solutions based on classic Boolean Network Tomography as well as approaches based on sequential group testing.


title: Early turbulence and pulsatile flows enhance diodicity of Tesla's macrofluidic valve

abstract: Microfluidics has enabled a revolution in the manipulation of small volumes of fluids. Controlling flows at larger scales and faster rates, or $\textit{macrofluidics}$, has broad applications but involves the unique complexities of inertial flow physics. We show how such effects are exploited in a device proposed by Nikola Tesla that acts as a diode or valve whose asymmetric internal geometry leads to direction-dependent fluidic resistance. Systematic tests for steady forcing conditions reveal that diodicity turns on abruptly at Reynolds number $\textrm{Re} \approx 200$ and is accompanied by nonlinear pressure-flux scaling and flow instabilities, suggesting a laminar-to-turbulent transition that is triggered at unusually low $\textrm{Re}$. To assess performance for unsteady forcing, we devise a circuit that functions as an AC-to-DC converter, rectifier or pump in which diodes transform imposed oscillations into directed flow. Our results confirm Tesla's conjecture that diodic performance is boosted for pulsatile flows. The connections between diodicity, early turbulence and pulsatility uncovered here can inform applications in fluidic mixing and pumping.


title: On Malle's conjecture for nilpotent groups, I

abstract: We develop an abstract framework for studying the strong form of Malle's conjecture for nilpotent groups $G$ in their regular representation. This framework is then used to prove the strong form of Malle's conjecture for any nilpotent group $G$ such that all elements of order $p$ are central, where $p$ is the smallest prime divisor of $\# G$. We also give an upper bound for any nilpotent group $G$ tight up to logarithmic factors, and tight up to a constant factor in case all elements of order $p$ pairwise commute. Finally, we give a new heuristical argument supporting Malle's conjecture in the case of nilpotent groups in their regular representation.


title: Quark flavor physics and lattice QCD

abstract: For a long time, investigation into the weak interactions of quarks has guided us toward understanding the Standard Model we know today. Now in the era of high precision, these studies are still one of the most promising avenues for peering beyond the Standard Model. This is a large-scale endeavour with many tales and many protagonists. In these pages I follow a few threads of a complex story, those passing through the realm of lattice gauge theory.


title: Solar origins of a strong stealth CME detected by Solar Orbiter

abstract: Aims.We aim to locate the origin of a stealth coronal mass ejection (CME) detected in situ by the MAG instrument on board Solar Orbiter, and make connections between the CME observed at the Sun, and the interplanetary CME (ICME) measured in situ. Methods. Remote sensing data are analysed using advanced image processing techniques to identify the source region of the stealth CME, and the global magnetic field at the time of the eruption is examined using Potential Field Source Surface (PFSS) models. The observations of the stealth CME at the Sun are compared with the magnetic field measured by the Solar Orbiter spacecraft, and plasma properties measured by the Wind spacecraft. Results. The source of the CME is found to be a quiet Sun cavity in the northern hemisphere. We find that the stealth CME has a strong magnetic field in situ, despite originating from a quiet Sun region with an extremely weak magnetic field. Conclusions. The interaction of the ICME with its surrounding environment is the likely cause of a higher magnetic field strength measured in situ. Stealth CMEs require multi-wavelength and multi-viewpoint observations in order to confidently locate the source region, however their elusive signatures still pose many problems for space weather forecasting. The findings have implications for Solar Orbiter observing sequences with instruments such as EUI that are designed to capture stealth CMEs


title: Logical Abstractions for Noisy Variational Quantum Algorithm Simulation

abstract: Due to the unreliability and limited capacity of existing quantum computer prototypes, quantum circuit simulation continues to be a vital tool for validating next generation quantum computers and for studying variational quantum algorithms, which are among the leading candidates for useful quantum computation. Existing quantum circuit simulators do not address the common traits of variational algorithms, namely: 1) their ability to work with noisy qubits and operations, 2) their repeated execution of the same circuits but with different parameters, and 3) the fact that they sample from circuit final wavefunctions to drive a classical optimization routine. We present a quantum circuit simulation toolchain based on logical abstractions targeted for simulating variational algorithms. Our proposed toolchain encodes quantum amplitudes and noise probabilities in a probabilistic graphical model, and it compiles the circuits to logical formulas that support efficient repeated simulation of and sampling from quantum circuits for different parameters. Compared to state-of-the-art state vector and density matrix quantum circuit simulators, our simulation approach offers greater performance when sampling from noisy circuits with at least eight to 20 qubits and with around 12 operations on each qubit, making the approach ideal for simulating near-term variational quantum algorithms. And for simulating noise-free shallow quantum circuits with 32 qubits, our simulation approach offers a $66\times$ reduction in sampling cost versus quantum circuit simulation techniques based on tensor network contraction.


title: Comparison of pulsed electroacoustic and thermally stimulated depolarization current measurements of thermally poled PET electrets

abstract: We have compared measurements of a set of polyethylene terephthalate (PET) electret samples by means of pulsed electroacoustic method (PEA) and thermally stimulated depolarization current (TSDC) techniques. Experimental parameters such as the combined thermal and electrical history and the electrode type have been selected in order to correlate the polarization mechanisms revealed by TSDC with the charge profile measured by PEA in five different cases. Existing deconvolution procedures for PEA have been improved as a means to enhance the calibration of PEA signals in the case of thin samples. Samples where the $\alpha$ dipolar relaxation or the $\rho$ space charge relaxation is activated show a uniform polarization that manifests itself as image charge at the electrodes. In the experiments where external charge carriers are injected into the sample, the same poling procedure has been tested under different electrode configurations. Charge profiles are qualitatively similar in all of them but the depolarization currents show clearly different behavior. These differences are explained, on the one hand, by the different blocking behavior of vacuum-deposited aluminum electrodes with regards to electrodes with a thin air gap and, on the other hand, by the distinct behavior of electrodes with an air gap for both directions of the charge carriers. Numerical analysis of the polarization of TSDC peaks and charge per unit area of charge profiles supports this interpretation and confirms the relationship between both measurement techniques. All in all, PEA in combination with TSDC turns out to be a useful technique in the study of thermally poled electrets, either in the study of relaxations or of external charge.


title: OLIVAW: Mastering Othello without Human Knowledge, nor a Fortune

abstract: We introduce OLIVAW, an AI Othello player adopting the design principles of the famous AlphaGo programs. The main motivation behind OLIVAW was to attain exceptional competence in a non-trivial board game at a tiny fraction of the cost of its illustrious predecessors. In this paper, we show how the AlphaGo Zero's paradigm can be successfully applied to the popular game of Othello using only commodity hardware and free cloud services. While being simpler than Chess or Go, Othello maintains a considerable search space and difficulty in evaluating board positions. To achieve this result, OLIVAW implements some improvements inspired by recent works to accelerate the standard AlphaGo Zero learning process. The main modification implies doubling the positions collected per game during the training phase, by including also positions not played but largely explored by the agent. We tested the strength of OLIVAW in three different ways: by pitting it against Edax, the strongest open-source Othello engine, by playing anonymous games on the web platform OthelloQuest, and finally in two in-person matches against top-notch human players: a national champion and a former world champion.


title: Joint Deep Multi-Graph Matching and 3D Geometry Learning from Inhomogeneous 2D Image Collections

abstract: Graph matching aims to establish correspondences between vertices of graphs such that both the node and edge attributes agree. Various learning-based methods were recently proposed for finding correspondences between image key points based on deep graph matching formulations. While these approaches mainly focus on learning node and edge attributes, they completely ignore the 3D geometry of the underlying 3D objects depicted in the 2D images. We fill this gap by proposing a trainable framework that takes advantage of graph neural networks for learning a deformable 3D geometry model from inhomogeneous image collections, i.e.,~a set of images that depict different instances of objects from the same category. Experimentally, we demonstrate that our method outperforms recent learning-based approaches for graph matching considering both accuracy and cycle-consistency error, while we in addition obtain the underlying 3D geometry of the objects depicted in the 2D images.


title: Rainbow Memory: Continual Learning with a Memory of Diverse Samples

abstract: Continual learning is a realistic learning scenario for AI models. Prevalent scenario of continual learning, however, assumes disjoint sets of classes as tasks and is less realistic rather artificial. Instead, we focus on 'blurry' task boundary; where tasks shares classes and is more realistic and practical. To address such task, we argue the importance of diversity of samples in an episodic memory. To enhance the sample diversity in the memory, we propose a novel memory management strategy based on per-sample classification uncertainty and data augmentation, named Rainbow Memory (RM). With extensive empirical validations on MNIST, CIFAR10, CIFAR100, and ImageNet datasets, we show that the proposed method significantly improves the accuracy in blurry continual learning setups, outperforming state of the arts by large margins despite its simplicity. Code and data splits will be available in https://github.com/clovaai/rainbow-memory.


title: CDiNN -Convex Difference Neural Networks

abstract: Neural networks with ReLU activation function have been shown to be universal function approximators and learn function mapping as non-smooth functions. Recently, there is considerable interest in the use of neural networks in applications such as optimal control. It is well-known that optimization involving non-convex, non-smooth functions are computationally intensive and have limited convergence guarantees. Moreover, the choice of optimization hyper-parameters used in gradient descent/ascent significantly affect the quality of the obtained solutions. A new neural network architecture called the Input Convex Neural Networks (ICNNs) learn the output as a convex function of inputs thereby allowing the use of efficient convex optimization methods. Use of ICNNs for determining the input for minimizing output has two major problems: learning of a non-convex function as a convex mapping could result in significant function approximation error, and we also note that the existing representations cannot capture simple dynamic structures like linear time delay systems. We attempt to address the above problems by introduction of a new neural network architecture, which we call the CDiNN, which learns the function as a difference of polyhedral convex functions from data. We also discuss that, in some cases, the optimal input can be obtained from CDiNN through difference of convex optimization with convergence guarantees and that at each iteration, the problem is reduced to a linear programming problem.


title: Neuro-Symbolic Constraint Programming for Structured Prediction

abstract: We propose Nester, a method for injecting neural networks into constrained structured predictors. The job of the neural network(s) is to compute an initial, raw prediction that is compatible with the input data but does not necessarily satisfy the constraints. The structured predictor then builds a structure using a constraint solver that assembles and corrects the raw predictions in accordance with hard and soft constraints. In doing so, Nester takes advantage of the features of its two components: the neural network learns complex representations from low-level data while the constraint programming component reasons about the high-level properties of the prediction task. The entire architecture can be trained in an end-to-end fashion. An empirical evaluation on handwritten equation recognition shows that Nester achieves better performance than both the neural network and the constrained structured predictor on their own, especially when training examples are scarce, while scaling to more complex problems than other neuro-programming approaches. Nester proves especially useful to reduce errors at the semantic level of the problem, which is particularly challenging for neural network architectures.Sub


title: Symmetric and antisymmetric kernels for machine learning problems in quantum physics and chemistry

abstract: We derive symmetric and antisymmetric kernels by symmetrizing and antisymmetrizing conventional kernels and analyze their properties. In particular, we compute the feature space dimensions of the resulting polynomial kernels, prove that the reproducing kernel Hilbert spaces induced by symmetric and antisymmetric Gaussian kernels are dense in the space of symmetric and antisymmetric functions, and propose a Slater determinant representation of the antisymmetric Gaussian kernel, which allows for an efficient evaluation even if the state space is high-dimensional. Furthermore, we show that by exploiting symmetries or antisymmetries the size of the training data set can be significantly reduced. The results are illustrated with guiding examples and simple quantum physics and chemistry applications.

categories: quant-ph math-ph math.MP physics.chem-ph stat.ML


title: Buckling and post-buckling of a compressed elastic half-space coated by double layers

abstract: We investigate the buckling and post-buckling properties of a hyperelastic half-space coated by two hyperelastic layers when the composite structure is subjected to a uniaxial compression. In the case of a half-space coated with a {\it single} layer, it is known that when the shear modulus $\mu_f$ of the layer is larger than the shear modulus $\mu_s$ of the half-space, a linear analysis predicts the existence of a critical stretch and wave number, whereas a weakly nonlinear analysis predicts the existence of a threshold value of the modulus ratio $\mu_s/\mu_f\approx 0.57$ below which the buckling is super-critical and above which the buckling is sub-critical. It is shown in this paper that when another layer is added, a larger variety of behaviour can be observed. For instance, buckling can occur at a preferred wavenumber super-critically even if both layers are softer than the half-space although the top layer would need to be harder than the bottom layer. When the shear modulus of the bottom layer lies in a certain interval, the super-critical to sub-critical transition can happen a number of times as the shear modulus of the top layer is increased gradually. Thus, an extra layer imparts more flexibility in producing wrinkling patterns with desired properties, and our weakly nonlinear analysis provides a road map on the parameter regimes where this can be achieved.


title: FANet: A Feedback Attention Network for Improved Biomedical Image Segmentation

abstract: The increase of available large clinical and experimental datasets has contributed to a substantial amount of important contributions in the area of biomedical image analysis. Image segmentation, which is crucial for any quantitative analysis, has especially attracted attention. Recent hardware advancement has led to the success of deep learning approaches. However, although deep learning models are being trained on large datasets, existing methods do not use the information from different learning epochs effectively. In this work, we leverage the information of each training epoch to prune the prediction maps of the subsequent epochs. We propose a novel architecture called feedback attention network (FANet) that unifies the previous epoch mask with the feature map of the current training epoch. The previous epoch mask is then used to provide a hard attention to the learned feature maps at different convolutional layers. The network also allows to rectify the predictions in an iterative fashion during the test time. We show that our proposed \textit{feedback attention} model provides a substantial improvement on most segmentation metrics tested on seven publicly available biomedical imaging datasets demonstrating the effectiveness of FANet. The source code is available at \url{https://github.com/nikhilroxtomar/FANet}.


title: High-Dimensional Uncertainty Quantification via Tensor Regression with Rank Determination and Adaptive Sampling

abstract: Fabrication process variations can significantly influence the performance and yield of nano-scale electronic and photonic circuits. Stochastic spectral methods have achieved great success in quantifying the impact of process variations, but they suffer from the curse of dimensionality. Recently, low-rank tensor methods have been developed to mitigate this issue, but two fundamental challenges remain open: how to automatically determine the tensor rank and how to adaptively pick the informative simulation samples. This paper proposes a novel tensor regression method to address these two challenges. We use a $\ell_{q}/ \ell_{2}$ group-sparsity regularization to determine the tensor rank. The resulting optimization problem can be efficiently solved via an alternating minimization solver. We also propose a two-stage adaptive sampling method to reduce the simulation cost. Our method considers both exploration and exploitation via the estimated Voronoi cell volume and nonlinearity measurement respectively. The proposed model is verified with synthetic and some realistic circuit benchmarks, on which our method can well capture the uncertainty caused by 19 to 100 random variables with only 100 to 600 simulation samples.


title: Accurate and Efficient Modeling of the Transverse Mode Instability in High Energy Laser Amplifiers

abstract: We study the transverse mode instability (TMI) in the limit where a single higher-order mode (HOM) is present. We demonstrate that when the beat length between the fundamental mode and the HOM is small compared to the length scales on which the pump amplitude and the optical mode amplitudes vary, TMI is a three-wave mixing process in which the two optical modes beat with the phase-matched component of the index of refraction that is induced by the thermal grating. This limit is the usual limit in applications, and in this limit TMI is identified as a stimulated thermal Rayleigh scattering (STRS) process. We demonstrate that a phase-matched model that is based on the three-wave mixing equations can have a large computational advantage over current coupled mode methods that must use longitudinal step sizes that are small compared to the beat length.


title: PySDM v1: particle-based cloud modelling package for warm-rain microphysics and aqueous chemistry

abstract: PySDM is an open-source Python package for simulating the dynamics of particles undergoing condensational and collisional growth, interacting with a fluid flow and subject to chemical composition changes. It is intended to serve as a building block for process-level as well as computational-fluid-dynamics simulation systems involving representation of a continuous phase (air) and a dispersed phase (aerosol), with PySDM being responsible for representation of the dispersed phase. The PySDM package core is a Pythonic high-performance implementation of the Super-Droplet Method (SDM) Monte-Carlo algorithm for representing collisional growth, hence the name. PySDM has two alternative parallel number-crunching backends available: multi-threaded CPU backend based on Numba and GPU-resident backend built on top of ThrustRTC. The usage examples are built on top of four simple atmospheric cloud modelling frameworks: box, adiabatic parcel, single-column and 2D prescribed flow kinematic models. In addition, the package ships with tutorial code depicting how PySDM can be used from Julia and Matlab.


title: Going deeper with Image Transformers

abstract: Transformers have been recently adapted for large scale image classification, achieving high scores shaking up the long supremacy of convolutional neural networks. However the optimization of image transformers has been little studied so far. In this work, we build and optimize deeper transformer networks for image classification. In particular, we investigate the interplay of architecture and optimization of such dedicated transformers. We make two transformers architecture changes that significantly improve the accuracy of deep transformers. This leads us to produce models whose performance does not saturate early with more depth, for instance we obtain 86.5% top-1 accuracy on Imagenet when training with no external data, we thus attain the current SOTA with less FLOPs and parameters. Moreover, our best model establishes the new state of the art on Imagenet with Reassessed labels and Imagenet-V2 / match frequency, in the setting with no additional training data. We share our code and models.


title: Spectral Dependence

abstract: This paper presents a general framework for modeling dependence in multivariate time series. Its fundamental approach relies on decomposing each signal in a system into various frequency components and then studying the dependence properties through these oscillatory activities.The unifying theme across the paper is to explore the strength of dependence and possible lead-lag dynamics through filtering. The proposed framework is capable of representing both linear and non-linear dependencies that could occur instantaneously or after some delay(lagged dependence). Examples for studying dependence between oscillations are illustrated through multichannel electroencephalograms. These examples emphasized that some of the most prominent frequency domain measures such as coherence, partial coherence,and dual-frequency coherence can be derived as special cases under this general framework.This paper also introduces related approaches for modeling dependence through phase-amplitude coupling and causality of (one-sided) filtered signals.


title: A multiscale model of urban morphogenesis

abstract: The dynamics and processes of urban morphogenesis are a central issue regarding a long-term sustainability of urban systems. They however imply stakeholders and parameters at multiple temporal and spatial scales simultaneously, leading to intricate interactions between dimensions and scales. We introduce in this paper from a theoretical viewpoint a simple agent-based model of urban morphogenesis at the scale of an urban area, with the feature of integrating the microscopic and the mesoscopic scales. At the local level, developer agents drive urban development conditioned by local properties but also an infrastructure network at a smaller scale. The network evolves more slowly following global properties. Indicators of sustainability including modal shares and urban density suggest an application of the model to multi-objective optimisation. We finally discuss possible implementation, extensions and applications of the model.


title: Dogfight: Detecting Drones from Drones Videos

abstract: As airborne vehicles are becoming more autonomous and ubiquitous, it has become vital to develop the capability to detect the objects in their surroundings. This paper attempts to address the problem of drones detection from other flying drones. The erratic movement of the source and target drones, small size, arbitrary shape, large intensity variations, and occlusion make this problem quite challenging. In this scenario, region-proposal based methods are not able to capture sufficient discriminative foreground-background information. Also, due to the extremely small size and complex motion of the source and target drones, feature aggregation based methods are unable to perform well. To handle this, instead of using region-proposal based methods, we propose to use a two-stage segmentation-based approach employing spatio-temporal attention cues. During the first stage, given the overlapping frame regions, detailed contextual information is captured over convolution feature maps using pyramid pooling. After that pixel and channel-wise attention is enforced on the feature maps to ensure accurate drone localization. In the second stage, first stage detections are verified and new probable drone locations are explored. To discover new drone locations, motion boundaries are used. This is followed by tracking candidate drone detections for a few frames, cuboid formation, extraction of the 3D convolution feature map, and drones detection within each cuboid. The proposed approach is evaluated on two publicly available drone detection datasets and outperforms several competitive baselines.


title: Fitting quantum noise models to tomography data

abstract: The presence of noise is currently one of the main obstacles to achieving large-scale quantum computation. Strategies to characterise and understand noise processes in quantum hardware are a critical part of mitigating it, especially as the overhead of full error correction and fault-tolerance is beyond the reach of current hardware. Non-Markovian effects are a particularly unfavourable type of noise, being both harder to analyse using standard techniques and more difficult to control using error correction. In this work we develop a set of efficient algorithms, based on the rigorous mathematical theory of Markovian master equations, to analyse and evaluate unknown noise processes. In the case of dynamics consistent with Markovian evolution, our algorithm outputs the best-fit Lindbladian, i.e., the generator of a memoryless quantum channel which best approximates the tomographic data to within the given precision. In the case of non-Markovian dynamics, our algorithm returns a quantitative and operationally meaningful measure of non-Markovianity in terms of isotropic noise addition. We provide a Python implementation of all our algorithms, and benchmark these on a range of 1- and 2-qubit examples of synthesised noisy tomography data, generated using the Cirq platform. The numerical results show that our algorithms succeed both in extracting a full description of the best-fit Lindbladian to the measured dynamics, and in computing accurate values of non-Markovianity that match analytical calculations.

categories: quant-ph math-ph math.MP physics.comp-ph


title: XY Neural Networks

abstract: The classical XY model is a lattice model of statistical mechanics notable for its universality in the rich hierarchy of the optical, laser and condensed matter systems. We show how to build complex structures for machine learning based on the XY model's nonlinear blocks. The final target is to reproduce the deep learning architectures, which can perform complicated tasks usually attributed to such architectures: speech recognition, visual processing, or other complex classification types with high quality. We developed the robust and transparent approach for the construction of such models, which has universal applicability (i.e. does not strongly connect to any particular physical system), allows many possible extensions while at the same time preserving the simplicity of the methodology.

categories: physics.comp-ph cond-mat.mes-hall cond-mat.other cs.ET cs.NE


title: Digital Twin Based Disaster Management System Proposal: DT-DMS

abstract: The damage and the impact of natural disasters are becoming more destructive with the increase of urbanization. Today's metropolitan cities are not sufficiently prepared for the pre and post-disaster situations. Digital Twin technology can provide a solution. A virtual copy of the physical city could be created by collecting data from sensors of the Internet of Things (IoT) devices and stored on the cloud infrastructure. This virtual copy is kept current and up to date with the continuous flow of the data coming from the sensors. We propose a disaster management system utilizing machine learning called DT-DMS is used to support decision-making mechanisms. This study aims to show how to educate and prepare emergency center staff by simulating potential disaster situations on the virtual copy. The event of a disaster will be simulated allowing emergency center staff to make decisions and depicting the potential outcomes of these decisions. A rescue operation after an earthquake is simulated. Test results are promising and the simulation scope is planned to be extended.


title: Recovering the origins of the lenticular galaxy NGC 3115 using multi-band imaging

abstract: A detailed study of the morphology of lenticular galaxies is an important way to understand how this type of galaxy formed and evolves over time. Decomposing a galaxy into its components (disc, bulge, bar, ...) allows recovering the colour gradients present in each system, its star formation history, and its assembly history. We use GALFITM to perform a multi-wavelength structural decomposition of the closest lenticular galaxy, NGC 3115, resulting in the description of its stellar light into several main components: a bulge, a thin disc, a thick disc and also evidence of a bar. We report the finding of central bluer stellar populations in the bulge, as compared to the colour of the galaxy outskirts, indicating either the presence of an Active Galactic Nucleus (AGN) and/or recent star formation activity. From the spectral energy distribution results, we show that the galaxy has a low luminosity AGN component, but even excluding the effect of the nuclear activity, the bulge is still bluer than the outer-regions of the galaxy, revealing a recent episode of star formation. Based on all of the derived properties, we propose a scenario for the formation of NGC 3115 consisting of an initial gas-rich merger, followed by accretions and feedback that quench the galaxy, until a recent encounter with the companion KK084 that reignited the star formation in the bulge, provoked a core displacement in NGC 3115 and generated spiral-like features. This result is consistent with the two-phase formation scenario, proposed in previous studies of this galaxy.


title: Finding optimal Bell inequalities using the cone-projection technique

abstract: Bell inequalities are relevant for many problems in quantum information science, but finding them for many particles is computationally hard. Recently, a computationally feasible method called cone-projection technique has been developed to find all optimal Bell inequalities under some constraints, which may be given by some symmetry or other linear conditions. In this paper we extend this work in several directions. We use the method to generalize the I4422 inequality to three particles and a so-called GYNI inequality to four particles. Additionally, we find Bell inequalities for three particles that generalize the I3322 inequality and the CHSH inequality at the same time. We discuss the obtained inequalities in some detail and characterize their violation in quantum mechanics.


title: A Particle-In-Cell Code Comparison for Ion Acceleration: EPOCH, LSP, and WarpX

abstract: There are now more Particle-in-Cell (PIC) codes than ever before that researchers use to simulate intense laser-plasma interactions. To date, there have been relatively few direct comparisons of these codes in the literature, especially for relativistic intensity lasers interacting with thin overdense targets. To address this we perform a code comparison of three PIC codes: EPOCH, LSP, and WarpX for the problem of laser-driven ion acceleration in a 2D(3v) geometry for a $10^{20}$ W cm$^{-2}$ intensity laser. We examine the plasma density, ion energy spectra, and laser-plasma coupling of the three codes and find strong agreement. We also run the same simulation 20 times with different random seeds to explore statistical fluctuations of the outputs. We then compare the execution times and memory usage of the codes (without "tuning" to improve performance) using between 1 and 48 processors on one node. We provide input files to encourage larger and more frequent code comparisons in this field.


title: StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery

abstract: Inspired by the ability of StyleGAN to generate highly realistic images in a variety of domains, much recent work has focused on understanding how to use the latent spaces of StyleGAN to manipulate generated and real images. However, discovering semantically meaningful latent manipulations typically involves painstaking human examination of the many degrees of freedom, or an annotated collection of images for each desired manipulation. In this work, we explore leveraging the power of recently introduced Contrastive Language-Image Pre-training (CLIP) models in order to develop a text-based interface for StyleGAN image manipulation that does not require such manual effort. We first introduce an optimization scheme that utilizes a CLIP-based loss to modify an input latent vector in response to a user-provided text prompt. Next, we describe a latent mapper that infers a text-guided latent manipulation step for a given input image, allowing faster and more stable text-based manipulation. Finally, we present a method for mapping a text prompts to input-agnostic directions in StyleGAN's style space, enabling interactive text-driven image manipulation. Extensive results and comparisons demonstrate the effectiveness of our approaches.


title: Leveraging Neural Machine Translation for Word Alignment

abstract: The most common tools for word-alignment rely on a large amount of parallel sentences, which are then usually processed according to one of the IBM model algorithms. The training data is, however, the same as for machine translation (MT) systems, especially for neural MT (NMT), which itself is able to produce word-alignments using the trained attention heads. This is convenient because word-alignment is theoretically a viable byproduct of any attention-based NMT, which is also able to provide decoder scores for a translated sentence pair. We summarize different approaches on how word-alignment can be extracted from alignment scores and then explore ways in which scores can be extracted from NMT, focusing on inferring the word-alignment scores based on output sentence and token probabilities. We compare this to the extraction of alignment scores from attention. We conclude with aggregating all of the sources of alignment scores into a simple feed-forward network which achieves the best results when combined alignment extractors are used.


title: Lower bound on the Voronoi diagram of lines in $\mathbb{R}^d$

abstract: This note gives a lower bound of $\Omega(n^{\lceil 2d/3\rceil})$ on the maximal complexity of the Euclidean Voronoi diagram of $n$ non-intersecting lines in $\mathbb{R}^d$ for $d>2$.


title: Enhancing human bodies with extra robotic arms and fingers: The Neural Resource Allocation Problem

abstract: The emergence of robot-based body augmentation promises exciting innovations that will inform robotics, human-machine interaction, and wearable electronics. Even though augmentative devices like extra robotic arms and fingers in many ways build on restorative technologies, they introduce unique challenges for bidirectional human-machine collaboration. Can humans adapt and learn to operate a new limb collaboratively with their biological limbs without sacrificing their physical abilities? To successfully achieve robotic body augmentation, we need to ensure that by giving a person an additional (artificial) limb, we are not in fact trading off an existing (biological) one. In this manuscript, we introduce the "Neural Resource Allocation" problem, which distinguishes body augmentation from existing robotics paradigms such as teleoperation and prosthetics. We discuss how to allow the effective and effortless voluntary control of augmentative devices without compromising the voluntary control of the biological body. In reviewing the relevant literature on extra robotic fingers and limbs we critically assess the range of potential solutions available for the "Neural Resource Allocation" problem. For this purpose, we combine multiple perspectives from engineering and neuroscience with considerations from human-machine interaction, sensory-motor integration, ethics and law. Altogether we aim to define common foundations and operating principles for the successful implementation of motor augmentation.


title: Dirichlet Baths and the Not-so-Fine-Grained Page Curve

abstract: We present a doubly holographic prescription for computing entanglement entropy on a gravitating brane. It involves a Ryu-Takayanagi surface with a Dirichlet anchoring condition. In braneworld cosmology, a related approach was used previously in arXiv:2007.06551. There, the prescription naturally computed a co-moving entanglement entropy, and was argued to resolve the information paradox for a black hole living in the cosmology. In this paper, we show that the Dirichlet prescription leads to reasonable results, when applied to a recently studied wedge holography set up with a gravitating bath. The nature of the information paradox and its resolution in our Dirichlet problem have a natural understanding in terms of the strength of gravity on the two branes and at the anchoring location. By sliding the anchor to the defect, we demonstrate that the limit where gravity decouples from the anchor is continuous -- in other words, as far as island physics is considered, weak gravity on the anchor is identical to no gravity. The weak and (moderately) strong gravity regions on the brane are separated by a "Dirichlet wall". We find an intricate interplay between various extremal surfaces, with an island coming to the rescue whenever there is an information paradox. This is despite the presence of massless gravitons in the spectrum. The overall physics is consistent with the slogan that gravity becomes "more holographic", as it gets stronger. Our observations strengthen the case that the conventional Page curve is indeed of significance, when discussing the information paradox in flat space. We work in high enough dimensions so that the graviton is non-trivial, and our results are in line with the previous discussions on gravitating baths in arXiv:2005.02993 and arXiv:2007.06551.


title: Carrick mat and further development of bipartite knots

abstract: We explore more the properties of bipartite knots and its rich combinatorial structure.


title: Subsidising Inclusive Insurance to Reduce Poverty

abstract: In this article, we assess the benefits of coordination and partnerships between governments and private insurers, and provide further evidence for microinsurance products as powerful and cost-effective tools for achieving poverty reduction. To explore these ideas, we model the capital of a household from a ruin-theoretic perspective to measure the impact of microinsurance on poverty dynamics and the governmental cost of social protection. We analyse the model under four frameworks: uninsured, insured (without subsidies), insured with subsidised constant premiums and insured with subsidised flexible premiums. Although insurance alone (without subsidies) may not be sufficient to reduce the likelihood of falling into the area of poverty for specific groups of households, since premium payments constrain their capital growth, our analysis suggests that subsidised schemes can provide maximum social benefits while reducing governmental costs.


title: An image-incorporated immersed boundary method for diffusion equations

abstract: A novel sharp interface ghost-cell based immersed boundary method has been proposed and its parameters have been optimized against an analytical model in diffusion applications. The proposed embedded constrained moving least-squares (ECMLS) algorithm minimizes the error of the interpolated concentration at the image point of the ghost point by applying a moving least-squares method on all internal nodes, near the ghost image point, and the associated mirrored image points of these internal nodes through the corresponding boundary conditions. Using an analytical model as a reference, the ECMLS algorithm is compared to the constrained moving least-squares (CMLS) algorithm and the staircase model using various grid sizes, interpolation basis functions, weight functions, and the penalty parameter of the constraint. It is found that using ECMLS algorithm in the investigated diffusion application, the incomplete quartic basis function yields the best performance while the quadratic, cubic, and bicubic basis functions also produce results better than the staircase model. It is also found that the linear and bilinear basis functions cannot produce results better than the staircase model in diffusion applications. It is shown that the optimal radius of the region of internal nodes used for interpolation scales with the logarithm of the boundary radius of curvature. It is shown that for the diffusion application, the proposed ECMLS algorithm produces lower errors at the boundary with better numerical stability over a wider range of basis functions, weight functions, boundary radius of curvature, and the penalty parameter than the CMLS algorithm.


title: Teaching Electrical Model of Power Transformers to Undergraduate Students: Magnetic Circuit Approach

abstract: This paper explains a unified approach for teaching the electrical model of power transformers to undergraduate students using magnetic circuits. The commonly used approach for explaining the electrical model of power transformers is a hybrid approach in which magnetic circuits are used to explain the presence of series inductances. However, the presence of shunt inductance and resistance in the model is explained using alternative approaches. In contrary, this paper explains how both series and shunt elements can be described by using magnetic circuits. Moreover, three real-world examples and Matlab/Simulink results are provided to demonstrate how the presented explanations can be used to describe the responses of power transformers in real-world applications.


title: Co-Adaptation of Algorithmic and Implementational Innovations in Inference-based Deep Reinforcement Learning

abstract: Recently many algorithms were devised for reinforcement learning (RL) with function approximation. While they have clear algorithmic distinctions, they also have many implementation differences that are algorithm-independent and sometimes under-emphasized. Such mixing of algorithmic novelty and implementation craftsmanship makes rigorous analyses of the sources of performance improvements across algorithms difficult. In this work, we focus on a series of off-policy inference-based actor-critic algorithms -- MPO, AWR, and SAC -- to decouple their algorithmic innovations and implementation decisions. We present unified derivations through a single control-as-inference objective, where we can categorize each algorithm as based on either Expectation-Maximization (EM) or direct Kullback-Leibler (KL) divergence minimization and treat the rest of specifications as implementation details. We performed extensive ablation studies, and identified substantial performance drops whenever implementation details are mismatched for algorithmic choices. These results show which implementation or code details are co-adapted and co-evolved with algorithms, and which are transferable across algorithms: as examples, we identified that tanh Gaussian policy and network sizes are highly adapted to algorithmic types, while layer normalization and ELU are critical for MPO's performances but also transfer to noticeable gains in SAC. We hope our work can inspire future work to further demystify sources of performance improvements across multiple algorithms and allow researchers to build on one another's both algorithmic and implementational innovations.


title: An Orthogonal Equivalence Theorem for Third Order Tensors

abstract: In 2011, Kilmer and Martin proposed tensor singular value decomposition (T-SVD) for third order tensors. Since then, T-SVD has applications in low rank tensor approximation, tensor recovery, multi-view clustering, multi-view feature extraction, tensor sketching, etc. By going through the Discrete Fourier Transform (DFT), matrix SVD and inverse DFT, a third order tensor is mapped to an f-diagonal third order tensor. We call this a Kilmer-Martin mapping. We show that the Kilmer-Martin mapping of a third order tensor is invariant if that third order tensor is taking T-product with some orthogonal tensors. We define singular values and T-rank of that third order tensor based upon its Kilmer-Martin mapping. Thus, tensor tubal rank, T-rank, singular values and T-singular values of a third order tensor are invariant when it is taking T-product with some orthogonal tensors. Some properties of singular values, T-rank and best T-rank one approximation are discussed.