title: Neutrino collective effects during their decoupling era in the early universe

abstract: There is an accepted approach to calculation of the neutrino flavor density-matrix in the halo of a supernova, in which neutrino amplitudes, not cross-sections, need to be followed carefully in the region above the region of frequent scatterings. The same reasoning and techniques, applied to the evolution of neutrino flavors and energy distributions in the early universe in the era of neutrino decoupling, leads to radical changes in the predictions of the effects of the neutrino-neutrino interaction. Predictions for the production of sterile neutrinos, should they exist, will also be changed.


title: The Power of Subsampling in Submodular Maximization

abstract: We propose subsampling as a unified algorithmic technique for submodular maximization in centralized and online settings. The idea is simple: independently sample elements from the ground set, and use simple combinatorial techniques (such as greedy or local search) on these sampled elements. We show that this approach leads to optimal/state-of-the-art results despite being much simpler than existing methods. In the usual offline setting, we present SampleGreedy, which obtains a $(p + 2 + o(1))$-approximation for maximizing a submodular function subject to a $p$-extendible system using $O(n + nk/p)$ evaluation and feasibility queries, where $k$ is the size of the largest feasible set. The approximation ratio improves to $p+1$ and $p$ for monotone submodular and linear objectives, respectively. In the streaming setting, we present SampleStreaming, which obtains a $(4p +2 - o(1))$-approximation for maximizing a submodular function subject to a $p$-matchoid using $O(k)$ memory and $O(km/p)$ evaluation and feasibility queries per element, where $m$ is the number of matroids defining the $p$-matchoid. The approximation ratio improves to $4p$ for monotone submodular objectives. We empirically demonstrate the effectiveness of our algorithms on video summarization, location summarization, and movie recommendation tasks.


title: A New Dimension in Testimony: Relighting Video with Reflectance Field Exemplars

abstract: We present a learning-based method for estimating 4D reflectance field of a person given video footage illuminated under a flat-lit environment of the same subject. For training data, we use one light at a time to illuminate the subject and capture the reflectance field data in a variety of poses and viewpoints. We estimate the lighting environment of the input video footage and use the subject's reflectance field to create synthetic images of the subject illuminated by the input lighting environment. We then train a deep convolutional neural network to regress the reflectance field from the synthetic images. We also use a differentiable renderer to provide feedback for the network by matching the relit images with the input video frames. This semi-supervised training scheme allows the neural network to handle unseen poses in the dataset as well as compensate for the lighting estimation error. We evaluate our method on the video footage of the real Holocaust survivors and show that our method outperforms the state-of-the-art methods in both realism and speed.


title: Bayesian adversarial multi-node bandit for optimal smart grid protection against cyber attacks

abstract: The cybersecurity of smart grids has become one of key problems in developing reliable modern power and energy systems. This paper introduces a non-stationary adversarial cost with a variation constraint for smart grids and enables us to investigate the problem of optimal smart grid protection against cyber attacks in a relatively practical scenario. In particular, a Bayesian multi-node bandit (MNB) model with adversarial costs is constructed and a new regret function is defined for this model. An algorithm called Thompson-Hedge algorithm is presented to solve the problem and the superior performance of the proposed algorithm is proven in terms of the convergence rate of the regret function. The applicability of the algorithm to real smart grid scenarios is verified and the performance of the algorithm is also demonstrated by numerical examples.


title: Looking into Your Speech: Learning Cross-modal Affinity for Audio-visual Speech Separation

abstract: In this paper, we address the problem of separating individual speech signals from videos using audio-visual neural processing. Most conventional approaches utilize frame-wise matching criteria to extract shared information between co-occurring audio and video. Thus, their performance heavily depends on the accuracy of audio-visual synchronization and the effectiveness of their representations. To overcome the frame discontinuity problem between two modalities due to transmission delay mismatch or jitter, we propose a cross-modal affinity network (CaffNet) that learns global correspondence as well as locally-varying affinities between audio and visual streams. Given that the global term provides stability over a temporal sequence at the utterance-level, this resolves the label permutation problem characterized by inconsistent assignments. By extending the proposed cross-modal affinity on the complex network, we further improve the separation performance in the complex spectral domain. Experimental results verify that the proposed methods outperform conventional ones on various datasets, demonstrating their advantages in real-world scenarios.


title: Misbehavior Detection in Wi-Fi/LTE Coexistence over Unlicensed Bands

abstract: We consider the problem of fair coexistence between LTE and Wi-Fi systems in the unlicensed 5 GHz U-NII bands. We focus on the misbehavior opportunities due to the heterogeneity in channel access mechanism and the lack of a common control plane. We define selfish misbehavior strategies for the LTE that yield an unfair share of the spectrum resources. Such strategies are based on manipulating the operational parameters of the LTE-LAA standard, namely the backoff mechanism, the traffic class parameters, the clear channel access (CCA) threshold, and others. Prior methods for detecting misbehavior in homogeneous settings are not applicable in a spectrum sharing scenario because the devices of one system cannot decode the transmissions of another. We develop implicit sensing techniques that can accurately estimate the operational parameters of LTE transmissions under various topological scenarios and {\em without decoding.} These techniques apply correlation-based signal detection to infer the required information. Our techniques are validated through experiments on a USRP testbed. We further apply a statistical inference framework for determining deviations of the LTE behavior from the coexistence etiquette. By characterizing the detection and false alarm probabilities, we show that our framework yields high detection accuracy at a very low false alarm rate. Although our methods focus on detecting misbehavior of the LTE system, they can be generalized to other coexistence scenarios.


title: Comment on "Fast-slow mode coupling instability for coasting beams in the presence of detuning impedance"

abstract: In this comment we show untenability of key points of the recent article of N. Biancacci, E. Metral and M. Migliorati [Phys. Rev. Accel. Beams 23, 124402 (2020)], hereafter the Article and the Authors. Specifically, the main Eqs. (23), suggested to describe mode coupling, are shown to be unacceptable even as an approximation. The Article claims the solution of this pair of equations to be in "excellent agreement" with the pyHEADTAIL simulations for CERN PS, which is purportedly demonstrated by Fig. 6. Were it really so, it would be a signal of a mistake in the code. However, the key part of the simulation results is not actually shown, and the demonstrated agreement has all the features of an illusion.


title: The PAU survey: Estimating galaxy photometry with deep learning

abstract: With the dramatic rise in high-quality galaxy data expected from Euclid and Vera C. Rubin Observatory, there will be increasing demand for fast high-precision methods for measuring galaxy fluxes. These will be essential for inferring the redshifts of the galaxies. In this paper, we introduce Lumos, a deep learning method to measure photometry from galaxy images. Lumos builds on BKGnet, an algorithm to predict the background and its associated error, and predicts the background-subtracted flux probability density function. We have developed Lumos for data from the Physics of the Accelerating Universe Survey (PAUS), an imaging survey using a 40 narrow-band filter camera (PAUCam). PAUCam images are affected by scattered light, displaying a background noise pattern that can be predicted and corrected for. On average, Lumos increases the SNR of the observations by a factor of 2 compared to an aperture photometry algorithm. It also incorporates other advantages like robustness towards distorting artefacts, e.g. cosmic rays or scattered light, the ability of deblending and less sensitivity to uncertainties in the galaxy profile parameters used to infer the photometry. Indeed, the number of flagged photometry outlier observations is reduced from 10% to 2%, comparing to aperture photometry. Furthermore, with Lumos photometry, the photo-z scatter is reduced by ~10% with the Deepz machine learning photo-z code and the photo-z outlier rate by 20%. The photo-z improvement is lower than expected from the SNR increment, however currently the photometric calibration and outliers in the photometry seem to be its limiting factor.


title: On the Arithmetic Fundamental Lemma conjecture over a general $p$-adic field

abstract: We prove the arithmetic fundamental lemma conjecture over a general $p$-adic field with odd residue cardinality $q\geq \dim V$. Our strategy is similar to the one used by the second author during his proof of the AFL over $\mathbb{Q}_p$ (arXiv:1909.02697), but only requires the modularity of divisor generating series on the Shimura variety (as opposed to its integral model). The resulting increase in flexibility allows us to work over an arbitrary base field. To carry out the strategy, we also generalize results of Howard (arXiv:1303.0545) on CM-cycle intersection and of Ehlen--Sankaran (arXiv:1607.06545) on Green function comparison from $\mathbb{Q}$ to general totally real base fields.


title: Bandcoin: Using Smart Contracts to Automate Mobile Network Bandwidth Roaming Agreements

abstract: We propose a new way to share licensed spectrum bandwidth capacity in mobile networks between operators, service providers and consumers using blockchain-based smart contracts. We discuss the foundational building blocks in the contract as well as various extensions to support more advanced features such as bulk purchases, future reservations, and various auction mechanisms. Furthermore, we demonstrate how the system can be implemented with an open-source, permissioned Enterprise blockchain, Hyperledger Sawtooth. We show that our smart contract implementation can improve blockchain transaction performance, by approximately four orders of magnitude compared to serial transactions and one order of magnitude compared to parallell transactions, using PKI-driven bulk purchases of mobile access grants, paving the way for fully automated, efficient, and fine-grained roaming agreements.


title: Fundamental groups of Galois covers as tools to study non-planar degenerations

abstract: This study establishes a preliminary investigation of geometric objects that degenerate to non-planar shapes, along with their Galois covers and groups. The study aims to determine the fundamental groups and signatures of the Galois covers of algebraic surfaces in general, as they are invariants of the classification of surfaces in the moduli space. The study investigates the tetrahedron and the double tetrahedron as first examples. The study's findings can advance the classification of surfaces and provide further links between algebraic geometry, group theory, and the topology of degenerative processes and their properties. The resulting groups indicate that the tetrahedron and the double tetrahedron are in different components in the moduli space.


title: Which planets trigger longer-lived vortices: low-mass or high-mass?

abstract: Recent ALMA observations have found many protoplanetary discs with rings that can be explained by gap-opening planets less massive than Jupiter. Meanwhile, recent studies have suggested that protoplanetary discs should have low levels of turbulence. Past computational work on low-viscosity discs has hinted that these two developments might not be self-consistent because even low-mass planets can be accompanied by vortices instead of conventional double rings. We investigate this potential discrepancy by conducting hydrodynamic simulations of growing planetary cores in discs with various aspect ratios ($H/r=0.04$, 0.06, 0.08) and viscosities ($1.5 \times 10^{-5} \lesssim \alpha \lesssim 3 \times 10^{-4}$), having these cores accrete their gas mass directly from the disc. With $\alpha < 10^{-4}$, we find that sub-Saturn-mass planets in discs with $H/r \le 0.06$ are more likely to be accompanied by dust asymmetries compared to Jupiter-mass planets because they can trigger several generations of vortices in succession. We also find that vortices with $H/r = 0.08$ survive $>6000$ planet orbits regardless of the planet mass or disc mass because they are less affected by the planet's spiral waves. We connect our results to observations and find that the outward migration of vortices with $H/r \ge 0.08$ may be able to explain the cavity in Oph IRS 48 or the two clumps in MWC 758. Lastly, we show that the lack of observed asymmetries in the disc population in Taurus is unexpected given the long asymmetry lifetimes in our low viscosity simulations ($\alpha \sim 2 \times 10^{-5}$), a discrepancy we suggest is due to these discs having higher viscosities.


title: A Coverage-Aware Distributed k-Connectivity Maintenance Algorithm for Arbitrarily Large k in Mobile Sensor Networks

abstract: Mobile sensor networks (MSNs) have emerged from the interaction between mobile robotics and wireless sensor networks. MSNs can be deployed in harsh environments, where failures in some nodes can partition MSNs into disconnected network segments or reduce the coverage area. A k-connected network can tolerate at least k-1 arbitrary node failures without losing its connectivity. In this study, we present a coverage-aware distributed k-connectivity maintenance (restoration) algorithm that generates minimum-cost movements of active nodes after a node failure to preserve a persistent k value subject to a coverage conservation criterion. The algorithm accepts a coverage conservation ratio (as a trade-off parameter between coverage and movements) and facilitates coverage with the generated movements according to this value. Extensive simulations and testbed experiments reveal that the proposed algorithm restores k-connectivity more efficiently than the existing restoration algorithms. Furthermore, our algorithm can be utilized to maintain k-connectivity without sacrificing the coverage, significantly.


title: Autoencoder-based Representation Learning from Heterogeneous Multivariate Time Series Data of Mechatronic Systems

abstract: Sensor and control data of modern mechatronic systems are often available as heterogeneous time series with different sampling rates and value ranges. Suitable classification and regression methods from the field of supervised machine learning already exist for predictive tasks, for example in the context of condition monitoring, but their performance scales strongly with the number of labeled training data. Their provision is often associated with high effort in the form of person-hours or additional sensors. In this paper, we present a method for unsupervised feature extraction using autoencoder networks that specifically addresses the heterogeneous nature of the database and reduces the amount of labeled training data required compared to existing methods. Three public datasets of mechatronic systems from different application domains are used to validate the results.


title: Localization of Autonomous Vehicles: Proof of Concept for A Computer Vision Approach

abstract: This paper introduces a visual-based localization method for autonomous vehicles (AVs) that operate in the absence of any complicated hardware system but a single camera. Visual localization refers to techniques that aim to find the location of an object based on visual information of its surrounding area. The problem of localization has been of interest for many years. However, visual localization is a relatively new subject in the literature of transportation. Moreover, the inevitable application of this type of localization in the context of autonomous vehicles demands special attention from the transportation community to this problem. This study proposes a two-step localization method that requires a database of geotagged images and a camera mounted on a vehicle that can take pictures while the car is moving. The first step which is image retrieval uses SIFT local feature descriptor to find an initial location for the vehicle using image matching. The next step is to utilize the Kalman filter to estimate a more accurate location for the vehicle as it is moving. All stages of the introduced method are implemented as a complete system using different Python libraries. The proposed system is tested on the KITTI dataset and has shown an average accuracy of 2 meters in finding the final location of the vehicle.


title: Shelling the m=1 amplituhedron

abstract: The amplituhedron $\mathcal{A}_{n,k,m}$ was introduced by Arkani-Hamed and Trnka (2014) in order to give a geometric basis for calculating scattering amplitudes in planar $\mathcal{N}=4$ supersymmetric Yang-Mills theory. It is a projection inside the Grassmannian $\text{Gr}_{k,k+m}$ of the totally nonnegative part of $\text{Gr}_{k,n}$. Karp and Williams (2019) studied the $m=1$ amplituhedron $\mathcal{A}_{n,k,1}$, giving a regular CW decomposition of it. Its face poset $R_{n,l}$ (with $l := n-k-1$) consists of all projective sign vectors of length $n$ with exactly $l$ sign changes. We show that $R_{n,l}$ is EL-shellable, resolving a problem posed by Karp and Williams. This gives a new proof that $\mathcal{A}_{n,k,1}$ is homeomorphic to a closed ball, which was originally proved by Karp and Williams. We also give explicit formulas for the $f$-vector and $h$-vector of $R_{n,l}$, and show that it is rank-log-concave and strongly Sperner. Finally, we consider a related poset $P_{n,l}$ introduced by Machacek (2019), consisting of all projective sign vectors of length $n$ with at most $l$ sign changes. We show that it is rank-log-concave, and conjecture that it is Sperner.


title: Exploring the flavor content of light and heavy-light pseudoscalars

abstract: The electroweak properties of light and charmed D and Ds pseudoscalar mesons are investigated within a unified covariant constituent quark model. The quark-antiquark-meson vertices are assumed to have a symmetric form by the exchange of quark momenta, which is successful in describing the light pseudoscalar meson properties. The flavor decomposition of the elastic electromagnetic form factors, electromagnetic charge radii, and weak decay constants are calculated. Based on the results a discussion on the SU(3) and SU(4) symmetry breaking is made and a comparison with the pion and kaon properties to highlight the Higgs contribution to the structure of these mesons.


title: Safe-by-Repair: A Convex Optimization Approach for Repairing Unsafe Two-Level Lattice Neural Network Controllers

abstract: In this paper, we consider the problem of repairing a data-trained Rectified Linear Unit (ReLU) Neural Network (NN) controller for a discrete-time, input-affine system. That is we assume that such a NN controller is available, and we seek to repair unsafe closed-loop behavior at one known "counterexample" state while simultaneously preserving a notion of safe closed-loop behavior on a separate, verified set of states. To this end, we further assume that the NN controller has a Two-Level Lattice (TLL) architecture, and exhibit an algorithm that can systematically and efficiently repair such an network. Facilitated by this choice, our approach uses the unique semantics of the TLL architecture to divide the repair problem into two significantly decoupled sub-problems, one of which is concerned with repairing the un-safe counterexample -- and hence is essentially of local scope -- and the other of which ensures that the repairs are realized in the output of the network -- and hence is essentially of global scope. We then show that one set of sufficient conditions for solving each these sub-problems can be cast as a convex feasibility problem, and this allows us to formulate the TLL repair problem as two separate, but significantly decoupled, convex optimization problems. Finally, we evaluate our algorithm on a TLL controller on a simple dynamical model of a four-wheel-car.


title: NeuMIP: Multi-Resolution Neural Materials

abstract: We propose NeuMIP, a neural method for representing and rendering a variety of material appearances at different scales. Classical prefiltering (mipmapping) methods work well on simple material properties such as diffuse color, but fail to generalize to normals, self-shadowing, fibers or more complex microstructures and reflectances. In this work, we generalize traditional mipmap pyramids to pyramids of neural textures, combined with a fully connected network. We also introduce neural offsets, a novel method which allows rendering materials with intricate parallax effects without any tessellation. This generalizes classical parallax mapping, but is trained without supervision by any explicit heightfield. Neural materials within our system support a 7-dimensional query, including position, incoming and outgoing direction, and the desired filter kernel size. The materials have small storage (on the order of standard mipmapping except with more texture channels), and can be integrated within common Monte-Carlo path tracing systems. We demonstrate our method on a variety of materials, resulting in complex appearance across levels of detail, with accurate parallax, self-shadowing, and other effects.


title: The Be/neutron star system Swift J004929.5-733107 in the Small Magellanic Cloud -- X-ray characteristics and optical counterpart candidates

abstract: Swift J004929.5-733107 is an X-ray source in the Small Magellanic Cloud (SMC) that has been reported several times, but the optical counterpart has been unclear due to source confusion in a crowded region of the SMC. Previous works proposed [MA93] 302 as the counterpart, however we show here, using data obtained from the S-CUBED project, that the X-ray positio is inconsistent with that object. Instead we propose a previously unclassified object which has all the indications of being a newly identified Be star exhibiting strong HU emission. Evidence for the presence of significant I-band variability strongly suggest that this is, in fact, a Be type star with a large circumstellar disk. Over 18 years worth of optical monitoring by the OGLE project reveal a periodic modulation at a period of 413d, probably the binary period of the system. A SALT optical spectrum shows strong Balmer emission and supports a proposed spectral classification of B1-3 III-IVe. The X-ray data obtained from the S-CUBED project reveal a time-averaged spectrum well fitted by a photon index = 0.93 pm 0.16. Assuming the known distance to the SMC the flux corresponds to a luminosity 10E35 erg/s. All of these observational facts suggest that this is confirmed as a Be star-neutron star X-ray binary (BeXRB) in the SMC, albeit one with an unusually long binary period at the limits of the Corbet Diagram.


title: Electronic Properties of Single-Layer CoO$_2$/Au(111)

abstract: We report direct measurements via angle-resolved photoemission spectroscopy (ARPES) of the electronic dispersion of single-layer CoO$_2$. The Fermi contour consists of a large hole pocket centered at the $\overline{\Gamma}$ point. To interpret the ARPES results, we use density functional theory (DFT) in combination with the multi-orbital Gutzwiller Approximation (DFT+GA), basing our calculations on crystalline structure parameters derived from x-ray photoelectron diffraction and low-energy electron diffraction. Our calculations are in good agreement with the measured dispersion. We conclude that the material is a moderately correlated metal. We also discuss substrate effects, and the influence of hydroxylation on the CoO$_2$ single-layer electronic structure.


title: Kink motion for the one-dimensional stochastic Allen-Cahn equation

abstract: We study the kink motion for the one-dimensional stochastic Allen-Cahn equation and its mass conserving counterpart. Using a deterministic slow manifold, in the sharp interface limit for sufficiently small noise strength we derive an explicit stochastic differential equation for the motion of the interfaces, which is valid as long as the solution stays close to the manifold. On a relevant time-scale, where interfaces move at most by the minimal allowed distance between interfaces, we show that the kinks behave approximately like the driving Wiener-process projected onto the slow manifold, while in the mass-conserving case they are additionally coupled via the mass constraint.


title: A fully automated end-to-end process for fluorescence microscopy images of yeast cells: From segmentation to detection and classification

abstract: In recent years, an enormous amount of fluorescence microscopy images were collected in high-throughput lab settings. Analyzing and extracting relevant information from all images in a short time is almost impossible. Detecting tiny individual cell compartments is one of many challenges faced by biologists. This paper aims at solving this problem by building an end-to-end process that employs methods from the deep learning field to automatically segment, detect and classify cell compartments of fluorescence microscopy images of yeast cells. With this intention we used Mask R-CNN to automatically segment and label a large amount of yeast cell data, and YOLOv4 to automatically detect and classify individual yeast cell compartments from these images. This fully automated end-to-end process is intended to be integrated into an interactive e-Science server in the PerICo1 project, which can be used by biologists with minimized human effort in training and operation to complete their various classification tasks. In addition, we evaluated the detection and classification performance of state-of-the-art YOLOv4 on data from the NOP1pr-GFP-SWAT yeast-cell data library. Experimental results show that by dividing original images into 4 quadrants YOLOv4 outputs good detection and classification results with an F1-score of 98% in terms of accuracy and speed, which is optimally suited for the native resolution of the microscope and current GPU memory sizes. Although the application domain is optical microscopy in yeast cells, the method is also applicable to multiple-cell images in medical applications


title: The interplay of inhibitory and electrical synapses results in complex persistent activity

abstract: Inhibitory neurons play a crucial role in maintaining persistent neuronal activity. Although connected extensively through electrical synapses (gap-junctions), these neurons also exhibit interactions through chemical synapses in certain regions of the brain. When the coupling is sufficiently strong, the effects of these two synaptic modalities combine in a nonlinear way. Hence, in this work, we focus on the strong inhibition regime and identify the parametric conditions that result in the emergence of self-sustained oscillations in systems of coupled excitable neurons, in the presence of a brief sub-threshold stimulus. Our investigation on the dynamics in a minimal network of two neurons reveals a rich set of dynamical behaviors viz., periodic and various complex oscillations including period-n (n=2,4,8...) dynamics and chaos. We further extend our study by considering a system of inhibitory neurons arranged in a one-dimensional ring topology and determine the optimal conditions for sustained activity. Our work highlights the nonlinear dynamical behavior arising due to the combined effects of gap-junctions and strong synaptic inhibition, which can have potential implications in maintaining robust memory patterns.


title: Besov regularity for a class of singular or degenerate elliptic equations

abstract: Motivated by applications to congested traffic problems, we establish higher integrability results for the gradient of local weak solutions to the strongly degenerate or singular elliptic PDE $-\mathrm{div}\left((\vert\nabla u\vert-1)_{+}^{q-1}\frac{\nabla u}{\vert\nabla u\vert}\right)=f$, $\mathrm{in}\,\,\Omega$, where $\Omega$ is a bounded domain in $\mathbb{R}^{n}$ for $n\geq2$, $1<q<\infty$ and $\left(\,\cdot\,\right)_{+}$ stands for the positive part. We assume that the datum $f$ belongs to a suitable Sobolev or Besov space. The main novelty here is that we deal with the case of subquadratic growth, i.e. $1<q<2$, which has so far been neglected. In the latter case, we also prove the higher fractional differentiability of the solution to a variational problem, which is characterized by the above equation. For the sake of completeness, we finally give a Besov regularity result also in the case $q\geq2$.


title: Controlling Movement at Nanoscale: Curvature Driven Mechanotaxis

abstract: Locating and manipulating nano-sized objects to drive motion is a time and effort consuming task. Recent advances show that it is possible to generate motion without direct intervention, by embedding the source of motion in the system configuration. In this work, we demonstrate an alternative manner to controllably displace nano-objects without external manipulation, by employing spiral-shaped carbon nanotube (CNT) and graphene nanoribbon structures (GNR). The spiral shape contains smooth gradients of curvature, which lead to smooth gradients of bending energy. We show these gradients can drive nanoscillators. We also carry out an energy analysis by approximating the carbon nanotube to a thin rod and discuss how torsional gradients can be used to drive motion. For the nanoribbons, we also analyzed the role of layer orientation. Our results show that motion is not sustainable for commensurate orientations, in which AB stacking occurs. For incommensurate orientations, friction almost vanishes, and in this instance, the motion can continue even if the driving forces are not very high. This suggests that mild curvature gradients, which can already be found in existing nanostructures, could provide mechanical stimuli to direct motion.


title: VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representations

abstract: Word vector embeddings have been shown to contain and amplify biases in data they are extracted from. Consequently, many techniques have been proposed to identify, mitigate, and attenuate these biases in word representations. In this paper, we utilize interactive visualization to increase the interpretability and accessibility of a collection of state-of-the-art debiasing techniques. To aid this, we present Visualization of Embedding Representations for deBiasing system ("VERB"), an open-source web-based visualization tool that helps the users gain a technical understanding and visual intuition of the inner workings of debiasing techniques, with a focus on their geometric properties. In particular, VERB offers easy-to-follow use cases in exploring the effects of these debiasing techniques on the geometry of high-dimensional word vectors. To help understand how various debiasing techniques change the underlying geometry, VERB decomposes each technique into interpretable sequences of primitive transformations and highlights their effect on the word vectors using dimensionality reduction and interactive visual exploration. VERB is designed to target natural language processing (NLP) practitioners who are designing decision-making systems on top of word embeddings, and also researchers working with fairness and ethics of machine learning systems in NLP. It can also serve as a visual medium for education, which helps an NLP novice to understand and mitigate biases in word embeddings.


title: Incompressible Energy Spectrum from Wave Turbulence

abstract: Bose-Einstein condensates with their superfluidity property provide an interesting parallel to classical fluids. Due to the Kolmogorov spectrum of homogeneous turbulence the statistics of the incompressible velocity field is of great interest, but in superfluids obtaining quantities such as the statistics of the velocity field from the macroscopic wavefunction turns out be a complicated task; therefore, most of the work up to now has been numerical in nature. We made use of the Weak Wave Turbulence (WWT) theory, which provides the statistics of the macroscopic wavefunction, to obtain the statistics of the velocity field, which allowed us to produce a semi analytical procedure for extracting the incompressible energy spectrum in the WWT regime. This is done by introducing an auxiliary wavefunction that preserves the relevant statistical and hydrodynamical properties of the condensate but with a homogeneous density thus allowing for a simpler description of the velocity field.


title: Out-of-Distribution Robustness with Deep Recursive Filters

abstract: Accurate state and uncertainty estimation is imperative for mobile robots and self driving vehicles to achieve safe navigation in pedestrian rich environments. A critical component of state and uncertainty estimation for robot navigation is to perform robustly under out-of-distribution noise. Traditional methods of state estimation decouple perception and state estimation making it difficult to operate on noisy, high dimensional data. Here, we describe an approach that combines the expressiveness of deep neural networks with principled approaches to uncertainty estimation found in recursive filters. We particularly focus on techniques that provide better robustness to out-of-distribution noise and demonstrate applicability of our approach on two scenarios: a simple noisy pendulum state estimation problem and real world pedestrian localization using the nuScenes dataset. We show that our approach improves state and uncertainty estimation compared to baselines while achieving approximately 3x improvement in computational efficiency.


title: A full order, reduced order and machine learning model pipeline for efficient prediction of reactive flows

abstract: We present an integrated approach for the use of simulated data from full order discretization as well as projection-based Reduced Basis reduced order models for the training of machine learning approaches, in particular Kernel Methods, in order to achieve fast, reliable predictive models for the chemical conversion rate in reactive flows with varying transport regimes.


title: The Dictionary for Double Holography and Graviton Masses in d Dimensions

abstract: Doubly-holographic models, also known as Karch-Randall brane worlds, have shown to be very useful for understanding recent developments around computing entropies in semi-classical gravity coupled to conformal matter. Although there cannot be a faithful bulk/brane dictionary, we show that there is a simple dictionary which relates brane fields to subleading coefficients of a near-brane expansion of bulk fields -- similar to the case of AdS/CFT. We use this dictionary to find a general formula for the leading order contribution to graviton masses in the $d$ dimensional Karch-Randall braneworld.


title: A New Imaginary Term in the 2nd Order Nonlinear Susceptibility from Charged Interfaces

abstract: Non-resonant second harmonic generation phase and amplitude measurements obtained from the silica:water interface at varying pH and 0.5 M ionic strength point to the existence of a nonlinear susceptibility term, which we call chi(3)X, that is associated with a 90 deg phase shift. Including this contribution in a model for the total effective second-order nonlinear susceptibility produces reasonable point estimates for interfacial potentials and second-order nonlinear susceptibilities when chi(3)Xis about 1.5 times chi(3)water. A model without this term and containing only traditional chi(2) and chi(3) terms cannot recapitulate the experimental data. The new model also provides a demonstrated utility for distinguishing apparent differences in the second-order nonlinear susceptibility when the electrolyte is NaCl vs MgSO4, pointing to the possibility of using HD-SHG to investigate ion-specificity in interfacial processes.


title: Simultaneous identification of multiple binding sites in proteins: A statistical mechanics approach

abstract: We present an extension of the Poisson-Boltzmann model in which the solute of interest is immersed in an assembly of self-orienting Langevin water dipoles, anions, cations, and hydrophobic molecules, all of variable densities. Interactions between charges are controlled by electrostatics, while hydrophobic interactions are modeled with a Yukawa potential. We impose steric constraints by assuming that the system is represented on a cubic lattice. We also assume incompressibility, i.e. all sites of the lattice are occupied. This model, which we refer to as the Hydrophobic Dipolar Poisson Boltzmann Langevin (HDPBL) model, leads to a system of two equations whose solutions give the water dipole, salt, and hydrophobic molecule densities, all of them in the presence of the others in a self-consistent way. We use those to study the organization of the ions, co-solvent and solvent molecules around proteins. In particular, peaks of densities are expected to reveal, simultaneously, the presence of compatible binding sites of different kinds on a protein. We have tested and validated the ability of HDPBL to detect pockets in proteins that bind to hydrophobic ligands, polar ligands and charged small probes as well as to characterize the environment of membrane proteins.


title: Efficient emotion recognition using hyperdimensional computing with combinatorial channel encoding and cellular automata

abstract: In this paper, a hardware-optimized approach to emotion recognition based on the efficient brain-inspired hyperdimensional computing (HDC) paradigm is proposed. Emotion recognition provides valuable information for human-computer interactions, however the large number of input channels (>200) and modalities (>3) involved in emotion recognition are significantly expensive from a memory perspective. To address this, methods for memory reduction and optimization are proposed, including a novel approach that takes advantage of the combinatorial nature of the encoding process, and an elementary cellular automaton. HDC with early sensor fusion is implemented alongside the proposed techniques achieving two-class multi-modal classification accuracies of >76% for valence and >73% for arousal on the multi-modal AMIGOS and DEAP datasets, almost always better than state of the art. The required vector storage is seamlessly reduced by 98% and the frequency of vector requests by at least 1/5. The results demonstrate the potential of efficient hyperdimensional computing for low-power, multi-channeled emotion recognition tasks.


title: First arrival picking using U-net with Lovasz loss and nearest point picking method

abstract: We proposed a robust segmentation and picking workflow to solve the first arrival picking problem for seismic signal processing. Unlike traditional classification algorithm, image segmentation method can utilize the location information by outputting a prediction map which has the same size of the input image. A parameter-free nearest point picking algorithm is proposed to further improve the accuracy of the first arrival picking. The algorithm is test on synthetic clean data, synthetic noisy data, synthetic picking-disconnected data and field data. It performs well on all of them and the picking deviation reaches as low as 4.8ms per receiver. The first arrival picking problem is formulated as the contour detection problem. Similar to \cite{wu2019semi}, we use U-net to perform the segmentation as it is proven to be state-of-the-art in many image segmentation tasks. Particularly, a Lovasz loss instead of the traditional cross-entropy loss is used to train the network for a better segmentation performance. Lovasz loss is a surrogate loss for Jaccard index or the so-called intersection-over-union (IoU) score, which is often one of the most used metrics for segmentation tasks. In the picking part, we use a novel nearest point picking (NPP) method to take the advantage of the coherence of the first arrival picking among adjacent receivers. Our model is tested and validated on both synthetic and field data with harmonic noises. The main contributions of this paper are as follows: 1. Used Lovasz loss to directly optimize the IoU for segmentation task. Improvement over the cross-entropy loss with regard to the segmentation accuracy is verified by the test result. 2. Proposed a nearest point picking post processing method to overcome any defects left by the segmentation output. 3. Conducted noise analysis and verified the model with both noisy synthetic and field datasets.


title: Searching for new solar twins: The Inti survey for the Northern Sky

abstract: Solar twins are key in different areas of astrophysics, however only just over a hundred were identified and well-studied in the last two decades. In this work, we take advantage of the very precise \textit{Gaia} (DR2/EDR3), Tycho and 2MASS photometric systems to create the Inti survey of new solar twins in the Northern Hemisphere. The spectra of our targets were initially obtained with spectrographs of moderate resolution (ARCES and Goodman spectrographs with $R$ = 31500 and 11930, respectively) to find the best solar twin candidates and then observed at McDonald Observatory with higher resolving power (TS23, $R$ = 60000) and signal-to-noise ratio (SNR $\sim$ 300-500). The stellar parameters were estimated through the differential spectroscopic equilibrium relative to the Sun, which allow us to achieve a high internal precision ($\sigma(T_{\rm{eff}})$ = 15 K, $\sigma(\log g)$ = 0.03 dex, $\sigma$([Fe/H]) = 0.01 dex, and $\sigma(v_{t})$ = 0.03 km s$^{-1}$). We propose a new class of stars with evolution similar to the Sun: \textit{solar proxy}, which is useful to perform studies related to the evolution of the Sun, such as its rotational and magnetic evolution. Its definition is based on metallicity ($-$0.15 dex $\leq$ [Fe/H] $\leq$ +0.15 dex) and mass (0.95 M$_{\odot}$ $\leq$ M $\leq$ 1.05 M$_{\odot}$) constraints, thus assuring that the star follows a similar evolutionary path as the Sun along the main sequence. Based on this new definition, we report 70 newly identified solar proxies, 46 solar analogs and 13 solar-type stars. In addition, we identified 9 \textit{close solar twins} whose stellar parameters are the most similar to those of the Sun.


title: Coloring graph classes with no induced fork via perfect divisibility

abstract: For a graph $G$, $\chi(G)$ will denote its chromatic number, and $\omega(G)$ its clique number. A graph $G$ is said to be perfectly divisible if for all induced subgraphs $H$ of $G$, $V(H)$ can be partitioned into two sets $A$, $B$ such that $H[A]$ is perfect and $\omega(H[B]) < \omega(H)$. An integer-valued function $f$ is called a $\chi$-binding function for a hereditary class of graphs $\cal C$ if $\chi(G) \leq f(\omega(G))$ for every graph $G\in \cal C$. The fork is the graph obtained from the complete bipartite graph $K_{1,3}$ by subdividing an edge once. The problem of finding a polynomial $\chi$-binding function for the class of fork-free graphs is open. In this paper, we study the structure of some classes of fork-free graphs; in particular, we study the class of (fork,$F$)-free graphs $\cal G$ in the context of perfect divisibility, where $F$ is a graph on five vertices with a stable set of size three, and show that every $G\in \cal G$ satisfies $\chi(G)\leq \omega(G)^2$. We also note that the class $\cal G$ does not admit a linear $\chi$-binding function.


title: Robust Control Barrier-Value Functions for Safety-Critical Control

abstract: This paper works towards unifying two popular approaches in the safety control community: Hamilton-Jacobi (HJ) reachability and Control Barrier Functions (CBFs). HJ Reachability has methods for direct construction of value functions that provide safety guarantees and safe controllers, however the online implementation can be overly conservative and/or rely on chattering bang-bang control. The CBF community has methods for safe-guarding controllers in the form of point-wise optimization using quadratic programs (CBF-QP), where the CBF-based safety certificate is used as a constraint. However, finding a valid CBF for a general dynamical system is challenging. This paper unifies these two methods by introducing a new reachability formulation inspired by the structure of CBFs to construct a Control Barrier-Value Function (CBVF). We verify that CBVF is a viscosity solution to a novel Hamilton-Jacobi-Isaacs Variational Inequality and preserves the same safety guarantee as the original reachability formulation. Finally, inspired by the CBF-QP, we propose a QP-based online control synthesis for systems affine in control and disturbance, whose solution is always the CBVF's optimal control signal robust to bounded disturbance. We demonstrate the benefit of using the CBVFs for double-integrator and Dubins car systems by comparing it to previous methods.


title: Growing the Simulation Ecosystem: Introducing Mesa Data to Provide Transparent, Accessible and Extensible Data Pipelines for Simulation Development

abstract: The Agent Based Model community has a rich and diverse ecosystem of libraries, platforms, and applications to help modelers develop rigorous simulations. Despite this robust and diverse ecosystem, the complexity of life from microbial communities to the global ecosystem still presents substantial challenges in making reusable code that can optimize the ability of the knowledge-sharing and reproducibility. This research seeks to provide new tools to mitigate some of these challenges by offering a vision of a more holistic ecosystem that takes researchers and practitioners from the data collection through validation, with transparent, accessible, and extensible subcomponents. This proposed approach is demonstrated through two data pipelines (crop yield and synthetic population) that take users from data download through the cleaning and processing until users of have data that can be integrated into an ABM. These pipelines are built to be transparent: by walking users step by step through the process, accessible: by being skill scalable so users can leverage them without code or with code, and extensible by being freely available on the coding sharing repository GitHub to facilitate community development. Reusing code that simulates complex phenomena is a significant challenge but one that must be consistently addressed to help the community move forward. This research seeks to aid that progress by offering potential new tools extended from the already robust ecosystem to help the community collaborate more effectively internally and across disciplines.


title: Sparse Partial Least Squares for Coarse Noisy Graph Alignment

abstract: Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different aspects of the same underlying phenomenon. To integrate these different data sources, graph alignment techniques attempt to find the best correspondence between vertices of two graphs. We consider a generalization of this problem, where there is no natural one-to-one mapping between vertices, but where there is correspondence between the community structures of each graph. Because we seek to learn structure at this higher community level, we refer to this problem as "coarse" graph alignment. To this end, we propose a novel regularized partial least squares method which both incorporates the observed graph structures and imposes sparsity in order to reflect the underlying block community structure. We provide efficient algorithms for our method and demonstrate its effectiveness in simulations.


title: C2CL: Contact to Contactless Fingerprint Matching

abstract: Matching contactless fingerprints or finger photos to contact-based fingerprint impressions has received increased attention in the wake of COVID-19 due to the superior hygiene of the contactless acquisition and the widespread availability of low cost mobile phones capable of capturing photos of fingerprints with sufficient resolution for verification purposes. This paper presents an end-to-end automated system, called C2CL, comprised of a mobile finger photo capture app, preprocessing, and matching algorithms to handle the challenges inhibiting previous cross-matching methods; namely i) low ridge-valley contrast of contactless fingerprints, ii) varying roll, pitch, yaw, and distance of the finger to the camera, iii) non-linear distortion of contact-based fingerprints, and vi) different image qualities of smartphone cameras. Our preprocessing algorithm segments, enhances, scales, and unwarps contactless fingerprints, while our matching algorithm extracts both minutiae and texture representations. A sequestered dataset of 9,888 contactless 2D fingerprints and corresponding contact-based fingerprints from 206 subjects (2 thumbs and 2 index fingers for each subject) acquired using our mobile capture app is used to evaluate the cross-database performance of our proposed algorithm. Furthermore, additional experimental results on 3 publicly available datasets show substantial improvement in the state-of-the-art for contact to contactless fingerprint matching (TAR in the range of 96.67% to 98.30% at FAR=0.01%).


title: Certain study of generalized Apostol-Bernoulli poly-daehee polynomials and its properties

abstract: In this paper, we present a new type of generating function of generalized Apostol-Bernoulli poly Daehee polynomial (GABPDP). By using the generating function of GABPDP, we discuss some special cases and useful identities of generalized Apostol-Bernoulli poly Daehee polynomials. We also drive implicit summation formulae of it.


title: High finesse microcavities in the optical telecom O-band

abstract: Optical microcavities allow to strongly confine light in small mode volumes and with long photon lifetimes. This confinement significantly enhances the interaction between light and matter inside the cavity, with applications such as optical trapping and cooling of nanoparticles, single-photon emission enhancement, quantum information processing, and sensing. For many applications, open resonators with direct access to the mode volume are necessary. Here we report on a scalable, open-access optical microcavity platform with mode volumes < 30 $\lambda^3$ and finesse approaching $5x10^5$. This result significantly exceeds the highest optical enhancement factors achieved to date for Fabry-P\'erot cavities. The platform provides a building block for high-performance quantum devices relying on strong light-matter interaction.


title: Magnetic imaging and statistical analysis of the metamagnetic phase transition of FeRh with electron spins in diamond

abstract: Magnetic imaging based on nitrogen-vacancy (NV) centers in diamond has emerged as a powerful tool for probing magnetic phenomena in fields ranging from biology to physics. A key strength of NV sensing is its local-probe nature, enabling high-resolution spatial images of magnetic stray fields emanating from a sample. However, this local character can also form a drawback for analysing the global properties of a system, such as a phase transition temperature. Here, we address this challenge by using statistical analyses of magnetic-field maps to characterize the first-order temperature-driven metamagnetic phase transition from the antiferromagnetic to the ferromagnetic state in FeRh. After imaging the phase transition and identifying the regimes of nucleation, growth, and coalescence of ferromagnetic domains, we statistically characterize the spatial magnetic-field maps to extract the transition temperature and thermal hysteresis width. By analysing the spatial correlations of the maps and their dependence on an external magnetic field, we investigate the magnetocrystalline anisotropy and detect a reorientation of domain walls across the phase transition. The employed statistical approach can be extended to the study of other magnetic phenomena with NV magnetometry or other sensing techniques.


title: On the Applicability of Synthetic Data for Face Recognition

abstract: Face verification has come into increasing focus in various applications including the European Entry/Exit System, which integrates face recognition mechanisms. At the same time, the rapid advancement of biometric authentication requires extensive performance tests in order to inhibit the discriminatory treatment of travellers due to their demographic background. However, the use of face images collected as part of border controls is restricted by the European General Data Protection Law to be processed for no other reason than its original purpose. Therefore, this paper investigates the suitability of synthetic face images generated with StyleGAN and StyleGAN2 to compensate for the urgent lack of publicly available large-scale test data. Specifically, two deep learning-based (SER-FIQ, FaceQnet v1) and one standard-based (ISO/IEC TR 29794-5) face image quality assessment algorithm is utilized to compare the applicability of synthetic face images compared to real face images extracted from the FRGC dataset. Finally, based on the analysis of impostor score distributions and utility score distributions, our experiments reveal negligible differences between StyleGAN vs. StyleGAN2, and further also minor discrepancies compared to real face images.


title: An index theorem on asymptotically static spacetimes with compact Cauchy surface

abstract: We consider the Dirac operator on asymptotically static Lorentzian manifolds with an odd-dimensional compact Cauchy surface. We prove that if Atiyah-Patodi-Singer boundary conditions are imposed at infinite times then the Dirac operator is Fredholm. This generalizes a theorem due to B\"ar-Strohmaier in the case of finite times, and we also show that the corresponding index formula extends to the infinite setting. Furthermore, we demonstrate the existence of a Fredholm inverse which is at the same time a Feynman parametrix in the sense of Duistermaat-H\"ormander. The proof combines methods from time-dependent scattering theory with a variant of Egorov's theorem for pseudo-differential hyperbolic systems.


title: A state-space approach to quantum permutations

abstract: An exposition of quantum permutation groups where an alternative to the 'Gelfand picture' of compact quantum groups is proposed. This point of view is inspired by algebraic quantum mechanics and posits that states on the algebra of continuous functions on a quantum permutation group can be interpreted as quantum permutations. This interpretation allows talk of an element of a compact quantum permutation group, and allows a clear understanding of the difference between deterministic, random, and quantum permutations. The interpretation is illustrated with the Kac-Paljutkin quantum group, the duals of finite groups, as well as by other finite quantum group phenomena.


title: Why? Why not? When? Visual Explanations of Agent Behavior in Reinforcement Learning

abstract: Reinforcement learning (RL) is used in many domains, including autonomous driving, robotics, stock trading, and video games. Unfortunately, the black box nature of RL agents, combined with legal and ethical considerations, makes it increasingly important that humans (including those are who not experts in RL) understand the reasoning behind the actions taken by an RL agent, particularly in safety-critical domains. To help address this challenge, we introduce PolicyExplainer, a visual analytics interface which lets the user directly query an autonomous agent. PolicyExplainer visualizes the states, policy, and expected future rewards for an agent, and supports asking and answering questions such as: Why take this action? Why not take this other action? When is this action taken? PolicyExplainer is designed based upon a domain analysis with RL researchers, and is evaluated via qualitative and quantitative assessments on a trio of domains: taxi navigation, a stack bot domain, and drug recommendation for HIV patients. We find that PolicyExplainer promotes trust and understanding of agent decisions better than a state-of-the-art text-based explanation approach. Interviews with domain practitioners provide further validation for PolicyExplainer as applied to safety-critical domains. Our results help demonstrate how visualization-based approaches can be leveraged to decode the behavior of autonomous RL agents, particularly for RL non-experts.


title: Learning to Rank Microphones for Distant Speech Recognition

abstract: Fully exploiting ad-hoc microphone networks for distant speech recognition is still an open issue. Empirical evidence shows that being able to select the best microphone leads to significant improvements in recognition without any additional effort on front-end processing. Current channel selection techniques either rely on signal, decoder or posterior-based features. Signal-based features are inexpensive to compute but do not always correlate with recognition performance. Instead decoder and posterior-based features exhibit better correlation but require substantial computational resources. In this work, we tackle the channel selection problem by proposing MicRank, a learning to rank framework where a neural network is trained to rank the available channels using directly the recognition performance on the training set. The proposed approach is agnostic with respect to the array geometry and type of recognition back-end. We investigate different learning to rank strategies using a synthetic dataset developed on purpose and the CHiME-6 data. Results show that the proposed approach is able to considerably improve over previous selection techniques, reaching comparable and in some instances better performance than oracle signal-based measures.


title: Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems

abstract: Compressive imaging using coded apertures (CA) is a powerful technique that can be used to recover depth, light fields, hyperspectral images and other quantities from a single snapshot. The performance of compressive imaging systems based on CAs mostly depends on two factors: the properties of the mask's attenuation pattern, that we refer to as "codification" and the computational techniques used to recover the quantity of interest from the coded snapshot. In this work, we introduce the idea of using time-varying CAs synchronized with spatially varying pixel shutters. We divide the exposure of a sensor into sub-exposures at the beginning of which the CA mask changes and at which the sensor's pixels are simultaneously and individually switched "on" or "off". This is a practically appealing codification as it does not introduce additional optical components other than the already present CA but uses a change in the pixel shutter that can be easily realized electronically. We show that our proposed time multiplexed coded aperture (TMCA) can be optimized end-to-end and induces better coded snapshots enabling superior reconstructions in two different applications: compressive light field imaging and hyperspectral imaging. We demonstrate both in simulation and on real captures (taken with prototypes we built) that this codification outperforms the state-of-the-art compressive imaging systems by more than 4dB in those applications.


title: Towards Measuring Fairness in AI: the Casual Conversations Dataset

abstract: This paper introduces a novel dataset to help researchers evaluate their computer vision and audio models for accuracy across a diverse set of age, genders, apparent skin tones and ambient lighting conditions. Our dataset is composed of 3,011 subjects and contains over 45,000 videos, with an average of 15 videos per person. The videos were recorded in multiple U.S. states with a diverse set of adults in various age, gender and apparent skin tone groups. A key feature is that each subject agreed to participate for their likenesses to be used. Additionally, our age and gender annotations are provided by the subjects themselves. A group of trained annotators labeled the subjects' apparent skin tone using the Fitzpatrick skin type scale. Moreover, annotations for videos recorded in low ambient lighting are also provided. As an application to measure robustness of predictions across certain attributes, we provide a comprehensive study on the top five winners of the DeepFake Detection Challenge (DFDC). Experimental evaluation shows that the winning models are less performant on some specific groups of people, such as subjects with darker skin tones and thus may not generalize to all people. In addition, we also evaluate the state-of-the-art apparent age and gender classification methods. Our experiments provides a thorough analysis on these models in terms of fair treatment of people from various backgrounds.


title: Low-Regret Active learning

abstract: We develop an online learning algorithm for identifying unlabeled data points that are most informative for training (i.e., active learning). By formulating the active learning problem as the prediction with sleeping experts problem, we provide a regret minimization framework for identifying relevant data with respect to any given definition of informativeness. Motivated by the successes of ensembles in active learning, we define regret with respect to an omnipotent algorithm that has access to an infinity large ensemble. At the core of our work is an efficient algorithm for sleeping experts that is tailored to achieve low regret on easy instances while remaining resilient to adversarial ones. Low regret implies that we can be provably competitive with an ensemble method \emph{without the computational burden of having to train an ensemble}. This stands in contrast to state-of-the-art active learning methods that are overwhelmingly based on greedy selection, and hence cannot ensure good performance across problem instances with high amounts of noise. We present empirical results demonstrating that our method (i) instantiated with an informativeness measure consistently outperforms its greedy counterpart and (ii) reliably outperforms uniform sampling on real-world scenarios.


title: Accelerated derivative-free nonlinear least-squares applied to the estimation of Manning coefficients

abstract: A general framework for solving nonlinear least squares problems without the employment of derivatives is proposed in the present paper together with a new general global convergence theory. With the aim to cope with the case in which the number of variables is big (for the standards of derivative-free optimization), two dimension-reduction procedures are introduced. One of them is based on iterative subspace minimization and the other one is based on spline interpolation with variable nodes. Each iteration based on those procedures is followed by an acceleration step inspired in the Sequential Secant Method. The practical motivation for this work is the estimation of parameters in Hydraulic models applied to dam breaking problems. Numerical examples of the application of the new method to those problems are given.


title: Modeling interactions of narrowband large amplitude whistler-mode waves with electrons in the solar wind inside ~.3 AU and at 1 AU using a particle tracing code

abstract: The discovery of large-amplitude narrowband whistler-mode waves at frequencies of tenths of the electron cyclotron frequency in large numbers both inside ~.3 AU and at ~1 AU provides an answer to longstanding questions about scattering and energization of solar wind electrons. The waves can have rapid nonlinear interactions with electrons over a broad energy range. Counter-propagation between electrons and waves is not required for resonance with the obliquely propagating waves in contrast to the case for parallel propagation. Using a full 3d particle tracing code, we have examined interactions of electrons with energies from 0 eV to 2 keV with whistler-mode waves with amplitudes of 20 mV/m and propagation angles from 0 to 180 degrees to the background magnetic field. Interactions with wave packets and single waves are both modeled based on observations at ~.3 AU and 1 AU. The simulations demonstrate the key role played by these waves in rapid scattering and energization of electrons. Results provide evidence for nonlinear effects, indicating that quasi-linear methods are not adequate for modeling the role of whistlers in the evolution of solar wind electrons. Strong scattering and energization for some initial energy and pitch angle ranges occurs for both counter-propagating and obliquely propagating waves. The strong scattering of strahl electrons counteracts the pitch angle narrowing due to conservation of the first adiabatic invariant as electrons propagate away from the sun into regions of smaller magnetic field. Scattering also produces the hotter isotropic halo. The concomitant limiting of the electron heat flux is also relevant in other astrophysical settings.


title: Fluorescence-Enhanced Mid-Infrared Photothermal Microscopy

abstract: Mid-infrared photothermal microscopy is a new chemical imaging technology in which a visible beam senses the photothermal effect induced by a pulsed infrared laser. This technology provides infrared spectroscopic information at sub-micron spatial resolution and enables infrared spectroscopy and imaging of living cells and organisms. Yet, current mid-infrared photothermal imaging sensitivity suffers from a weak dependance of scattering on temperature and the image quality is vulnerable to the speckles caused by scattering. Here, we present a novel version of mid-infrared photothermal microscopy in which thermo-sensitive fluorescent probes are harnessed to sense the mid-infrared photothermal effect. The fluorescence intensity can be modulated at the level of 1% per Kelvin, which is 100 times larger than the modulation of scattering intensity. In addition, fluorescence emission is free of speckles, thus much improving the image quality. Moreover, fluorophores can target specific organelles or biomolecules, thus augmenting the specificity of photothermal imaging. Spectral fidelity is confirmed through fingerprinting a single bacterium. Finally, the photobleaching issue is successfully addressed through the development of a wide-field fluorescence-enhanced mid-infrared photothermal microscope which allows video rate bond-selective imaging of biological specimens.


title: Approximate Linearization of Fixed Point Iterations: Error Analysis of Tangent and Adjoint Problems Linearized about Non-Stationary Points

abstract: Previous papers have shown the impact of partial convergence of discretized PDE on the accuracy of tangent and adjoint linearizations. A series of papers suggested linearization of the fixed point iteration used in the solution process as a means of computing the sensitivities rather than linearizing the discretized PDE, as the lack of convergence of the nonlinear problem indicates that the discretized form of the governing equations has not been satisfied. These works showed that the accuracy of an approximate linearization depends in part on the convergence of the nonlinear system. This work shows an error analysis of the impact of the approximate linearization and the convergence of the nonlinear problem for both the tangent and adjoint modes and provides a series of results for an exact Newton solver, an inexact Newton solver, and a low storage explicit Runge-Kutta scheme to confirm the error analyses.


title: Efficient state and parameter estimation for high-dimensional nonlinear system identification with application to MEG brain network modeling

abstract: System identification poses a significant bottleneck to characterizing and controlling complex systems. This challenge is greatest when both the system states and parameters are not directly accessible leading to a dual-estimation problem. Current approaches to such problems are limited in their ability to scale with many-parameter systems as often occurs in networks. In the current work, we present a new, computationally efficient approach to treat large dual-estimation problems. Our approach consists of directly integrating pseudo-optimal state estimation (the Extended Kalman Filter) into a dual-optimization objective, leaving a differentiable cost/error function of only in terms of the unknown system parameters which we solve using numerical gradient/Hessian methods. Intuitively, our approach consists of solving for the parameters that generate the most accurate state estimator (Extended Kalman Filter). We demonstrate that our approach is at least as accurate in state and parameter estimation as joint Kalman Filters (Extended/Unscented), despite lower complexity. We demonstrate the utility of our approach by inverting anatomically-detailed individualized brain models from human magnetoencephalography (MEG) data.


title: Ecole: A Library for Learning Inside MILP Solvers

abstract: In this paper we describe Ecole (Extensible Combinatorial Optimization Learning Environments), a library to facilitate integration of machine learning in combinatorial optimization solvers. It exposes sequential decision making that must be performed in the process of solving as Markov decision processes. This means that, rather than trying to predict solutions to combinatorial optimization problems directly, Ecole allows machine learning to work in cooperation with a state-of-the-art a mixed-integer linear programming solver that acts as a controllable algorithm. Ecole provides a collection of computationally efficient, ready to use learning environments, which are also easy to extend to define novel training tasks. Documentation and code can be found at https://www.ecole.ai.


title: TLUSTY and SYNSPEC Users's Guide IV: Upgraded Versions 208 and 54

abstract: We present a brief description of the newly upgraded versions of the programs TLUSTY, version 208, and SYNSPEC, version 54. TLUSTY is used to generate model stellar atmospheres or accretion disks, and SYNSPEC produces detailed synthetic spectra and/or opacity tables. This paper complements published guides that provide a detailed description of earlier versions of the codes, TLUSTY205, and SYNSPEC51. The main upgrades include the flexible construction of opacity tables in SYNSPEC, and their use in producing hybrid models with TLUSTY}, with important species treated in NLTE, while the bulk of opacity of atomic and molecular lines and continua are considered in LTE using a pre-calculated opacity table. There is also a number of additional changes and upgrades that increase the versatility and flexibility of these codes.


title: IndoFashion : Apparel Classification for Indian Ethnic Clothes

abstract: Cloth categorization is an important research problem that is used by e-commerce websites for displaying correct products to the end-users. Indian clothes have a large number of clothing categories both for men and women. The traditional Indian clothes like "Saree" and "Dhoti" are worn very differently from western clothes like t-shirts and jeans. Moreover, the style and patterns of ethnic clothes have a very different distribution from western outfits. Thus the models trained on standard cloth datasets fail miserably on ethnic outfits. To address these challenges, we introduce the first large-scale ethnic dataset of over 106k images with 15 different categories for fine-grained classification of Indian ethnic clothes. We gathered a diverse dataset from a large number of Indian e-commerce websites. We then evaluate several baselines for the cloth classification task on our dataset. In the end, we obtain 88.43% classification accuracy. We hope that our dataset would foster research in the development of several algorithms such as cloth classification, landmark detection, especially for ethnic clothes.


title: Better Neural Machine Translation by Extracting Linguistic Information from BERT

abstract: Adding linguistic information (syntax or semantics) to neural machine translation (NMT) has mostly focused on using point estimates from pre-trained models. Directly using the capacity of massive pre-trained contextual word embedding models such as BERT (Devlin et al., 2019) has been marginally useful in NMT because effective fine-tuning is difficult to obtain for NMT without making training brittle and unreliable. We augment NMT by extracting dense fine-tuned vector-based linguistic information from BERT instead of using point estimates. Experimental results show that our method of incorporating linguistic information helps NMT to generalize better in a variety of training contexts and is no more difficult to train than conventional Transformer-based NMT.


title: ARC: A Vision-based Automatic Retail Checkout System

abstract: Retail checkout systems employed at supermarkets primarily rely on barcode scanners, with some utilizing QR codes, to identify the items being purchased. These methods are time-consuming in practice, require a certain level of human supervision, and involve waiting in long queues. In this regard, we propose a system, that we call ARC, which aims at making the process of check-out at retail store counters faster, autonomous, and more convenient, while reducing dependency on a human operator. The approach makes use of a computer vision-based system, with a Convolutional Neural Network at its core, which scans objects placed beneath a webcam for identification. To evaluate the proposed system, we curated an image dataset of one-hundred local retail items of various categories. Within the given assumptions and considerations, the system achieves a reasonable test-time accuracy, pointing towards an ambitious future for the proposed setup. The project code and the dataset are made publicly available.


title: Generalized Navier-Stokes equations and soft hairy horizons in fluid/gravity correspondence

abstract: The fluid/gravity correspondence establishes how gravitational dynamics, as dictated by Einstein's field equations, are related to the fluid dynamics, governed by the relativistic Navier-Stokes equations. In this work the correspondence is extended, where the duality between incompressible fluids and gravitational backgrounds with soft hair excitations is implemented. This construction is set through appropriate boundary conditions to the gravitational background, leading to a correspondence between generalized incompressible Navier-Stokes equations and soft hairy horizons.


title: A no expanding breather theorem for noncompact Ricci flows

abstract: In this note we show that, under certain curvature positivity conditions (the weak $\operatorname{PIC}-2$ condition or the nonnegative bisectional curvature condition), a complete and noncompact expanding breather of the Ricci flow is also an expanding gradient Ricci soliton. This is the first no expanding breather theorem in the noncompact category.


title: Matter-wave Atomic Gradiometer Interferometric Sensor (MAGIS-100)

abstract: MAGIS-100 is a next-generation quantum sensor under construction at Fermilab that aims to explore fundamental physics with atom interferometry over a 100-meter baseline. This novel detector will search for ultralight dark matter, test quantum mechanics in new regimes, and serve as a technology pathfinder for future gravitational wave detectors in a previously unexplored frequency band. It combines techniques demonstrated in state-of-the-art 10-meter-scale atom interferometers with the latest technological advances of the world's best atomic clocks. MAGIS-100 will provide a development platform for a future kilometer-scale detector that would be sufficiently sensitive to detect gravitational waves from known sources. Here we present the science case for the MAGIS concept, review the operating principles of the detector, describe the instrument design, and study the detector systematics.


title: Non-Asymptotic Analysis for Two Time-scale TDC with General Smooth Function Approximation

abstract: Temporal-difference learning with gradient correction (TDC) is a two time-scale algorithm for policy evaluation in reinforcement learning. This algorithm was initially proposed with linear function approximation, and was later extended to the one with general smooth function approximation. The asymptotic convergence for the on-policy setting with general smooth function approximation was established in [bhatnagar2009convergent], however, the finite-sample analysis remains unsolved due to challenges in the non-linear and two-time-scale update structure, non-convex objective function and the time-varying projection onto a tangent plane. In this paper, we develop novel techniques to explicitly characterize the finite-sample error bound for the general off-policy setting with i.i.d.\ or Markovian samples, and show that it converges as fast as $\mathcal O(1/\sqrt T)$ (up to a factor of $\mathcal O(\log T)$). Our approach can be applied to a wide range of value-based reinforcement learning algorithms with general smooth function approximation.


title: Fast Unmixing and Change Detection in Multitemporal Hyperspectral Data

abstract: Multitemporal spectral unmixing (SU) is a powerful tool to process hyperspectral image (HI) sequences due to its ability to reveal the evolution of materials over time and space in a scene. However, significant spectral variability is often observed between collection of images due to variations in acquisition or seasonal conditions. This characteristic has to be considered in the design of SU algorithms. Because of its good performance, the multiple endmember spectral mixture analysis algorithm (MESMA) has been recently used to perform SU in multitemporal scenarios arising in several practical applications. However, MESMA does not consider the relationship between the different HIs, and its computational complexity is extremely high for large spectral libraries. In this work, we propose an efficient multitemporal SU method that exploits the high temporal correlation between the abundances to provide more accurate results at a lower computational complexity. We propose to solve the complex general multitemporal SU problem by separately addressing the endmember selection and the abundance estimation problems. This leads to a simpler solution without sacrificing the accuracy of the results. We also propose a strategy to detect and address abrupt abundance variations in time. Theoretical results demonstrate how the proposed method compares to MESMA in terms of quality, and how effective it is in detecting abundance changes. This analysis provides valuable insight into the conditions under which the algorithm succeeds. Simulation results show that the proposed method achieves state-of-the-art performance at a smaller computational cost.


title: Implications of the detection of sub-PeV diffuse $\gamma$ rays from the Galactic disk apart from discrete sources

abstract: Very recently, the Tibet-AS$\gamma$ collaboration reported the detection of $\gamma$ rays from the galactic disk in the energy range of 100 TeV -- 1 PeV. Remarkably, many of these $\gamma$ rays were observed apart from known very high energy (E$>$ 100 GeV) $\gamma$-ray sources. These results are best understood if these diffuse $\gamma$ rays: 1) were produced by a conventional rather than an exotic (i.e. dark matter decay or annihilation) process, 2) have a hadronic rather than a leptonic origin, 3) were produced in impulsive rather than stable sources or, alternatively, in optically thick sources. In addition to that, the detection of the sub-PeV diffuse $\gamma$ rays implies a limit on the flux of neutrinos from the Galactic disk and a lower limit on the rigidity of the cutoff in the Galactic cosmic ray spectrum.


title: Holographic QCD and magnetic fields

abstract: We review the holographic approach to electromagnetic phenomena in large N QCD. After a brief discussion of existing holographic models, we concentrate on the improved holographic QCD model extended to include magnetically induced phenomena. We explore the influence of magnetic fields on the QCD ground state, focusing on (inverse) magnetic catalysis of chiral condensate, investigate the phase diagram of the theory as a function of magnetic field, temperature and quark chemical potential, and, finally discuss effects of magnetic fields on the quark-anti-quark potential, shear viscosity, speed of sound and magnetization.


title: Constraints on the duration of inflation from entanglement entropy bounds

abstract: Using the fact that we only observe those modes which exit the Hubble horizon during inflation, one can calculate the entanglement entropy of such long-wavelength perturbations by tracing out unobservable sub-Hubble fluctuations they are coupled to. On requiring that this perturbative entanglement entropy, which increases with time, obey the covariant entropy bound for an accelerating background, we find an upper bound on the duration of inflation. This presents a new perspective on the (meta-)stability of de Sitter spacetime and an associated lifetime for it.


title: Learning Triadic Belief Dynamics in Nonverbal Communication from Videos

abstract: Humans possess a unique social cognition capability; nonverbal communication can convey rich social information among agents. In contrast, such crucial social characteristics are mostly missing in the existing scene understanding literature. In this paper, we incorporate different nonverbal communication cues (e.g., gaze, human poses, and gestures) to represent, model, learn, and infer agents' mental states from pure visual inputs. Crucially, such a mental representation takes the agent's belief into account so that it represents what the true world state is and infers the beliefs in each agent's mental state, which may differ from the true world states. By aggregating different beliefs and true world states, our model essentially forms "five minds" during the interactions between two agents. This "five minds" model differs from prior works that infer beliefs in an infinite recursion; instead, agents' beliefs are converged into a "common mind". Based on this representation, we further devise a hierarchical energy-based model that jointly tracks and predicts all five minds. From this new perspective, a social event is interpreted by a series of nonverbal communication and belief dynamics, which transcends the classic keyframe video summary. In the experiments, we demonstrate that using such a social account provides a better video summary on videos with rich social interactions compared with state-of-the-art keyframe video summary methods.


title: Anisotropic Turbulence in Position-Position-Velocity Space: Probing Three-Dimensional Magnetic Fields

abstract: Direct measurements of three-dimensional magnetic fields in the interstellar medium (ISM) are not achievable. However, the anisotropic nature of magnetohydrodynamic (MHD) turbulence provides a novel way of tracing the magnetic fields. Guided by the advanced understanding of turbulence's anisotropy in the Position-Position-Velocity (PPV) space, we extend the Structure-Function Analysis (SFA) to measure both the three-dimensional magnetic field orientation and Alfven Mach number $M_A$, which provides the information on magnetic field strength. Following the theoretical framework developed in Kandel et al. (2016), we find that the anisotropy in a given velocity channel is affected by the inclination angle between the 3D magnetic field direction and the line-of-sight as well as media magnetization. We analyze the synthetic PPV cubes generated by incompressible and compressible MHD simulations. We confirm that the PPV channel's intensity fluctuations measured in various position angles reveal plane-of-the-sky magnetic field orientation. We show that by varying the channel width, the anisotropies of the intensity fluctuations in PPV space can be used to simultaneously estimate both magnetic field inclination angle and strength of total magnetic fields.


title: A Geometrical Method for the Smoluchowski Equation on the Sphere

abstract: A study of the diffusion of a passive Brownian particle on the surface of a sphere and subject to the effects of an external potential, coupled linearly to the probability density of the particle's position, is presented through a numerical algorithm devised to simulate the trajectories of an ensemble of Brownian particles. The algorithm is based on elementary geometry and practically only algebraic operations are used, which makes the algorithm efficient and simple, and converges, in the \textit{weak sense}, to the solutions of the Smoluchowski equation on the sphere. Our findings show that the global effects of curvature are taken into account in both the time dependent and stationary processes.


title: GEM: Group Enhanced Model for Learning Dynamical Control Systems

abstract: Learning the dynamics of a physical system wherein an autonomous agent operates is an important task. Often these systems present apparent geometric structures. For instance, the trajectories of a robotic manipulator can be broken down into a collection of its transitional and rotational motions, fully characterized by the corresponding Lie groups and Lie algebras. In this work, we take advantage of these structures to build effective dynamical models that are amenable to sample-based learning. We hypothesize that learning the dynamics on a Lie algebra vector space is more effective than learning a direct state transition model. To verify this hypothesis, we introduce the Group Enhanced Model (GEM). GEMs significantly outperform conventional transition models on tasks of long-term prediction, planning, and model-based reinforcement learning across a diverse suite of standard continuous-control environments, including Walker, Hopper, Reacher, Half-Cheetah, Inverted Pendulums, Ant, and Humanoid. Furthermore, plugging GEM into existing state of the art systems enhances their performance, which we demonstrate on the PETS system. This work sheds light on a connection between learning of dynamics and Lie group properties, which opens doors for new research directions and practical applications along this direction. Our code is publicly available at: https://tinyurl.com/GEMMBRL.


title: A General Destriping Framework for Remote Sensing Images Using Flatness Constraint

abstract: Removing stripe noise, i.e., destriping, from remote sensing images is an essential task in terms of visual quality and subsequent processing. Most existing destriping methods are designed by combining a particular image regularization with a stripe noise characterization that cooperates with the regularization, which precludes us to examine and activate different regularizations to adapt to various target images. To resolve this, two requirements need to be considered: a general framework that can handle a variety of image regularizations in destriping, and a strong stripe noise characterization that can consistently capture the nature of stripe noise, regardless of the choice of image regularization. To this end, this paper proposes a general destriping framework using a newly-introduced stripe noise characterization, named flatness constraint, where we can handle various regularization functions in a unified manner. Specifically, we formulate the destriping problem as a nonsmooth convex optimization problem involving a general form of image regularization and the flatness constraint. The constraint mathematically models that the intensity of each stripe is constant along one direction, resulting in a strong characterization of stripe noise. For solving the optimization problem, we also develop an efficient algorithm based on a diagonally preconditioned primal-dual splitting algorithm (DP-PDS), which can automatically adjust the stepsizes. The effectiveness of our framework is demonstrated through destriping experiments, where we comprehensively compare combinations of a variety of image regularizations and stripe noise characterizations using hyperspectral images (HSI) and infrared (IR) videos.


title: MultiScene: A Large-scale Dataset and Benchmark for Multi-scene Recognition in Single Aerial Images

abstract: Aerial scene recognition is a fundamental research problem in interpreting high-resolution aerial imagery. Over the past few years, most studies focus on classifying an image into one scene category, while in real-world scenarios, it is more often that a single image contains multiple scenes. Therefore, in this paper, we investigate a more practical yet underexplored task -- multi-scene recognition in single images. To this end, we create a large-scale dataset, called MultiScene, composed of 100,000 unconstrained high-resolution aerial images. Considering that manually labeling such images is extremely arduous, we resort to low-cost annotations from crowdsourcing platforms, e.g., OpenStreetMap (OSM). However, OSM data might suffer from incompleteness and incorrectness, which introduce noise into image labels. To address this issue, we visually inspect 14,000 images and correct their scene labels, yielding a subset of cleanly-annotated images, named MultiScene-Clean. With it, we can develop and evaluate deep networks for multi-scene recognition using clean data. Moreover, we provide crowdsourced annotations of all images for the purpose of studying network learning with noisy labels. We conduct experiments with extensive baseline models on both MultiScene-Clean and MultiScene to offer benchmarks for multi-scene recognition in single images and learning from noisy labels for this task, respectively. To facilitate progress, we make our dataset and trained models available on https://gitlab.lrz.de/ai4eo/reasoning/multiscene.


title: Deep Implicit Statistical Shape Models for 3D Medical Image Delineation

abstract: 3D delineation of anatomical structures is a cardinal goal in medical imaging analysis. Prior to deep learning, statistical shape models that imposed anatomical constraints and produced high quality surfaces were a core technology. Prior to deep learning, statistical shape models that imposed anatomical constraints and produced high quality surfaces were a core technology. Today fully-convolutional networks (FCNs), while dominant, do not offer these capabilities. We present deep implicit statistical shape models (DISSMs), a new approach to delineation that marries the representation power of convolutional neural networks (CNNs) with the robustness of SSMs. DISSMs use a deep implicit surface representation to produce a compact and descriptive shape latent space that permits statistical models of anatomical variance. To reliably fit anatomically plausible shapes to an image, we introduce a novel rigid and non-rigid pose estimation pipeline that is modelled as a Markov decision process(MDP). We outline a training regime that includes inverted episodic training and a deep realization of marginal space learning (MSL). Intra-dataset experiments on the task of pathological liver segmentation demonstrate that DISSMs can perform more robustly than three leading FCN models, including nnU-Net: reducing the mean Hausdorff distance (HD) by 7.7-14.3mm and improving the worst case Dice-Sorensen coefficient (DSC) by 1.2-2.3%. More critically, cross-dataset experiments on a dataset directly reflecting clinical deployment scenarios demonstrate that DISSMs improve the mean DSC and HD by 3.5-5.9% and 12.3-24.5mm, respectively, and the worst-case DSC by 5.4-7.3%. These improvements are over and above any benefits from representing delineations with high-quality surface.


title: Experimental test of the majorization uncertainty relation with mixed states

abstract: The uncertainty relation lies at the heart of quantum theory and behaves as a non-classical constraint on the indeterminacies of incompatible observables in a system. In the literature, many experiments have been devoted to the test of the uncertainty relations which mainly focus on the pure states. In this work we test the novel majorization uncertainty relations of three incompatible observables using a series of mixed states with adjustable mixing degrees, and compare the compactness of various entropy uncertainty relations. The experimental results confirm that for general mixed quantum system, the majorization uncertainty relation tends to be the tightest constraint on uncertainty, and indicate that the entropy uncertainty relation obtained from the majorzation uncertainty relation is the optimal one. Our experimental setup provides an easy means for preparing mixed states, and based on this simple optical elements can be utilized to realize the required quantum states.


title: Relay-Reconfigurable Intelligent Surface Cooperation for Energy-Efficient Multiuser Systems

abstract: Reconfigurable intelligent surfaces (RIS) have drawn considerable attention recently due to their controllable scattering elements that are able to direct electromagnetic waves into desirable directions. Although RISs share some similarities with relays, the two have fundamental differences impacting their performance. To harness the benefits of both relaying and RISs, a multi-user communication system is proposed in this paper wherein a relay and an RIS cooperate to improve performance in terms of energy efficiency. To utilize the RIS efficiently, the discrete phase shifts of the RIS elements are optimized along with the beamforming matrices at the transmitter and the relay, targeting the minimization of the total transmit power subject to a quality-of-service (QoS) constraint. Then, two suboptimal efficient solutions are proposed for the resulting discrete and non-convex problem, one based on singular value decomposition (SVD) and uplink-downlink duality and the other is based on SVD combined with zero-forcing. Simulations show that the proposed solutions outperform a system with either a relay or an RIS only, especially when both are closer to the users than to the base-station.


title: LI-Net: Large-Pose Identity-Preserving Face Reenactment Network

abstract: Face reenactment is a challenging task, as it is difficult to maintain accurate expression, pose and identity simultaneously. Most existing methods directly apply driving facial landmarks to reenact source faces and ignore the intrinsic gap between two identities, resulting in the identity mismatch issue. Besides, they neglect the entanglement of expression and pose features when encoding driving faces, leading to inaccurate expressions and visual artifacts on large-pose reenacted faces. To address these problems, we propose a Large-pose Identity-preserving face reenactment network, LI-Net. Specifically, the Landmark Transformer is adopted to adjust driving landmark images, which aims to narrow the identity gap between driving and source landmark images. Then the Face Rotation Module and the Expression Enhancing Generator decouple the transformed landmark image into pose and expression features, and reenact those attributes separately to generate identity-preserving faces with accurate expressions and poses. Both qualitative and quantitative experimental results demonstrate the superiority of our method.


title: Interpreting A Pre-trained Model Is A Key For Model Architecture Optimization: A Case Study On Wav2Vec 2.0

abstract: A deep Transformer model with good evaluation score does not mean each subnetwork (a.k.a transformer block) learns reasonable representation. Diagnosing abnormal representation and avoiding it can contribute to achieving a better evaluation score. We propose an innovative perspective for analyzing attention patterns: summarize block-level patterns and assume abnormal patterns contribute negative influence. We leverage Wav2Vec 2.0 as a research target and analyze a pre-trained model's pattern. All experiments leverage Librispeech-100-clean as training data. Through avoiding diagnosed abnormal ones, our custom Wav2Vec 2.0 outperforms the original version about 4.8% absolute word error rate (WER) on test-clean with viterbi decoding. Our version is still 0.9% better when decoding with a 4-gram language model. Moreover, we identify that avoiding abnormal patterns is the main contributor for performance boosting.


title: Topological Disclination Pump

abstract: A topological pump enables robust transport of quantized particles when the system parameters are varied in a cyclic process. In previous studies, topological pump was achieved inhomogeneous systems guaranteed by a topological invariant of the bulk band structure when time is included as an additional synthetic dimension. Recently, bulk-boundary correspondence has been generalized to the bulk-disclination correspondence, describing the emergence of topological bounded states in the crystallographic defects protected by the bulk topology. Here we show the topological pumping can happen between different disclination states with different chiralities in an inhomogeneous structure. Based on a generalized understanding of the charge pumping process, we explain the topological disclination pump by tracing the motion of Wannier centers in each unit cell. Besides, by constructing two disclination structures and introducing a symmetry-breaking perturbation, we achieve a topological pumping between different dislocation cores. Our result opens a route to study the topological pumping in inhomogeneous topological crystalline systems and provides a flexible platform for robust energy transport.