title: Non-linear Instability of periodic orbits of suspensions of thin fibers in fluids

abstract: This paper is concerned with difficulties encountered by engineers when they attempt to predict the orientation of fibers in the creation of injection molded plastic parts. It is known that Jeffery's equation, which was designed to model a single fiber in an infinite fluid, breaks down very badly when applied, with no modifications, to this situation. In a previous paper, the author described how interactions between the fiber orientation and the viscosity of the suspension might cause instability, which could result in the simple predictions from Jeffery's equation being badly wrong. In this paper, we give some rigorous proofs of instability using Floquet Theory. We also give an example where the spectal radius of the monodromy operator is one, but there is still non-linear instability.


title: A massive quiescent galaxy confirmed in a protocluster at z=3.09

abstract: We report a massive quiescent galaxy at $z_{\rm spec}=3.0922^{+0.008}_{-0.004}$ spectroscopically confirmed at a protocluster in the SSA22 field by detecting the Balmer and Ca {\footnotesize II} absorption features with multi-object spectrometer for infrared exploration (MOSFIRE) on the Keck I telescope. This is the most distant quiescent galaxy confirmed in a protocluster to date. We fit the optical to mid-infrared photometry and spectrum simultaneously with spectral energy distribution (SED) models of parametric and nonparametric star formation histories (SFH). Both models fit the observed SED well and confirm that this object is a massive quiescent galaxy with the stellar mass of $\log(\rm M_{\star}/M_{\odot}) = 11.26^{+0.03}_{-0.04}$ and $11.54^{+0.03}_{-0.00}$, and star formation rate of $\rm SFR/M_{\odot}~yr^{-1} <0.3$ and $=0.01^{+0.03}_{-0.01}$ for parametric and nonparametric models, respectively. The SFH from the former modeling is described as an instantaneous starburst while that of the latter modeling is longer-lived but both models agree with a sudden quenching of the star formation at $\sim0.6$ Gyr ago. This massive quiescent galaxy is confirmed in an extremely dense group of galaxies predicted as a progenitor of a brightest cluster galaxy formed via multiple mergers in cosmological numerical simulations. We newly find three plausible [O III]$\lambda$5007 emitters at $3.0791\leq z_{\rm spec}\leq3.0833$ happened to be detected around the target. Two of them just between the target and its nearest massive galaxy are possible evidence of their interactions. They suggest the future strong size and stellar mass evolution of this massive quiescent galaxy via mergers.


title: Performance Evaluation of Cooperative NOMA-based Improved Hybrid SWIPT Protocol

abstract: This study proposes the integration of a cooperative non-orthogonal multiple access (CNOMA) and improved hybrid simultaneous wireless information and power transfer (IHS SWIPT) protocol (termed as CNOMA-IHS) to enhance the spectral efficiency (SE) of a downlink (DL) CNOMA communication system. CNOMA-IHS scheme can enhance the ergodic sum capacity (ESC) and energy efficiency (EE) of DL CNOMA by transferring additional symbols towards the users and energize the relay operation as well without any additional resources (e.g., time slot/frequency/code). The analytical and simulation results indicate that the proposed CNOMA-IHS scheme outperforms other existing SWIPT-based schemes (e.g., CNOMA with hybrid SWIPT, CNOMA with power-splitting SWIPT, wireless-powered CNOMA, CNOMA with time switching SWIPT, and orthogonal multiple access with IHS SWIPT) in terms of the ESC. Moreover, the CNOMA-IHS scheme also enhances EE compared with other conventional TS-SWIPT-based schemes, which is also illustrated by the simulation results. In addition, the proposed CNOMA-IHS scheme with the considered EE optimization technique outplayed the proposed CNOMA-IHS scheme without EE optimization and other existing TS-SWIPT-based schemes in terms of EE.


title: Lossy Compression for Lossless Prediction

abstract: Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize the bit-rate required to ensure high performance on all predictive tasks that are invariant under a set of transformations, such as data augmentations. Based on our theory, we design unsupervised objectives for training neural compressors. Using these objectives, we train a generic image compressor that achieves substantial rate savings (more than $1000\times$ on ImageNet) compared to JPEG on 8 datasets, without decreasing downstream classification performance.


title: MeshRIR: A Dataset of Room Impulse Responses on Meshed Grid Points For Evaluating Sound Field Analysis and Synthesis Methods

abstract: A new impulse response (IR) dataset called "MeshRIR" is introduced. Currently available datasets usually include IRs at an array of microphones from several source positions under various room conditions, which are basically designed for evaluating speech enhancement and distant speech recognition methods. On the other hand, methods of estimating or controlling spatial sound fields have been extensively investigated in recent years; however, the current IR datasets are not applicable to validating and comparing these methods because of the low spatial resolution of measurement points. MeshRIR consists of IRs measured at positions obtained by finely discretizing a spatial region. Two subdatasets are currently available: one consists of IRs in a three-dimensional cuboidal region from a single source, and the other consists of IRs in a two-dimensional square region from an array of 32 sources. Therefore, MeshRIR is suitable for evaluating sound field analysis and synthesis methods. This dataset is freely available at https://sh01k.github.io/MeshRIR/ with some codes of sample applications.


title: Low-density superconductivity in SrTiO$_3$ bounded by the adiabatic criterion

abstract: SrTiO$_3$ exhibits superconductivity for carrier densities $10^{19}-10^{21}$ cm$^{-3}$. Across this range, the Fermi level traverses a number of vibrational modes in the system, making it ideal for studying dilute superconductivity. We use high-resolution planar-tunneling spectroscopy to probe chemically-doped SrTiO$_3$ across the superconducting dome. The over-doped superconducting boundary aligns, with surprising precision, to the Fermi energy crossing the Debye energy. Superconductivity emerges with decreasing density, maintaining throughout the Bardeen-Cooper-Schrieffer (BCS) gap to transition-temperature ratio, despite being in the anti-adiabatic regime. At lowest superconducting densities, the lone remaining adiabatic phonon van Hove singularity is the soft transverse-optic mode, associated with the ferroelectric instability. We suggest a scenario for pairing mediated by this mode in the presence of spin-orbit coupling, which naturally accounts for the superconducting dome and BCS ratio.


title: Qubit Heating Near a Hotspot

abstract: Effective theories describing black hole exteriors contain many open-system features due to the large number of gapless degrees of freedom that lie beyond reach across the horizon. A simple solvable Caldeira-Leggett type model of a quantum field interacting within a small area with many unmeasured thermal degrees of freedom was recently proposed in arXiv:2106.09854 to provide a toy model of this kind of dynamics against which more complete black hole calculations might be compared. We here compute the response of a simple Unruh-DeWitt detector (or qubit) interacting with a massless quantum field $\phi$ coupled to such a hotspot. Our treatment differs from traditional treatments of Unruh-DeWitt detectors by using Open-EFT tools to reliably calculate the qubit's late-time behaviour. We use these tools to determine the efficiency with which the qubit thermalizes as a function of its proximity to the hotspot. We identify a Markovian regime in which thermalization does occur, though only for qubits closer to the hotspot than a characteristic distance scale set by the $\phi$-hotspot coupling. We compute the thermalization time, and find that it varies inversely with the $\phi$-qubit coupling strength in the standard way.


title: Quantum Hotspots: Mean Fields, Open EFTs, Nonlocality and Decoherence Near Black Holes

abstract: Effective theories describing black hole exteriors resemble open quantum systems inasmuch as many unmeasurable degrees of freedom beyond the horizon interact with those we can see. A solvable Caldeira-Leggett type model of a quantum field that mixes with many unmeasured thermal degrees of freedom on a shared surface was proposed in arXiv:2106.09854 to provide a benchmark against which more complete black hole calculations might be compared. We here use this model to test two types of field-theoretic approximation schemes that also lend themselves to describing black hole behaviour: Open EFT techniques (as applied to the fields themselves, rather than Unruh-DeWitt detectors) and mean-field methods. Mean-field methods are of interest because the effective Hamiltonians to which they lead can be nonlocal; a possible source for the nonlocality that is sometimes entertained as being possible for black holes in the near-horizon regime. Open EFTs compute the evolution of the field state, allowing discussion of thermalization and decoherence even when these occur at such late times that perturbative methods fail (as they often do). Applying both of these methods to a solvable system identifies their domains of validity and shows how their predictions relate to more garden-variety perturbative tools.


title: Exact tensor closures for the three dimensional Jeffery's equation

abstract: This paper presents an exact formula for calculating the fourth-moment tensor from the second-moment tensor for the three dimensional Jeffery's equation. Although this approach falls within the category of a moment tensor closure, it does not rely upon an approximation, either analytic or curve fit, of the fourth-moment tensor as do previous closures. This closure is orthotropic in the sense of \cite{cintra:95}, or equivalently, a natural closure in the sense of \cite{verleye:93}. The existence of these explicit formulae has been asserted previously, but as far as the authors know, the explicit forms have yet to be published. The formulae involve elliptic integrals, and are valid whenever fiber orientation was isotropic at some point in time. Finally, this paper presents the Fast Exact Closure (FEC), a fast and in principle exact method for solving Jeffery's equation, which does not require approximate closures, nor the elliptic integral computation.


title: Ensemble of ACCDOA- and EINV2-based Systems with D3Nets and Impulse Response Simulation for Sound Event Localization and Detection

abstract: This report describes our systems submitted to the DCASE2021 challenge task 3: sound event localization and detection (SELD) with directional interference. Our previous system based on activity-coupled Cartesian direction of arrival (ACCDOA) representation enables us to solve a SELD task with a single target. This ACCDOA-based system with efficient network architecture called RD3Net and data augmentation techniques outperformed state-of-the-art SELD systems in terms of localization and location-dependent detection. Using the ACCDOA-based system as a base, we perform model ensembles by averaging outputs of several systems trained with different conditions such as input features, training folds, and model architectures. We also use the event independent network v2 (EINV2)-based system to increase the diversity of the model ensembles. To generalize the models, we further propose impulse response simulation (IRS), which generates simulated multi-channel signals by convolving simulated room impulse responses (RIRs) with source signals extracted from the original dataset. Our systems significantly improved over the baseline system on the development dataset.


title: Adversarial Examples Make Strong Poisons

abstract: The adversarial machine learning literature is largely partitioned into evasion attacks on testing data and poisoning attacks on training data. In this work, we show that adversarial examples, originally intended for attacking pre-trained models, are even more effective for data poisoning than recent methods designed specifically for poisoning. Our findings indicate that adversarial examples, when assigned the original label of their natural base image, cannot be used to train a classifier for natural images. Furthermore, when adversarial examples are assigned their adversarial class label, they are useful for training. This suggests that adversarial examples contain useful semantic content, just with the ``wrong'' labels (according to a network, but not a human). Our method, adversarial poisoning, is substantially more effective than existing poisoning methods for secure dataset release, and we release a poisoned version of ImageNet, ImageNet-P, to encourage research into the strength of this form of data obfuscation.


title: The Fast Exact Closure for Jeffery's Equation with Diffusion

abstract: Jeffery's equation with diffusion is widely used to predict the motion of concentrated fiber suspensions in flows with low Reynold's numbers. Unfortunately, the evaluation of the fiber orientation distribution can require excessive computation, which is often avoided by solving the related second order moment tensor equation. This approach requires a `closure' that approximates the distribution function's fourth order moment tensor from its second order moment tensor. This paper presents the Fast Exact Closure (FEC) which uses conversion tensors to obtain a pair of related ordinary differential equations; avoiding approximations of the higher order moment tensors altogether. The FEC is exact in that when there are no fiber interactions, it exactly solves Jeffery's equation. Numerical examples for dense fiber suspensions are provided with both a Folgar-Tucker (1984) diffusion term and the recent anisotropic rotary diffusion term proposed by Phelps and Tucker (2009). Computations demonstrate that the FEC exhibits improved accuracy with computational speeds equivalent to or better than existing closure approximations.


title: Dislocation and Indium Droplet Related Emission Inhomogeneities in InGaN LEDs

abstract: This report classifies emission inhomogeneities that manifest in InGaN quantum well blue light-emitting diodes grown by plasma-assisted molecular beam epitaxy on free-standing GaN substrates. By a combination of spatially resolved electroluminescence and cathodoluminescence measurements, atomic force microscopy, scanning electron microscopy and hot wet KOH etching, the identified inhomogeneities are found to fall in four categories. Labeled here as type I through IV, they are distinguishable by their size, density, energy, intensity, radiative and electronic characteristics and chemical etch pits which correlates them with dislocations. Type I exhibits a blueshift of about 120 meV for the InGaN quantum well emission attributed to a perturbation of the active region, which is related to indium droplets that form on the surface in the metal-rich InGaN growth condition. Specifically, we attribute the blueshift to a decreased growth rate of and indium incorporation in the InGaN quantum wells underneath the droplet which is postulated to be the result of reduced incorporated N species due to increased N$_{2}$ formation. The location of droplets are correlated with mixed type dislocations for type I defects. Types II through IV are due to screw dislocations, edge dislocations, and dislocation bunching, respectively, and form dark spots due to leakage current and nonradiative recombination.


title: Some properties of rectangle and a random point

abstract: We establish a relationship between the two important central lines of the triangle, the Euler line and the Brocard axis, in a configuration with an arbitrary rectangle and a random point. The classical Cartesian coordinate system method shows its strength in these theorems. Along with that, some related problems on rectangles and a random point are proposed with similar solutions using Cartesian coordinate system.


title: DiGS : Divergence guided shape implicit neural representation for unoriented point clouds

abstract: Shape implicit neural representations (INRs) have recently shown to be effective in shape analysis and reconstruction tasks. Existing INRs require point coordinates to learn the implicit level sets of the shape. When a normal vector is available for each point, a higher fidelity representation can be learned, however normal vectors are often not provided as raw data. Furthermore, the method's initialization has been shown to play a crucial role for surface reconstruction. In this paper, we propose a divergence guided shape representation learning approach that does not require normal vectors as input. We show that incorporating a soft constraint on the divergence of the distance function favours smooth solutions that reliably orients gradients to match the unknown normal at each point, in some cases even better than approaches that use ground truth normal vectors directly. Additionally, we introduce a novel geometric initialization method for sinusoidal INRs that further improves convergence to the desired solution. We evaluate the effectiveness of our approach on the task of surface reconstruction and shape space learning and show SOTA performance compared to other unoriented methods. Code and model parameters available at our project page https://chumbyte.github.io/DiGS-Site/.


title: ToAlign: Task-oriented Alignment for Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptive classifcation intends to improve the classifcation performance on unlabeled target domain. To alleviate the adverse effect of domain shift, many approaches align the source and target domains in the feature space. However, a feature is usually taken as a whole for alignment without explicitly making domain alignment proactively serve the classifcation task, leading to sub-optimal solution. In this paper, we propose an effective Task-oriented Alignment (ToAlign) for unsupervised domain adaptation (UDA). We study what features should be aligned across domains and propose to make the domain alignment proactively serve classifcation by performing feature decomposition and alignment under the guidance of the prior knowledge induced from the classifcation task itself. Particularly, we explicitly decompose a feature in the source domain into a task-related/discriminative feature that should be aligned, and a task-irrelevant feature that should be avoided/ignored, based on the classifcation meta-knowledge. Extensive experimental results on various benchmarks (e.g., Offce-Home, Visda-2017, and DomainNet) under different domain adaptation settings demonstrate the effectiveness of ToAlign which helps achieve the state-of-the-art performance. The code is publicly available at https://github.com/microsoft/UDA


title: Quantum-Enhanced Heat Engine Based on Superabsorption

abstract: We propose a quantum-enhanced heat engine with entanglement. The key feature of our scheme is superabsorption, which facilitates enhanced energy absorption by entangled qubits. Whereas a conventional engine with $N$ separable qubits provides power with a scaling of $P = \Theta (N)$, our engine uses superabsorption to provide power with a quantum scaling of $P = \Theta(N^2)$. This quantum heat engine also exhibits a scaling advantage over classical ones composed of $N$-particle Langevin systems. Our work elucidates the quantum properties allowing for the enhancement of performance.


title: On Simple Mechanisms for Dependent Items

abstract: We study the problem of selling $n$ heterogeneous items to a single buyer, whose values for different items are dependent. Under arbitrary dependence, Hart and Nisan show that no simple mechanism can achieve a non-negligible fraction of the optimal revenue even with only two items. We consider the setting where the buyer's type is drawn from a correlated distribution that can be captured by a Markov Random Field, one of the most prominent frameworks for modeling high-dimensional distributions with structure. If the buyer's valuation is additive or unit-demand, we extend the result to all MRFs and show that max(SRev,BRev) can achieve an $\Omega\left(\frac{1}{e^{O(\Delta)}}\right)$-fraction of the optimal revenue, where $\Delta$ is a parameter of the MRF that is determined by how much the value of an item can be influenced by the values of the other items. We further show that the exponential dependence on $\Delta$ is unavoidable for our approach and a polynomial dependence on $\Delta$ is unavoidable for any approach. When the buyer has a XOS valuation, we show that max(Srev,Brev) achieves at least an $\Omega\left(\frac{1}{e^{O(\Delta)}+\frac{1}{\sqrt{n\gamma}}}\right)$-fraction of the optimal revenue, where $\gamma$ is the spectral gap of the Glauber dynamics of the MRF. Note that in the special case of independently distributed items, $\Delta=0$ and $\frac{1}{n\gamma}\leq 1$, and our results recover the known constant factor approximations for a XOS buyer. We further extend our parametric approximation to several other well-studied dependency measures such as the Dobrushin coefficient and the inverse temperature. Our results are based on the Duality-Framework by Cai et al. and a new concentration inequality for XOS functions over dependent random variables.


title: Structured Sparse R-CNN for Direct Scene Graph Generation

abstract: Scene graph generation (SGG) is to detect object pairs with their relations in an image. Existing SGG approaches often use multi-stage pipelines to decompose this task into object detection, relation graph construction, and dense or dense-to-sparse relation prediction. Instead, from a perspective on SGG as a direct set prediction, this paper presents a simple, sparse, and unified framework, termed as Structured Sparse R-CNN. The key to our method is a set of learnable triplet queries and a structured triplet detector which could be jointly optimized from the training set in an end-to-end manner. Specifically, the triplet queries encode the general prior for object pairs with their relations, and provide an initial guess of scene graphs for subsequent refinement. The triplet detector presents a cascaded architecture to progressively refine the detected scene graphs with the customized dynamic heads. In addition, to relieve the training difficulty of our method, we propose a relaxed and enhanced training strategy based on knowledge distillation from a Siamese Sparse R-CNN. We perform experiments on several datasets: Visual Genome and Open Images V4/V6, and the results demonstrate that our method achieves the state-of-the-art performance. In addition, we also perform in-depth ablation studies to provide insights on our structured modeling in triplet detector design and training strategies. The code and models are made available at https://github.com/MCG-NJU/Structured-Sparse-RCNN.


title: Out of Context: A New Clue for Context Modeling of Aspect-based Sentiment Analysis

abstract: Aspect-based sentiment analysis (ABSA) aims to predict the sentiment expressed in a review with respect to a given aspect. The core of ABSA is to model the interaction between the context and given aspect to extract the aspect-related information. In prior work, attention mechanisms and dependency graph networks are commonly adopted to capture the relations between the context and given aspect. And the weighted sum of context hidden states is used as the final representation fed to the classifier. However, the information related to the given aspect may be already discarded and adverse information may be retained in the context modeling processes of existing models. This problem cannot be solved by subsequent modules and there are two reasons: first, their operations are conducted on the encoder-generated context hidden states, whose value cannot change after the encoder; second, existing encoders only consider the context while not the given aspect. To address this problem, we argue the given aspect should be considered as a new clue out of context in the context modeling process. As for solutions, we design several aspect-aware context encoders based on different backbones: an aspect-aware LSTM and three aspect-aware BERTs. They are dedicated to generate aspect-aware hidden states which are tailored for ABSA task. In these aspect-aware context encoders, the semantics of the given aspect is used to regulate the information flow. Consequently, the aspect-related information can be retained and aspect-irrelevant information can be excluded in the generated hidden states. We conduct extensive experiments on several benchmark datasets with empirical analysis, demonstrating the efficacies and advantages of our proposed aspect-aware context encoders.


title: Analytical Gradient Theory for Resolvent-Fitted Second-Order Extended Multiconfiguration Perturbation Theory (XMCQDPT2)

abstract: We present the formulation and implementation of an analytical gradient algorithm for extended multiconfiguration quasidegenerate perturbation theory (XMCQDPT2) with the resolvent-fitting approximation by Granovsky. This algorithm is powerful when optimizing molecular configurations with a moderate-sized active space and many electronic states. First, we present the powerfulness and accuracy of resolvent-fitting approximations compared to the canonical XMCQDPT2 theory. Then, we demonstrate the utility of the current algorithm in frequency analyses, optimizing the minimum energy conical intersection (MECI) geometries of the retinal chromophore model RPSB6, and evaluating nuclear gradients when there are many electronic states. Furthermore, we parallelize the algorithm using the OpenMP/MPI hybrid approach. Additionally, we report the computational cost and parallel efficiency of the program.


title: $L^p$ regularity theory for even order elliptic systems with antisymmetric first order potentials

abstract: Motivated by a challenging expectation of Rivi\`ere (2011), in the recent interesting work of deLongueville-Gastel (2019), de Longueville and Gastel proposed the following geometrical even order elliptic system \begin{equation*} \Delta^{m}u=\sum_{l=0}^{m-1}\Delta^{l}\left\langle V_{l},du\right\rangle +\sum_{l=0}^{m-2}\Delta^{l}\delta\left(w_{l}du\right)\qquad \text{ in } B^{2m}\label{eq: Longue-Gastel system} \end{equation*} which includes polyharmonic mappings as special cases. Under minimal regularity assumptions on the coefficient functions and an additional algebraic antisymmetry assumption on the first order potential, they successfully established a conservation law for this system, from which everywhere continuity of weak solutions follows. This beautiful result amounts to a significant advance in the expectation of Rivi\`ere. In this paper, we seek for the optimal interior regularity of the above system, aiming at a more complete solution to the aforementioned expectation of Rivi\`ere. Combining their conservation law and some new ideas together, we obtain optimal H\"older continuity and sharp $L^p$ regularity theory, similar to that of Sharp and Topping \cite{Sharp-Topping-2013-TAMS}, for weak solutions to a related inhomogeneous system. Our results can be applied to study heat flow and bubbling analysis for polyharmonic mappings.


title: QUBO formulations for numerical quantum computing

abstract: With the advent of quantum computers, many quantum computing algorithms are being developed. Solving linear systems is one of the most fundamental problems in almost all science and engineering. The Harrow-Hassidim-Lloyd algorithm, a monumental quantum algorithm for solving linear systems on gate model quantum computers, was invented and several advanced variations have been developed. For a given n by n matrix A and a vector b, we will find unconstrained binary optimization (QUBO) models for a vector x that satisfies Ax=b. To formulate QUBO models for a linear system solving problem, we make use of a linear least-square problem with binary representation of the solution. We validate those QUBO models on the D-Wave system and discuss the results. For a simple system, we provide a Python code to calculate the matrix characterizing the relationship between the variables and to print the test code that can be used directly in the D-Wave system.


title: Stateful ODE-Nets using Basis Function Expansions

abstract: The recently-introduced class of ordinary differential equation networks (ODE-Nets) establishes a fruitful connection between deep learning and dynamical systems. In this work, we reconsider formulations of the weights as continuous-in-depth functions using linear combinations of basis functions which enables us to leverage parameter transformations such as function projections. In turn, this view allows us to formulate a novel stateful ODE-Block that handles stateful layers. The benefits of this new ODE-Block are twofold: first, it enables incorporating meaningful continuous-in-depth batch normalization layers to achieve state-of-the-art performance; second, it enables compressing the weights through a change of basis, without retraining, while maintaining near state-of-the-art performance and reducing both inference time and memory footprint. Performance is demonstrated by applying our stateful ODE-Block to (a) image classification tasks using convolutional units and (b) sentence-tagging tasks using transformer encoder units.


title: Demonstration of Panda: A Weakly Supervised Entity Matching System

abstract: Entity matching (EM) refers to the problem of identifying tuple pairs in one or more relations that refer to the same real world entities. Supervised machine learning (ML) approaches, and deep learning based approaches in particular, typically achieve state-of-the-art matching results. However, these approaches require many labeled examples, in the form of matching and non-matching pairs, which are expensive and time-consuming to label. In this paper, we introduce Panda, a weakly supervised system specifically designed for EM. Panda uses the same labeling function abstraction as Snorkel, where labeling functions (LF) are user-provided programs that can generate large amounts of (somewhat noisy) labels quickly and cheaply, which can then be combined via a labeling model to generate accurate final predictions. To support users developing LFs for EM, Panda provides an integrated development environment (IDE) that lives in a modern browser architecture. Panda's IDE facilitates the development, debugging, and life-cycle management of LFs in the context of EM tasks, similar to how IDEs such as Visual Studio or Eclipse excel in general-purpose programming. Panda's IDE includes many novel features purpose-built for EM, such as smart data sampling, a builtin library of EM utility functions, automatically generated LFs, visual debugging of LFs, and finally, an EM-specific labeling model. We show in this demo that Panda IDE can greatly accelerate the development of high-quality EM solutions using weak supervision.


title: BCJ Amplitude Relations for Anti-de Sitter Boundary Correlators in Embedding Space

abstract: We generalize the color/kinematics duality of flat-space scattering amplitudes to the embedding space formulation of AdS boundary correlators. Kinematic numerators and propagators are replaced with differential operators acting on a scalar contact diagram that is the AdS generalization of the momentum conserving delta function of flat space scattering amplitudes. We show that color/kinematics duality implies differential relations among AdS boundary correlators that naturally generalize the flat space BCJ amplitude relations and verify them for the correlators of Yang-Mills theory and of the Nonlinear Sigma Model through four- and six-points, respectively. For the latter we also find representations of the four- and six-point correlator that manifest the duality. Possible double-copy procedures in AdS space are also discussed.


title: 3D Object Detection for Autonomous Driving: A Survey

abstract: Autonomous driving is regarded as one of the most promising remedies to shield human beings from severe crashes. To this end, 3D object detection serves as the core basis of perception stack especially for the sake of path planning, motion prediction, and collision avoidance etc. Taking a quick glance at the progress we have made, we attribute challenges to visual appearance recovery in the absence of depth information from images, representation learning from partially occluded unstructured point clouds, and semantic alignments over heterogeneous features from cross modalities. Despite existing efforts, 3D object detection for autonomous driving is still in its infancy. Recently, a large body of literature have been investigated to address this 3D vision task. Nevertheless, few investigations have looked into collecting and structuring this growing knowledge. We therefore aim to fill this gap in a comprehensive survey, encompassing all the main concerns including sensors, datasets, performance metrics and the recent state-of-the-art detection methods, together with their pros and cons. Furthermore, we provide quantitative comparisons with the state of the art. A case study on fifteen selected representative methods is presented, involved with runtime analysis, error analysis, and robustness analysis. Finally, we provide concluding remarks after an in-depth analysis of the surveyed works and identify promising directions for future work.


title: A flat band-induced correlated kagome metal

abstract: The notion of an electronic flat band refers to a collectively degenerate set of quantum mechanical eigenstates in periodic solids. The vanishing kinetic energy of flat bands relative to the electron-electron interaction is expected to result in a variety of many-body quantum phases of matter. Despite intense theoretical interest, systematic design and experimental realization of such flat band-driven correlated states in natural crystals have remained a challenge. Here we report the realization of a partially filled flat band in a new single crystalline kagome metal Ni$_3$In. This flat band is found to arise from the Ni $3d$-orbital wave functions localized at triangular motifs within the kagome lattice plane, where an underlying destructive interference among hopping paths flattens the dispersion. We observe unusual metallic and thermodynamic responses suggestive of the presence of local fluctuating magnetic moments originating from the flat band states, which together with non-Fermi liquid behavior indicate proximity to quantum criticality. These results demonstrate a lattice and orbital engineering approach to designing flat band-based many-body phenomena that may be applied to integrate correlation with topology and as a novel means to construct quantum criticality.


title: Reflecting brownian motion and the gauss-bonnet-chern theorem

abstract: We use reflecting Brownian motion (RBM) to prove the well known Gauss-Bonnet-Chern theorem for a compact Riemannian manifold with boundary. The boundary integrand is obtained by carefully analyzing the asymptotic behavior of the boundary local time of RBM for small times.


title: Does Robustness Improve Fairness? Approaching Fairness with Word Substitution Robustness Methods for Text Classification

abstract: Existing bias mitigation methods to reduce disparities in model outcomes across cohorts have focused on data augmentation, debiasing model embeddings, or adding fairness-based optimization objectives during training. Separately, certified word substitution robustness methods have been developed to decrease the impact of spurious features and synonym substitutions on model predictions. While their end goals are different, they both aim to encourage models to make the same prediction for certain changes in the input. In this paper, we investigate the utility of certified word substitution robustness methods to improve equality of odds and equality of opportunity on multiple text classification tasks. We observe that certified robustness methods improve fairness, and using both robustness and bias mitigation methods in training results in an improvement in both fronts


title: nonlocal quark condensate from Dyson-Schwinger Equation and its contributions to the gluon vacuum polarization based on OPE approach

abstract: The operator-product expansion(OPE) could be employed to obtain the lowest-order, nonlocal quark scalar condensate component of gluon vacuum polarization. In particular, nonlocal quark scalar condensate can be calculated by solving Dyson-Schwinger Equation(DSE) of QCD. Then, field-theoretic aspects of the gluon vacuum polarization and nonperturbative gluon propagator will be considered in the Landau gauge of the Lorentz gauge fixing. The gluon propagator we obtained is finite in the infrared domain where the single gluon mass $m_g$ can be determined. Our results of the ratio $m_{g}/\Lambda_{QCD}$ the range of that from 1.33 to 1.39 agree with previous determinations for this ratio. Besides, the analytic structure of the gluon propagators from the OPE's result is explored. Our numerical analysis of the gluon' Schwinger function finds clear evidence of the positivity violations in the gluon propagator. In addition, a new method for obtaining the chemical potential dependence of the gluon vacuum polarization and the dressed gluon propagator is developed.


title: Controllable Context-aware Conversational Speech Synthesis

abstract: In spoken conversations, spontaneous behaviors like filled pause and prolongations always happen. Conversational partner tends to align features of their speech with their interlocutor which is known as entrainment. To produce human-like conversations, we propose a unified controllable spontaneous conversational speech synthesis framework to model the above two phenomena. Specifically, we use explicit labels to represent two typical spontaneous behaviors filled-pause and prolongation in the acoustic model and develop a neural network based predictor to predict the occurrences of the two behaviors from text. We subsequently develop an algorithm based on the predictor to control the occurrence frequency of the behaviors, making the synthesized speech vary from less disfluent to more disfluent. To model the speech entrainment at acoustic level, we utilize a context acoustic encoder to extract a global style embedding from the previous speech conditioning on the synthesizing of current speech. Furthermore, since the current and previous utterances belong to the different speakers in a conversation, we add a domain adversarial training module to eliminate the speaker-related information in the acoustic encoder while maintaining the style-related information. Experiments show that our proposed approach can synthesize realistic conversations and control the occurrences of the spontaneous behaviors naturally.


title: Two-Stream Consensus Network: Submission to HACS Challenge 2021 Weakly-Supervised Learning Track

abstract: This technical report presents our solution to the HACS Temporal Action Localization Challenge 2021, Weakly-Supervised Learning Track. The goal of weakly-supervised temporal action localization is to temporally locate and classify action of interest in untrimmed videos given only video-level labels. We adopt the two-stream consensus network (TSCN) as the main framework in this challenge. The TSCN consists of a two-stream base model training procedure and a pseudo ground truth learning procedure. The base model training encourages the model to predict reliable predictions based on single modality (i.e., RGB or optical flow), based on the fusion of which a pseudo ground truth is generated and in turn used as supervision to train the base models. On the HACS v1.1.1 dataset, without fine-tuning the feature-extraction I3D models, our method achieves 22.20% on the validation set and 21.68% on the testing set in terms of average mAP. Our solution ranked the 2nd in this challenge, and we hope our method can serve as a baseline for future academic research.


title: Global boundedness of solutions to a parabolic-parabolic chemotaxis system with local sensing in higher dimensions

abstract: This paper deals with classical solutions to the parabolic-parabolic system \begin{align*} \begin{cases} u_t=\Delta (\gamma (v) u ) &\mathrm{in}\ \Omega\times(0,\infty), \\[1mm] v_t=\Delta v - v + u &\mathrm{in}\ \Omega\times(0,\infty), \\[1mm] \displaystyle \frac{\partial u}{\partial \nu} = \frac{\partial v}{\partial \nu} = 0 &\mathrm{on}\ \partial\Omega \times (0,\infty), \\[1mm] u(\cdot,0)=u_0, \ v(\cdot,0)=v_0 &\mathrm{in}\ \Omega, \end{cases} \end{align*} where $\Omega$ is a smooth bounded domain in $\mathbf{R}^n$($n \geq 3$), $\gamma (v)=v^{-k}$ ($k>0$) and the initial data $(u_0,v_0)$ is positive and regular. This system has striking features similar to those of the logarithmic Keller--Segel system. It is established that classical solutions of the system exist globally in time and remain uniformly bounded in time if $k \in (0,n/(n-2))$, independently the magnitude of mass. This constant $n/(n-2)$ is conjectured as the optimal range guaranteeing global existence and boundedness in the corresponding logarithmic Keller--Segel system. We will derive sufficient estimates for solutions through some single evolution equation that some auxiliary function satisfies. The cornerstone of the analysis is the refined comparison estimate for solutions, which enables us to control the nonlinearity of the auxiliary equation.


title: Glow-WaveGAN: Learning Speech Representations from GAN-based Variational Auto-Encoder For High Fidelity Flow-based Speech Synthesis

abstract: Current two-stage TTS framework typically integrates an acoustic model with a vocoder -- the acoustic model predicts a low resolution intermediate representation such as Mel-spectrum while the vocoder generates waveform from the intermediate representation. Although the intermediate representation is served as a bridge, there still exists critical mismatch between the acoustic model and the vocoder as they are commonly separately learned and work on different distributions of representation, leading to inevitable artifacts in the synthesized speech. In this work, different from using pre-designed intermediate representation in most previous studies, we propose to use VAE combining with GAN to learn a latent representation directly from speech and then utilize a flow-based acoustic model to model the distribution of the latent representation from text. In this way, the mismatch problem is migrated as the two stages work on the same distribution. Results demonstrate that the flow-based acoustic model can exactly model the distribution of our learned speech representation and the proposed TTS framework, namely Glow-WaveGAN, can produce high fidelity speech outperforming the state-of-the-art GAN-based model.


title: Online Handbook of Argumentation for AI: Volume 2

abstract: This volume contains revised versions of the papers selected for the second volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for researchers interested in symbolic representations of knowledge and defeasible reasoning. The purpose of this handbook is to provide an open access and curated anthology for the argumentation research community. OHAAI is designed to serve as a research hub to keep track of the latest and upcoming PhD-driven research on the theory and application of argumentation in all areas related to AI.


title: Triviality results for quasi $k$-Yamabe solitons

abstract: In this paper, we show that any compact quasi $k$-Yamabe gradient solitons must have constant $\sigma_{k}$-curvature. Moreover, we provide a certain condition for a compact quasi $k$-Yamabe soliton to be gradient, and for noncompact solitons, we present a geometric rigidity under a decaiment condition on the norm of the soliton field.


title: Interpretable Face Manipulation Detection via Feature Whitening

abstract: Why should we trust the detections of deep neural networks for manipulated faces? Understanding the reasons is important for users in improving the fairness, reliability, privacy and trust of the detection models. In this work, we propose an interpretable face manipulation detection approach to achieve the trustworthy and accurate inference. The approach could make the face manipulation detection process transparent by embedding the feature whitening module. This module aims to whiten the internal working mechanism of deep networks through feature decorrelation and feature constraint. The experimental results demonstrate that our proposed approach can strike a balance between the detection accuracy and the model interpretability.


title: Empower Distantly Supervised Relation Extraction with Collaborative Adversarial Training

abstract: With recent advances in distantly supervised (DS) relation extraction (RE), considerable attention is attracted to leverage multi-instance learning (MIL) to distill high-quality supervision from the noisy DS. Here, we go beyond label noise and identify the key bottleneck of DS-MIL to be its low data utilization: as high-quality supervision being refined by MIL, MIL abandons a large amount of training instances, which leads to a low data utilization and hinders model training from having abundant supervision. In this paper, we propose collaborative adversarial training to improve the data utilization, which coordinates virtual adversarial training (VAT) and adversarial training (AT) at different levels. Specifically, since VAT is label-free, we employ the instance-level VAT to recycle instances abandoned by MIL. Besides, we deploy AT at the bag-level to unleash the full potential of the high-quality supervision got by MIL. Our proposed method brings consistent improvements (~ 5 absolute AUC score) to the previous state of the art, which verifies the importance of the data utilization issue and the effectiveness of our method.


title: Active Learning for Deep Neural Networks on Edge Devices

abstract: When dealing with deep neural network (DNN) applications on edge devices, continuously updating the model is important. Although updating a model with real incoming data is ideal, using all of them is not always feasible due to limits, such as labeling and communication costs. Thus, it is necessary to filter and select the data to use for training (i.e., active learning) on the device. In this paper, we formalize a practical active learning problem for DNNs on edge devices and propose a general task-agnostic framework to tackle this problem, which reduces it to a stream submodular maximization. This framework is light enough to be run with low computational resources, yet provides solutions whose quality is theoretically guaranteed thanks to the submodular property. Through this framework, we can configure data selection criteria flexibly, including using methods proposed in previous active learning studies. We evaluate our approach on both classification and object detection tasks in a practical setting to simulate a real-life scenario. The results of our study show that the proposed framework outperforms all other methods in both tasks, while running at a practical speed on real devices.


title: Electrochemical control of ferroelectricity in hafnia-based ferroelectric devices using reversible oxygen migration

abstract: Ferroelectricity, especially in hafnia-based thin films at nanosizes, has been rejuvenated in the fields of low-power, nonvolatile and Si-compatible modern memory and logic applications. Despite tremendous efforts to explore the formation of the metastable ferroelectric phase and the polarization degradation during field cycling, the ability of oxygen vacancy to exactly engineer and switch polarization remains to be elucidated. Here we report reversibly electrochemical control of ferroelectricity in Hf$_{0.5}$Zr$_{0.5}$O$_2$ (HZO) heterostructures with a mixed ionic-electronic LaSrMnO$_3$ electrode, achieving a hard breakdown field more than 18 MV/cm, over fourfold as high as that of typical HZO. The electrical extraction and insertion of oxygen into HZO is macroscopically characterized and atomically imaged in situ. Utilizing this reversible process, we achieved multiple polarization states and even repeatedly repaired the damaged ferroelectricity by reversed negative electric fields. Our study demonstrates the robust and switchable ferroelectricity in hafnia oxide distinctly associated with oxygen vacancy and opens up opportunities to recover, manipulate, and utilize rich ferroelectric functionalities for advanced ferroelectric functionality to empower the existing Si-based electronics such as multi-bit storage.


title: TeV-scale Lepton Number Violation: Connecting Leptogenesis, Neutrinoless Double Beta Decay, and Colliders

abstract: In the context of TeV-scale lepton number violating (LNV) interactions, we illustrate the interplay between leptogenesis, neutrinoless double beta ($0\nu\beta\beta$) decay, and LNV searches at proton-proton colliders. Using a concrete model for illustration, we identify the parameter space where standard thermal leptogenesis is rendered unviable due to washout processes and show how $0\nu\beta\beta$ decay and $pp$ collisions provide complementary probes. We find that the new particle spectrum can have a decisive impact on the relative sensitivity of these two probes.


title: On The Finiteness of 6d Supergravity Landscape

abstract: We consider supergravity theories with 8 supercharges in $d=6$. We show that all the proposed anomaly free theories with unbounded number of massless modes are restricted to a finite subset and thus argue that there is an upper bound on the number of massless modes, consistent with the String Lamppost Principle.


title: Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling

abstract: Multi-head attention has each of the attention heads collect salient information from different parts of an input sequence, making it a powerful mechanism for sequence modeling. Multilingual and multi-domain learning are common scenarios for sequence modeling, where the key challenge is to maximize positive transfer and mitigate negative transfer across languages and domains. In this paper, we find that non-selective attention sharing is sub-optimal for achieving good generalization across all languages and domains. We further propose attention sharing strategies to facilitate parameter sharing and specialization in multilingual and multi-domain sequence modeling. Our approach automatically learns shared and specialized attention heads for different languages and domains to mitigate their interference. Evaluated in various tasks including speech recognition, text-to-text and speech-to-text translation, the proposed attention sharing strategies consistently bring gains to sequence models built upon multi-head attention. For speech-to-text translation, our approach yields an average of $+2.0$ BLEU over $13$ language directions in multilingual setting and $+2.0$ BLEU over $3$ domains in multi-domain setting.


title: Entitled to Property: How Breaking the Gender Barrier Improves Child Health in India

abstract: Non-unitary household models suggest that enhancing women's bargaining power can influence child health, a crucial determinant of human capital and economic standing throughout adulthood. We examine the effects of a policy shift, the Hindu Succession Act Amendment (HSAA), which granted inheritance rights to unmarried women in India, on child health. Our findings indicate that the HSAA improved children's height and weight. Furthermore, we uncover evidence supporting a mechanism whereby the policy bolstered women's intra-household bargaining power, resulting in downstream benefits through enhanced parental care for children and improved child health. These results emphasize that children fare better when mothers control a larger share of family resources. Policies empowering women can yield additional positive externalities for children's human capital.


title: On the modularity of solutions of certain differential equations of hypergeometric type

abstract: The purpose of this paper is to provide answers to some questions raised in a paper by Kaneko and Koike about the modularity of the solutions of a differential equations of hypergeometric type. In particular, we provide a number-theoretic explanation of why the modularity of the solutions occurs in some cases and does not occur in other cases. This also proves their conjecture on the completeness of the list of modular solutions after adding some missing cases.


title: The peak-and-end rule and differential equations with maxima: a view on the unpredictability of happiness

abstract: In the 1990s, after a series of experiments, the behavioral psychologist and economist Daniel Kahneman and his colleagues formulated the following Peak-End evaluation rule: "The remembered utility of pleasant or unpleasant episodes is accurately predicted by averaging the Peak (most intense value) of instant utility (or disutility) recorded during an episode and the instant utility recorded near the end of the experience", (D. Kahneman et al., 1997, QJE, p. 381). Hence, the simplest mathematical model for time evolution of the experienced utility function $u=u(t)$ can be given by the scalar differential equation $u'(t)=a u(t) + b \max \{u(s) : s\in [t-h,t]\}+f(t) \ (*),$ where $f$ represents exogenous stimuli, $h$ is the maximal duration of the experience, and $a, b \in \mathbb R$ are some averaging weights. In this work, we study equation $(*)$ and show that, for a range of parameters $a, b, h$ and a periodic sine-like term $f$, the dynamics of $(*)$ can be completely described in terms of an associated one-dimensional dynamical system generated by a piece-wise continuous map from a finite interval into itself. We illustrate our approach with two examples. In particular, we show that the hedonic utility $u(t)$ (`happiness') can exhibit chaotic behavior.


title: Output, Employment, and Price Effects of U.S. Narrative Tax Changes: A Factor-Augmented Vector Autoregression Approach

abstract: This paper examines the short- and long-run effects of U.S. federal personal income and corporate income tax cuts on a wide array of economic policy variables in a data-rich environment. Using a panel of U.S. macroeconomic data set, made up of 132 quarterly macroeconomic series for 1959-2018, the study estimates factor-augmented vector autoregression (FAVARs) models where an extended narrative tax changes dataset combined with unobserved factors. The narrative approach classifies if tax changes are exogenous or endogenous. This paper identifies narrative tax shocks in the vector autoregression model using the sign restrictions with Uhlig's (2005) penalty function. Empirical findings show a significant expansionary effect of tax cuts on the macroeconomic variables. Cuts in personal and corporate income taxes cause a rise in output, investment, employment, and consumption; however, cuts in personal taxes appear to be a more effective fiscal policy tool than the cut in corporate income taxes. Real GDP, employment, investment, and industrial production increase significantly and reach their maximum response values two years after personal income tax cuts. The effects of corporate tax cuts have relatively smaller effects on output and consumption but show immediate and higher effects on fixed investment and price levels.


title: Electronic properties of bilayer graphene with magnetic quantum structures studied using the Dirac equation

abstract: The electronic properties of bilayer graphene with a magnetic quantum dot and a magnetic quantum ring are investigated. The eigenenergies and wavefunctions of quasiparticle states are calculated analytically by solving decoupled fourth-order differential equations. For the magnetic quantum dot, in the case of a negative inner magnetic field, two peculiar characteristics of the eigenenergy evolution are found: (i) the energy eigenstates change in a stepwise manner owing to energy anticrossing and (ii) the quantum states approach zero energy. For the magnetic quantum ring, there is an angular momentum transition of eigenenergy as the inner radius of the ring varies, and the Aharonov--Bohm effect is observed in the eigenenergy spectra for both positive and negative magnetic fields inside the inner radius.


title: Trainable Class Prototypes for Few-Shot Learning

abstract: Metric learning is a widely used method for few shot learning in which the quality of prototypes plays a key role in the algorithm. In this paper we propose the trainable prototypes for distance measure instead of the artificial ones within the meta-training and task-training framework. Also to avoid the disadvantages that the episodic meta-training brought, we adopt non-episodic meta-training based on self-supervised learning. Overall we solve the few-shot tasks in two phases: meta-training a transferable feature extractor via self-supervised learning and training the prototypes for metric classification. In addition, the simple attention mechanism is used in both meta-training and task-training. Our method achieves state-of-the-art performance in a variety of established few-shot tasks on the standard few-shot visual classification dataset, with about 20% increase compared to the available unsupervised few-shot learning methods.


title: Accessing Topological Fluctuations of Gauge Fields with Chiral Magnetic Effect

abstract: Gauge fields provide the fundamental interactions in the Standard Model of particle physics. Gauge field configurations with nontrivial topological windings are known to play crucial roles in many important phenomena, from matter-anti-matter asymmetry of today's universe to spontaneous chiral symmetry breaking in strong interaction. Their presence is however elusive for direct detection in experiments. Here we show that measurements of the chiral magnetic effect (CME) in heavy ion collisions can be used for accessing the topological fluctuations of the non-Abelian gauge fields in the Quantum Chromodynamics (QCD). To achieve this, we implemented a key ingredient, the stochastic dynamics of gauge field topological fluctuations, into a state-of-the-art framework for simulating the CME in these collisions. This new framework provides the necessary tool to quantify initial topological fluctuations from any definitive CME signal to be extracted from experimental data. It also reveals a universal scaling relation between initial topological fluctuations and particle multiplicity produced in the corresponding collision events.


title: Nonlinear Hall response in the driving dynamics of ultracold atoms in optical lattices

abstract: We propose that a nonlinear Hall response can be observed in Bloch oscillations of ultracold atoms in optical lattices under the condition of preserved time-reversal symmetry. In the short-time limit of Bloch oscillations driven by a direct current (dc) field, the nonlinear Hall current dominates, being a second-order response to the external field strength. The associated Berry curvature dipole, which is a second-order nonlinear coefficient of the driving field, can be obtained from the oscillation of atoms. In an alternating current (ac) driving field, the nonlinear Hall response has a double frequency of the driving force in the case of time-reversal symmetry.


title: Deep learning based surrogate model for first-principles global simulations of fusion plasmas

abstract: The accurate identification and control of plasma instabilities is important for successful fusion experiments. First-principles simulations which can provide physics based instability information including the growth rate and mode structure are generally not fast enough for real-time applications. In this work, a deep-learning based surrogate model as an instability simulator has been developed and trained in a supervised manner with data from the gyrokinetic toroidal code (GTC) global electromagnetic simulations of the current driven kink instabilities in DIII-D plasmas. The inference time of the surrogate model of GTC (SGTC) is on the order of milliseconds, which fits the requirement of the DIII-D real-time plasma control system (PCS). SGTC demonstrates strong predictive capabilities for the kink mode instability properties including the growth rate and mode structure.


title: Robust Pooling through the Data Mode

abstract: The task of learning from point cloud data is always challenging due to the often occurrence of noise and outliers in the data. Such data inaccuracies can significantly influence the performance of state-of-the-art deep learning networks and their ability to classify or segment objects. While there are some robust deep learning approaches, they are computationally too expensive for real-time applications. This paper proposes a deep learning solution that includes a novel robust pooling layer which greatly enhances network robustness and performs significantly faster than state-of-the-art approaches. The proposed pooling layer looks for data a mode/cluster using two methods, RANSAC, and histogram, as clusters are indicative of models. We tested the pooling layer into frameworks such as Point-based and graph-based neural networks, and the tests showed enhanced robustness as compared to robust state-of-the-art methods.


title: Witten-type topological field theory of self-organized criticality for stochastic neural networks

abstract: We study the Witten-type topological field theory(W-TFT) of self-organized criticality(SOC) for stochastic neural networks. The Parisi-Sourlas-Wu quantization of general stochastic differential equations (SDEs) for neural networks, the Becchi-Rouet-Stora-Tyutin(BRST)-symmetry of the diffusion system and the relation between spontaneous breaking and instantons connecting steady states of the SDEs, as well as the sufficient and necessary condition on pseudo-supersymmetric stochastic neural networks are obtained. Suppose neuronal avalanche is a mechanism of cortical information processing and storage \cite{Beggs}\cite{Plenz1}\cite{Plenz2} and the model of stochastic neural networks\cite{Dayan} is correct, as well as the SOC system can be looked upon as a W-TFT with spontaneously broken BRST symmetry. Then we should recover the neuronal avalanches and spontaneously broken BRST symmetry from the model of stochastic neural networks. We find that, provided the divergence of drift coefficients is small and non-constant, the model of stochastic neural networks is BRST symmetric. That is, if the SOC of brain neural networks system can be looked upon as a W-TFT with spontaneously broken BRST symmetry, then the general model of stochastic neural networks which be extensively used in neuroscience \cite{Dayan} is not enough to describe the SOC. On the other hand, using the Fokker-Planck equation, we show the sufficient condition on diffusion so that there exists a steady state probability distribution for the stochastic neural networks. Rhythms of the firing rates of the neuronal networks arise from the process, meanwhile some biological laws are conserved.


title: CUDA-GHR: Controllable Unsupervised Domain Adaptation for Gaze and Head Redirection

abstract: The robustness of gaze and head pose estimation models is highly dependent on the amount of labeled data. Recently, generative modeling has shown excellent results in generating photo-realistic images, which can alleviate the need for annotations. However, adopting such generative models to new domains while maintaining their ability to provide fine-grained control over different image attributes, \eg, gaze and head pose directions, has been a challenging problem. This paper proposes CUDA-GHR, an unsupervised domain adaptation framework that enables fine-grained control over gaze and head pose directions while preserving the appearance-related factors of the person. Our framework simultaneously learns to adapt to new domains and disentangle visual attributes such as appearance, gaze direction, and head orientation by utilizing a label-rich source domain and an unlabeled target domain. Extensive experiments on the benchmarking datasets show that the proposed method can outperform state-of-the-art techniques on both quantitative and qualitative evaluations. Furthermore, we demonstrate the effectiveness of generated image-label pairs in the target domain for pretraining networks for the downstream task of gaze and head pose estimation. The source code and pre-trained models are available at https://github.com/jswati31/cuda-ghr.


title: On the Importance of Environments in Human-Robot Coordination

abstract: When studying robots collaborating with humans, much of the focus has been on robot policies that coordinate fluently with human teammates in collaborative tasks. However, less emphasis has been placed on the effect of the environment on coordination behaviors. To thoroughly explore environments that result in diverse behaviors, we propose a framework for procedural generation of environments that are (1) stylistically similar to human-authored environments, (2) guaranteed to be solvable by the human-robot team, and (3) diverse with respect to coordination measures. We analyze the procedurally generated environments in the Overcooked benchmark domain via simulation and an online user study. Results show that the environments result in qualitatively different emerging behaviors and statistically significant differences in collaborative fluency metrics, even when the robot runs the same planning algorithm.


title: Catastrophic Cooling in Superwinds. II. Exploring the Parameter Space

abstract: Superwinds and superbubbles driven by mechanical feedback from super star clusters (SSCs) are common features in many star-forming galaxies. While the adiabatic fluid model can well describe the dynamics of superwinds, several observations of starburst galaxies revealed the presence of compact regions with suppressed superwinds and strongly radiative cooling, i.e., catastrophic cooling. In the present study, we employ the non-equilibrium atomic chemistry and cooling package MAIHEM, built on the FLASH hydrodynamics code, to generate a grid of models investigating the dependence of cooling modes on the metallicity, SSC outflow parameters, and ambient density. While gas metallicity plays a substantial role, catastrophic cooling is more sensitive to high mass-loading and reduced kinetic heating efficiency. Our hydrodynamic simulations indicate that the presence of a hot superbubble does not necessarily imply an adiabatic outflow, and vice versa. Using CLOUDY photoionization models, we predict UV and optical line emission for both adiabatic and catastrophic cooling outflows, for radiation-bounded and partially density-bounded models. Although the line ratios predicted by our radiation-bounded models agree well with observations of star-forming galaxies, they do not provide diagnostics that unambiguously distinguish the parameter space of catastrophically cooling flows. Comparison with observations suggests the possibility of minor density bounding, non-equilibrium ionization, and/or observational bias toward the central outflow regions.


title: CIL: Contrastive Instance Learning Framework for Distantly Supervised Relation Extraction

abstract: The journey of reducing noise from distant supervision (DS) generated training data has been started since the DS was first introduced into the relation extraction (RE) task. For the past decade, researchers apply the multi-instance learning (MIL) framework to find the most reliable feature from a bag of sentences. Although the pattern of MIL bags can greatly reduce DS noise, it fails to represent many other useful sentence features in the datasets. In many cases, these sentence features can only be acquired by extra sentence-level human annotation with heavy costs. Therefore, the performance of distantly supervised RE models is bounded. In this paper, we go beyond typical MIL framework and propose a novel contrastive instance learning (CIL) framework. Specifically, we regard the initial MIL as the relational triple encoder and constraint positive pairs against negative pairs for each instance. Experiments demonstrate the effectiveness of our proposed framework, with significant improvements over the previous methods on NYT10, GDS and KBP.


title: Multiple positive solutions for degenerate Kirchhoff equations with singular and Choquard nonlinearity

abstract: In this paper we study the existence, multiplicity and regularity of positive weak solutions for the following Kirchhoff-Choquard problem: \begin{equation*} \begin{array}{cc} \displaystyle M\left( \iint\limits_{\mathbb{R}^{2N}} \frac{|u(x)-u(y)|^2}{|x-y|^{N+2s}}\,dxdy\right) (-\Delta)^s u = \frac{\lambda}{u^\gamma} + \left( \int\limits_{\Omega} \frac{|u(y)|^{2^{*}_{\mu ,s}}}{|x-y|^ \mu}\, dy\right) |u|^{2^{*}_{\mu ,s}-2}u \;\text{in} \; \Omega, %\quad \quad u > 0\quad \text{in} \; \Omega, \quad \quad u = 0\quad \text{in} \; \mathbb{R}^{N}\backslash\Omega, \end{array} \end{equation*} where $\Omega$ is open bounded domain of $\mathbb{R}^{N}$ with $C^2$ boundary, $N > 2s$ and $s \in (0,1)$. $M$ models Kirchhoff-type coefficient in particular, the degenerate case where Kirchhoff coefficient M is zero at zero. $(-\Delta)^s$ is fractional Laplace operator, $\lambda > 0$ is a real parameter, $\gamma \in (0,1)$ and $2^{*}_{\mu ,s} = \frac{2N-\mu}{N-2s}$ is the critical exponent in the sense of Hardy-Littlewood-Sobolev inequality. We prove that each positive weak solution is bounded and satisfy H\"older regularity of order $s$. Furthermore, using the variational methods and truncation arguments we prove the existence of two positive solutions.


title: Single pixel wide gamut dynamic color modulation based on graphene micromechanical system

abstract: Dynamic color modulation in the composite structure of graphene microelectromechanical systems (MEMS)- photonic crystal microcavity is investigated in this work. The designed photonic crystal microcavity has three resonant standing wave modes corresponding to the three primary colors of red (R), green (G) and blue (B), forming strong localization of light in three modes at different positions of the microcavity. Once graphene is added, it can govern the transmittance of three modes. When graphene is located in the abdomen of the standing wave, which has strong light absorption and therefore the structure's transmittance is lower, or when graphene is located in the node of the standing wave, it has weak light absorption and therefore the structure's transmittance is higher. Therefore, the graphene absorption of different colors of light can be regulated dynamically by applying voltages to tune the equilibrium position of the graphene MEMS in the microcavity, consequently realizing the output of vivid monochromatic light or multiple mixed colors of light within a single pixel, thus greatly improving the resolution. Our work provides a route to dynamic color modulation with graphene and provides guidance for the design and manufacture of ultrahigh resolution, ultrafast modulation and wide color gamut interferometric modulator displays.


title: Single-shot measurement of a Rydberg superatom via collective photon burst

abstract: With Rydberg dipole interactions, a mesoscopic atomic ensemble may behave like a two-level single atom, resulting in the so-called picture of superatom. It is in potential a strong candidate as a qubit in quantum information science, especially for efficient coupling with single photons via collective enhancement that is essential for building quantum internet to connect remote quantum computers. Previously, preliminary studies have been carried out in demonstrating basic concept of Rydberg superatom, a single-photon source, and entanglement with a single photon, etc. While a crucial element of single-shot qubit measurement is still missing. Here we realize the deterministic measurement of a superatom qubit via photon burst in a single shot. We make use of a low-finesse ring cavity to enhance the atom-photon interaction and obtain an in-fiber retrieval efficiency of 44%. Harnessing dipole interaction between two Rydberg levels, we may either create a sequence of multiple single photons or nothing, conditioned on the initial qubit state. We achieve a single-shot measurement fidelity of 93.2% in 4.8 us. Our work complements the experimental toolbox of harnessing Rydberg superatom for quantum information applications.


title: Moving in a 360 World: Synthesizing Panoramic Parallaxes from a Single Panorama

abstract: We present Omnidirectional Neural Radiance Fields (OmniNeRF), the first method to the application of parallax-enabled novel panoramic view synthesis. Recent works for novel view synthesis focus on perspective images with limited field-of-view and require sufficient pictures captured in a specific condition. Conversely, OmniNeRF can generate panorama images for unknown viewpoints given a single equirectangular image as training data. To this end, we propose to augment the single RGB-D panorama by projecting back and forth between a 3D world and different 2D panoramic coordinates at different virtual camera positions. By doing so, we are able to optimize an Omnidirectional Neural Radiance Field with visible pixels collecting from omnidirectional viewing angles at a fixed center for the estimation of new viewing angles from varying camera positions. As a result, the proposed OmniNeRF achieves convincing renderings of novel panoramic views that exhibit the parallax effect. We showcase the effectiveness of each of our proposals on both synthetic and real-world datasets.


title: Multiplying Matrices Without Multiplying

abstract: Multiplying matrices is among the most fundamental and compute-intensive operations in machine learning. Consequently, there has been significant work on efficiently approximating matrix multiplies. We introduce a learning-based algorithm for this task that greatly outperforms existing methods. Experiments using hundreds of matrices from diverse domains show that it often runs $100\times$ faster than exact matrix products and $10\times$ faster than current approximate methods. In the common case that one matrix is known ahead of time, our method also has the interesting property that it requires zero multiply-adds. These results suggest that a mixture of hashing, averaging, and byte shuffling$-$the core operations of our method$-$could be a more promising building block for machine learning than the sparsified, factorized, and/or scalar quantized matrix products that have recently been the focus of substantial research and hardware investment.


title: On the small time asymptotics of stochastic Ladyzhenskaya-Smagorinsky equations with damping perturbed by multiplicative noise

abstract: The Ladyzhenskaya-Smagorinsky equations model turbulence phenomena, and are given by $$\frac{\partial \boldsymbol{u}}{\partial t}-\mu \mathrm{div}\left(\left(1+|\nabla\boldsymbol{u}|^2\right)^{\frac{p-2}{2}}\nabla\boldsymbol{u}\right)+(\boldsymbol{u}\cdot\nabla)\boldsymbol{u}+\nabla p=\boldsymbol{f}, \ \nabla\cdot\boldsymbol{u}=0,$$ for $p\geq 2,$ in a bounded domain $\mathcal{O}\subset\mathbb{R}^d$ ($2\leq d\leq 4$). In this work, we consider the stochastic Ladyzhenskaya-Smagorinsky equations with the damping $\alpha\boldsymbol{u}+\beta|\boldsymbol{u}|^{r-2}\boldsymbol{u},$ for $r\geq 2$ ($\alpha,\beta\geq 0$), subjected to multiplicative Gaussian noise. We show the local monotoincity ($p\geq \frac{d}{2}+1,\ r\geq 2$) as well as global monotonicity ($p\geq 2,\ r\geq 4$) properties of the linear and nonlinear operators, which along with an application of stochastic version of Minty-Browder technique imply the existence of a unique pathwise strong solution. Then, we discuss the small time asymptotics by studying the effect of small, highly nonlinear, unbounded drifts (small time large deviation principle) for the stochastic Ladyzhenskaya-Smagorinsky equations with damping.


title: ArgFuse: A Weakly-Supervised Framework for Document-Level Event Argument Aggregation

abstract: Most of the existing information extraction frameworks (Wadden et al., 2019; Veysehet al., 2020) focus on sentence-level tasks and are hardly able to capture the consolidated information from a given document. In our endeavour to generate precise document-level information frames from lengthy textual records, we introduce the task of Information Aggregation or Argument Aggregation. More specifically, our aim is to filter irrelevant and redundant argument mentions that were extracted at a sentence level and render a document level information frame. Majority of the existing works have been observed to resolve related tasks of document-level event argument extraction (Yang et al., 2018a; Zheng et al., 2019a) and salient entity identification (Jain et al.,2020) using supervised techniques. To remove dependency from large amounts of labelled data, we explore the task of information aggregation using weakly-supervised techniques. In particular, we present an extractive algorithm with multiple sieves which adopts active learning strategies to work efficiently in low-resource settings. For this task, we have annotated our own test dataset comprising of 131 document information frames and have released the code and dataset to further research prospects in this new domain. To the best of our knowledge, we are the first to establish baseline results for this task in English. Our data and code are publicly available at https://github.com/DebanjanaKar/ArgFuse.


title: Chordal graphs, higher independence and vertex decomposable complexes

abstract: Given a simple undirected graph $G$ there is a simplicial complex $\mathrm{Ind}(G)$, called the independence complex, whose faces correspond to the independent sets of $G$. This is a well studied concept because it provides a fertile ground for interactions between commutative algebra, graph theory and algebraic topology. One of the line of research pursued by many authors is to determine the graph classes for which the associated independence complex is Cohen-Macaulay. For example, it is known that when $G$ is a chordal graph the complex $\mathrm{Ind}(G)$ is in fact vertex decomposable, the strongest condition in the Cohen-Macaulay ladder. In this article we consider a generalization of independence complex. Given $r\geq 1$, a subset of the vertex set is called $r$-independent if the connected components of the induced subgraph have cardinality at most $r$. The collection of all $r$-independent subsets of $G$ form a simplicial complex called the $r$-independence complex and is denoted by $\mathrm{Ind}_r(G)$. It is known that when $G$ is a chordal graph the complex $\mathrm{Ind}_r(G)$ has the homotopy type of a wedge of spheres. Hence it is natural to ask which of these complexes are shellable or even vertex decomposable. We prove, using Woodroofe's chordal hypergraph notion, that these complexes are always shellable when the underlying chordal graph is a tree. Further, using the notion of vertex splittable ideals we show that for caterpillar graphs the associated $r$-independence complex is vertex decomposable for all values of $r$. We also construct chordal graphs on $2r+2$ vertices such that their $r$-independence complexes are not sequentially Cohen-Macaulay for any $r \ge 2$.


title: Equation of the Aftershocks and its Phase Portrait

abstract: Recently, simple differential models of aftershocks have attracted increased attention of researchers at the Institute of Physics of the Earth, Russian Academy of Sciences for their remarkable properties. The shortened Bernoulli equation allows us to introduce the concept of the source deactivation factor and phenomenologically describe the nonstationarity of the geological environment in the earthquake source, "cooling down" after the main shock. The Verhulst logistic equation makes it possible to take into account the transition of the aftershock flow to the background seismicity mode. The Kolmogorov-Petrovsky-Piskunov nonlinear diffusion equation is convenient for modeling the spatio-temporal evolution of aftershocks. This paper focuses on the phase portrait of a dynamical system that simulates the evolution of aftershocks. The phase portrait allows us to understand why the Omori hyperbolic law is most clearly manifested after strong earthquakes. It is noted that the Omori epoch, during which the deactivation coefficient is constant, does not immediately end with a transition to the background mode. In the experience after the end of the Omori epoch, the deactivation coefficient changes over time in a rather complex way, and can even becomes negative. The theory predicts that if negative values of the coefficient are held long enough, then a geotectonic explosion occurs, vaguely resembling the main shock of earthquake. The paper discusses possible directions for the further development of the theory. Keywords: earthquake, aftershock, deactivation factor, Omori epoch, logistic equation, explosive instability, Bath law.


title: Benign Overfitting in Multiclass Classification: All Roads Lead to Interpolation

abstract: The literature on "benign overfitting" in overparameterized models has been mostly restricted to regression or binary classification; however, modern machine learning operates in the multiclass setting. Motivated by this discrepancy, we study benign overfitting in multiclass linear classification. Specifically, we consider the following training algorithms on separable data: (i) empirical risk minimization (ERM) with cross-entropy loss, which converges to the multiclass support vector machine (SVM) solution; (ii) ERM with least-squares loss, which converges to the min-norm interpolating (MNI) solution; and, (iii) the one-vs-all SVM classifier. First, we provide a simple sufficient deterministic condition under which all three algorithms lead to classifiers that interpolate the training data and have equal accuracy. When the data is generated from Gaussian mixtures or a multinomial logistic model, this condition holds under high enough effective overparameterization. We also show that this sufficient condition is satisfied under "neural collapse", a phenomenon that is observed in training deep neural networks. Second, we derive novel bounds on the accuracy of the MNI classifier, thereby showing that all three training algorithms lead to benign overfitting under sufficient overparameterization. Ultimately, our analysis shows that good generalization is possible for SVM solutions beyond the realm in which typical margin-based bounds apply.


title: Customizing Graph Neural Networks using Path Reweighting

abstract: Graph Neural Networks (GNNs) have been extensively used for mining graph-structured data with impressive performance. However, because these traditional GNNs do not distinguish among various downstream tasks, embeddings embedded by them are not always effective. Intuitively, paths in a graph imply different semantics for different downstream tasks. Inspired by this, we design a novel GNN solution, namely Customized Graph Neural Network with Path Reweighting (CustomGNN for short). Specifically, the proposed CustomGNN can automatically learn the high-level semantics for specific downstream tasks to highlight semantically relevant paths as well to filter out task-irrelevant noises in a graph. Furthermore, we empirically analyze the semantics learned by CustomGNN and demonstrate its ability to avoid the three inherent problems in traditional GNNs, i.e., over-smoothing, poor robustness, and overfitting. In experiments with the node classification task, CustomGNN achieves state-of-the-art accuracies on three standard graph datasets and four large graph datasets. The source code of the proposed CustomGNN is available at \url{https://github.com/cjpcool/CustomGNN}.


title: Filtering states with total spin on a quantum computer

abstract: Starting from a general wave function described on a set of spins/qubits, we propose several quantum algorithms to extract the components of this state on eigenstates of the total spin ${\bf S}^2$ and its azimuthal projection $S_z$. The method plays the role of total spin projection and gives access to the amplitudes of the initial state on a total spin basis. The different algorithms have various degrees of sophistication depending on the requested tasks. They can either solely project onto the subspace with good total spin or completely uplift the degeneracy in this subspace. After each measurement, the state collapses to one of the spin eigenstates that could be used for post-processing. For this reason, we call the method Total Quantum Spin filtering (TQSf). Possible applications ranging from many-body physics to random number generators are discussed.


title: Mixing of X and Y states from QCD Sum Rules analysis

abstract: We study $\bar{Q}Q\bar{q}q$ and $\bar{Q}qQ\bar{q}$ states as mixed states in QCD sum rules. By calculating the two-point correlation functions of pure states of their corresponding currents, we review the mass and coupling constant predictions of $J^{PC}=1^{++}$, $1^{--}$, $1^{-+}$ states. By calculating the two-point mixed correlation functions of $\bar{Q}Q\bar{q}q$ and $\bar{Q}qQ\bar{q}$ currents, and we estimate the mass and coupling constants of the corresponding `"physical state" that couples to both $\bar{Q}Q\bar{q}q$ and $\bar{Q}qQ\bar{q}$ currents. Our results suggest that $1^{++}$ states are more likely mixing from $\bar{Q}Q\bar{q}q$ and $\bar{Q}qQ\bar{q}$ components, while for $1^{--}$ and $1^{-+}$ states, there is less mixing between $\bar{Q}Q\bar{q}q$ and $\bar{Q}qQ\bar{q}$. Our results suggest the $Y$ series of states have more complicated components.


title: Coexistence of Multiple Magnetic Interactions in Oxygen Deficient V2O5 Nanoparticles

abstract: In this paper, we report the spin glass-like coexistence of Ferromagnetic (FM), paramagnetic (PM) and antiferromagnetic (AFM) orders in oxygen deficient V2O5 nanoparticles (NP). It has a chemical stoichiometry of nearly V2O4.65 and a bandgap of nearly 2.2 eV with gap states due to significant defect density. The temperature dependent electrical conductivity and thermopower measurements clearly demonstrate a polaronic conduction mechanism of small polaron hopping with hopping energy of about 0.112 eV. The V2O5 sample shows a strong field as well as temperature dependent magnetic behavior when measured using a sensitive SQUID magnetometer. It shows a positive magnetic susceptibility over the entire temperature range (2- 350 K). The FC-ZFC data shows clear hysteresis indicating glassy behavior with dominant superparamagnetism (SPM). The Curie-Weiss fitting confirms the AFM to PM transition at nearly 280 K and the curie constant yields 1.56 muB which is close to single electron moment. The small polaron formation, which arises due to oxygen vacancy defects compensated by charge defects of V4+, results in Magneto-Electronic Phase Separation (MEPS) and hence various magnetic exchanges, as predicted by first principle calculations. This is further revealed as strong hybridization of V bonded to oxygen vacancy VO and neighboring V5+ ions, resulting in net magnetic moment per vacancy (1.77 muB which is in good agreement with experiment). Besides, the rise in V4+ defects is found to show AFM component as observed from the calculations. Thus, the diversity in magnetism of undoped V2O5 has its origin in defect number density as well as their random distribution led to MEPS. This involves localized spins in polarons and their FM clusters on the PM background while, V4+ dimers within and across the ladder, inducing AFM interactions.


title: Non-native English lexicon creation for bilingual speech synthesis

abstract: Bilingual English speakers speak English as one of their languages. Their English is of a non-native kind, and their conversations are of a code-mixed fashion. The intelligibility of a bilingual text-to-speech (TTS) system for such non-native English speakers depends on a lexicon that captures the phoneme sequence used by non-native speakers. However, due to the lack of non-native English lexicon, existing bilingual TTS systems employ native English lexicons that are widely available, in addition to their native language lexicon. Due to the inconsistency between the non-native English pronunciation in the audio and native English lexicon in the text, the intelligibility of synthesized speech in such TTS systems is significantly reduced. This paper is motivated by the knowledge that the native language of the speaker highly influences non-native English pronunciation. We propose a generic approach to obtain rules based on letter to phoneme alignment to map native English lexicon to their non-native version. The effectiveness of such mapping is studied by comparing bilingual (Indian English and Hindi) TTS systems trained with and without the proposed rules. The subjective evaluation shows that the bilingual TTS system trained with the proposed non-native English lexicon rules obtains a 6% absolute improvement in preference.


title: Enhanced optical nonlinearities in epitaxial quantum dots lasers on silicon for future photonic integrated systems

abstract: Four-wave mixing (FWM) is an important nonlinear optical phenomenon that underlines many of the discoveries and device applications since the laser was invented. Examples include parametric amplification, mode-locked pulses and frequency combs, and in the quantum optics regime, entangled-photon generation, squeezed-state production and optical transduction from the visible to infrared wavelengths. For quantum dot systems, the basic understanding of FWM is limited by the conventional investigation method, which concentrates on the FWM susceptibility measured with optical amplifiers. This paper addresses this weakness by performing laser experiments to account for all optical nonlinearities contributing to the FWM signal. Meanwhile, we gain valuable insight into the intricate interplay among optical nonlinearities. Using quantum dot lasers directly grown on silicon, we achieved FWM conversion efficiency sufficient to demonstrate self-mode-locking in a single-section laser diode, with sub-ps mode-locked pulse duration and kHz frequency-comb linewidth. A comparison with first-principles based multimode laser theory indicates measured FWM conversion efficiencies that are close to the theoretical limit. An advantage over earlier studies and crucial to confidence in the results are the quality and reproducibility of state-of-the-art quantum dot lasers. They make possible the detailed study of conversion efficiency over a broad parameter space, and the identification of the importance of p-doping. Systematic improvement based on our understanding of underlying physics will lead to transform limited performance and effective compensation of intrinsic and extrinsic effects, such as linewidth enhancement and background dispersion. The integration of FWM with lasing impacts numerous optoelectronic components used in telecom and datacom.


title: EM-based Solutions for Covariance Structure Detection and Classification in Polarimetric SAR Images

abstract: This paper addresses the challenge of classifying polarimetric SAR images by leveraging the peculiar characteristics of the polarimetric covariance matrix (PCM). To this end, a general framework to solve a multiple hypothesis test is introduced with the aim to detect and classify contextual spatial variations in polarimetric SAR images. Specifically, under the null hypothesis, only an unknown structure is assumed for data belonging to a 2-dimensional spatial sliding window, whereas under each alternative hypothesis, data are partitioned into subsets sharing different structures. The problem of partition estimation is solved by resorting to hidden random variables representative of covariance structure classes and the expectation-maximization algorithm. The effectiveness of the proposed detection strategies is demonstrated on both simulated and real polarimetric SAR data also in comparison with existing classification algorithms.


title: Boundedness of denominators of special values of the L-functions for modular forms

abstract: For a cuspidal Hecke eigenform $F$ for $Sp_n(Z)$ and a Dirichlet character $\chi$ let $L(s,F,\chi,St)$ be the standard $L$-function of $F$ twisted by $\chi$. Boecherer showed the boundedness of denominators of the algebraic part of $L(m,F,\chi,St)$ at a critical point $m$ when $\chi$ varies. In this paper, we give a refined version of his result We also prove a similar result for the products of Hecke $L$ functions of primitive forms for $SL_2(Z)$.


title: FedCM: Federated Learning with Client-level Momentum

abstract: Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle problems of partial participation and client heterogeneity in real-world federated learning applications. FedCM aggregates global gradient information in previous communication rounds and modifies client gradient descent with a momentum-like term, which can effectively correct the bias and improve the stability of local SGD. We provide theoretical analysis to highlight the benefits of FedCM. We also perform extensive empirical studies and demonstrate that FedCM achieves superior performance in various tasks and is robust to different levels of client numbers, participation rate and client heterogeneity.


title: An End-to-End Khmer Optical Character Recognition using Sequence-to-Sequence with Attention

abstract: This paper presents an end-to-end deep convolutional recurrent neural network solution for Khmer optical character recognition (OCR) task. The proposed solution uses a sequence-to-sequence (Seq2Seq) architecture with attention mechanism. The encoder extracts visual features from an input text-line image via layers of residual convolutional blocks and a layer of gated recurrent units (GRU). The features are encoded in a single context vector and a sequence of hidden states which are fed to the decoder for decoding one character at a time until a special end-of-sentence (EOS) token is reached. The attention mechanism allows the decoder network to adaptively select parts of the input image while predicting a target character. The Seq2Seq Khmer OCR network was trained on a large collection of computer-generated text-line images for seven common Khmer fonts. The proposed model's performance outperformed the state-of-art Tesseract OCR engine for Khmer language on the 3000-images test set by achieving a character error rate (CER) of 1% vs 3%.


title: Total Generate: Cycle in Cycle Generative Adversarial Networks for Generating Human Faces, Hands, Bodies, and Natural Scenes

abstract: We propose a novel and unified Cycle in Cycle Generative Adversarial Network (C2GAN) for generating human faces, hands, bodies, and natural scenes. Our proposed C2GAN is a cross-modal model exploring the joint exploitation of the input image data and guidance data in an interactive manner. C2GAN contains two different generators, i.e., an image-generation generator and a guidance-generation generator. Both generators are mutually connected and trained in an end-to-end fashion and explicitly form three cycled subnets, i.e., one image generation cycle and two guidance generation cycles. Each cycle aims at reconstructing the input domain and simultaneously produces a useful output involved in the generation of another cycle. In this way, the cycles constrain each other implicitly providing complementary information from both image and guidance modalities and bringing an extra supervision gradient across the cycles, facilitating a more robust optimization of the whole model. Extensive results on four guided image-to-image translation subtasks demonstrate that the proposed C2GAN is effective in generating more realistic images compared with state-of-the-art models. The code is available at https://github.com/Ha0Tang/C2GAN.


title: Three steps away from Shapiro's problem: lower bounds for graphic sums with functions `max' or `min' in denominators

abstract: Taking Shapiro's cyclic sums $\sum_{i=1}^n x_i/(x_{i+1}+x_{i+2})$ (assuming index addition mod $n$) as a starting point, we introduce a broader class of cyclic sums, called generalized Shapiro-Diananda sums, where the denominators are $p$-th order power means of the sets $\{x_{i+j_1},\dots,x_{i+j_k}\}$ with fixed distinct integers $j_1,\dots,j_k$ and $1\leq i\leq n$. Generalizing further, we replace the set of arguments of the power mean in the $i$-th denominator by an arbitrary nonempty subset of $\{1,\dots,n\}$ interpreted as the set of out-neighbors of the node number $i$ in a directed graph with $n$ nodes. We call such sums graphic power sums since their structure is controlled by directed graphs. The inquiry, as in the well-researched case of Shapiro's sums, concerns the greatest lower bound of the given ``sum'' as a function of positive variables $x_1,\dots,x_n$. We show that the cases of $p=+\infty$ (max-sums) and $p=-\infty$ (min-sums) are tractable. For the max-sum associated with a given graph the g.l.b. is always an integer; for a strongly connected graph it equals to graph's girth. For the similar min-sum, we could not relate the g.l.b. to a known combinatorial invariant; we only give some estimates and describe a method for finding the g.l.b., which has factorial complexity in $n$. A satisfactory analytical treatment is available for the secondary minimization -- when the g.l.b.'s of min-sums for individual graphs are mininized over the class of strongly connected graphs with $n$ nodes. The result (depending only on $n$) is found to be asymptotic to $e\ln n$.