title: Cost Sensitive Optimization of Deepfake Detector

abstract: Since the invention of cinema, the manipulated videos have existed. But generating manipulated videos that can fool the viewer has been a time-consuming endeavor. With the dramatic improvements in the deep generative modeling, generating believable looking fake videos has become a reality. In the present work, we concentrate on the so-called deepfake videos, where the source face is swapped with the targets. We argue that deepfake detection task should be viewed as a screening task, where the user, such as the video streaming platform, will screen a large number of videos daily. It is clear then that only a small fraction of the uploaded videos are deepfakes, so the detection performance needs to be measured in a cost-sensitive way. Preferably, the model parameters also need to be estimated in the same way. This is precisely what we propose here.


title: Regularized Fingerprinting in Detection and Attribution of Climate Change with Weight Matrix Optimizing the Efficiency in Scaling Factor Estimation

abstract: The optimal fingerprinting method for detection and attribution of climate change is based on a multiple regression where each covariate has measurement error whose covariance matrix is the same as that of the regression error up to a known scale. Inferences about the regression coefficients are critical not only for making statements about detection and attribution but also for quantifying the uncertainty in important outcomes derived from detection and attribution analyses. When there is no errors-in-variables (EIV), the optimal weight matrix in estimating the regression coefficients is the precision matrix of the regression error which, in practice, is never known and has to be estimated from climate model simulations. We construct a weight matrix by inverting a nonlinear shrinkage estimate of the error covariance matrix that minimizes loss functions directly targeting the uncertainty of the resulting regression coefficient estimator. The resulting estimator of the regression coefficients is asymptotically optimal as the sample size of the climate model simulations and the matrix dimension go to infinity together with a limiting ratio. When EIVs are present, the estimator of the regression coefficients based on the proposed weight matrix is asymptotically more efficient than that based on the inverse of the existing linear shrinkage estimator of the error covariance matrix. The performance of the method is confirmed in finite sample simulation studies mimicking realistic situations in terms of the length of the confidence intervals and empirical coverage rates for the regression coefficients. An application to detection and attribution analyses of the mean temperature at different spatial scales illustrates the utility of the method.


title: GPU Accelerated Exhaustive Search for Optimal Ensemble of Black-Box Optimization Algorithms

abstract: Black-box optimization is essential for tuning complex machine learning algorithms which are easier to experiment with than to understand. In this paper, we show that a simple ensemble of black-box optimization algorithms can outperform any single one of them. However, searching for such an optimal ensemble requires a large number of experiments. We propose a Multi-GPU-optimized framework to accelerate a brute force search for the optimal ensemble of black-box optimization algorithms by running many experiments in parallel. The lightweight optimizations are performed by CPU while expensive model training and evaluations are assigned to GPUs. We evaluate 15 optimizers by training 2.7 million models and running 541,440 optimizations. On a DGX-1, the search time is reduced from more than 10 days on two 20-core CPUs to less than 24 hours on 8-GPUs. With the optimal ensemble found by GPU-accelerated exhaustive search, we won the 2nd place of NeurIPS 2020 black-box optimization challenge.


title: Universal $p$-ary designs

abstract: We investigate $p$-ary $t$-designs which are simultaneously designs for all $t$, which we call universal $p$-ary designs. Null universal designs are well understood due to Gordon James via the representation theory of the symmetric group. We study non-null designs and determine necessary and sufficient conditions on the coefficients for such a design to exist. This allows us to classify all universal designs, up to similarity.


title: A Topological Method for Comparing Document Semantics

abstract: Comparing document semantics is one of the toughest tasks in both Natural Language Processing and Information Retrieval. To date, on one hand, the tools for this task are still rare. On the other hand, most relevant methods are devised from the statistic or the vector space model perspectives but nearly none from a topological perspective. In this paper, we hope to make a different sound. A novel algorithm based on topological persistence for comparing semantics similarity between two documents is proposed. Our experiments are conducted on a document dataset with human judges' results. A collection of state-of-the-art methods are selected for comparison. The experimental results show that our algorithm can produce highly human-consistent results, and also beats most state-of-the-art methods though ties with NLTK.


title: On rich lenses in planar arrangements of circles and related problems

abstract: We show that the maximum number of pairwise non-overlapping $k$-rich lenses (lenses formed by at least $k$ circles) in an arrangement of $n$ circles in the plane is $O\left(\frac{n^{3/2}\log{(n/k^3)}}{k^{5/2}} + \frac{n}{k} \right)$, and the sum of the degrees of the lenses of such a family (where the degree of a lens is the number of circles that form it) is $O\left(\frac{n^{3/2}\log{(n/k^3)}}{k^{3/2}} + n\right)$. Two independent proofs of these bounds are given, each interesting in its own right (so we believe). We then show that these bounds lead to the known bound of Agarwal et al. (JACM 2004) and Marcus and Tardos (JCTA 2006) on the number of point-circle incidences in the plane. Extensions to families of more general algebraic curves and some other related problems are also considered.


title: Observation of 4- and 6-magnon bound-states in the spin-anisotropic frustrated antiferromagnet FeI$_2$

abstract: Spin-waves e.g. magnons are the conventional elementary excitations of ordered magnets. However, other possibilities exist. For instance, magnon bound-states can arise due to attractive magnon-magnon interactions and drastically impact the static and dynamic properties of materials. Here, we demonstrate a zoo of distinct multi-magnon quasiparticles in the frustrated spin-1 triangular antiferromagnet FeI$_2$ using time-domain terahertz spectroscopy. The energy-magnetic field excitation spectrum contains signatures of one-, two-, four- and six-magnon bound-states, which we analyze using an exact diagonalization approach for a dilute gas of interacting magnons. The two-magnon single-ion bound states occur due to strong anisotropy and the preponderance of even higher order excitations arises from the tendency of the single-ion bound states to themselves form bound states due to their very flat dispersion. This menagerie of tunable interacting quasiparticles provides a unique platform in a condensed matter setting that is reminiscent of the few-body quantum phenomena central to cold-atom, nuclear, and particle physics experiments.


title: Anomalous doping evolution of superconductivity and quasiparticle interference in Bi2Sr2Ca2Cu3O10+{\delta} trilayer cuprates

abstract: We use scanning tunneling microscopy to investigate Bi2Sr2Ca2Cu3O10+{\delta} trilayer cuprates from the optimally doped to overdoped regime. We find that the two distinct superconducting gaps from the inner and outer CuO2 planes both decrease rapidly with doping, in sharp contrast to the nearly constant Tc. Spectroscopic imaging reveals the absence of quasiparticle interference in the antinodal region of overdoped samples, showing an opposite trend to that in single- and double-layer compounds. We propose that the existence of two types of inequivalent CuO2 planes and the intricate interaction between them are responsible for these highly anomalous observations in trilayer cuprates.


title: Efficient Estimation of Influence of a Training Instance

abstract: Understanding the influence of a training instance on a neural network model leads to improving interpretability. However, it is difficult and inefficient to evaluate the influence, which shows how a model's prediction would be changed if a training instance were not used. In this paper, we propose an efficient method for estimating the influence. Our method is inspired by dropout, which zero-masks a sub-network and prevents the sub-network from learning each training instance. By switching between dropout masks, we can use sub-networks that learned or did not learn each training instance and estimate its influence. Through experiments with BERT and VGGNet on classification datasets, we demonstrate that the proposed method can capture training influences, enhance the interpretability of error predictions, and cleanse the training dataset for improving generalization.


title: Celestial Amplitudes from UV to IR

abstract: Celestial amplitudes represent 4D scattering of particles in boost, rather than the usual energy-momentum, eigenstates and hence are sensitive to both UV and IR physics. We show that known UV and IR properties of quantum gravity translate into powerful constraints on the analytic structure of celestial amplitudes. For example the soft UV behavior of quantum gravity is shown to imply that the exact four-particle scattering amplitude is meromorphic in the complex boost weight plane with poles confined to even integers on the negative real axis. Would-be poles on the positive real axis from UV asymptotics are shown to be erased by a flat space analog of the AdS resolution of the bulk point singularity. The residues of the poles on the negative axis are identified with operator coefficients in the IR effective action. Far along the real positive axis, the scattering is argued to grow exponentially according to the black hole area law. Exclusive amplitudes are shown to simply factorize into conformally hard and conformally soft factors. The soft factor contains all IR divergences and is given by a celestial current algebra correlator of Goldstone bosons from spontaneously broken asymptotic symmetries. The hard factor describes the scattering of hard particles together with the boost-eigenstate clouds of soft photons or gravitons required by asymptotic symmetries. These provide an IR safe $\mathcal{S}$-matrix for the scattering of hard particles.


title: Quantification of the Impact of Water on the Wetting Behavior of Hydrophilic Ionic liquid: A Molecular Dynamics Study

abstract: We have used molecular dynamics simulations to study the effect of water on the wetting behavior and the interfacial structure of ionic liquid (IL) 1-ethyl-3-methylimidazolium boron tetrafluoride[EMIM][BF4] droplets on graphite surfaces which, is a prerequisite for the new IL-based applications in the field of chemical engineering. A slight decrement in the value of the contact angle has been found while adding water up to 20wt%; afterward, the contact angle starts to increase. The non-monotonic behavior of contact angle of IL droplet with the addition of water molecules was examined through several key parameters, such as the interaction energies between the graphite and IL molecules, density distributions, cluster formation, and the number of formed hydrogen bonds (HBs) for the different weight percentages of water molecules. The results indicate that the hydrogen bond network and the cluster formation among the water molecules play a vital role during the transition from IL rich medium to water-rich medium of the droplet.


title: The Architectural Implications of Distributed Reinforcement Learning on CPU-GPU Systems

abstract: With deep reinforcement learning (RL) methods achieving results that exceed human capabilities in games, robotics, and simulated environments, continued scaling of RL training is crucial to its deployment in solving complex real-world problems. However, improving the performance scalability and power efficiency of RL training through understanding the architectural implications of CPU-GPU systems remains an open problem. In this work we investigate and improve the performance and power efficiency of distributed RL training on CPU-GPU systems by approaching the problem not solely from the GPU microarchitecture perspective but following a holistic system-level analysis approach. We quantify the overall hardware utilization on a state-of-the-art distributed RL training framework and empirically identify the bottlenecks caused by GPU microarchitectural, algorithmic, and system-level design choices. We show that the GPU microarchitecture itself is well-balanced for state-of-the-art RL frameworks, but further investigation reveals that the number of actors running the environment interactions and the amount of hardware resources available to them are the primary performance and power efficiency limiters. To this end, we introduce a new system design metric, CPU/GPU ratio, and show how to find the optimal balance between CPU and GPU resources when designing scalable and efficient CPU-GPU systems for RL training.


title: Quantum Fully Homomorphic Encryption by Integrating Pauli One-time Pad with Quaternions

abstract: Quantum fully homomorphic encryption (QFHE) allows to evaluate quantum circuits on encrypted data. We present a novel QFHE scheme, which extends Pauli one-time pad encryption by relying on the quaternion representation of SU(2). With the scheme, evaluating 1-qubit gates is more efficient, and evaluating general quantum circuits is polynomially improved in asymptotic complexity. Technically, a new encrypted multi-bit control technique is proposed, which allows to perform any 1-qubit gate whose parameters are given in the encrypted form. With this technique, we establish a conversion between the new encryption and previous Pauli one-time pad encryption, bridging our QFHE scheme with previous ones. Also, this technique is useful for private quantum circuit evaluation. The security of the scheme relies on the hardness of the underlying quantum capable FHE scheme, and the latter sets its security on the learning with errors problem and the circular security assumption.


title: Maximum mass of hybrid star formed via shock induced phase transition in cold neutron stars

abstract: This article studies the maximum mass limit of the quark star formed after the shock-induced phase transition of a cold neutron star. By employing hadronic and quark equation of state that satisfies the current mass bound, we use combustion adiabat conditions to find such a limit. The combustion adiabat condition results in a local or a global maximum pressure at an intermediate density range. The maximum pressure corresponds to a local or global maximum mass for the phase transformed hybrid star. The phase transition is usually exothermic if we have a local maximum mass. The criteria for exothermic or endothermic phase transition depend on whether the quark pressure/energy ratios to nuclear pressure/energy are smaller or greater than 1. We find that exothermic phase transition in a cold neutron star usually results in hybrid stars whose mass is smaller than a parent neutron star. The phase transition is endothermic for a global maximum pressure; thereby, one gets a global maximum mass. Hybrid stars much massive than phase transformed local maximum mass can be formed, provided there is some external energy source during the phase transition process. However, for some cases, even massive hybrid stars can form with exothermic phase transition for EoSs having global maximum pressure.


title: Deterministic Privacy Preservation in Static Average Consensus Problem

abstract: In this paper we consider the problem of privacy preservation in the static average consensus problem. This problem normally is solved by proposing privacy preservation augmentations for the popular first order Laplacian-based algorithm. These mechanisms however come with computational overhead, may need coordination among the agents to choose their parameters and also alter the transient response of the algorithm. In this paper we show that an alternative iterative algorithm that is proposed in the literature in the context of dynamic average consensus problem has intrinsic privacy preservation and can be used as a privacy preserving algorithm that yields the same performance behavior as the well-known Laplacian consensus algorithm but without the overheads that come with the existing privacy preservation methods.


title: Noise-induced acceleration of single molecule kinesin-1

abstract: The movement of single kinesin molecules was observed while applying noisy external forces that mimic intracellular active fluctuations. We found kinesin accelerates under noise, especially when a large hindering load is added. The behavior quantitatively conformed to a theoretical model that describes the kinesin movement with simple two-state reactions. The universality of the kinetic theory suggests that intracellular enzymes share a similar noise-induced acceleration mechanism, i.e. active fluctuations in cells are not just noise but are utilized to promote various physiological processes.


title: On Aadhaar Identity Management System

abstract: A unique identification for citizens can lead to effective governance to manage and provide citizen-centric services. While ensuring this service, privacy of the citizens needs to be preserved. Aadhaar, the identification system by UIDAI has faced some critics regarding its privacy preserving feature. This paper discusses those concerns in Aadhaar system and proposed a new model for the Aadhaar system. The proposed solution is aimed to address the issue of collusion of third party service providers and profiling of Aadhaar users. The proposed solution uses a distributed model capturing the Aadhaar system, in which data of users is decentralized and stored in zonal office's databases as well as the CIDR. The proposed solution provides the functioning of the authentication process of the Aadhaar system more effective, as it reduces the number of requests being handled directly by the CIDR and also tackles the concern of correlation of data.


title: Fairness Preferences, Actual and Hypothetical: A Study of Crowdworker Incentives

abstract: How should we decide which fairness criteria or definitions to adopt in machine learning systems? To answer this question, we must study the fairness preferences of actual users of machine learning systems. Stringent parity constraints on treatment or impact can come with trade-offs, and may not even be preferred by the social groups in question (Zafar et al., 2017). Thus it might be beneficial to elicit what the group's preferences are, rather than rely on a priori defined mathematical fairness constraints. Simply asking for self-reported rankings of users is challenging because research has shown that there are often gaps between people's stated and actual preferences(Bernheim et al., 2013). This paper outlines a research program and experimental designs for investigating these questions. Participants in the experiments are invited to perform a set of tasks in exchange for a base payment--they are told upfront that they may receive a bonus later on, and the bonus could depend on some combination of output quantity and quality. The same group of workers then votes on a bonus payment structure, to elicit preferences. The voting is hypothetical (not tied to an outcome) for half the group and actual (tied to the actual payment outcome) for the other half, so that we can understand the relation between a group's actual preferences and hypothetical (stated) preferences. Connections and lessons from fairness in machine learning are explored.


title: Phase-Amplitude Coupling in Neuronal Oscillator Networks

abstract: Phase-amplitude coupling (PAC) describes the phenomenon where the power of a high-frequency oscillation evolves with the phase of a low-frequency one. We propose a model that explains the emergence of PAC in two commonly-accepted architectures in the brain, namely, a high-frequency neural oscillation driven by an external low-frequency input and two interacting local oscillations with distinct, locally-generated frequencies. We further propose an interconnection structure for brain regions and demonstrate that low-frequency phase synchrony can integrate high-frequency activities regulated by local PAC and control the direction of information flow across distant regions.


title: Evaluating Explainable Methods for Predictive Process Analytics: A Functionally-Grounded Approach

abstract: Predictive process analytics focuses on predicting the future states of running instances of a business process. While advanced machine learning techniques have been used to increase accuracy of predictions, the resulting predictive models lack transparency. Current explainable machine learning methods, such as LIME and SHAP, can be used to interpret black box models. However, it is unclear how fit for purpose these methods are in explaining process predictive models. In this paper, we draw on evaluation measures used in the field of explainable AI and propose functionally-grounded evaluation metrics for assessing explainable methods in predictive process analytics. We apply the proposed metrics to evaluate the performance of LIME and SHAP in interpreting process predictive models built on XGBoost, which has been shown to be relatively accurate in process predictions. We conduct the evaluation using three open source, real-world event logs and analyse the evaluation results to derive insights. The research contributes to understanding the trustworthiness of explainable methods for predictive process analytics as a fundamental and key step towards human user-oriented evaluation.


title: Formal degrees and the local theta correspondence: the quaternionic case

abstract: In this paper, we determine a constant occurring in a local analogue of the Siegel-Weil formula, and describe the behavior of the formal degrees under the local theta correspondence for quaternionic dual pairs of almost equal rank over a non-Archimedean local field of characteristic $0$. As an application, we prove the formal degree conjecture of Hiraga-Ichino-Ikeda for the non-split inner forms of ${\rm Sp}_4$ and ${\rm GSp}_4$.


title: Partitions of Correlated N-Qubit Systems

abstract: The production and manipulation of quantum correlation protocols will play a central role where the quantum nature of the correlation can be used as a resource to yield properties unachievable within a classical framework is a very active and important area of research. In this work, we provide a description of a measure of correlation strength between quantum systems, especially for multipartite quantum systems.


title: Ditto: Fair and Robust Federated Learning Through Personalization

abstract: Fairness and robustness are two important concerns for federated learning systems. In this work, we identify that robustness to data and model poisoning attacks and fairness, measured as the uniformity of performance across devices, are competing constraints in statistically heterogeneous networks. To address these constraints, we propose employing a simple, general framework for personalized federated learning, Ditto, that can inherently provide fairness and robustness benefits, and develop a scalable solver for it. Theoretically, we analyze the ability of Ditto to achieve fairness and robustness simultaneously on a class of linear problems. Empirically, across a suite of federated datasets, we show that Ditto not only achieves competitive performance relative to recent personalization methods, but also enables more accurate, robust, and fair models relative to state-of-the-art fair or robust baselines.


title: Scale Aware Adaptation for Land-Cover Classification in Remote Sensing Imagery

abstract: Land-cover classification using remote sensing imagery is an important Earth observation task. Recently, land cover classification has benefited from the development of fully connected neural networks for semantic segmentation. The benchmark datasets available for training deep segmentation models in remote sensing imagery tend to be small, however, often consisting of only a handful of images from a single location with a single scale. This limits the models' ability to generalize to other datasets. Domain adaptation has been proposed to improve the models' generalization but we find these approaches are not effective for dealing with the scale variation commonly found between remote sensing image collections. We therefore propose a scale aware adversarial learning framework to perform joint cross-location and cross-scale land-cover classification. The framework has a dual discriminator architecture with a standard feature discriminator as well as a novel scale discriminator. We also introduce a scale attention module which produces scale-enhanced features. Experimental results show that the proposed framework outperforms state-of-the-art domain adaptation methods by a large margin.


title: Startlingly Fast Evolution of the Stingray Planetary Nebula and its Central Star, V839 Arae

abstract: The planetary nebula (PN) called the Stingray (PN G331.3$-$12.1) suddenly turned on in the 1980s, and its central star (V839 Ara) started a fast evolution with large amplitudes in magnitude, surface temperature, and surface gravity, perhaps as part of a late thermal pulse causing a loop in the Hertzsprung-Russell (HR) diagram. With these fast changes, we have taken images with the Hubble Space Telescope in 2016. We do not see the massive high-velocity mass loss of the 1980s, either close in to the central star, or as clumps or changes in the nebula far from the star, or as localized or general increases in the emission-line flux caused by the shocks of the outflowing ejecta ramming into the slow-moving PN shell. We think that the lack of seeing the outgoing material is because the relatively modest total mass had already suffused the PN before the first resolved imaging in 1992, and it was the shocks from this impact that initially ionized the Stingray starting in the 1980s. We also quantify the complex fast fading of the Stingray, with each emission line and each structure having different fade rates, with half-lives ranging from 3 to 29 years. In a century or two, the PN will fade to invisibility. With this complex fading of different structures, it is impossible to derive any expansion rate for the PN. The central star had its brightness roughly constant from 1996 to 2016, but with substantial erratic variability from 15.50 to 14.18 mag in the $V$ band.


title: KNN-enhanced Deep Learning Against Noisy Labels

abstract: Supervised learning on Deep Neural Networks (DNNs) is data hungry. Optimizing performance of DNN in the presence of noisy labels has become of paramount importance since collecting a large dataset will usually bring in noisy labels. Inspired by the robustness of K-Nearest Neighbors (KNN) against data noise, in this work, we propose to apply deep KNN for label cleanup. Our approach leverages DNNs for feature extraction and KNN for ground-truth label inference. We iteratively train the neural network and update labels to simultaneously proceed towards higher label recovery rate and better classification performance. Experiment results show that under the same setting, our approach outperforms existing label correction methods and achieves better accuracy on multiple datasets, e.g.,76.78% on Clothing1M dataset.


title: Active Learning: Problem Settings and Recent Developments

abstract: In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high precision at a limited cost through the adaptive selection of samples for labeling. This paper explains the basic problem settings of active learning and recent research trends. In particular, research on learning acquisition functions to select samples from the data for labeling, theoretical work on active learning algorithms, and stopping criteria for sequential data acquisition are highlighted. Application examples for material development and measurement are introduced.


title: A Unifying Framework for Formal Theories of Novelty:Framework, Examples and Discussion

abstract: Managing inputs that are novel, unknown, or out-of-distribution is critical as an agent moves from the lab to the open world. Novelty-related problems include being tolerant to novel perturbations of the normal input, detecting when the input includes novel items, and adapting to novel inputs. While significant research has been undertaken in these areas, a noticeable gap exists in the lack of a formalized definition of novelty that transcends problem domains. As a team of researchers spanning multiple research groups and different domains, we have seen, first hand, the difficulties that arise from ill-specified novelty problems, as well as inconsistent definitions and terminology. Therefore, we present the first unified framework for formal theories of novelty and use the framework to formally define a family of novelty types. Our framework can be applied across a wide range of domains, from symbolic AI to reinforcement learning, and beyond to open world image recognition. Thus, it can be used to help kick-start new research efforts and accelerate ongoing work on these important novelty-related problems. This extended version of our AAAI 2021 paper included more details and examples in multiple domains.


title: Entangled gene regulatory networks with cooperative expression endow robust adaptive responses to unforeseen environmental changes

abstract: Living organisms must respond to environmental changes. Generally, accurate and rapid responses are provided by simple, unidirectional networks that connect inputs with outputs. Besides accuracy and speed, biological responses should also be robust to environmental or intracellular noise and mutations. Furthermore, cells must also respond to unforeseen environmental changes that have not previously been experienced, to avoid extinction prior to the evolutionary rewiring of their networks, which takes numerous generations. We have investigated gene regulatory networks that mutually activate or inhibit, and have demonstrated that complex entangled networks can make appropriate input-output relationships that satisfy the robust and adaptive responses required for unforeseen challenges. Such entangled networks function for sloppy and unreliable responses with low Hill coefficient reactions for the expression of each gene. To compensate for such sloppiness, several detours in the regulatory network exist. By taking advantage of the averaging over such detours, the network shows a higher robustness to environmental and intracellular noise as well as to mutations in the network, when compared to simple unidirectional circuits. Furthermore, the appropriate response to unforeseen challenges, allowing for functional outputs, is achieved as many genes exhibit similar dynamic expression responses, irrespective of inputs, as confirmed by applying dynamic time warping and dynamic mode decomposition. As complex entangled networks are common in gene regulatory networks and global gene expression responses are observed in microbial experiments, the present results provide a novel design principle for cellular networks.


title: Accelerating Continuous Normalizing Flow with Trajectory Polynomial Regularization

abstract: In this paper, we propose an approach to effectively accelerating the computation of continuous normalizing flow (CNF), which has been proven to be a powerful tool for the tasks such as variational inference and density estimation. The training time cost of CNF can be extremely high because the required number of function evaluations (NFE) for solving corresponding ordinary differential equations (ODE) is very large. We think that the high NFE results from large truncation errors of solving ODEs. To address the problem, we propose to add a regularization. The regularization penalizes the difference between the trajectory of the ODE and its fitted polynomial regression. The trajectory of ODE will approximate a polynomial function, and thus the truncation error will be smaller. Furthermore, we provide two proofs and claim that the additional regularization does not harm training quality. Experimental results show that our proposed method can result in 42.3% to 71.3% reduction of NFE on the task of density estimation, and 19.3% to 32.1% reduction of NFE on variational auto-encoder, while the testing losses are not affected.


title: Discrete mKdV equation via Darboux transformation

abstract: We introduce an efficient route to obtaining the discrete potential mKdV equation emerging from a particular discrete motion of discrete planar curves.


title: Master integrals for bipartite cuts of three-loop photon self energy

abstract: We calculate master integrals for bipartite cuts of the three-loop propagator QED diagrams. These master integrals determine the spectral density of the photon self energy. Our results are expressed in terms of the iterated integrals, which, apart from the $4m$ cut, reduce to Goncharov's polylogarithms. The master integrals for $4m$ cut have been calculated in our previous paper in terms of the one-fold integrals of harmonic polylogarithms and complete elliptic integrals. We provide the threshold and high-energy asymptotics of the master integrals found, including those for $4m$ cut.


title: A Deep Generative Model for Molecule Optimization via One Fragment Modification

abstract: Molecule optimization is a critical step in drug development to improve desired properties of drug candidates through chemical modification. We developed a novel deep generative model Modof over molecular graphs for molecule optimization. Modof modifies a given molecule through the prediction of a single site of disconnection at the molecule and the removal and/or addition of fragments at that site. A pipeline of multiple, identical Modof models is implemented into Modof-pipe to modify an input molecule at multiple disconnection sites. Here we show that Modof-pipe is able to retain major molecular scaffolds, allow controls over intermediate optimization steps and better constrain molecule similarities. Modof-pipe outperforms the state-of-the-art methods on benchmark datasets: without molecular similarity constraints, Modof-pipe achieves 81.2% improvement in octanol-water partition coefficient penalized by synthetic accessibility and ring size; and 51.2%, 25.6% and 9.2% improvement if the optimized molecules are at least 0.2, 0.4 and 0.6 similar to those before optimization, respectively. Modof-pipe is further enhanced into Modof-pipem to allow modifying one molecule to multiple optimized ones. Modof-pipem achieves additional performance improvement as at least 17.8% better than Modof-pipe.


title: Results from high-frequency all-sky search for continuous gravitational waves from small-ellipticity sources

abstract: We present the results of an all-sky search for continuous gravitational wave signals with frequencies in the 1700-2000 Hz range from neutron stars with ellipticity of 1e-8. The search employs the Falcon analysis pipeline [citation 5] on LIGO O2 public data. Our results improve by a factor greater than 5 over [citation 11]. This is a huge leap forward: it takes an entirely new generation of gravitational wave detectors to achieve a 10-fold sensitivity increase over the previous generation [citation 12]. Within the probed frequency range and aside from the detected outliers, we can exclude neutron stars with ellipticity of 1e-8 within 65 pc of Earth. We set upper limits on the gravitational wave amplitude that hold even for worst-case signal parameters. New outliers are found, some of which we are unable to associate with any instrumental cause. If any were associated with a rotating neutron star, this would likely be the fastest neutron star today.


title: Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users Based on Weakly Supervised Learning

abstract: The dissemination of fake news significantly affects personal reputation and public trust. Recently, fake news detection has attracted tremendous attention, and previous studies mainly focused on finding clues from news content or diffusion path. However, the required features of previous models are often unavailable or insufficient in early detection scenarios, resulting in poor performance. Thus, early fake news detection remains a tough challenge. Intuitively, the news from trusted and authoritative sources or shared by many users with a good reputation is more reliable than other news. Using the credibility of publishers and users as prior weakly supervised information, we can quickly locate fake news in massive news and detect them in the early stages of dissemination. In this paper, we propose a novel Structure-aware Multi-head Attention Network (SMAN), which combines the news content, publishing, and reposting relations of publishers and users, to jointly optimize the fake news detection and credibility prediction tasks. In this way, we can explicitly exploit the credibility of publishers and users for early fake news detection. We conducted experiments on three real-world datasets, and the results show that SMAN can detect fake news in 4 hours with an accuracy of over 91%, which is much faster than the state-of-the-art models.


title: Analysis of a viscoelastic phase separation model

abstract: A new model for viscoelastic phase separation is proposed, based on a systematically derived conservative two-fluid model. Dissipative effects are included by phenomenological viscoelastic terms. By construction, the model is consistent with the second law of thermodynamics, and we study well-posedness of the model, i.e., existence of weak solutions, a weak-strong uniqueness principle, and stability with respect to perturbations, which are proven by means of relative energy estimates. A good qualitative agreement with mesoscopic simulations is observed in numerical tests.


title: NLO QCD corrections to the processes pp $\rightarrow $ ZZ with 0, 1 and 2 jets at the LHC

abstract: We propose an implementation of ZZ, ZZj and ZZjj productions in MadGraph5_aMC@NLO framework at $\sqrt{s}$ = 14 TeV. We calculate these processes at leading order and next-to-leading order with QCD corrections and we present a theoretical prediction of their total cross sections with different cuts in transverse momentum of jets, including gluon fusion contributions. In the same time we estimate their theoretical uncertainty. We discuss the various kinematical distributions spectrums at partonic level and hadronic level applying the showering and hadronization using Pythia8. In order to reconstruct the events similar to that found at LHC, we use the ATLAS cards and the fast detector simulation Delphes.


title: Phase sensitivity approaching quantum Cramer-Rao bound in a modified SU(1,1) interferometer

abstract: SU(1,1) interferometers, based on the usage of nonlinear elements, are superior to passive interferometers in phase sensitivity. However, the SU(1,1) interferometer cannot make full use of photons carrying phase information as the second nonlinear element annihilates some of the photons inside. Here, we focus on improving phase sensitivity and propose a new protocol based on a modified SU(1,1) interferometer, where the second nonlinear element is replaced by a beam splitter. We utilize two coherent states as inputs and implement balanced homodyne measurement at the output. Our analysis suggests that the protocol we propose can achieve sub-shot-noise-limited phase sensitivity and is robust against photon loss and background noise. Our work is important for practical quantum metrology using SU(1,1) interferometers.


title: Quantum-to-classical transition via quantum cellular automata

abstract: A quantum cellular automaton (QCA) is an abstract model consisting of an array of finite-dimensional quantum systems that evolves in discrete time by local unitary operations. Here we propose a simple coarse-graining map, where the spatial structure of the QCA is merged into effective ones. Starting with a QCA that simulates the Dirac equation, we apply this coarse-graining map recursively until we get its effective dynamics in the semiclassical limit, which can be described by a classical cellular automaton. We show that the emergent-effective result of the former microscopic discrete model converges to the diffusion equation and to a classical transport equation under a specific initial condition. Therefore, QCA is a good model to validate the quantum-to-classical transition.


title: Wideband Beam Tracking in THz Massive MIMO Systems

abstract: Terahertz (THz) massive multiple-input multipleoutput (MIMO) has been considered as one of the promising technologies for future 6G wireless communications. It is essential to obtain channel information by beam tracking scheme to track mobile users in THz massive MIMO systems. However, the existing beam tracking schemes designed for narrowband systems with the traditional hybrid precoding structure suffer from a severe performance loss caused by the beam split effect, and thus cannot be directly applied to wideband THz massive MIMO systems. To solve this problem, in this paper we propose a beam zooming based beam tracking scheme by considering the recently proposed delay-phase precoding structure for THz massive MIMO. Specifically, we firstly prove the beam zooming mechanism to flexibly control the angular coverage of frequencydependent beams over the whole bandwidth, which can be realized by the elaborate design of time delays in the delay-phase precoding structure. Then, based on this beam zooming mechanism, we propose to track multiple user physical directions simultaneously in each time slot by generating multiple beams. The angular coverage of these beams is flexibly zoomed to adapt to the potential variation range of the user physical direction. After several time slots, the base station is able to obtain the exact user physical direction by finding out the beam with the largest user received power. Unlike traditional schemes where only one frequency-independent beam can be usually generated by one radio-frequency chain, the proposed beam zooming based beam tracking scheme can simultaneously track multiple user physical directions by using multiple frequency-dependent beams generated by one radio-frequency chain. Theoretical analysis shows that the proposed scheme can achieve the near-optimal achievable sum-rate performance with low beam training overhead.


title: Detecting and characterizing close-in exoplanets with Vortex Fiber Nulling

abstract: Vortex Fiber Nulling (VFN) is an interferometric method for suppressing starlight to detect and spectroscopically characterize exoplanets. It relies on a vortex phase mask and single-mode fiber to reject starlight while simultaneously coupling up to 20% of the planet light at separations of $\lesssim1\lambda/D$, thereby enabling spectroscopic characterization of a large population of RV and transit-detected planets, among others, that are inaccessible to conventional coronagraphs. VFN has been demonstrated in the lab at visible wavelengths and here we present the latest results of these experiments. This includes polychromatic nulls of $5\times10^{-4}$ in 10% bandwidth light centered around 790 nm. An upgraded testbed has been designed and is being built in the lab now; we also present a status update on that work here. Finally, we present preliminary K-band (2 $\mu$m) fiber nulling results with the infrared mask that will be used on-sky as part of a VFN mode for the Keck Planet Imager and Characterizer Instrument in 2021.


title: Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework

abstract: Deep Neural Networks (DNNs) have achieved extraordinary performance in various application domains. To support diverse DNN models, efficient implementations of DNN inference on edge-computing platforms, e.g., ASICs, FPGAs, and embedded systems, are extensively investigated. Due to the huge model size and computation amount, model compression is a critical step to deploy DNN models on edge devices. This paper focuses on weight quantization, a hardware-friendly model compression approach that is complementary to weight pruning. Unlike existing methods that use the same quantization scheme for all weights, we propose the first solution that applies different quantization schemes for different rows of the weight matrix. It is motivated by (1) the distribution of the weights in the different rows are not the same; and (2) the potential of achieving better utilization of heterogeneous FPGA hardware resources. To achieve that, we first propose a hardware-friendly quantization scheme named sum-of-power-of-2 (SP2) suitable for Gaussian-like weight distribution, in which the multiplication arithmetic can be replaced with logic shifter and adder, thereby enabling highly efficient implementations with the FPGA LUT resources. In contrast, the existing fixed-point quantization is suitable for Uniform-like weight distribution and can be implemented efficiently by DSP. Then to fully explore the resources, we propose an FPGA-centric mixed scheme quantization (MSQ) with an ensemble of the proposed SP2 and the fixed-point schemes. Combining the two schemes can maintain, or even increase accuracy due to better matching with weight distributions.


title: Two FRT bialgebroids and their relations

abstract: We generalize the FRT construction for the quiver-theoretical quantum Yang-Baxter equation and obtain a left bialgebroid $\mathfrak{A}(w)$. There are some relations between the left bialgebroid $ \mathfrak{A}(w)$ and a left bialgebroid $A_{\sigma}$ by the FRT construction for the dynamical Yang-Baxter map.


title: Texture Transform Attention for Realistic Image Inpainting

abstract: Over the last few years, the performance of inpainting to fill missing regions has shown significant improvements by using deep neural networks. Most of inpainting work create a visually plausible structure and texture, however, due to them often generating a blurry result, final outcomes appear unrealistic and make feel heterogeneity. In order to solve this problem, the existing methods have used a patch based solution with deep neural network, however, these methods also cannot transfer the texture properly. Motivated by these observation, we propose a patch based method. Texture Transform Attention network(TTA-Net) that better produces the missing region inpainting with fine details. The task is a single refinement network and takes the form of U-Net architecture that transfers fine texture features of encoder to coarse semantic features of decoder through skip-connection. Texture Transform Attention is used to create a new reassembled texture map using fine textures and coarse semantics that can efficiently transfer texture information as a result. To stabilize training process, we use a VGG feature layer of ground truth and patch discriminator. We evaluate our model end-to-end with the publicly available datasets CelebA-HQ and Places2 and demonstrate that images of higher quality can be obtained to the existing state-of-the-art approaches.


title: Observation of gravitational waves by light polarization

abstract: We provide analysis to determine the effects of gravitational waves on electromagnetic waves, using perturbation theory in general relativity. Our analysis is performed in a completely covariant manner without invoking any coordinates. For a given observer, in the geometrical-optics approximation, we work out the perturbations of the phase, amplitude, frequency and polarization properties--axes of ellipse and ellipticity of light, due to gravitational waves. With regard to the observation of gravitational waves, we discuss the measurement of Stokes parameters, through which the antenna patterns are presented to show the detectability of the gravitational wave signals.


title: Finite temperature instabilities of 2D dipolar Bose gas at arbitrary tilt angle

abstract: Advances in creating stable dipolar Bose systems, and ingenious box traps have generated tremendous interest. Theory study of dipolar bosons at finite temperature (T) has been limited. Motivated by these, we study 2D dipolar bosons at arbitrary tilt angle, $\theta$, using finite-T random phase approximation. We show that a comprehensive understanding of phases and instabilities at non-zero T can be obtained on concurrently considering dipole strength, density, temperature and $\theta$. We find the system to be in a homogeneous non-condensed phase that undergoes a collapse transition at large $\theta$, and a finite momentum instability, signaling a striped phase, at large dipolar strength; there are important differences with the T=0 case. At T = 0, BEC appears at critical dipolar strength, and at critical density. Our predictions for polar molecule system, $^{41}K^{87}Rb$, and $^{166}Er$ may provide tests of our results. Our approach may apply broadly to systems with long-range, anisotropic interactions.


title: Efficient Numerical Algorithms for the Generalized Langevin Equation

abstract: We study the design and implementation of numerical methods to solve the generalized Langevin equation (GLE) focusing on canonical sampling properties of numerical integrators. For this purpose, we cast the GLE in an extended phase space formulation and derive a family of splitting methods which generalize existing Langevin dynamics integration methods. We show exponential convergence in law and the validity of a central limit theorem for the Markov chains obtained via these integration methods, and we show that the dynamics of a suggested integration scheme is consistent with asymptotic limits of the exact dynamics and can reproduce (in the short memory limit) a superconvergence property for the analogous splitting of underdamped Langevin dynamics. We then apply our proposed integration method to several model systems, including a Bayesian inference problem. We demonstrate in numerical experiments that our method outperforms other proposed GLE integration schemes in terms of the accuracy of sampling. Moreover, using a parameterization of the memory kernel in the GLE as proposed by Ceriotti et al [9], our experiments indicate that the obtained GLE-based sampling scheme outperforms state-of-the-art sampling schemes based on underdamped Langevin dynamics in terms of robustness and efficiency.


title: Comparison Between Different Topological Models of Concurrency

abstract: In this note, we provide an explicit non-Quillen equivalence between the category of precubical sets and Gaucher's category of flows via a class of "realization functors" (with mild assumptions on the cofibrations of the category of precubical sets). In addition, we demonstrate a Quillen equivalence between simplicial semicategories and flows before proving that simplicial semicategories satisfy many of the same properties as flows. Finally, we introduce the category of boxed symmetric trees, presheaves on which may provide a slightly more flexible setting for concurrent computing than (pre)cubical sets, before showing that when endowed with degeneracies, the aforementioned presheaf category is a test category (although not strict test).


title: Experimental noise in small-angle scattering can be assessed using the Bayesian indirect Fourier transformation

abstract: Small-angle X-ray and neutron scattering are widely used to investigate soft matter and biophysical systems. The experimental errors are essential when assessing how well a hypothesized model fits the data. Likewise, they are important when weights are assigned to multiple data sets used to refine the same model. Therefore, it is problematic when experimental errors are over- or under-estimated. A method is presented, using Bayesian indirect Fourier transformation for small-angle scattering data, to assess whether or not a given small-angle scattering data set has over- or under-estimated experimental errors. The method is effective on both simulated and experimental data, and can be used to assess and rescale the errors accordingly. Even if the estimated experimental errors are appropriate, it is ambiguous whether or not a model fits sufficiently well, as the "true" reduced $\chi^2$ of the data is not necessarily unity. This is particularly relevant for approaches where overfitting is an inherent challenge, such as reweighting of a simulated molecular dynamics trajectory against small-angle scattering data or ab initio modelling. Using the outlined method, it is shown that one can determine what reduced $\chi^2$ to aim for when fitting a model against small-angle scattering data. The method is easily accessible via the web interface BayesApp.


title: Generalization of the Secant Method for Nonlinear Equations (extended version)

abstract: The secant method is a very effective numerical procedure used for solving nonlinear equations of the form $f(x)=0$. It is derived via a linear interpolation procedure and employs only values of $f(x)$ at the approximations to the root of $f(x)=0$, hence it computes $f(x)$ only once per iteration. In this note, we generalize it by replacing the relevant linear interpolant by a suitable $(k+1)$-point polynomial of interpolation, where $k$ is an integer at least 2. Just as the secant method, this generalization too enjoys the property that it computes $f(x)$ only once per iteration. We provide its error in closed form and analyze its order of convergence $s_k$. We show that this order of convergence is greater than that of the secant method, and it increases towards $2$ as $k\to \infty$. (Indeed, $s_7=1.9960\cdots$, for example.) This is true for the efficiency index of the method too. We also confirm the theory via an illustrative example.


title: An explanation for high defect tolerance in metal halide perovskite quantum dots

abstract: We propose Auger-like process assisted by quantum defects in metal halide perovskite quantum dots, where a charge carrier in the ground state of the quantum dot is trapped by quantum defects, resulting in another charge carrier in defect is excited and returns back to the ground state of the quantum dot. We find that the whole process is on the femtosecond scale. More importantly, the process is independent of the depth and species of the defects, which is in good agreement with the recent theoretical prediction using ab initio nonadiabatic molecular dynamics simulation. This Auger-like process may provide a potential explanation of high defect tolerance in metal halide perovskite materials.


title: Out-Of-Distribution Detection With Subspace Techniques And Probabilistic Modeling Of Features

abstract: This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap method to detect OOD samples in DNN. However, the features produced by a DNN at any given layer do not fully occupy the corresponding high-dimensional feature space. We apply linear statistical dimensionality reduction techniques and nonlinear manifold-learning techniques on the high-dimensional features in order to capture the true subspace spanned by the features. We hypothesize that such lower-dimensional feature embeddings can mitigate the curse of dimensionality, and enhance any feature-based method for more efficient and effective performance. In the context of uncertainty estimation and OOD, we show that the log-likelihood score obtained from the distributions learnt on this lower-dimensional subspace is more discriminative for OOD detection. We also show that the feature reconstruction error, which is the $L_2$-norm of the difference between the original feature and the pre-image of its embedding, is highly effective for OOD detection and in some cases superior to the log-likelihood scores. The benefits of our approach are demonstrated on image features by detecting OOD images, using popular DNN architectures on commonly used image datasets such as CIFAR10, CIFAR100, and SVHN.


title: Variational Interaction Information Maximization for Cross-domain Disentanglement

abstract: Cross-domain disentanglement is the problem of learning representations partitioned into domain-invariant and domain-specific representations, which is a key to successful domain transfer or measuring semantic distance between two domains. Grounded in information theory, we cast the simultaneous learning of domain-invariant and domain-specific representations as a joint objective of multiple information constraints, which does not require adversarial training or gradient reversal layers. We derive a tractable bound of the objective and propose a generative model named Interaction Information Auto-Encoder (IIAE). Our approach reveals insights on the desirable representation for cross-domain disentanglement and its connection to Variational Auto-Encoder (VAE). We demonstrate the validity of our model in the image-to-image translation and the cross-domain retrieval tasks. We further show that our model achieves the state-of-the-art performance in the zero-shot sketch based image retrieval task, even without external knowledge. Our implementation is publicly available at: https://github.com/gr8joo/IIAE


title: Increase of Low-Frequency Modes of User Dynamics in Online Social Networks During Overheating of Discussions

abstract: User dynamics in online social networks have a significant impact on not only the online community but also real-world activities. As examples, we can mention explosive user dynamics triggered by social polarization, echo chamber phenomena, fake news, etc. Explosive user dynamics are frequently called online flaming. The wave equation-based model for online social networks (called the oscillation model) is a theoretical model proposed to describe user dynamics in online social networks. This model can be used to understand the relationship between explosive user dynamics and the structure of social networks. However, since the oscillation model was introduced as a purely theoretical model of social networks, it is necessary to confirm whether the model describes real phenomena correctly or not. In this paper, we first show a prediction from the oscillation model; the low-frequency oscillation mode of user dynamics will be dominant when the structure of online social networks changes so that user activity is activated. To verify the predictions with actual data, we show spectral analyses of both the log data of posts on an electronic bulletin board site and the frequency data of word search from Google Trends. The results support the predictions from the theoretical model.


title: Lefschetz fibrations on nonorientable 4-manifolds

abstract: Let $W$ be a nonorientable $4$-dimensional handlebody without $3$- and $4$-handles. We show that $W$ admits a Lefschetz fibration over the $2$-disk, whose regular fiber is a nonorientable surface with nonempty boundary. This is an analogue of a result of Harer obtained in the orientable case. As a corollary, we obtain a $4$-dimensional proof of the fact that every nonorientable closed $3$-manifold admits an open book decomposition, which was first proved by Berstein and Edmonds using branched coverings. Moreover, the monodromy of the open book we obtain for a given $3$-manifold belongs to the twist subgroup of the mapping class group of the page. In particular, we construct an explicit minimal open book for the connected sum of arbitrarily many copies of the product of the circle with the real projective plane. We also obtain a relative trisection diagram for $W$, based on the nonorientable Lefschetz fibration we construct, similar to the orientable case first studied by Castro. As a corollary, we get trisection diagrams for some closed $4$-manifolds, e.g. the product of the $2$-sphere with the real projective plane, by doubling $W$. Moreover, if $X$ is a closed nonorientable $4$-manifold which admits a Lefschetz fibration over the $2$-sphere, equipped with a section of square $\pm 1$, then we construct a trisection diagram of $X$, which is determined by the vanishing cycles of the Lefschetz fibration. Finally, we include some simple observations about low-genus Lefschetz fibrations on closed nonorientable $4$-manifolds.


title: RouTEE: A Secure Payment Network Routing Hub using Trusted Execution Environments

abstract: Cryptocurrencies such as Bitcoin and Ethereum have made payment transactions possible without a trusted third party, but they have a scalability issue due to their consensus mechanisms. Payment networks have emerged to overcome this limitation by executing transactions outside of the blockchain, which is why these are referred to as off-chain transactions. In order to establish a payment channel between two users, the users lock their deposits in the blockchain, and then they can pay each other through the channel. Furthermore, payment networks support multi-hop payments that allow users to transfer their balances to other users who are connected to them via multiple channels. However, multi-hop payments are hard to be accomplished, as they are heavily dependent on routing users on a payment path from a sender to a receiver. Although routing hubs can make multi-hop payments more practical and efficient, they need a lot of collateral locked for a long period and have privacy issues in terms of payment history. We propose RouTEE, a secure payment routing hub that is fully feasible without the hub's deposit. Unlike existing payment networks, RouTEE provides high balance liquidity, and details about payments are concealed from hosts by leveraging trusted execution environments (TEEs). RouTEE is designed to make rational hosts behave honestly, by introducing a new routing fee scheme and a secure settlement method. Moreover, users do not need to monitor the blockchain in real-time or run full nodes. They can participate in RouTEE by simply verifying block headers through light clients; furthermore, having only one channel with RouTEE is sufficient to interact with other users. Our implementation demonstrates that RouTEE is highly efficient and outperforms Lightning Network that is the state-of-the-art payment network.


title: Polyhedral Homotopies in Cox Coordinates

abstract: We introduce the Cox homotopy algorithm for solving a sparse system of polynomial equations on a compact toric variety $X_\Sigma$. The algorithm lends its name from a construction, described by Cox, of $X_\Sigma$ as a GIT quotient $X_\Sigma = (\mathbb{C}^k \setminus Z) // G$ of a quasi-affine variety by the action of a reductive group. Our algorithm tracks paths in the total coordinate space $\mathbb{C}^k$ of $X_\Sigma$ and can be seen as a homogeneous version of the standard polyhedral homotopy, which works on the dense torus of $X_\Sigma$. It furthermore generalizes the commonly used path tracking algorithms in (multi)projective spaces in that it tracks a set of homogeneous coordinates contained in the $G$-orbit corresponding to each solution. The Cox homotopy combines the advantages of polyhedral homotopies and (multi)homogeneous homotopies, tracking only mixed volume many solutions and providing an elegant way to deal with solutions on or near the special divisors of $X_\Sigma$. In addition, the strategy may help to understand the deficiency of the root count for certain families of systems with respect to the BKK bound.


title: Data InStance Prior (DISP) in Generative Adversarial Networks

abstract: Recent advances in generative adversarial networks (GANs) have shown remarkable progress in generating high-quality images. However, this gain in performance depends on the availability of a large amount of training data. In limited data regimes, training typically diverges, and therefore the generated samples are of low quality and lack diversity. Previous works have addressed training in low data setting by leveraging transfer learning and data augmentation techniques. We propose a novel transfer learning method for GANs in the limited data domain by leveraging informative data prior derived from self-supervised/supervised pre-trained networks trained on a diverse source domain. We perform experiments on several standard vision datasets using various GAN architectures (BigGAN, SNGAN, StyleGAN2) to demonstrate that the proposed method effectively transfers knowledge to domains with few target images, outperforming existing state-of-the-art techniques in terms of image quality and diversity. We also show the utility of data instance prior in large-scale unconditional image generation.


title: Observation of $\eta^\prime\rightarrow\pi^+\pi^-\mu^+\mu^-$

abstract: Using $(1310.6 \pm 7.0) \times 10^{6}~J/\psi$ events acquired with the BESIII detector at the BEPCII storage rings, the decay $\eta^\prime\rightarrow\pi^+\pi^-\mu^+\mu^-$ is observed for the first time with a significance of 8$\sigma$ via the process $J/\psi\rightarrow\gamma\eta'$. We measure the branching fraction of $\eta^\prime\rightarrow\pi^+\pi^-\mu^+\mu^-$ to be $\mathcal{B}(\eta^\prime\rightarrow\pi^+\pi^-\mu^+\mu^-)$=(1.97$\pm$0.33(stat.)$\pm$0.18(syst.))$\times10^{-5}$, where the first and second uncertainties are statistical and systematic, respectively.


title: Intrinsic magnetic topological insulators

abstract: Introducing magnetism into topological insulators breaks time-reversal symmetry, and the magnetic exchange interaction can open a gap in the otherwise gapless topological surface states. This allows various novel topological quantum states to be generated, including the quantum anomalous Hall effect (QAHE) and axion insulator states. Magnetic doping and magnetic proximity are viewed as being useful means of exploring the interaction between topology and magnetism. However, the inhomogeneity of magnetic doping leads to complicated magnetic ordering and small exchange gaps, and consequently the observed QAHE appears only at ultralow temperatures. Therefore, intrinsic magnetic topological insulators are highly desired for increasing the QAHE working temperature and for investigating topological quantum phenomena further. The realization and characterization of such systems are essential for both fundamental physics and potential technical revolutions. This review summarizes recent research progress in intrinsic magnetic topological insulators, focusing mainly on the antiferromagnetic topological insulator MnBi2Te4 and its family of materials.


title: On Sharp Enhancement of Effective Mass of Quasiparticles and Coefficient of T^{2} Term of Resistivity around First-Order Metamagnetic Transition Observed in UTe_{2}

abstract: The mechanism underlying the enhancement of the Sommerfeld coefficient of quasiparticles at the first-order metamagnetic transition in UTe_2, reported by Miyake et al. in J. Phys. Soc. Jpn. 88, 063706 (2019), is discussed theoretically by taking into account the ferromagnetic order-parameter fluctuations on the basis of the Landau theory of phase transition. We find that the enhanced ferromagnetic spin fluctuation gives rise to the enhancement of the effective mass of the quasiparticles or the Sommerfeld coefficient \gamma,which is consistent with the experimental observations. At the same time, the Kadowaki-Woods type scaling around the metamagnetic transition, reported by Imajo et al.in J. Phys. Soc. Jpn. 88, 083705 (2019) and Knafo et al. in J. Phys. Soc. Jpn. 88, 063705 (2019), is also understood semi-quantitatively by assuming reasonable values of parameters of Landau-type free energy reproducing key quantities characterizing the metamagnetic transition.


title: Precision of silicon oxynitride refractive-index profile retrieval using optical characterization

abstract: Layers with gradient refractive-index profile are an attractive alternative to conventional homogeneous stack coatings. However, the optical characterization and monitoring of the graded refractive-index profile is a complex issue, which has been typically solved by using a simplified model of mixed materials. Although this approach provides a solution to the problem, the precision, which can be expected from optical characterization of the refractive index gradient, remains unclear. In this work, we study optical characterization of SiO_xN_y layers deposited via reactive dual ion beam sputtering. To characterize the deposited layers, we use several methods including reflectance, and transmittance spectra at a broad range of incident angles, together with spectral ellipsometry. All the data were simultaneously fitted with a general profile of refractive index. The expected profile used in our fit was based on characterization of SiO_xN_y layers with a varying stoichiometry. By altering of the profile, we discussed sensitivity of such alternation on fit quality and we studied ambiguity of merit-function minimization. We demonstrate that while the scanning of particular parameters of the profile can be seemingly very precise, we obtain a very good agreement between the experimental data and model for a broad range of gradient shapes, where the refractive-index value on major part of the profile can differ as much as 0.02 from the mean value.


title: Extending the frequency reach of pulsar timing array based gravitational wave search without high cadence observations

abstract: Gravitational wave (GW) searches using pulsar timing arrays (PTAs) are assumed to be limited by the typical average observational cadence of $1/(2~{\rm weeks})$ for a single pulsar to GW frequencies $\lesssim 4\times 10^{-7}$ Hz. We show that this assumption is incorrect and that a PTA can detect signals with much higher frequencies, which are preserved in the data due to aliasing, by exploiting asynchronous observations from multiple pulsars. This allows an observation strategy that is scalable to future large-scale PTAs containing $O(10^3)$ pulsars, enabled by the Five-hundred meter Aperture Spherical Telescope and the Square Kilometer Array, without requiring a higher per-pulsar observation cadence. We show that higher frequency GW observations, reaching up to $4\times 10^{-4}$ Hz with an SKA-era PTA, have significant astrophysical implications, such as (i) a three orders of magnitude better constraint than current high-cadence observations on GW strain in the $[10,400]$ $\mu{\rm Hz}$ band, and (ii) sensitive tests of the no-hair theorem in the mass range of supermassive black hole binaries using their inspiral, merger, and ringdown signals.


title: Overcomplete Representations Against Adversarial Videos

abstract: Adversarial robustness of deep neural networks is an extensively studied problem in the literature and various methods have been proposed to defend against adversarial images. However, only a handful of defense methods have been developed for defending against attacked videos. In this paper, we propose a novel Over-and-Under complete restoration network for Defending against adversarial videos (OUDefend). Most restoration networks adopt an encoder-decoder architecture that first shrinks spatial dimension then expands it back. This approach learns undercomplete representations, which have large receptive fields to collect global information but overlooks local details. On the other hand, overcomplete representations have opposite properties. Hence, OUDefend is designed to balance local and global features by learning those two representations. We attach OUDefend to target video recognition models as a feature restoration block and train the entire network end-to-end. Experimental results show that the defenses focusing on images may be ineffective to videos, while OUDefend enhances robustness against different types of adversarial videos, ranging from additive attacks, multiplicative attacks to physically realizable attacks. Code: https://github.com/shaoyuanlo/OUDefend


title: Towards Accurate Active Camera Localization

abstract: In this work, we tackle the problem of active camera localization, which controls the camera movements actively to achieve an accurate camera pose. The past solutions are mostly based on Markov Localization, which reduces the position-wise camera uncertainty for localization. These approaches localize the camera in the discrete pose space and are agnostic to the localization-driven scene property, which restricts the camera pose accuracy in the coarse scale. We propose to overcome these limitations via a novel active camera localization algorithm, composed of a passive and an active localization module. The former optimizes the camera pose in the continuous pose space by establishing point-wise camera-world correspondences. The latter explicitly models the scene and camera uncertainty components to plan the right path for accurate camera pose estimation. We validate our algorithm on the challenging localization scenarios from both synthetic and scanned real-world indoor scenes. Experimental results demonstrate that our algorithm outperforms both the state-of-the-art Markov Localization based approach and other compared approaches on the fine-scale camera pose accuracy. Code and data are released at https://github.com/qhFang/AccurateACL.


title: Raw Image Deblurring

abstract: Deep learning-based blind image deblurring plays an essential role in solving image blur since all existing kernels are limited in modeling the real world blur. Thus far, researchers focus on powerful models to handle the deblurring problem and achieve decent results. For this work, in a new aspect, we discover the great opportunity for image enhancement (e.g., deblurring) directly from RAW images and investigate novel neural network structures benefiting RAW-based learning. However, to the best of our knowledge, there is no available RAW image deblurring dataset. Therefore, we built a new dataset containing both RAW images and processed sRGB images and design a new model to utilize the unique characteristics of RAW images. The proposed deblurring model, trained solely from RAW images, achieves the state-of-art performance and outweighs those trained on processed sRGB images. Furthermore, with fine-tuning, the proposed model, trained on our new dataset, can generalize to other sensors. Additionally, by a series of experiments, we demonstrate that existing deblurring models can also be improved by training on the RAW images in our new dataset. Ultimately, we show a new venue for further opportunities based on the devised novel raw-based deblurring method and the brand-new Deblur-RAW dataset.


title: Learning to Generate Content-Aware Dynamic Detectors

abstract: Model efficiency is crucial for object detection. Mostprevious works rely on either hand-crafted design or auto-search methods to obtain a static architecture, regardless ofthe difference of inputs. In this paper, we introduce a newperspective of designing efficient detectors, which is automatically generating sample-adaptive model architectureon the fly. The proposed method is named content-aware dynamic detectors (CADDet). It first applies a multi-scale densely connected network with dynamic routing as the supernet. Furthermore, we introduce a course-to-fine strat-egy tailored for object detection to guide the learning of dynamic routing, which contains two metrics: 1) dynamic global budget constraint assigns data-dependent expectedbudgets for individual samples; 2) local path similarity regularization aims to generate more diverse routing paths. With these, our method achieves higher computational efficiency while maintaining good performance. To the best of our knowledge, our CADDet is the first work to introduce dynamic routing mechanism in object detection. Experiments on MS-COCO dataset demonstrate that CADDet achieves 1.8 higher mAP with 10% fewer FLOPs compared with vanilla routing strategy. Compared with the models based upon similar building blocks, CADDet achieves a 42% FLOPs reduction with a competitive mAP.


title: Visualization and Manipulation of Bilayer Graphene Quantum Dots with Broken Rotational Symmetry and Nontrivial Topology

abstract: Electrostatically defined quantum dots (QDs) in Bernal stacked bilayer graphene (BLG) are a promising quantum information platform because of their long spin decoherence times, high sample quality, and tunability. Importantly, the shape of QD states determines the electron energy spectrum, the interactions between electrons, and the coupling of electrons to their environment, all of which are relevant for quantum information processing. Despite its importance, the shape of BLG QD states remains experimentally unexamined. Here we report direct visualization of BLG QD states by using a scanning tunneling microscope. Strikingly, we find these states exhibit a robust broken rotational symmetry. By using a numerical tight-binding model, we determine that the observed broken rotational symmetry can be attributed to low energy anisotropic bands. We then compare confined holes and electrons and demonstrate the influence of BLG's nontrivial band topology. Our study distinguishes BLG QDs from prior QD platforms with trivial band topology.


title: Improving the open cluster census. I. Comparison of clustering algorithms applied to Gaia DR2 data

abstract: The census of open clusters in the Milky Way is in a never-before seen state of flux. Recent works have reported hundreds of new open clusters thanks to the incredible astrometric quality of the Gaia satellite, but other works have also reported that many open clusters discovered in the pre Gaia era may be associations. We aim to conduct a comparison of clustering algorithms used to detect open clusters, attempting to statistically quantify their strengths and weaknesses by deriving the sensitivity, specificity, and precision of each as well as their true positive rate against a larger sample. We selected DBSCAN, HDBSCAN, and Gaussian mixture models for further study, owing to their speed and appropriateness for use with Gaia data. We developed a preprocessing pipeline for Gaia data and developed the algorithms further for the specific application to open clusters. We derived detection rates for all 1385 open clusters in the fields in our study as well as more detailed performance statistics for 100 of these open clusters. DBSCAN was sensitive to 50% to 62% of the true positive open clusters in our sample, with generally very good specificity and precision. HDBSCAN traded precision for a higher sensitivity of up to 82%, especially across different distances and scales of open clusters. Gaussian mixture models were slow and only sensitive to 33% of open clusters in our sample, which tended to be larger objects. Additionally, we report on 41 new open cluster candidates detected by HDBSCAN, three of which are closer than 500 pc. When used with additional post-processing to mitigate its false positives, we have found that HDBSCAN is the most sensitive and effective algorithm for recovering open clusters in Gaia data. Our results suggest that many more new and already reported open clusters have yet to be detected in Gaia data.


title: UnrealPerson: An Adaptive Pipeline towards Costless Person Re-identification

abstract: The main difficulty of person re-identification (ReID) lies in collecting annotated data and transferring the model across different domains. This paper presents UnrealPerson, a novel pipeline that makes full use of unreal image data to decrease the costs in both the training and deployment stages. Its fundamental part is a system that can generate synthesized images of high-quality and from controllable distributions. Instance-level annotation goes with the synthesized data and is almost free. We point out some details in image synthesis that largely impact the data quality. With 3,000 IDs and 120,000 instances, our method achieves a 38.5% rank-1 accuracy when being directly transferred to MSMT17. It almost doubles the former record using synthesized data and even surpasses previous direct transfer records using real data. This offers a good basis for unsupervised domain adaption, where our pre-trained model is easily plugged into the state-of-the-art algorithms towards higher accuracy. In addition, the data distribution can be flexibly adjusted to fit some corner ReID scenarios, which widens the application of our pipeline. We will publish our data synthesis toolkit and synthesized data in https://github.com/FlyHighest/UnrealPerson.


title: Hydrodynamic effects in the capture of rod-like molecules by a nanopore

abstract: In the approach of biomolecules to a nanopore, it is essential to capture the effects of hydrodynamic anisotropy of the molecules and the near-wall hydrodynamic interactions which hinder their diffusion. We present a detailed theoretical analysis of the behaviour of a rod-like molecule attracted electrostatically by a charged nanopore. We first estimate the time scales corresponding to Brownian and electrostatic translations and reorientation. We find that Brownian motion becomes negligible at distances within the pore capture radius, and numerically determine the trajectories of the nano-rod in this region to explore the effects of anisotropic mobility. This allows us to determine the range of directions from the pore in which hydrodynamic interactions with the boundary shape the approach dynamics and need to be accounted for in detailed modelling.


title: High Curie Temperature Ferromagnetic Semiconductor: Bimetal Transition Iodide V$_2$Cr$_2$I$_9$

abstract: Bimetal transition iodides in two-dimensional scale provide an interesting idea to combine a set of single-transition-metal ferromagnetic semiconductors together. Motivated by structural engineering on bilayer CrI$_3$ to tune its magnetism and works that realize ideal properties by stacking van der Waals transitional metal dichalcogenides in a certain order. Here we stack monolayer VI$_3$ onto monolayer CrI$_3$ with a middle-layer I atoms discarded to construct monolayer V$_2$Cr$_2$I$_9$. Based on this crystal model, the stable and metastable phases are determined among 7 possible phases by first-principles calculations. It is illustrated that both the two phases have Curie temperature $\sim$ 6 (4) times higher than monolayer CrI$_3$ and VI$_3$. The reason can be partly attributed to their large magnetic anisotropy energy (the maximum value reaches 412.9 $\mu$eV/atom). More importantly, the Curie temperature shows an electric field and strain dependent character and can even surpass room temperature under a moderate strain range. At last, we believe that the bimetal transition iodide V$_2$Cr$_2$I$_9$ monolayer would support potential opportunities for spintronic devices.


title: Sparse Correspondence Analysis for Contingency Tables

abstract: Since the introduction of the lasso in regression, various sparse methods have been developed in an unsupervised context like sparse principal component analysis (s-PCA), sparse canonical correlation analysis (s-CCA) and sparse singular value decomposition (s-SVD). These sparse methods combine feature selection and dimension reduction. One advantage of s-PCA is to simplify the interpretation of the (pseudo) principal components since each one is expressed as a linear combination of a small number of variables. The disadvantages lie on the one hand in the difficulty of choosing the number of non-zero coefficients in the absence of a well established criterion and on the other hand in the loss of orthogonality for the components and/or the loadings. In this paper we propose sparse variants of correspondence analysis (CA)for large contingency tables like documents-terms matrices used in text mining, together with pPMD, a deation technique derived from projected deflation in s-PCA. We use the fact that CA is a double weighted PCA (for rows and columns) or a weighted SVD, as well as a canonical correlation analysis of indicator variables. Applying s-CCA or s-SVD allows to sparsify both rows and columns weights. The user may tune the level of sparsity of rows and columns and optimize it according to some criterium, and even decide that no sparsity is needed for rows (or columns) by relaxing one sparsity constraint. The latter is equivalent to apply s-PCA to matrices of row (or column) profiles.


title: Oscillatory and tip-splitting instabilities in 2D dynamic fracture: The roles of intrinsic material length and time scales

abstract: Recent theoretical and computational progress has led to unprecedented understanding of symmetry-breaking instabilities in 2D dynamic fracture. At the heart of this progress resides the identification of two intrinsic, near crack tip length scales -- a nonlinear elastic length scale $\ell$ and a dissipation length scale $\xi$ -- that do not exist in the classical theory of cracks. In particular, it has been shown that at a high propagation velocity $v$, cracks in 2D brittle materials undergo an oscillatory instability whose wavelength varies linearly with $\ell$, and at yet higher propagation velocities and larger loading levels, a tip-splitting instability emerges, both in agreements with experiments. In this paper, using phase-field models of brittle fracture, we demonstrate the following properties of the oscillatory instability: (i) It exists also in the absence of near-tip elastic nonlinearity, i.e. in the limit $\ell\!\to\!0$, with a wavelength determined by the dissipation length scale $\xi$. This result shows that the instability crucially depends on the existence of an intrinsic length scale associated with the breakdown of linear elasticity near crack tips, independently of whether the latter is related to nonlinear elasticity or to dissipation. (ii) It is a supercritical Hopf bifurcation, featuring a vanishing oscillations amplitude at onset. (iii) It is largely independent of the fracture energy $\Gamma(v)$ that is controlled by a dissipation time scale. These results substantiate the universal nature of the oscillatory instability of ultra-high speed cracks in 2D. In addition, we provide evidence indicating that the ultra-high velocity tip-splitting instability is controlled by the limiting rate of elastic energy transport inside the crack tip region. Finally, we describe in detail the numerical implementation scheme of the employed phase-field fracture approach.


title: Exergy analysis of marine waste heat recovery CO2 closed-cycle gas turbine system

abstract: This paper presents an exergy analysis of marine waste heat recovery CO2 closed-cycle gas turbine system. Based on the operating parameters obtained in system exploitation, it is performed analysis of each system component individually, as well as analysis of the whole observed system. While observing all heat exchangers it is found that combustion gases-CO2 heat exchangers have the lowest exergy destructions and the highest exergy efficiencies (higher than 92%). The lowest exergy efficiency of all heat exchangers is detected in Cooler (51.84%). Observed system is composed of two gas turbines and two compressors. The analysis allows detection of dominant mechanical power producer and the dominant mechanical power consumer. It is also found that the turbines from the observed system have much higher exergy efficiencies in comparison to compressors (exergy efficiency of both turbines is higher than 94%, while exergy efficiency of both compressors did not exceed 87%). The whole observed waste heat recovery system has exergy destruction equal to 6270.73 kW, while the exergy efficiency of the whole system is equal to 64.12% at the selected ambient state. Useful mechanical power produced by the whole system and used for electrical generator drive equals 11204.80 kW. The obtained high exergy efficiency of the whole observed system proves its application on-board ships.


title: The planar interface instability during freezing of a polymer solution: Diffusion-controlled or not?

abstract: Freezing of polymer solutions has been extensively investigated from many aspects, especially the complex pattern formation. The cell/dendrite micro-structures are believed to be in the type of diffusion-induced M-S instability. However, the presence of polymer as an impurity in water is significantly different from that of small ions. The quantitative transient investigation on directional freezing of polymer solutions remains lack due to some challenges. For the first time, we observed the planar instability behaviors during unidirectional freezing of a polymer solution together with a typical ionic solution with manipulated ice orientation, and their pattern formation of S/L interface morphology as a function of time in the transient planar instability process has been revealed and compared to each other. It is found with real-time observation that the polymer solution exhibits a global instability mode instead of a local instability mode that is common in ionic solution during planar instability. W-L model was applied to quantitatively address the variation of solute recoil of ionic/polymer solution. And it is found that the W-L model can only reproduce the solute recoil of ionic solution instead of polymer solution, which indicates the complex physics behind freezing of a polymer solution. The paper provides a spectacular contrast of directional freezing process between polymer solution and ionic solution and is believed to promote relevant investigations in terms of the theoretical approach to describing the freezing behavior of polymer solution.


title: Optimization of spatial control strategies for population replacement, application to Wolbachia

abstract: In this article, we are interested in the analysis and simulation of solutions to an optimal control problem motivated by population dynamics issues. In order to control the spread of mosquito-borne arboviruses, the population replacement technique consists in releasing into the environment mosquitoes infected with the Wolbachia bacterium, which greatly reduces the transmission of the virus to the humans. Spatial releases are then sought in such a way that the infected mosquito population invades the uninfected mosquito population. Assuming very high mosquito fecundity rates, we first introduce an asymptotic model on the proportion of infected mosquitoes and then an optimal control problem to determine the best spatial strategy to achieve these releases. We then analyze this problem, including the optimality of natural candidates and carry out first numerical simulations in one dimension of space to illustrate the relevance of our approach.


title: Revisiting Iterative Back-Translation from the Perspective of Compositional Generalization

abstract: Human intelligence exhibits compositional generalization (i.e., the capacity to understand and produce unseen combinations of seen components), but current neural seq2seq models lack such ability. In this paper, we revisit iterative back-translation, a simple yet effective semi-supervised method, to investigate whether and how it can improve compositional generalization. In this work: (1) We first empirically show that iterative back-translation substantially improves the performance on compositional generalization benchmarks (CFQ and SCAN). (2) To understand why iterative back-translation is useful, we carefully examine the performance gains and find that iterative back-translation can increasingly correct errors in pseudo-parallel data. (3) To further encourage this mechanism, we propose curriculum iterative back-translation, which better improves the quality of pseudo-parallel data, thus further improving the performance.


title: Comparisons of multiple treatment groups with a negative control or placebo group: Dunnett test vs. closed test procedur

abstract: Several treatments are usually compared with a control using the Dunnett test. As an alternative, three variants of the closed testing approach are considered, one with ANOVA-F-tests, one with MCT-GrandMean and one with global Dunnett-tests in the partition hypotheses.


title: On the fine properties of parabolic measures associated to strongly degenerate parabolic operators of Kolmogorov type

abstract: We consider strongly degenerate parabolic operators of the form \[ \mathcal{L}:=\nabla_X\cdot(A(X,Y,t)\nabla_X)+X\cdot\nabla_Y-\partial_t \] in unbounded domains \[ \Omega=\{(X,Y,t)=(x,x_{m},y,y_{m},t)\in\mathbb R^{m-1}\times\mathbb R\times\mathbb R^{m-1}\times\mathbb R\times\mathbb R\mid x_m>\psi(x,y,t)\}. \] We assume that $A=A(X,Y,t)$ is bounded, measurable and uniformly elliptic (as a matrix in $\mathbb R^{m}$) and concerning $\psi$ and $\Omega$ we assume that $\Omega$ is what we call an (unbounded) Lipschitz domain: $\psi$ satisfies a uniform Lipschitz condition adapted to the dilation structure and the (non-Euclidean) Lie group underlying the operator $\mathcal{L}$. We prove, assuming in addition that $\psi$ is independent of the variable $y_m$, that $\psi$ satisfies an additional regularity condition formulated in terms of a Carleson measure, and additional conditions on $A$, that the associated parabolic measure is absolutely continuous with respect to a surface measure and that the associated Radon-Nikodym derivative defines an $A_\infty$-weight with respect to the surface measure.


title: Singular flat bands

abstract: We review recent progresses in the study of flat band systems, especially focusing on the fundamental physics related to the singularity of the flat band's Bloch wave functions. We first explain that the flat bands can be classified into two classes: singular and nonsingular flat bands, based on the presence or absence of the singularity in the flat band's Bloch wave functions. The singularity is generated by the band crossing of the flat band with another dispersive band. In the singular flat band, one can find special kind of eigenmodes, called the non-contractible loop states and the robust boundary modes, which exhibit nontrivial real space topology. Then, we review the experimental realization of these topological eigenmodes of the flat band in the photonic lattices. While the singularity of the flat band is topologically trivial, we show that the maximum quantum distance around the singularity is a bulk invariant representing the strength of the singularity which protects the robust boundary modes. Finally, we discuss how the maximum quantum distance or the strength of the singularity manifests itself in the anomalous Landau level spreading of the singular flat band when it has a quadratic band-crossing with another band.


title: Towards Uncovering the Intrinsic Data Structures for Unsupervised Domain Adaptation using Structurally Regularized Deep Clustering

abstract: Unsupervised domain adaptation (UDA) is to learn classification models that make predictions for unlabeled data on a target domain, given labeled data on a source domain whose distribution diverges from the target one. Mainstream UDA methods strive to learn domain-aligned features such that classifiers trained on the source features can be readily applied to the target ones. Although impressive results have been achieved, these methods have a potential risk of damaging the intrinsic data structures of target discrimination, raising an issue of generalization particularly for UDA tasks in an inductive setting. To address this issue, we are motivated by a UDA assumption of structural similarity across domains, and propose to directly uncover the intrinsic target discrimination via constrained clustering, where we constrain the clustering solutions using structural source regularization that hinges on the very same assumption. Technically, we propose a hybrid model of Structurally Regularized Deep Clustering, which integrates the regularized discriminative clustering of target data with a generative one, and we thus term our method as H-SRDC. Our hybrid model is based on a deep clustering framework that minimizes the Kullback-Leibler divergence between the distribution of network prediction and an auxiliary one, where we impose structural regularization by learning domain-shared classifier and cluster centroids. By enriching the structural similarity assumption, we are able to extend H-SRDC for a pixel-level UDA task of semantic segmentation. We conduct extensive experiments on seven UDA benchmarks of image classification and semantic segmentation. With no explicit feature alignment, our proposed H-SRDC outperforms all the existing methods under both the inductive and transductive settings. We make our implementation codes publicly available at https://github.com/huitangtang/H-SRDC.


title: CTRLsum: Towards Generic Controllable Text Summarization

abstract: Current summarization systems yield generic summaries that are disconnected from users' preferences and expectations. To address this limitation, we present CTRLsum, a novel framework for controllable summarization. Our approach enables users to control multiple aspects of generated summaries by interacting with the summarization system through textual input in the form of a set of keywords or descriptive prompts. Using a single unified model, CTRLsum is able to achieve a broad scope of summary manipulation at inference time without requiring additional human annotations or pre-defining a set of control aspects during training. We quantitatively demonstrate the effectiveness of our approach on three domains of summarization datasets and five control aspects: 1) entity-centric and 2) length-controllable summarization, 3) contribution summarization on scientific papers, 4) invention purpose summarization on patent filings, and 5) question-guided summarization on news articles in a reading comprehension setting. Moreover, when used in a standard, uncontrolled summarization setting, CTRLsum achieves state-of-the-art results on the CNN/DailyMail dataset. Code and model checkpoints are available at https://github.com/salesforce/ctrl-sum