title: Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose

abstract: Recent works have shown how realistic talking face images can be obtained under the supervision of geometry guidance, e.g., facial landmark or boundary. To alleviate the demand for manual annotations, in this paper, we propose a novel self-supervised hybrid model (DAE-GAN) that learns how to reenact face naturally given large amounts of unlabeled videos. Our approach combines two deforming autoencoders with the latest advances in the conditional generation. On the one hand, we adopt the deforming autoencoder to disentangle identity and pose representations. A strong prior in talking face videos is that each frame can be encoded as two parts: one for video-specific identity and the other for various poses. Inspired by that, we utilize a multi-frame deforming autoencoder to learn a pose-invariant embedded face for each video. Meanwhile, a multi-scale deforming autoencoder is proposed to extract pose-related information for each frame. On the other hand, the conditional generator allows for enhancing fine details and overall reality. It leverages the disentangled features to generate photo-realistic and pose-alike face images. We evaluate our model on VoxCeleb1 and RaFD dataset. Experiment results demonstrate the superior quality of reenacted images and the flexibility of transferring facial movements between identities.


title: Persistent Identification Of Instruments

abstract: Instruments play an essential role in creating research data. Given the importance of instruments and associated metadata to the assessment of data quality and data reuse, globally unique, persistent and resolvable identification of instruments is crucial. The Research Data Alliance Working Group Persistent Identification of Instruments (PIDINST) developed a community-driven solution for persistent identification of instruments which we present and discuss in this paper. Based on an analysis of 10 use cases, PIDINST developed a metadata schema and prototyped schema implementation with DataCite and ePIC as representative persistent identifier infrastructures and with HZB (Helmholtz-Zentrum Berlin f\"ur Materialien und Energie) and BODC (British Oceanographic Data Centre) as representative institutional instrument providers. These implementations demonstrate the viability of the proposed solution in practice. Moving forward, PIDINST will further catalyse adoption and consolidate the schema by addressing new stakeholder requirements.


title: The general position number of integer lattices

abstract: The general position number ${\rm gp}(G)$ of a connected graph $G$ is the cardinality of a largest set $S$ of vertices such that no three pairwise distinct vertices from $S$ lie on a common geodesic. The $n$-dimensional grid graph $\pn$ is the Cartesian product of $n$ copies of the two-way infinite path $P_\infty$. It is proved that if $n\in {\mathbb N}$, then ${\rm gp}({P_\infty^n}) = 2^{2^{n-1}}$. The result was earlier known only for $n\in \{1,2\}$ and partially for $n=3$.


title: The Erd\H{o}s-Hajnal property for graphs with no fixed cycle as a pivot-minor

abstract: We prove that for every integer $k$, there exists $\varepsilon > 0$ such that for every n-vertex graph $G$ with no pivot-minor isomorphic to $C_k$, there exist disjoint sets $A,B \subseteq V(G)$ such that $|A|,|B| \geq \varepsilon n$, and $A$ is either complete or anticomplete to $B$. This proves the analog of the Erd\H{o}s-Hajnal conjecture for the class of graphs with no pivot-minor isomorphic to $C_k$.


title: Clickbait Detection using Multiple Categorization Techniques

abstract: Clickbaits are online articles with deliberately designed misleading titles for luring more and more readers to open the intended web page. Clickbaits are used to tempted visitors to click on a particular link either to monetize the landing page or to spread the false news for sensationalization. The presence of clickbaits on any news aggregator portal may lead to unpleasant experience to readers. Automatic detection of clickbait headlines from news headlines has been a challenging issue for the machine learning community. A lot of methods have been proposed for preventing clickbait articles in recent past. However, the recent techniques available in detecting clickbaits are not much robust. This paper proposes a hybrid categorization technique for separating clickbait and non-clickbait articles by integrating different features, sentence structure, and clustering. During preliminary categorization, the headlines are separated using eleven features. After that, the headlines are recategorized using sentence formality, syntactic similarity measures. In the last phase, the headlines are again recategorized by applying clustering using word vector similarity based on t-Stochastic Neighbourhood Embedding (t-SNE) approach. After categorization of these headlines, machine learning models are applied to the data set to evaluate machine learning algorithms. The obtained experimental results indicate the proposed hybrid model is more robust, reliable and efficient than any individual categorization techniques for the real-world dataset we used.


title: GPS-Net: Graph Property Sensing Network for Scene Graph Generation

abstract: Scene graph generation (SGG) aims to detect objects in an image along with their pairwise relationships. There are three key properties of scene graph that have been underexplored in recent works: namely, the edge direction information, the difference in priority between nodes, and the long-tailed distribution of relationships. Accordingly, in this paper, we propose a Graph Property Sensing Network (GPS-Net) that fully explores these three properties for SGG. First, we propose a novel message passing module that augments the node feature with node-specific contextual information and encodes the edge direction information via a tri-linear model. Second, we introduce a node priority sensitive loss to reflect the difference in priority between nodes during training. This is achieved by designing a mapping function that adjusts the focusing parameter in the focal loss. Third, since the frequency of relationships is affected by the long-tailed distribution problem, we mitigate this issue by first softening the distribution and then enabling it to be adjusted for each subject-object pair according to their visual appearance. Systematic experiments demonstrate the effectiveness of the proposed techniques. Moreover, GPS-Net achieves state-of-the-art performance on three popular databases: VG, OI, and VRD by significant gains under various settings and metrics. The code and models are available at \url{https://github.com/taksau/GPS-Net}.


title: Electromagnetic scattering by homogeneous, isotropic, dielectric-magnetic sphere with topologically insulating surface states

abstract: The Lorenz--Mie formulation of electromagnetic scattering by a homogeneous, isotropic, dielectric-magnetic sphere was extended to incorporate topologically insulating surface states characterized by a surface admittance $\gamma$. Closed-form expressions were derived for the expansion coefficients of the scattered field phasors in terms of those of the incident field phasors. These expansion coefficients were used to obtain analytical expressions for the total scattering, extinction, forward scattering, and backscattering efficiencies of the sphere. Resonances exist for relatively low values of $\gamma$, when the sphere is either nondissipative or weakly dissipative. For large values of $\gamma$, the scattering characteristics are close to that of a perfect electrically conducting sphere, regardless of whether the sphere is composed of a dissipative or nondissipative material, and regardless of whether that material supports planewave propagation with positive or negative phase velocity.


title: On Structure space of the ring $B_1(X)$

abstract: In this article, we continue our study of the ring of Baire one functions on a topological space $(X,\tau)$, denoted by $B_1(X)$ and extend the well known M. H. Stones's theorem from $C(X)$ to $B_1(X)$. Introducing the structure space of $B_1(X)$, an analogue of Gelfand Kolmogoroff theorem is established. It is observed that $(X,\tau)$ may not be embedded inside the structure space of $B_1(X)$. This observation inspired us to introduce a weaker form of embedding and show that in case $X$ is a $T_4$ space, $X$ is weakly embedded as a dense subspace, in the structure space of $B_1(X)$. It is further established that the ring $B_1^{*}(X)$ of all bounded Baire one functions is a C-type ring and also, the structure space of $B_1^{*}(X)$ is homeomorphic to the structure space of $B_1(X)$. Introducing a finer topology $\sigma$ than the original $T_4$ topology $\tau$ on $X$, it is proved that $B_1(X)$ contains free (maximal) ideals if $\sigma$ is strictly finer than $\tau$. It is also proved that $\tau = \sigma$ if and only if $B_1(X) = C(X)$. Moreover, in the class of all perfectly normal $T_1$ spaces, $B_1(X) = C(X)$ is equivalent to the discreteness of the space $X$.


title: Equidistribution from the Chinese Remainder Theorem

abstract: We prove the equidistribution of subsets of $(\Rr/\Zz)^n$ defined by fractional parts of subsets of~$(\Zz/q\Zz)^n$ that are constructed using the Chinese Remainder Theorem.


title: Maximality and finiteness of type 1 subdiagonal algebras

abstract: Let $\mathfrak A$ be a type 1 subdiagonal algebra in a $\sigma$-finite von Neumann algebra $\mathcal M$ with respect to a faithful normal conditional expectation $\Phi$. We give necessary and sufficient conditions for which $\mathfrak A$ is maximal among the $\sigma$-weakly closed subalgebras of $\mathcal M$. In addition, we show that a type 1 subdiagonal algebra in a finite von Neumann algebra is automatically finite which gives a positive answer of Arveson's finiteness problem in 1967 in type 1 case.


title: Stability results for an elastic-viscoelastic waves interaction systems with localized Kelvin-Voigt damping and with an internal or boundary time delay

abstract: We investigate the stability of a one-dimensional wave equation with non smooth localized internal viscoelastic damping of Kelvin-Voigt type and with boundary or localized internal delay feedback. The main novelty in this paper is that the Kelvin-Voigt and the delay damping are both localized via non smooth coefficients. In the case that the Kelvin-Voigt damping is localized faraway from the tip and the wave is subjected to a locally distributed internal or boundary delay feedback, we prove that the energy of the system decays polynomially of type t^{-4}. However, an exponential decay of the energy of the system is established provided that the Kelvin-Voigt damping is localized near a part of the boundary and a time delay damping acts on the second boundary. While, when the Kelvin-Voigt and the internal delay damping are both localized via non smooth coefficients near the tip, the energy of the system decays polynomially of type t^{-4}. Frequency domain arguments combined with piecewise multiplier techniques are employed.


title: A Decentralized Policy with Logarithmic Regret for a Class of Multi-Agent Multi-Armed Bandit Problems with Option Unavailability Constraints and Stochastic Communication Protocols

abstract: This paper considers a multi-armed bandit (MAB) problem in which multiple mobile agents receive rewards by sampling from a collection of spatially dispersed stochastic processes, called bandits. The goal is to formulate a decentralized policy for each agent, in order to maximize the total cumulative reward over all agents, subject to option availability and inter-agent communication constraints. The problem formulation is motivated by applications in which a team of autonomous mobile robots cooperates to accomplish an exploration and exploitation task in an uncertain environment. Bandit locations are represented by vertices of the spatial graph. At any time, an agent's option consist of sampling the bandit at its current location, or traveling along an edge of the spatial graph to a new bandit location. Communication constraints are described by a directed, non-stationary, stochastic communication graph. At any time, agents may receive data only from their communication graph in-neighbors. For the case of a single agent on a fully connected spatial graph, it is known that the expected regret for any optimal policy is necessarily bounded below by a function that grows as the logarithm of time. A class of policies called upper confidence bound (UCB) algorithms asymptotically achieve logarithmic regret for the classical MAB problem. In this paper, we propose a UCB-based decentralized motion and option selection policy and a non-stationary stochastic communication protocol that guarantee logarithmic regret. To our knowledge, this is the first such decentralized policy for non-fully connected spatial graphs with communication constraints. When the spatial graph is fully connected and the communication graph is stationary, our decentralized algorithm matches or exceeds the best reported prior results from the literature.


title: Finite groups with the same join graph as a finite nilpotent group

abstract: Given a finite group $G,$ we denote by $\Delta(G)$ the graph whose vertices are the proper subgroups of $G$ and in which two vertices $H$ and $K$ are joined by an edge if and only if $G=\langle H,K\rangle.$ We prove that if there exists a finite nilpotent group $X$ with $\Delta(G)\cong \Delta(X),$ then $G$ is supersoluble.


title: Elastic Coupled Co-clustering for Single-Cell Genomic Data

abstract: The recent advances in single-cell technologies have enabled us to profile genomic features at unprecedented resolution and datasets from multiple domains are available, including datasets that profile different types of genomic features and datasets that profile the same type of genomic features across different species. These datasets typically have different powers in identifying the unknown cell types through clustering, and data integration can potentially lead to a better performance of clustering algorithms. In this work, we formulate the problem in an unsupervised transfer learning framework, which utilizes knowledge learned from auxiliary dataset to improve the clustering performance of target dataset. The degree of shared information among the target and auxiliary datasets can vary, and their distributions can also be different. To address these challenges, we propose an elastic coupled co-clustering based transfer learning algorithm, by elastically propagating clustering knowledge obtained from the auxiliary dataset to the target dataset. Implementation on single-cell genomic datasets shows that our algorithm greatly improves clustering performance over the traditional learning algorithms. The source code and data sets are available at https://github.com/cuhklinlab/elasticC3.


title: Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds

abstract: Local and global patterns of an object are closely related. Although each part of an object is incomplete, the underlying attributes about the object are shared among all parts, which makes reasoning the whole object from a single part possible. We hypothesize that a powerful representation of a 3D object should model the attributes that are shared between parts and the whole object, and distinguishable from other objects. Based on this hypothesis, we propose to learn point cloud representation by bidirectional reasoning between the local structures at different abstraction hierarchies and the global shape without human supervision. Experimental results on various benchmark datasets demonstrate the unsupervisedly learned representation is even better than supervised representation in discriminative power, generalization ability, and robustness. We show that unsupervisedly trained point cloud models can outperform their supervised counterparts on downstream classification tasks. Most notably, by simply increasing the channel width of an SSG PointNet++, our unsupervised model surpasses the state-of-the-art supervised methods on both synthetic and real-world 3D object classification datasets. We expect our observations to offer a new perspective on learning better representation from data structures instead of human annotations for point cloud understanding.


title: On the Precise Error Analysis of Support Vector Machines

abstract: This paper investigates the asymptotic behavior of the soft-margin and hard-margin support vector machine (SVM) classifiers for simultaneously high-dimensional and numerous data (large $n$ and large $p$ with $n/p\to\delta$) drawn from a Gaussian mixture distribution. Sharp predictions of the classification error rate of the hard-margin and soft-margin SVM are provided, as well as asymptotic limits of as such important parameters as the margin and the bias. As a further outcome, the analysis allow for the identification of the maximum number of training samples that the hard-margin SVM is able to separate. The precise nature of our results allow for an accurate performance comparison of the hard-margin and soft-margin SVM as well as a better understanding of the involved parameters (such as the number of measurements and the margin parameter) on the classification performance. Our analysis, confirmed by a set of numerical experiments, builds upon the convex Gaussian min-max Theorem, and extends its scope to new problems never studied before by this framework.


title: A Recursive Network with Dynamic Attention for Monaural Speech Enhancement

abstract: A person tends to generate dynamic attention towards speech under complicated environments. Based on this phenomenon, we propose a framework combining dynamic attention and recursive learning together for monaural speech enhancement. Apart from a major noise reduction network, we design a separated sub-network, which adaptively generates the attention distribution to control the information flow throughout the major network. To effectively decrease the number of trainable parameters, recursive learning is introduced, which means that the network is reused for multiple stages, where the intermediate output in each stage is correlated with a memory mechanism. As a result, a more flexible and better estimation can be obtained. We conduct experiments on TIMIT corpus. Experimental results show that the proposed architecture obtains consistently better performance than recent state-of-the-art models in terms of both PESQ and STOI scores.


title: Dynamics of the multicolor box-ball system with random initial conditions via Pitman's transformation

abstract: The Box-Ball System (BBS) is a cellular automaton introduced by Takahashi and Satsuma in the 1990s. The system is a discrete counterpart of the KdV equation and exhibits solitonic behavior. Recently, the BBS started from a random two-sided infinite particle configuration has been studied, by encoding the particle configuration to a certain discrete path on Z and defining the dynamic of the BBS in terms of the path. In this paper, we extend some results of the previous study in this direction to a generalization of the BBS with \k{appa}-color balls (particles), called the multicolor BBS. We first introduce an encoding of the \k{appa}-color particles configuration to a discrete path in \k{appa}-dimensional Euclidean space. Then we show that the dynamics of the multicolor BBS is expressed by the composition of the Pitman's transformation and a permutation operator. Applying this expression, we characterize the set of configurations for which the dynamics are well-defined and reversible for all times. Then, we give a simple class of random initial conditions which are invariant in distribution under the dynamics of the multicolor BBS. Finally, we introduce a continuous version of the multicolor BBS, which is defined for continuous paths on R in \k{appa}-dimensional Euclidean space, and show that \k{appa}-dimensional Brownian motion with a proper drift is invariant under the dynamics of the continuous version of the multicolor BBS.


title: Secure Platooning of Autonomous Vehicles Under Attacked GPS Data

abstract: In this paper, we study how to secure the platooning of autonomous vehicles when an unknown vehicle is under attack and bounded system uncertainties exist. For the attacked vehicle, its position and speed measurements from GPS can be manipulated arbitrarily by a malicious attacker. First, to find out which vehicle is under attack, two detectors are proposed by using the relative measurements (by camera or radar) and the local innovation obtained through measurements from neighboring vehicles. Then, based on the results of the detectors, we design a local state observer for each vehicle by applying a saturation method to the measurement innovation. Moreover, based on the neighbor state estimates provided by the observer, a distributed controller is proposed to achieve the consensus in vehicle speed and keep fixed desired distance between two neighboring vehicles. The estimation error by the observer and the platooning error by the controller are shown to be asymptotically upper bounded under certain conditions. The effectiveness of the proposed methods is also evaluated in numerical simulations.


title: Nonuniqueness of Solutions of a Class of $\ell_{0}$-minimization Problems

abstract: Recently, finding the sparsest solution of an underdetermined linear system has become an important request in many areas such as compressed sensing, image processing, statistical learning, and data sparse approximation. In this paper, we study some theoretical properties of the solutions to a general class of $\ell_{0}$-minimization problems, which can be used to deal with many practical applications. We establish some necessary conditions for a point being the sparsest solution to this class of problems, and we also characterize the conditions for the multiplicity of the sparsest solutions to the problem. Finally, we discuss certain conditions for the boundedness of the solution set of this class of problems.


title: Tensor products of quandles and 1-handles attached to surface-links

abstract: A quandle is an algebra with two binary operations satisfying three conditions which are related to Reidemeister moves in knot theory. In this paper we introduce the notion of the (canonical) tensor product of a quandle. The tensor product of the knot quandle or the knot symmetric quandle of a surface-link in $4$-space can be used to classify or construct invariants of $1$-handles attaching to the surface-link.


title: SE(3) based Extended Kalman Filter for Spacecraft Attitude Estimation

abstract: In this paper, the spacecraft attitude estimation problem has been investigated making use of the concept of matrix Lie group. Through formulation of the attitude and gyroscope bias as elements of SE(3), the corresponding extended Kalman filter, termed as SE(3)-EKF, has been derived. It is shown that the resulting SE(3)-EKF is just the newly-derived geometric extended Kalman filter (GEKF) for spacecraft attitude estimation. This provides a new perspective on the GEKF besides the common frame errors definition. Moreover, the SE(3)-EKF with reference frame attitude error is also derived and the resulting algorithm bears much resemblance to the right invariant EKF.


title: Spatial Attention Pyramid Network for Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation is critical in various computer vision tasks, such as object detection, instance segmentation, and semantic segmentation, which aims to alleviate performance degradation caused by domain-shift. Most of previous methods rely on a single-mode distribution of source and target domains to align them with adversarial learning, leading to inferior results in various scenarios. To that end, in this paper, we design a new spatial attention pyramid network for unsupervised domain adaptation. Specifically, we first build the spatial pyramid representation to capture context information of objects at different scales. Guided by the task-specific information, we combine the dense global structure representation and local texture patterns at each spatial location effectively using the spatial attention mechanism. In this way, the network is enforced to focus on the discriminative regions with context information for domain adaption. We conduct extensive experiments on various challenging datasets for unsupervised domain adaptation on object detection, instance segmentation, and semantic segmentation, which demonstrates that our method performs favorably against the state-of-the-art methods by a large margin. Our source code is available at https://isrc.iscas.ac.cn/gitlab/research/domain-adaption.


title: ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings

abstract: We present ClusterVO, a stereo Visual Odometry which simultaneously clusters and estimates the motion of both ego and surrounding rigid clusters/objects. Unlike previous solutions relying on batch input or imposing priors on scene structure or dynamic object models, ClusterVO is online, general and thus can be used in various scenarios including indoor scene understanding and autonomous driving. At the core of our system lies a multi-level probabilistic association mechanism and a heterogeneous Conditional Random Field (CRF) clustering approach combining semantic, spatial and motion information to jointly infer cluster segmentations online for every frame. The poses of camera and dynamic objects are instantly solved through a sliding-window optimization. Our system is evaluated on Oxford Multimotion and KITTI dataset both quantitatively and qualitatively, reaching comparable results to state-of-the-art solutions on both odometry and dynamic trajectory recovery.


title: LiDAR-Based Navigation of Tethered Drone Formations in an Unknown Environment

abstract: The problem of navigating a formation of interconnected tethered drones, named STEM (System of TEthered Multicopters), in an unknown environment is considered. The tethers feed electrical power from a ground station to the drones and also serve as communication links. The presence of more than one interconnected drone provides enough degrees of freedom to navigate in a cluttered area. The leader drone in the formation must reach a given point of interest, while the followers must move accordingly, avoiding interference with the obstacles. The challenges are the uncertainty in the environment, with obstacles of unknown shape and position, the use of LiDAR (Light Detection And Ranging) sensors, providing only partial information of the surroundings of each drone, and the presence of the tethers, which must not impact with the obstacles and pose additional constraints to how the drones can move. To cope with these problems, a novel real-time planning algorithm based on numerical optimization is proposed: the reference position of each drone is chosen in a centralized way via a convex program, where the LiDAR scans are used to approximate the free space and the drones are moved towards suitably defined intermediate goals in order to eventually reach the point of interest. The approach is successfully tested in numerical simulations with a realistic model of the system.


title: Robust ferromagnetism in highly strained SrCoO3 thin films

abstract: Epitaxial strain provides important pathways to control the magnetic and electronic states in transition metal oxides. However, the large strain is usually accompanied by a strong reduction of the oxygen vacancy formation energy, which hinders the direct manipulation of their intrinsic properties. Here using a post-deposition ozone annealing method, we obtained a series of oxygen stoichiometric SrCoO3 thin films with the tensile strain up to 3.0%. We observed a robust ferromagnetic ground state in all strained thin films, while interestingly the tensile strain triggers a distinct metal to insulator transition along with the increase of the tensile strain. The persistent ferromagnetic state across the electrical transition therefore suggests that the magnetic state is directly correlated with the localized electrons, rather than the itinerant ones, which then calls for further investigation of the intrinsic mechanism of this magnetic compound beyond the double-exchange mechanism.


title: Phase-field dynamics with transfer of materials: The Cahn--Hilliard equation with reaction rate dependent dynamic boundary conditions

abstract: The Cahn--Hilliard equation is one of the most common models to describe phase separation processes of a mixture of two materials. For a better description of short-range interactions between the material and the boundary, various dynamic boundary conditions for the Cahn--Hilliard equation have been proposed and investigated in recent times. Of particular interests are the model by Goldstein, Miranville and Schimperna (Physica D, 2011) and the model by Liu and Wu (Arch.~Ration.~Mech.~Anal., 2019). Both of these models satisfy similar physical properties but differ greatly in their mass conservation behaviour. In this paper we introduce a new model which interpolates between these previous models, and investigate analytical properties such as the existence of unique solutions and convergence to the previous models mentioned above in both the weak and the strong sense. For the strong convergences we also establish rates in terms of the interpolation parameter, which are supported by numerical simulations obtained from a fully discrete, unconditionally stable and convergent finite element scheme for the new interpolation model.


title: Sensitivities of future solar neutrino observatories to NSI

abstract: We study the matter effect caused by non-standard neutrino interactions (NSI) in the future solar neutrino experiments, DUNE, HK and MICA. The upcoming reactor experiment, JUNO is expected to provide the most precise measurements of solar neutrino oscillation parameters and is going to open up the era of sub-percent precision in the leptonic mixing sector of the Standard Model (SM). Considering JUNO can measure $\Delta m ^2 _{21}$ and $\theta_{12}$ by sub-percent precision and assuming SM as the null hypothesis, we study the possibility to constrain NSI parameters by the future solar neutrino experiments such as DUNE, HK and MICA. For this purpose, we study the effect of NSI on solar neutrino propagation in the Sun and Earth and explore the dependence of the day-night asymmetry on the NSI parameters. We also study the effect of NSI at the water Cerenkov detector on the simulated data for these experiments.


title: A Set-Theoretic Study of the Relationships of Image Models and Priors for Restoration Problems

abstract: Image prior modeling is the key issue in image recovery, computational imaging, compresses sensing, and other inverse problems. Recent algorithms combining multiple effective priors such as the sparse or low-rank models, have demonstrated superior performance in various applications. However, the relationships among the popular image models are unclear, and no theory in general is available to demonstrate their connections. In this paper, we present a theoretical analysis on the image models, to bridge the gap between applications and image prior understanding, including sparsity, group-wise sparsity, joint sparsity, and low-rankness, etc. We systematically study how effective each image model is for image restoration. Furthermore, we relate the denoising performance improvement by combining multiple models, to the image model relationships. Extensive experiments are conducted to compare the denoising results which are consistent with our analysis. On top of the model-based methods, we quantitatively demonstrate the image properties that are inexplicitly exploited by deep learning method, of which can further boost the denoising performance by combining with its complementary image models.


title: Thermodynamics and Van der Waals Phase Transition of Charged Black Holes in Flat Space via R\'enyi Statistics

abstract: The phase structure and critical phenomena of the 3+1 dimensional charged black holes in asymptotically flat spacetime are investigated in terms of thermodynamic properties within the R\'enyi statistics. With this approach as the non-extensive parameter above zero, we find that the charged black hole can be in thermodynamic equilibrium with surrounding thermal radiation, and have a Hawking-Page phase transition in the same way in the case of AdS charged black hole. This gives more evidence supporting the proposal that there exists an equivalence between the black hole thermodynamics in asymptotically flat spacetime via R\'enyi statistics and that in asymptotically AdS spacetime via Gibbs-Boltzmann statistics, proposed by Czinner et al. However, the present work also provides another aspect of supporting evidence through exploring the extended phase space within the R\'enyi statistics. Working on a modified version of Smarr formula, the thermodynamic pressure $P$ and volume $v$ of a charged black hole are found to be related to the non-extensive parameter. The resulting $P-v$ diagram indicates that the thermodynamics of charged black holes in asymptotically flat spacetime via R\'enyi statistics has the Van der Waals phase structure, equivalent to that in asymptotically AdS spacetime via Gibbs-Boltzmann statistics.


title: Holographic boiling and generalized thermodynamic description beyond local equilibrium

abstract: Tuning a very simple two-component holographic superfluid model, we can have a first order phase transition between two superfluid phases in the probe limit. Inspired by the potential landscape discussion, an intuitive physical picture for systems with first order phase transitions is provided. We stress that holography perfectly offers a generalized thermodynamic description of certain strongly coupled systems even out of local equilibrium, which enables us to carefully study domain wall structures of the system under first order phase transitions, either static or in real time dynamics. We numerically construct the 1D domain wall configuration and compute the surface tension of the domain wall from its generalized grand potential. We also numerically simulate the real time dynamics of a 2D bubble nucleation process (holographic boiling). The surface tension of the 1D domain wall nicely matches the final state of the 2D bubble nucleation process when the bubble radius is large enough.


title: Failed prominence eruptions near 24 cycle maximum

abstract: We analyze 16 failed filament eruptions observed near 24 solar cycle maximum from May 2013 to July 2014. No significant rotation of filament spines is observed during the ascent in all studied failed eruptions, which does not support kink-instability mechanism of triggering the eruptions. We calculate potential magnetic field distributions in the corona above the initial locations of the filaments to study their height dependence. In seven events, the vertical profiles of the decay index $n$ are monotonic. The other nine events occur in the regions with the switchback or saddle-like n-profiles. The direction of the horizontal field near the saddle bottom is turned through more than 100$^\circ$ relative its direction at the initial filament position, which reveals the quadrupolar magnetic configuration with null points in these regions. The eruptive filaments stop above the null points where the total Lorenz force is directed upward. The most reasonable force that can terminate filament ascending and balance the Lorenz force seems the gravity.


title: The holographic p+ip solution failed to win the competition in dRGT massive gravity

abstract: In this paper, the holographic p-wave superfluid model with charged complex vector field is studied in dRGT massive gravity beyond the probe limit. The stability of p-wave and p+ip solutions are compared in the grand canonical ensemble. The p-wave solution always get lower value of grand potential than the p+ip solution, showing that the holographic system still favors an anisotropic (p-wave) solution even with considering a massive gravity theory in bulk. In the holographic superconductor models with dRGT massive gravity in bulk, a key sailing symmetry is found to be violated by fixing the reference metric parameter $c_0$. Therefore, in order to get the dependence of condensate and grand potential on temperature, different values of horizon radius should be considered in numerical work. With a special choice of model parameters, we further study the dependence of critical back-reaction strength on the graviton mass parameter, beyond which the superfluid phase transition become first order. We also give the dependence of critical temperature on the back reaction strength $b$ and graviton mass parameter $m^2$.


title: Learning and Testing Variable Partitions

abstract: $ $Let $F$ be a multivariate function from a product set $\Sigma^n$ to an Abelian group $G$. A $k$-partition of $F$ with cost $\delta$ is a partition of the set of variables $\mathbf{V}$ into $k$ non-empty subsets $(\mathbf{X}_1, \dots, \mathbf{X}_k)$ such that $F(\mathbf{V})$ is $\delta$-close to $F_1(\mathbf{X}_1)+\dots+F_k(\mathbf{X}_k)$ for some $F_1, \dots, F_k$ with respect to a given error metric. We study algorithms for agnostically learning $k$ partitions and testing $k$-partitionability over various groups and error metrics given query access to $F$. In particular we show that $1.$ Given a function that has a $k$-partition of cost $\delta$, a partition of cost $\mathcal{O}(k n^2)(\delta + \epsilon)$ can be learned in time $\tilde{\mathcal{O}}(n^2 \mathrm{poly} (1/\epsilon))$ for any $\epsilon > 0$. In contrast, for $k = 2$ and $n = 3$ learning a partition of cost $\delta + \epsilon$ is NP-hard. $2.$ When $F$ is real-valued and the error metric is the 2-norm, a 2-partition of cost $\sqrt{\delta^2 + \epsilon}$ can be learned in time $\tilde{\mathcal{O}}(n^5/\epsilon^2)$. $3.$ When $F$ is $\mathbb{Z}_q$-valued and the error metric is Hamming weight, $k$-partitionability is testable with one-sided error and $\mathcal{O}(kn^3/\epsilon)$ non-adaptive queries. We also show that even two-sided testers require $\Omega(n)$ queries when $k = 2$. This work was motivated by reinforcement learning control tasks in which the set of control variables can be partitioned. The partitioning reduces the task into multiple lower-dimensional ones that are relatively easier to learn. Our second algorithm empirically increases the scores attained over previous heuristic partitioning methods applied in this context.


title: On the decoding of 1-Fibonacci error correcting codes

abstract: The study of new error correcting codes has raised attention in the last years, especially because of their use in cryptosystems that are resistant to attacks running on quantum computers. In 2006, while leaving a more in-depth analysis for future research, Stakhov gave some interesting ideas on how to exploit Fibonacci numbers to derive an original error correcting code with a compact representation. In this work we provide an explicit formula to compute the redundancy of Stakhov codes, we identify some flows in the initial decoding procedure described by Stakhov, whose crucial point is to solve some non-trivial Diophantine equations, and provide a detailed discussion on how to avoid solving such equations in some cases and on how to detect and correct errors more efficiently.


title: Statistical hadronization model for heavy-ion collisions in a few GeV energy regime

abstract: We show that the transverse-mass and rapidity spectra of protons and pions produced in Au-Au collisions at sqrt(sNN) = 2.4 GeV can be well reproduced in a thermodynamic model assuming single freeze-out of particles from a spherically symmetric hypersurface. This scenario corresponds to a physical picture used by Siemens and Rasmussen in the original formulation of the blast-wave model. Our framework modifies and extends this approach by incorporation of a Hubble-like expansion of QCD matter and inclusion of resonance decays. In particular, the Delta(1232) resonance is taken into account, with a width obtained from the virial expansion. Altogether, our results bring evidence for substantial thermalization of the matter produced in heavy-ion collisions in a few GeV energy regime and its nearly spherical expansion.


title: Computing the renormalization group flow of two-dimensional $\phi^4$ theory with tensor networks

abstract: We study the renormalization group flow of $\phi^4$ theory in two dimensions. Regularizing space into a fine-grained lattice and discretizing the scalar field in a controlled way, we rewrite the partition function of the theory as a tensor network. Combining local truncations and a standard coarse-graining scheme, we obtain the renormalization group flow of the theory as a map in a space of tensors. Aside from qualitative insights, we verify the scaling dimensions at criticality and extrapolate the critical coupling constant $f_{\rm c} = \lambda / \mu ^2$ to the continuum to find $f^{\rm cont.}_{\rm c} = 11.0861(90)$, which favorably compares with alternative methods.


title: Emergent behaviors of Thermodynamic Kuramoto ensemble on a regular ring lattice

abstract: The temporal evolution of Kuramoto oscillators influenced by the temperature field often appears in biological oscillator ensembles. In this paper, we propose a generalized Kuramoto type lattice model on a regular ring lattice with the equal spacing assuming that each oscillator has an internal energy (temperature). Our lattice model is derived from the thermodynamical Cucker-Smale model for flocking on the 2D free space under the assumption that the ratio between velocity field and temperature field at each lattice point has a uniform magnitude over lattice points. The proposed model satisfies an entropy principle and exhibits emergent dynamics under some sufficient frameworks formulated in terms of initial data and system parameters. Moreover, the phase-field tends to the Kuramoto phase-field asymptotically.


title: Surfaces with $c_1^2 =9$ and $\chi =5$ whose canonical classes are divisible by $3$

abstract: We shall study minimal complex surfaces with $c^2 = 9$ and $\chi=5$ whose canonical classes are divisible by $3$ in the integral cohomology groups, where $c_1^2$ and $\chi$ denote the first Chern number of an algebraic surface and the Euler characteristic of the structure sheaf, respectively. The main results are a structure theorem for such surfaces, the unirationality of the moduli space, and a description of the behavior of the canonical map. As a byproduct, we shall also rule out a certain case mentioned in a paper by Ciliberto--Francia--Mendes Lopes. Since the irregularity $q$ vanishes for our surfaces, our surfaces have geometric genus $p_g = 4$.


title: Thermoelectric and electron heat rectification properties of quantum dot superlattice nanowire arrays

abstract: Heat engines made of quantum-dot (QD) superlattice nanowires (SLNWs) offer promising applications in energy harvesting due to the reduction of phonon thermal conductivity. In solid state electrical generators (refrigerators), one needs to generate (remove) large amount of charge current (heat current). Consequently, a high QD SLNW density is required for realistic applications. This study theoretically investigated the properties of power factor and electron heat rectification for an SLNW array under the transition from a one dimensional system to a two dimensional system. The SLNW arrays show the functionality of heat diodes, which is mainly attributed to a transmission coefficient with a temperature-bias direction dependent characteristic.


title: Simplicity of vacuum modules and associated varieties

abstract: In this note, we prove that the universal affine vertex algebra associated with a simple Lie algebra $\mathfrak{g}$ is simple if and only if the associated variety of its unique simple quotient is equal to $\mathfrak{g}^*$. We also derive an analogous result for the quantized Drinfeld-Sokolov reduction applied to the universal affine vertex algebra.


title: U(1)-Symmetry protected Dirac nodal loops of triplons in SrCu2(BO3)2

abstract: We demonstrate the appearance of symmetry protected triplon Dirac modal lines in the low energy excitation spectrum of a realistic microscopic model of the geometrically frustrated quantum magnet SrCu2(BO3)2 in its high symmetry phase. The symmetry-allowed Dzyaloshinskii-Moriya interactions induce dispersive trilpon bands within the bond-operator formalism that cross linearly over an extended closed path in the Brillouin zone. Our results establish that the nodal lines are protected by a $U(1)$-symmetry and robust against perturbations that preserve this symmetry. In the presence of a longitudinal field, the nodal loop shrinks and vanishes for a sufficiently strong field.


title: Overcharging magnetized black holes at linear order and the weak cosmic censorship conjecture

abstract: Evidences have been found that the weak cosmic censorship conjecture could be violated if test particles with charge and angular momentum are injected into a black hole. However, second-order corrections and fine-tunings on the particle's parameters are required in previous studies, indicating that self-force and radiative effects must be taken into account. In this paper, we first consider a magnetically charged particle falling into an extremal Bardeen black hole, which is regular (with no singularity) and has a magnetic monopole at the center. We then investigate a general class of magnetic black holes with or without singularities. In all the cases, we show that the test particle with magnetic charge could overcharge the black hole, causing possible violation of the weak cosmic censorship conjecture. In contrast to previous arguments in the literature, second-order corrections are not necessary in our analysis and the results are not sensitive to the particle's parameters. Our work indicates that the self-force effect, which is related to the second-order correction, may not help rescue the weak cosmic censorship conjecture in our examples.


title: Experimental observation of coherent-information superadditivity in a dephrasure channel

abstract: We present an experimental approach to construct a dephrasure channel, which contains both dephasing and erasure noises, and can be used as an efficient tool to study the superadditivity of coherent information. By using a three-fold dephrasure channel, the superadditivity of coherent information is observed, and a substantial gap is found between the zero single-letter coherent information and zero quantum capacity. Particularly, we find that when the coherent information of n channel uses is zero, in the case of larger number of channel uses, it will become positive. These phenomena exhibit a more obvious superadditivity of coherent information than previous works, and demonstrate a higher threshold for non-zero quantum capacity. Such novel channels built in our experiment also can provide a useful platform to study the non-additive properties of coherent information and quantum channel capacity.


title: Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling

abstract: We consider the problem of minimizing a high-dimensional objective function, which may include a regularization term, using (possibly noisy) evaluations of the function. Such optimization is also called derivative-free, zeroth-order, or black-box optimization. We propose a new $\textbf{Z}$eroth-$\textbf{O}$rder $\textbf{R}$egularized $\textbf{O}$ptimization method, dubbed ZORO. When the underlying gradient is approximately sparse at an iterate, ZORO needs very few objective function evaluations to obtain a new iterate that decreases the objective function. We achieve this with an adaptive, randomized gradient estimator, followed by an inexact proximal-gradient scheme. Under a novel approximately sparse gradient assumption and various different convex settings, we show the (theoretical and empirical) convergence rate of ZORO is only logarithmically dependent on the problem dimension. Numerical experiments show that ZORO outperforms the existing methods with similar assumptions, on both synthetic and real datasets.


title: Divergence Conditions for Investigation and Control of Nonautonomous Dynamical Systems

abstract: The paper describes a novel method for studying the stability of nonautonomous dynamical systems. This method based on the flow and divergence of the vector field with coupling to the method of Lyapunov functions. The necessary and sufficient stability conditions are formulated. It is shown that the necessary stability conditions are related to the integral and differential forms of continuity equations with the sources (the flux is directed inward) located in the equilibrium points of the dynamical system. The sufficient stability conditions are applied to design the state feedback control laws. The proposed control law is found as a solution of partial differential inequality, whereas the control law based on Lyapunov technique is found from the solution of algebraic inequality. The examples illustrate the effectiveness of the proposed method compared with some existing ones.


title: Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining

abstract: Pre-trained neural language models bring significant improvement for various NLP tasks, by fine-tuning the models on task-specific training sets. During fine-tuning, the parameters are initialized from pre-trained models directly, which ignores how the learning process of similar NLP tasks in different domains is correlated and mutually reinforced. In this paper, we propose an effective learning procedure named Meta Fine-Tuning (MFT), served as a meta-learner to solve a group of similar NLP tasks for neural language models. Instead of simply multi-task training over all the datasets, MFT only learns from typical instances of various domains to acquire highly transferable knowledge. It further encourages the language model to encode domain-invariant representations by optimizing a series of novel domain corruption loss functions. After MFT, the model can be fine-tuned for each domain with better parameter initializations and higher generalization ability. We implement MFT upon BERT to solve several multi-domain text mining tasks. Experimental results confirm the effectiveness of MFT and its usefulness for few-shot learning.


title: Information geometry for phylogenetic trees

abstract: We propose a new space of phylogenetic trees which we call wald space. The motivation is to develop a space suitable for statistical analysis of phylogenies, but with a geometry based on more biologically principled assumptions than existing spaces: in wald space, trees are close if they induce similar distributions on genetic sequence data. As a point set, wald space contains the previously developed Billera-Holmes-Vogtmann (BHV) tree space; it also contains disconnected forests, like the edge-product (EP) space but without certain singularities of the EP space. We investigate two related geometries on wald space. The first is the geometry of the Fisher information metric of character distributions induced by the two-state symmetric Markov substitution process on each tree. Infinitesimally, the metric is proportional to the Kullback-Leibler divergence, or equivalently, as we show, any to f -divergence. The second geometry is obtained analogously but using a related continuous-valued Gaussian process on each tree, and it can be viewed as the trace metric of the affine-invariant metric for covariance matrices. We derive a gradient descent algorithm to project from the ambient space of covariance matrices to wald space. For both geometries we derive computational methods to compute geodesics in polynomial time and show numerically that the two information geometries (discrete and continuous) are very similar. In particular geodesics are approximated extrinsically. Comparison with the BHV geometry shows that our canonical and biologically motivated space is substantially different.

categories: math.PR cs.IT math.DG math.IT q-bio.PE stat.ME


title: Transparent Metamaterial Absorber with Broadband RCS Reduction for Solar Arrays

abstract: Solar arrays are the primary energy source of the satellite. In this paper, a metamaterial absorber for solar arrays with simultaneous high optical transparency and broadband microwave absorption is presented. By tailoring the reflection response of meta-atoms, 85% absorption performance from 6.8GHz to 18GHz is obtained. In the meantime, by employing transparent substrates, including indium tin oxide (ITO) film and anti-reflection glass, a maximum of 87% light transmittance is achieved. The absorptivity of the proposed metamaterial absorber is simulated and measured experimentally. Light transmittance and the effect of transparent metamaterial absorber on the conversion efficiency of the solar array have also been measured. These results fully demonstrate the reliability of our design for solar arrays, which also meet the requirements of structural strength, atomic oxygen erosion resistance, weight limitation, etc.


title: Data-Driven Neuromorphic DRAM-based CNN and RNN Accelerators

abstract: The energy consumed by running large deep neural networks (DNNs) on hardware accelerators is dominated by the need for lots of fast memory to store both states and weights. This large required memory is currently only economically viable through DRAM. Although DRAM is high-throughput and low-cost memory (costing 20X less than SRAM), its long random access latency is bad for the unpredictable access patterns in spiking neural networks (SNNs). In addition, accessing data from DRAM costs orders of magnitude more energy than doing arithmetic with that data. SNNs are energy-efficient if local memory is available and few spikes are generated. This paper reports on our developments over the last 5 years of convolutional and recurrent deep neural network hardware accelerators that exploit either spatial or temporal sparsity similar to SNNs but achieve SOA throughput, power efficiency and latency even with the use of DRAM for the required storage of the weights and states of large DNNs.


title: Perfect absorption of a focused light beam by a single nanoparticle

abstract: Absorption of electromagnetic energy by a dissipative material is one of the most fundamental electromagnetic processes that underlies a plethora of applied problems, including sensing and molecular detection, radar detection, wireless power transfer, and photovoltaics. Perfect absorption is a particular regime when all of the incoming electromagnetic energy is absorbed by the system without scattering. Commonly, the incident energy is delivered to the absorbing system by a plane wave, hence perfect absorption of this wave requires an infinitely extended planar structure. Here, we demonstrate theoretically that a confined incident beam carrying a finite amount of electromagnetic energy can be perfectly absorbed by a finite size deep subwavelength scatterer on a substrate. We analytically solve the self-consistent scattering problem in the dipole approximation and find a closed-form expression for the spatial spectrum of the incident field and the required complex polarizability of the particle. All analytical predictions are confirmed with full-wave simulations.


title: Real-rooted polynomials and a generalised Hermite-Sylvester theorem

abstract: A polynomial is real-rooted if all of its roots are real. For every polynomial $f(t) \in {\mathbf R}[t]$, the Hermite-Sylvester theorem associates a quadratic form $\Phi_2$ such that $f(t)$ is real-rooted if and only if $\Phi_2$ is positive semidefinite. In this note, for every positive integer $m$, an $2m$-adic form $\Phi_{2m}$ is constructed such that $f(t)$ is real-rooted if and only if $\Phi_{2m}$ is positive semidefinite for some $m$ if and only if $\Phi_{2m}(x_1,\ldots, x_n)$ is positive semidefinite for all $m$.


title: HCN 3-2 survey towards a sample of local galaxies

abstract: We present observations of HCN 3-2 emissions towards 37 local galaxies using 10-m Submillimeter Telescope (SMT). HCN 3-2 emission is detected in 23 galaxies. The correlation of infrared luminosity (LIR) and the luminosity of HCN 3-2 line emission measured in our sample is fitted with a slope of 1.11 and correlation coefficient of 0.91, which follows the linear correlation found in other dense gas tracers in the literatures. Although molecular gas above a certain volume density threshold (i.e., $n_{\rm H_2}\geq$ 10$^4$ cm$^{-3}$) statistically gave similar relation with infrared luminosity, the large scatter of HCN 3-2/HCN1-0 ratios for galaxies with different LIR indicates that dense gas masses estimated from the line luminosities of only one transition of dense gas tracers should be treated with caution for individual galaxies.


title: Fluctuation-enhanced quantum metrology

abstract: The main obstacle for practical quantum technology is the noise, which can induce the decoherence and destroy the potential quantum advantages. The fluctuation of a field, which induces the dephasing of the system, is one of the most common noises and widely regarded as detrimental to quantum technologies. Here we show, contrary to the conventional belief, the fluctuation can be used to improve the precision limits in quantum metrology for the estimation of various parameters. Specifically, we show that for the estimation of the direction and rotating frequency of a field, the achieved precisions at the presence of the fluctuation can even surpass the highest precision achievable under the unitary dynamics which have been widely taken as the ultimate limit. We provide explicit protocols, which employs the adaptive quantum error correction, to achieve the higher precision limits with the fluctuating fields. Our study provides a completely new perspective on the role of the noises in quantum metrology. It also opens the door for higher precisions beyond the limit that has been believed to be ultimate.


title: A Central Limit Theorem for the mean starting hitting time for a random walk on a random graph

abstract: We consider simple random walk on a realization of an Erd\H{o}s-R\'enyi graph that is asymptotically almost surely (a.a.s.) connected. We show a Central Limit Theorem (CLT) for the average starting hitting time, i.e. the expected time it takes the random walker on average to first hit a vertex $j$ when starting in a fixed vertex $i$. The average is taken with respect to $\pi_j$, the invariant measure of the random walk.


title: New deformations on spherical curves and \"Ostlund Conjecture

abstract: In 2018, Funakoshi, Hashizume, Ito, Kobayashi, and Murai used a deformation of spherical curves called deformation type $\alpha$. Then, it was showed that if two spherical curves $P$ and $P'$ are equivalent under the relation consisting of deformations of type RI and type RIII up to ambient isotopy, and satisfy certain conditions, then $P'$ is obtained from $P$ by a finite sequence of deformations of type $\alpha$. In this paper, we introduce a new type of deformations of spherical curves, called deformation of type $\beta$. The main result of this paper is: Two spherical curves $P$ and $P'$ are equivalent under (possibly empty) deformations of type RI and a single deformation of type RIII up to ambient isotopy if and only if reduced(P) and reduced(P') are transformed each other by exactly one deformation which is of type RIII, type $\alpha$, or type $\beta$ up to ambient isotopy, where reduced(Q) is the spherical curve which does not contain a $1$-gon obtained from a spherical curve $Q$ by applying deformations of type RI up to ambient isotopy.


title: Time-lapse reconstruction of the fracture front from diffracted waves arrivals in laboratory hydraulic fracture experiments

abstract: 4D acoustic imaging via an array of 32 sources / 32 receivers is used to monitor hydraulic fracture propagating in a 250~mm cubic specimen under a true-triaxial state of stress. We present a method based on the arrivals of diffracted waves to reconstruct the fracture geometry (and fluid front when distinct from the fracture front). Using Bayesian model selection, we rank different possible fracture geometries (radial, elliptical, tilted or not) and estimate model error. The imaging is repeated every 4 seconds and provide a quantitative measurement of the growth of these low velocity fractures. We test the proposed method on two experiments performed in two different rocks (marble and gabbro) under experimental conditions characteristic respectively of the fluid lag-viscosity (marble) and toughness (gabbro) dominated hydraulic fracture propagation regimes. In both experiments, about 150 to 200 source-receiver combinations exhibit clear diffracted wave arrivals. The results of the inversion indicate a radial geometry evolving slightly into an ellipse towards the end of the experiment when the fractures feel the specimen boundaries. The estimated modelling error with all models is of the order of the wave arrival picking error. Posterior estimates indicate an uncertainty of the order of a millimeter on the fracture front location for a given acquisition sequence. The reconstructed fracture evolution from diffracted waves is shown to be consistent with the analysis of $90^{\circ}$ incidence transmitted waves across the growing fracture.


title: Reconfigurable Intelligent Surfaces-Assisted Multiuser MIMO Uplink Transmission with Partial CSI

abstract: This paper considers the application of reconfigurable intelligent surfaces (RISs) (a.k.a. intelligent reflecting surfaces (IRSs)) to assist multiuser multiple-input multiple-output (MIMO) uplink transmission from several multi-antenna user terminals (UTs) to a multi-antenna base station (BS). For reducing the signaling overhead, only partial channel state information (CSI), including the instantaneous CSI between the RIS and the BS as well as the slowly varying statistical CSI between the UTs and the RIS, is exploited in our investigation. In particular, an optimization framework is proposed for jointly designing the transmit covariance matrices of the UTs and the RIS phase shift matrix to maximize the system global energy efficiency (GEE) with partial CSI. We first obtain closed-form solutions for the eigenvectors of the optimal transmit covariance matrices of the UTs. Then, to facilitate the design of the transmit power allocation matrices and the RIS phase shifts, we derive an asymptotically deterministic equivalent of the objective function with the aid of random matrix theory. We further propose a suboptimal algorithm to tackle the GEE maximization problem with guaranteed convergence, capitalizing on the approaches of alternating optimization, fractional programming, and sequential optimization. Numerical results substantiate the effectiveness of the proposed approach as well as the considerable GEE gains provided by the RIS-assisted transmission scheme over the traditional baselines.


title: Statistics of Quenched Defects Containing Semi-Flexible Polymer Chain: Exact Results (II)

abstract: We describe method to discuss thermodynamics of a defected semi-flexible homo-polymer chain in the two and three dimensions using fully directed self-avoiding walk lattice model. The defects are located along a line and these defects are not in the thermal equilibrium with the monomers of the semi-flexible polymer chain; i. e. we consider the case of defected semi-flexible polymer chain in the present manuscript for the case of quenched defects. There are m defects on the conformations of the N monomers long semi-flexible polymer chain and we exactly count the number of Q realizations of the defected conformations of N-monomers long self-avoiding semi-flexible polymer chain; and thus we derive the exact expression of the free energy of the defected semi-flexible polymer chain for the finite length (i. e. using the fixed particle ensemble method); and we also derive exact expression of the partition function for the defected self-avoiding semi-flexible polymer chain in the thermodynamic limit using the grand canonical ensemble theory. The method described in this manuscript may be easily extended to another case of the defected polymer chain for isotropic/directed walk lattice models.


title: A Dataset of German Legal Documents for Named Entity Recognition

abstract: We describe a dataset developed for Named Entity Recognition in German federal court decisions. It consists of approx. 67,000 sentences with over 2 million tokens. The resource contains 54,000 manually annotated entities, mapped to 19 fine-grained semantic classes: person, judge, lawyer, country, city, street, landscape, organization, company, institution, court, brand, law, ordinance, European legal norm, regulation, contract, court decision, and legal literature. The legal documents were, furthermore, automatically annotated with more than 35,000 TimeML-based time expressions. The dataset, which is available under a CC-BY 4.0 license in the CoNNL-2002 format, was developed for training an NER service for German legal documents in the EU project Lynx.


title: Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinement

abstract: Almost all previous deep learning-based multi-view stereo (MVS) approaches focus on improving reconstruction quality. Besides quality, efficiency is also a desirable feature for MVS in real scenarios. Towards this end, this paper presents a Fast-MVSNet, a novel sparse-to-dense coarse-to-fine framework, for fast and accurate depth estimation in MVS. Specifically, in our Fast-MVSNet, we first construct a sparse cost volume for learning a sparse and high-resolution depth map. Then we leverage a small-scale convolutional neural network to encode the depth dependencies for pixels within a local region to densify the sparse high-resolution depth map. At last, a simple but efficient Gauss-Newton layer is proposed to further optimize the depth map. On one hand, the high-resolution depth map, the data-adaptive propagation method and the Gauss-Newton layer jointly guarantee the effectiveness of our method. On the other hand, all modules in our Fast-MVSNet are lightweight and thus guarantee the efficiency of our approach. Besides, our approach is also memory-friendly because of the sparse depth representation. Extensive experimental results show that our method is 5$\times$ and 14$\times$ faster than Point-MVSNet and R-MVSNet, respectively, while achieving comparable or even better results on the challenging Tanks and Temples dataset as well as the DTU dataset. Code is available at https://github.com/svip-lab/FastMVSNet.


title: Delaunay surfaces of prescribed mean curvature in $\mathrm{Nil}_3$ and $\widetilde{SL_2}(\mathbb{R})$

abstract: We obtain a classification result for rotational surfaces in the Heisenberg space and the universal cover of the special linear group, whose mean curvature is given as a prescribed $C^1$ function depending on their angle function. We show that these surfaces behave like the Delaunay surfaces of constant mean curvature, under some assumptions on the prescribed function. In contrast with the constant mean curvature case, we exhibit the existence of rotational, embedded tori, providing counterexamples of the Alexandrov problem for this class of immersed surfaces.


title: Power Functions over Finite Fields with Low $c$-Differential Uniformity

abstract: Very recently, a new concept called multiplicative differential (and the corresponding $c$-differential uniformity) was introduced by Ellingsen \textit{et al} in [C-differentials, multiplicative uniformity and (almost) perfect c-nonlinearity, IEEE Trans. Inform. Theory, 2020] which is motivated from practical differential cryptanalysis. Unlike classical perfect nonlinear functions, there are perfect $c$-nonlinear functions even for characteristic two. The objective of this paper is to study power function $F(x)=x^d$ over finite fields with low $c$-differential uniformity. Some power functions are shown to be perfect $c$-nonlinear or almost perfect $c$-nonlinear. Notably, we completely determine the $c$-differential uniformity of almost perfect nonlinear functions with the well-known Gold exponent. We also give an affirmative solution to a recent conjecture proposed by Bartoli and Timpanella in 2019 related to an exceptional quasi-planar power function.


title: Domain evolution in bended freestanding BaTiO3 ultrathin films: a phase-field simulation

abstract: Perovskite ferroelectric oxides are usually considered to be brittle materials, however, recent work [Dong et al., Science 366, 475 (2019)] demonstrated the super-elasticity in the freestanding BaTiO3 thin films. This property may originate from the ferroelectric domain evolution during the bending, which is difficult to observe in experiments. Therefore, understanding the relation among the bending deformation, thickness of the films, and the domain dynamics is critical for their potential applications in flexible ferroelectric devices. Here, we reported the dynamics of ferroelectric polarization in the freestanding BaTiO3 ultrathin films in the presence of large bending deformation up to 40{\deg} using phase-field simulation. The ferroelectric domain evolution reveals the transition from the flux-closure to a/c domains with "vortex-like" structures, which caused by the increase of out-of-plane ferroelectric polarization. Additionally, by varying the film thickness in the identical bending situation, we found the a/c phase with "vortex-like" structure emerges only as the film thickness reached 12 nm or higher. Results from our investigations provide instructive information for the microstructure evolution of bending ferroelectric perovskite oxide films, which could serve as guide for the future application of ferroelectric films on flexible electronic devices.


title: SuperNet -- An efficient method of neural networks ensembling

abstract: The main flaw of neural network ensembling is that it is exceptionally demanding computationally, especially, if the individual sub-models are large neural networks, which must be trained separately. Having in mind that modern DNNs can be very accurate, they are already the huge ensembles of simple classifiers, and that one can construct more thrifty compressed neural net of a similar performance for any ensemble, the idea of designing the expensive SuperNets can be questionable. The widespread belief that ensembling increases the prediction time, makes it not attractive and can be the reason that the main stream of ML research is directed towards developing better loss functions and learning strategies for more advanced and efficient neural networks. On the other hand, all these factors make the architectures more complex what may lead to overfitting and high computational complexity, that is, to the same flaws for which the highly parametrized SuperNets ensembles are blamed. The goal of the master thesis is to speed up the execution time required for ensemble generation. Instead of training K inaccurate sub-models, each of them can represent various phases of training (representing various local minima of the loss function) of a single DNN [Huang et al., 2017; Gripov et al., 2018]. Thus, the computational performance of the SuperNet can be comparable to the maximum CPU time spent on training its single sub-model, plus usually much shorter CPU time required for training the SuperNet coupling factors.


title: Reducibility of 1-d Schr\"odinger equation with unbounded oscillation perturbations

abstract: We build a new estimate for the normalized eigenfunctions of the operator $-\partial_{xx}+\mathcal V(x)$ based on the oscillatory integrals and Langer's turning point method, where $\mathcal V(x)\sim |x|^{2\ell}$ at infinity with $\ell>1$. From it and an improved reducibility theorem we show that the equation \[\textstyle {\rm i}\partial_t \psi =-\partial_x^2 \psi+\mathcal V(x) \psi+\epsilon \langle x\rangle^{\mu} W(\nu x,\omega t)\psi,\quad \psi=\psi(t,x),~x\in\mathbb R, ~\mu<\min\left\{\ell-\frac23,\frac{\sqrt{4\ell^2-2\ell+1}-1}2\right\},\] can be reduced in $L^2(\mathbb R)$ to an autonomous system for most values of the frequency vector $\omega$ and $\nu$, where $W(\varphi, \phi)$ is a smooth map from $ \mathbb T^d\times \mathbb T^n$ to $\mathbb R$ and odd in $\varphi$.


title: A constructive approach to Fourier-Mukai transforms for projective spaces via $A_{\infty}$-functors between pretriangulated dg categories

abstract: We discuss the following problem: how can an arbitrary Fourier-Mukai transform $\phi: \mathrm{D}^{\mathrm{b}}( \mathbb{P}^a ) \rightarrow \mathrm{D}^{\mathrm{b}}( \mathbb{P}^b )$ between the bounded derived categories of two projective spaces of dimensions $a$ and $b$ be expressed in explicit terms as an exact functor between the homotopy categories $\mathrm{K}^{\mathrm{b}}( \mathbb{B}^a ) \rightarrow \mathrm{K}^{\mathrm{b}}( \mathbb{B}^b )$ generated by the full strong exceptional sequences of the line bundles $\mathbb{B}^a = \{\mathcal{O}(-a), \dots, \mathcal{O}\}$ and $\mathbb{B}^b = \{\mathcal{O}(-b), \dots, \mathcal{O}\}$? We show that this problem can be reduced to the following task which is independent of any prescribed Fourier-Mukai kernel: finding an $A_{\infty}$-functor $P$ in explicit terms whose induced functor on homotopy categories yields the embedding of $\{ \mathcal{O}(i) \boxtimes \mathcal{O}(j) \mid i = -2a, \dots, 0, ~~j = -2b, \dots 0 \}$ into $\mathrm{D}^{\mathrm{b}}( \mathbb{P}^{a} \times \mathbb{P}^{b})$. As our main technical tool we provide an explicit formula for the lift of an $A_{\infty}$-functor $F: \mathbf{A} \rightarrow \mathbf{B}$ between a dg category $\mathbf{A}$ and a pretriangulated dg category $\mathbf{B}$ to the pretriangulated hull of $\mathbf{A}$ given by the universal property of pretriangulated hulls. As a further application of this tool, we provide a simple example of two non-isomorphic exact functors between triangulated categories that coincide on the full subcategory generated by a full strong exceptional sequence.


title: Einstein, $\sigma$-model and Ernst-type equations and non-isospectral GBDT version of Darboux transformation

abstract: We present a non-isospectral GBDT version of B\"acklund-Darboux transformation for the gravitational and $\sigma$-model equations. New families of explicit solutions correspond to the case of GBDT with non-diagonal generalized matrix eigenvalues. An interesting integrable Ernst-type system, the auxiliary linear systems of which are non-isospectral canonical systems, is studied as well.


title: Hopf algebra actions and rational ideals

abstract: This note discusses a framework for the investigation of the prime spectrum of an associative algebra A that is equipped with an action of a Hopf algebra H. In particular, we study a notion of H-rationality for ideals of A and comment on a possible Dixmier-Moeglin equivalence for H-prime ideals of A.


title: The Role of annealed defects on conformational statistics of a selfavoiding semi-flexible polymer chain: Exact Results (I)

abstract: We study equilibrium statistics of single semi-flexible polymer chain in the presence of defects. The defects are lying along a line in the two and three dimensions and the monomers are interacting with the onsite potential of the defects. A fully directed self-avoiding walk model is used in two and three dimensions to describe thermo-dynamical behaviour of the chain in the presence of m defects. We have found that the number of conformations of the semiflexible polymer chain may be controlled by means of introduction of such defects so that a particular fraction of the chain conformations may be either suppressed or populated as per our requirements for synthesizing the polymer-nanoaggregates. We discuss the role of annealed defects for its Q realizations and m defects analytically, i. e. when the defects are in the thermal equilibrium with the monomers of the semi-flexible chain.


title: Abstractive Text Summarization based on Language Model Conditioning and Locality Modeling

abstract: We explore to what extent knowledge about the pre-trained language model that is used is beneficial for the task of abstractive summarization. To this end, we experiment with conditioning the encoder and decoder of a Transformer-based neural model on the BERT language model. In addition, we propose a new method of BERT-windowing, which allows chunk-wise processing of texts longer than the BERT window size. We also explore how locality modelling, i.e., the explicit restriction of calculations to the local context, can affect the summarization ability of the Transformer. This is done by introducing 2-dimensional convolutional self-attention into the first layers of the encoder. The results of our models are compared to a baseline and the state-of-the-art models on the CNN/Daily Mail dataset. We additionally train our model on the SwissText dataset to demonstrate usability on German. Both models outperform the baseline in ROUGE scores on two datasets and show its superiority in a manual qualitative analysis.


title: Abstractive Summarization with Combination of Pre-trained Sequence-to-Sequence and Saliency Models

abstract: Pre-trained sequence-to-sequence (seq-to-seq) models have significantly improved the accuracy of several language generation tasks, including abstractive summarization. Although the fluency of abstractive summarization has been greatly improved by fine-tuning these models, it is not clear whether they can also identify the important parts of the source text to be included in the summary. In this study, we investigated the effectiveness of combining saliency models that identify the important parts of the source text with the pre-trained seq-to-seq models through extensive experiments. We also proposed a new combination model consisting of a saliency model that extracts a token sequence from a source text and a seq-to-seq model that takes the sequence as an additional input text. Experimental results showed that most of the combination models outperformed a simple fine-tuned seq-to-seq model on both the CNN/DM and XSum datasets even if the seq-to-seq model is pre-trained on large-scale corpora. Moreover, for the CNN/DM dataset, the proposed combination model exceeded the previous best-performed model by 1.33 points on ROUGE-L.


title: The response of a macromolecule near a tiled substrate

abstract: We analyze response of a macromolecule near to a substrate; the substrate is tiled in the sequential and specific manner so that repeat units of the macromolecule may have different response on its adsorption in different directions onto the substrate. The lattice model of random walk has been used to analyze the adsorption-desorption behavior of an infinitely long homo-polymer molecule on a sequentially tiled substrate in three dimensions. The lattice model for the Gaussian chain and directed self-avoiding chain has been solved analytically. It has been emphasized on the basis of analytical estimates that a suitable coating may modify affinity of the macromolecule on the living surfaces and on the non living substrates in the complex manner which may be suitable means to control growth and also a route to restrict the spread of the deadly microbes.


title: A bibliometric analysis of research based on the Roy Adaptation Model: a contribution to Nursing

abstract: Objective. To perform a modern bibliometric analysis of the research based on the Roy Adaptation Model, a founding nursing model proposed by Sor Callista Roy in the1970s. Method. A descriptive and longitudinal study. We used information from the two dominant scientific databases, Web Of Science and SCOPUS. We obtained 137 publications from the Core Collection of WoS, and 338 publications from SCOPUS. We conducted our analysis using the software Bibliometrix, an R-package specialized in creating bibliometric analyses from a perspective of descriptive statistics and network analysis, including co-citation, co-keyword occurrence and collaboration networks. Results. Our quantitative results show the main actors around the research based on the model and the founding literature or references on which this research was based. We analyze the main keywords and how they are linked. Furthermore, we present the most prolific authors both in number of publications and in centrality in the network of coauthors. We present the most central institutions in the global network of collaboration. Conclusions. We highlight the relevance of this theoretical model in nursing and detail its evolution. The United States is the dominant country in production of documents on the topic, and the University of Massachusetts Boston and Boston College are the most influential institutions. The network of collaboration also describes clusters in Mexico, Turkey and Spain. Our findings are useful to acquire a general vision of the field.


title: On some properties of the \L ojasiewicz exponent

abstract: In this note, we study the behaviour of the Lojasiewicz exponent under hyperplane sections and its relation to the order of tangency.


title: Named Entities in Medical Case Reports: Corpus and Experiments

abstract: We present a new corpus comprising annotations of medical entities in case reports, originating from PubMed Central's open access library. In the case reports, we annotate cases, conditions, findings, factors and negation modifiers. Moreover, where applicable, we annotate relations between these entities. As such, this is the first corpus of this kind made available to the scientific community in English. It enables the initial investigation of automatic information extraction from case reports through tasks like Named Entity Recognition, Relation Extraction and (sentence/paragraph) relevance detection. Additionally, we present four strong baseline systems for the detection of medical entities made available through the annotated dataset.


title: Mechanical classification of voice quality

abstract: While there is no a priori definition of good singing voices, we tend to make consistent evaluations of the quality of singing almost instantaneously. Such an instantaneous evaluation might be based on the sound spectrum that can be perceived in a short time. Here we devise a Bayesian algorithm that learns to evaluate the choral proficiency, musical scale, and gender of individual singers using the sound spectra of singing voices. In particular, the classification is performed on a set of sound spectral intensities, whose frequencies are selected by minimizing the Bayes risk. This optimization allows the algorithm to capture sound frequencies that are essential for each discrimination task, resulting in a good assessment performance. Experimental results revealed that a sound duration of about 0.1 sec is sufficient for determining the choral proficiency and gender of a singer. With a program constructed on this algorithm, everyone can evaluate choral voices of others and perform private vocal exercises.


title: 1-d Quantum Harmonic Oscillator with Time Quasi-periodic Quadratic Perturbation: Reducibility and Growth of Sobolev Norms

abstract: For a family of 1-d quantum harmonic oscillator with a perturbation which is $C^2$ parametrized by $E\in{\mathcal I}\subset{\Bbb R}$ and quadratic on $x$ and $-{\rm i}\partial_x$ with coefficients quasi-periodically depending on time $t$, we show the reducibility (i.e., conjugation to time-independent) for a.e. $E$. As an application of reducibility, we describe the behaviors of solution in Sobolev space: -- Boundedness w.r.t. $t$ is always true for "most" $E\in{\mathcal I}$. -- For "generic" time-dependent perturbation, polynomial growth and exponential growth to infinity w.r.t. $t$ occur for $E$ in a "small" part of ${\mathcal I}$. Concrete examples are given for which the growths of Sobolev norm do occur.


title: Multi-Path Region Mining For Weakly Supervised 3D Semantic Segmentation on Point Clouds

abstract: Point clouds provide intrinsic geometric information and surface context for scene understanding. Existing methods for point cloud segmentation require a large amount of fully labeled data. Using advanced depth sensors, collection of large scale 3D dataset is no longer a cumbersome process. However, manually producing point-level label on the large scale dataset is time and labor-intensive. In this paper, we propose a weakly supervised approach to predict point-level results using weak labels on 3D point clouds. We introduce our multi-path region mining module to generate pseudo point-level label from a classification network trained with weak labels. It mines the localization cues for each class from various aspects of the network feature using different attention modules. Then, we use the point-level pseudo labels to train a point cloud segmentation network in a fully supervised manner. To the best of our knowledge, this is the first method that uses cloud-level weak labels on raw 3D space to train a point cloud semantic segmentation network. In our setting, the 3D weak labels only indicate the classes that appeared in our input sample. We discuss both scene- and subcloud-level weakly labels on raw 3D point cloud data and perform in-depth experiments on them. On ScanNet dataset, our result trained with subcloud-level labels is compatible with some fully supervised methods.


title: Ultrafast photochromism and bacteriochromism in one dimensional hybrid plasmonic photonic structures

abstract: Hybrid plasmonic photonic structures combine the plasmonic response with the photonic band gap, holding promise for utilization as optical switches and sensors. Here, we demonstrate the active modulation of the optical response in such structures with two different external stimuli, e.g. laser pulses and bacteria. First, we report the fabrication of a miniaturized (5 x 5 mm) indium tin oxide (ITO) grating employing femtosecond laser micromachining, and we show the possibility to modulate the photonic band gap in the visible via ultrafast photoexcitation in the infrared part of the spectrum. Note that the demonstrated time response in the picosecond range of the spectral modulation have an industrial relevance. Moreover, we manufacture one-dimensional photonic crystals consisting of a solution-processed dielectric Bragg stack exposing a top-layer of bio-active silver. We assign the bacterial responsivity of the system to polarization charges at the Ag/bacterium interface, giving rise to an overall blue shift of the photonic band gap.


title: Unified Lagrangian-Hamiltonian formalism for contact systems

abstract: We present a unified geometric framework for describing both the Lagrangian and Hamiltonian formalisms of contact autonomous mechanical systems, which is based on the approach of the pionnering work of R. Skinner and R. Rusk. This framework permits to skip the second order differential equation problem, which is obtained as a part of the constraint algorithm (for singular or regular Lagrangians), and is specially useful to describe singular Lagrangian systems. Some examples are also discussed to illustrate the method.


title: Identification of Patterns in Cosmic-Ray Arrival Directions using Dynamic Graph Convolutional Neural Networks

abstract: We present a new approach for the identification of ultra-high energy cosmic rays from sources using dynamic graph convolutional neural networks. These networks are designed to handle sparsely arranged objects and to exploit their short- and long-range correlations. Our method searches for patterns in the arrival directions of cosmic rays, which are expected to result from coherent deflections in cosmic magnetic fields. The network discriminates astrophysical scenarios with source signatures from those with only isotropically distributed cosmic rays and allows for the identification of cosmic rays that belong to a deflection pattern. We use simulated astrophysical scenarios where the source density is the only free parameter to show how density limits can be derived. We apply this method to a public data set from the AGASA Observatory.


title: Cosimplicial monoids and deformation theory of tensor categories

abstract: We introduce a notion of $n$-commutativity ($0\le n\le \infty$) for cosimplicial monoids in a symmetric monoidal category ${\bf V}$, where $n=0$ corresponds to just cosimplicial monoids in ${\bf V,}$ while $n=\infty$ corresponds to commutative cosimplicial monoids. If ${\bf V}$ has a monoidal model structure we show (under some mild technical conditions) that the total object of an $n$-cosimplicial monoid has a natural $E_{n+1}$-algebra structure. Our main applications are to the deformation theory of tensor categories and tensor functors. We show that the deformation complex of a tensor functor is a total complex of a $1$-commutative cosimplicial monoid and, hence, has an $E_2$-algebra structure similar to the $E_2$-structure on Hochschild complex of an associative algebra provided by Deligne's conjecture. We further demonstrate that the deformation complex of a tensor category is the total complex of a $2$-commutative cosimplicial monoid and, therefore, is naturally an $E_3$-algebra. We make these structures very explicit through a language of Delannoy paths and their noncommutative liftings. We investigate how these structures manifest themselves in concrete examples.


title: On integral models of Shimura varieties

abstract: We show how to characterize integral models of Shimura varieties over places of the reflex field where the level subgroup is parahoric by formulating a definition of a "canonical" integral model. We then prove that in Hodge type cases and under a tameness hypothesis, the integral models constructed by the author and Kisin in previous work are canonical and, in particular, independent of choices. A main tool is a theory of displays with parahoric structure that we develop in this paper.


title: Intermittent Inverse-Square L\'evy Walks are Optimal for Finding Targets of All Sizes

abstract: L\'evy walks are random walk processes whose step-lengths follow a long-tailed power-law distribution. Due to their abundance as movement patterns of biological organisms, significant theoretical efforts have been devoted to identifying the foraging circumstances that would make such patterns advantageous. However, despite extensive research, there is currently no mathematical proof indicating that L\'evy walks are, in any manner, preferable strategies in higher dimensions than one. Here we prove that in finite two-dimensional terrains, the inverse-square L\'evy walk strategy is extremely efficient at finding sparse targets of arbitrary size and shape. Moreover, this holds even under the weak model of intermittent detection. Conversely, any other intermittent L\'evy walk fails to efficiently find either large targets or small ones. Our results shed new light on the \emph{L\'evy foraging hypothesis}, and are thus expected to impact future experiments on animals performing L\'evy walks.


title: Omni-sourced Webly-supervised Learning for Video Recognition

abstract: We introduce OmniSource, a novel framework for leveraging web data to train video recognition models. OmniSource overcomes the barriers between data formats, such as images, short videos, and long untrimmed videos for webly-supervised learning. First, data samples with multiple formats, curated by task-specific data collection and automatically filtered by a teacher model, are transformed into a unified form. Then a joint-training strategy is proposed to deal with the domain gaps between multiple data sources and formats in webly-supervised learning. Several good practices, including data balancing, resampling, and cross-dataset mixup are adopted in joint training. Experiments show that by utilizing data from multiple sources and formats, OmniSource is more data-efficient in training. With only 3.5M images and 800K minutes videos crawled from the internet without human labeling (less than 2% of prior works), our models learned with OmniSource improve Top-1 accuracy of 2D- and 3D-ConvNet baseline models by 3.0% and 3.9%, respectively, on the Kinetics-400 benchmark. With OmniSource, we establish new records with different pretraining strategies for video recognition. Our best models achieve 80.4%, 80.5%, and 83.6 Top-1 accuracies on the Kinetics-400 benchmark respectively for training-from-scratch, ImageNet pre-training and IG-65M pre-training.


title: Noise Modeling, Synthesis and Classification for Generic Object Anti-Spoofing

abstract: Using printed photograph and replaying videos of biometric modalities, such as iris, fingerprint and face, are common attacks to fool the recognition systems for granting access as the genuine user. With the growing online person-to-person shopping (e.g., Ebay and Craigslist), such attacks also threaten those services, where the online photo illustration might not be captured from real items but from paper or digital screen. Thus, the study of anti-spoofing should be extended from modality-specific solutions to generic-object-based ones. In this work, we define and tackle the problem of Generic Object Anti-Spoofing (GOAS) for the first time. One significant cue to detect these attacks is the noise patterns introduced by the capture sensors and spoof mediums. Different sensor/medium combinations can result in diverse noise patterns. We propose a GAN-based architecture to synthesize and identify the noise patterns from seen and unseen medium/sensor combinations. We show that the procedure of synthesis and identification are mutually beneficial. We further demonstrate the learned GOAS models can directly contribute to modality-specific anti-spoofing without domain transfer. The code and GOSet dataset are available at cvlab.cse.msu.edu/project-goas.html.


title: Implicit Cooperation: Emotion Detection for Validation and Adaptation of Automated Vehicles' Driving Behavior

abstract: Human emotion detection in automated vehicles helps to improve comfort and safety. Research in the automotive domain focuses a lot on sensing drivers' drowsiness and aggression. We present a new form of implicit driver-vehicle cooperation, where emotion detection is integrated into an automated vehicle's decision-making process. Constant evaluation of the driver's reaction to vehicle behavior allows us to revise decisions and helps to increase the safety of future automated vehicles.


title: Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimation

abstract: Unsupervised learning of optical flow, which leverages the supervision from view synthesis, has emerged as a promising alternative to supervised methods. However, the objective of unsupervised learning is likely to be unreliable in challenging scenes. In this work, we present a framework to use more reliable supervision from transformations. It simply twists the general unsupervised learning pipeline by running another forward pass with transformed data from augmentation, along with using transformed predictions of original data as the self-supervision signal. Besides, we further introduce a lightweight network with multiple frames by a highly-shared flow decoder. Our method consistently gets a leap of performance on several benchmarks with the best accuracy among deep unsupervised methods. Also, our method achieves competitive results to recent fully supervised methods while with much fewer parameters.


title: Dominant role of orbital splitting in determining cathode potential in $O3$ $NaTMO_2$ compounds

abstract: Designing high potential cathodes for Na-ion batteries, which are comparable in performance to Li-ion cathodes, remains a challenging task. Through comprehensive density functional calculations, we disentangle the relationship between the cathode potential and the ionicity of $TM-O$ bonds in $O3$ $NaTMO_2$ compounds in which TM ions is a fourth- or fifth-row transition metal. We demonstrate that the magnetic exchange interaction and the local distortions in the coordination environment of TM ions play more significant roles in determining the cathode potential of the $TM^{3+}$ $\to$ $TM^{4+}+ e^-$ reaction than the ionicity of the $TM-O$ bonds in these compounds. These results indicate that designing cathode materials solely based on empirical electronegativity values to achieve high potential may not be a feasible strategy without taking into account a detailed structural assessment.


title: Dual-density-based reweighted $\ell_{1}$-algorithms for a class of $\ell_{0}$-minimization problems

abstract: The optimization problem with sparsity arises in many areas of science and engineering such as compressed sensing, image processing, statistical learning and data sparse approximation. In this paper, we study the dual-density-based reweighted $\ell_{1}$-algorithms for a class of $\ell_{0}$-minimization models which can be used to model a wide range of practical problems. This class of algorithms is based on certain convex relaxations of the reformulation of the underlying $\ell_{0}$-minimization model. Such a reformulation is a special bilevel optimization problem which, in theory, is equivalent to the underlying $\ell_{0}$-minimization problem under the assumption of strict complementarity. Some basic properties of these algorithms are discussed, and numerical experiments have been carried out to demonstrate the efficiency of the proposed algorithms. Comparison of numerical performances of the proposed methods and the classic reweighted $\ell_1$-algorithms has also been made in this paper.


title: Attentive CutMix: An Enhanced Data Augmentation Approach for Deep Learning Based Image Classification

abstract: Convolutional neural networks (CNN) are capable of learning robust representation with different regularization methods and activations as convolutional layers are spatially correlated. Based on this property, a large variety of regional dropout strategies have been proposed, such as Cutout, DropBlock, CutMix, etc. These methods aim to promote the network to generalize better by partially occluding the discriminative parts of objects. However, all of them perform this operation randomly, without capturing the most important region(s) within an object. In this paper, we propose Attentive CutMix, a naturally enhanced augmentation strategy based on CutMix. In each training iteration, we choose the most descriptive regions based on the intermediate attention maps from a feature extractor, which enables searching for the most discriminative parts in an image. Our proposed method is simple yet effective, easy to implement and can boost the baseline significantly. Extensive experiments on CIFAR-10/100, ImageNet datasets with various CNN architectures (in a unified setting) demonstrate the effectiveness of our proposed method, which consistently outperforms the baseline CutMix and other methods by a significant margin.