title: Design and Development of a Gecko-Adhesive Gripper for the Astrobee Free-Flying Robot

abstract: Assistive free-flying robots are a promising platform for supporting and working alongside astronauts in carrying out tasks that require interaction with the environment. However, current free-flying robot platforms are limited by existing manipulation technologies in being able to grasp and manipulate surrounding objects. Instead, gecko-inspired adhesives offer many advantages for an alternate grasping and manipulation paradigm for use in assistive free-flyer applications. In this work, we present the design of a gecko-inspired adhesive gripper for performing perching and grasping maneuvers for the Astrobee robot, a free-flying robot currently operating on-board the International Space Station. We present software and hardware integration details for the gripper units that were launched to the International Space Station in 2019 for in-flight experiments with Astrobee. Finally, we present preliminary results for on-ground experiments conducted with the gripper and Astrobee on a free-floating spacecraft test bed.


title: Weight Distillation: Transferring the Knowledge in Neural Network Parameters

abstract: Knowledge distillation has been proven to be effective in model acceleration and compression. It allows a small network to learn to generalize in the same way as a large network. Recent successes in pre-training suggest the effectiveness of transferring model parameters. Inspired by this, we investigate methods of model acceleration and compression in another line of research. We propose Weight Distillation to transfer the knowledge in the large network parameters through a parameter generator. Our experiments on WMT16 En-Ro, NIST12 Zh-En, and WMT14 En-De machine translation tasks show that weight distillation can train a small network that is 1.88~2.94x faster than the large network but with competitive performance. With the same sized small network, weight distillation can outperform knowledge distillation by 0.51~1.82 BLEU points.


title: Hidden Incentives for Auto-Induced Distributional Shift

abstract: Decisions made by machine learning systems have increasing influence on the world, yet it is common for machine learning algorithms to assume that no such influence exists. An example is the use of the i.i.d. assumption in content recommendation. In fact, the (choice of) content displayed can change users' perceptions and preferences, or even drive them away, causing a shift in the distribution of users. We introduce the term auto-induced distributional shift (ADS) to describe the phenomenon of an algorithm causing a change in the distribution of its own inputs. Our goal is to ensure that machine learning systems do not leverage ADS to increase performance when doing so could be undesirable. We demonstrate that changes to the learning algorithm, such as the introduction of meta-learning, can cause hidden incentives for auto-induced distributional shift (HI-ADS) to be revealed. To address this issue, we introduce `unit tests' and a mitigation strategy for HI-ADS, as well as a toy environment for modelling real-world issues with HI-ADS in content recommendation, where we demonstrate that strong meta-learners achieve gains in performance via ADS. We show meta-learning and Q-learning both sometimes fail unit tests, but pass when using our mitigation strategy.


title: CLEVR Parser: A Graph Parser Library for Geometric Learning on Language Grounded Image Scenes

abstract: The CLEVR dataset has been used extensively in language grounded visual reasoning in Machine Learning (ML) and Natural Language Processing (NLP) domains. We present a graph parser library for CLEVR, that provides functionalities for object-centric attributes and relationships extraction, and construction of structural graph representations for dual modalities. Structural order-invariant representations enable geometric learning and can aid in downstream tasks like language grounding to vision, robotics, compositionality, interpretability, and computational grammar construction. We provide three extensible main components - parser, embedder, and visualizer that can be tailored to suit specific learning setups. We also provide out-of-the-box functionality for seamless integration with popular deep graph neural network (GNN) libraries. Additionally, we discuss downstream usage and applications of the library, and how it accelerates research for the NLP research community.


title: SecDD: Efficient and Secure Method for Remotely Training Neural Networks

abstract: We leverage what are typically considered the worst qualities of deep learning algorithms - high computational cost, requirement for large data, no explainability, high dependence on hyper-parameter choice, overfitting, and vulnerability to adversarial perturbations - in order to create a method for the secure and efficient training of remotely deployed neural networks over unsecured channels.


title: A new channel to form IMBHs throughout cosmic time

abstract: While the formation of the first black holes at high redshift is reasonably well understood though debated, massive black hole formation at later cosmic epochs has not been adequately explored. We present a gas accretion driven mechanism that can build up black hole masses rapidly in dense, gas-rich nuclear star clusters (NSCs). Wind-fed supra-exponential accretion of an initially wandering black hole in NSCs can lead to extremely fast growth, scaling stellar mass remnant seed black holes up to intermediate mass black holes (IMBHs). Operating throughout cosmic time, growth via this new channel is modulated by the gas supply, and premature termination results in the formation of lower mass black holes with masses in the range of 50 - few 100 solar masses, filling in the so-called mass gap. However, in most gas-rich NSCs, growth is unimpeded, inevitably leading to the formation of IMBHs with masses ranging from 100 - 100,000 solar masses. A spate of new detection spanning the full range of the IMBH mass function - from the LIGO-VIRGO source GW190521 to the emerging population of 10^5 solar mass black holes harbored in low-mass dwarf galaxies - are revealing this elusive population. Naturally accounting for the detected presence of off-center IMBHs in low-mass dwarfs, this new pathway also predicts the existence of an extensive population of wandering non-central black holes in more massive galaxies would be detectable via tidal disruption events and as GW sources. Gas-rich NSCs serve as incubators for the continual formation of black holes over a wide range in mass throughout cosmic time.


title: Main physical characteristics of crystal, magnetic and electronic structures of Ce3+-based perovskites CeTmO3 [Tm3+ = Sc, Ti, V] investigated via the first-principles computational utilizing LDA, PBE-GGA and WC-GGA functionals

abstract: Main physical characteristics, crystal, magnetic and electronic structures, of cerium-based perovskites CeTmO3 [Tm3+ = Sc, Ti, V] are systematically investigated via the first-principles computations. Full-potential linear augmented plane-wave with the local density approximation and generalized gradient approximation, under Perdew-Burke-Ernzerh and Wu-Cohen, based on DFT. The optimized crystal parameters indicate that the crystal of compounds can categorized under cubic structure (space group Pm-3m, no. 221), and their obtained lattice constants in good agreement with the available experimental values. The computed electronic band structures, density of states (DOS) and charge density reveal the metallic nature for CeTmO3, except for [Tm3+ = Sc], exhibits half-metallic characteristics. Besides, all functionals provide nearly similar results of crystal structures, DOSs as well as spin magnetic moments confirm that the CeTmO3 are ferromagnetic (FM) metals.


title: Proceedings 36th International Conference on Logic Programming (Technical Communications)

abstract: Since the first conference held in Marseille in 1982, ICLP has been the premier international event for presenting research in logic programming. Contributions are solicited in all areas of logic programming and related areas, including but not restricted to: - Foundations: Semantics, Formalisms, Answer-Set Programming, Non-monotonic Reasoning, Knowledge Representation. - Declarative Programming: Inference engines, Analysis, Type and mode inference, Partial evaluation, Abstract interpretation, Transformation, Validation, Verification, Debugging, Profiling, Testing, Logic-based domain-specific languages, constraint handling rules. - Related Paradigms and Synergies: Inductive and Co-inductive Logic Programming, Constraint Logic Programming, Interaction with SAT, SMT and CSP solvers, Logic programming techniques for type inference and theorem proving, Argumentation, Probabilistic Logic Programming, Relations to object-oriented and Functional programming, Description logics, Neural-Symbolic Machine Learning, Hybrid Deep Learning and Symbolic Reasoning. - Implementation: Concurrency and distribution, Objects, Coordination, Mobility, Virtual machines, Compilation, Higher Order, Type systems, Modules, Constraint handling rules, Meta-programming, Foreign interfaces, User interfaces. - Applications: Databases, Big Data, Data Integration and Federation, Software Engineering, Natural Language Processing, Web and Semantic Web, Agents, Artificial Intelligence, Bioinformatics, Education, Computational life sciences, Education, Cybersecurity, and Robotics.


title: A Convergence Rate for Extended-Source Internal DLA in the Plane

abstract: Internal DLA (IDLA) is an internal aggregation model in which particles perform random walks from the origin, in turn, and stop upon reaching an unoccupied site. Levine and Peres showed that, when particles start instead from fixed multiple-point distributions, the modified IDLA processes have deterministic scaling limits related to a certain obstacle problem. In this paper, we investigate the convergence rate of this "extended source" IDLA in the plane to its scaling limit. We show that, if $\delta$ is the lattice size, fluctuations of the IDLA occupied set are at most of order $\delta^{3/5}$ from its scaling limit, with probability at least $1-e^{-1/\delta^{2/5}}$.


title: Poincar\'{e} duality for rigid analytic Hyodo--Kato theory

abstract: The purpose of this paper is to establish Hyodo--Kato theory with compact support for semistable schemes through rigid analytic methods. To this end we introduce several types of log rigid cohomology with compact support. moreover we show that additional structures on the (rigid) Hyodo--Kato cohomology and the Hyodo--Kato map introduced in our previous paper are compatible with Poincar\'{e} duality. Compared to the crystalline approach, the constructions are explicit yet versatile, and hence suitable for computations.


title: Label-Based Diversity Measure Among Hidden Units of Deep Neural Networks: A Regularization Method

abstract: Although the deep structure guarantees the powerful expressivity of deep networks (DNNs), it also triggers serious overfitting problem. To improve the generalization capacity of DNNs, many strategies were developed to improve the diversity among hidden units. However, most of these strategies are empirical and heuristic in absence of either a theoretical derivation of the diversity measure or a clear connection from the diversity to the generalization capacity. In this paper, from an information theoretic perspective, we introduce a new definition of redundancy to describe the diversity of hidden units under supervised learning settings by formalizing the effect of hidden layers on the generalization capacity as the mutual information. We prove an opposite relationship existing between the defined redundancy and the generalization capacity, i.e., the decrease of redundancy generally improving the generalization capacity. The experiments show that the DNNs using the redundancy as the regularizer can effectively reduce the overfitting and decrease the generalization error, which well supports above points.


title: Extracting Summary Knowledge Graphs from Long Documents

abstract: Knowledge graphs capture entities and relations from long documents and can facilitate reasoning in many downstream applications. Extracting compact knowledge graphs containing only salient entities and relations is important but challenging for understanding and summarizing long documents. We introduce a new text-to-graph task of predicting summarized knowledge graphs from long documents. We develop a dataset of 200k document/graph pairs using automatic and human annotations. We also develop strong baselines for this task based on graph learning and text summarization, and provide quantitative and qualitative studies of their effect.


title: Improving Spiking Sparse Recovery via Non-Convex Penalties

abstract: Compared with digital methods, sparse recovery based on spiking neural networks has great advantages like high computational efficiency and low power-consumption. However, current spiking algorithms cannot guarantee more accurate estimates since they are usually designed to solve the classical optimization with convex penalties, especially the $\ell_{1}$-norm. In fact, convex penalties are observed to underestimate the true solution in practice, while non-convex ones can avoid the underestimation. Inspired by this, we propose an adaptive version of spiking sparse recovery algorithm to solve the non-convex regularized optimization, and provide an analysis on its global asymptotic convergence. Through experiments, the accuracy is greatly improved under different adaptive ways.


title: Fast and robust quantum state transfer via a topological chain

abstract: We propose a fast and robust quantum state transfer protocol employing a Su-Schrieffer-Heeger chain, where the interchain couplings vary in time. Based on simple considerations around the terms involved in the definition of the adiabatic invariant, we construct an exponential time-driving function that successfully takes advantage of resonant effects to speed up the transfer process. Using optimal control theory, we confirm that the proposed time-driving function is close to optimal. To unravel the crucial aspects of our construction, we proceed to a comparison with two other protocols. One where the underlying Su-Schrieffer-Heeger chain is adiabatically time-driven and another where the underlying chain is topologically trivial and resonant effects are at work. By numerically investigating the resilience of each protocol to static noise, we highlight the robustness of the exponential driving.


title: A study into the impact of anti-extradition bill protests on Bangladeshi immigration into Hong Kong

abstract: Consequences from the 2019 anti-extradition protests in Hong Kong have been studied in many facets, but one topic of interest that has not been explored is the impact on the immigration of Bangladeshi immigrants into the city. This paper explores the value add of Bangladeshis to the Hong Kong, how the protests affected their mentality and consequently their immigration, and potentially longer-term detrimental effects on the city.


title: Hypergroup structures of open quantum random walks on distance sets

abstract: Wildberger has introduced the method to construct a hermitian discrete hypergroup from a random walk on a graph. We will apply his method to an open quantum random walk (OQRW) on a distance set, and show that any discrete hypergroup which is not necessary hermitian is realized by an OQRW on a distance set. We will investigate distributions of OQRWs on distance sets in the view point of hypergroups.


title: Second-order topological insulator and fragile topology in topological circuitry simulation

abstract: Second-order topological insulators (SOTIs) are the topological phases of matter in d dimensions that manifest (d-2)-dimensional localized modes at the intersection of the edges. We show that SOTIs can be designed via stacked Chern insulators with opposite chiralities connected by interlayer coupling. To characterize the bulk-corner correspondence, we establish a Jacobian-transformed nested Wilson loop method and an edge theory that are applicable to a wider class of higher-order topological systems. The corresponding topological invariant admits a filling anomaly of the corner modes with fractional charges. The system manifests a fragile topological phase characterized by the absence of a Wannier gap in the Wilson loop spectrum. Furthermore, we argue that the proposed approach can be generalized to multilayers. Our work offers perspectives for exploring and understanding higher-order topological phenomena.


title: Dynamic Scheduling and Workforce Assignment in Open Source Software Development

abstract: A novel modeling framework is proposed for dynamic scheduling of projects and workforce assignment in open source software development (OSSD). The goal is to help project managers in OSSD distribute workforce to multiple projects to achieve high efficiency in software development (e.g. high workforce utilization and short development time) while ensuring the quality of deliverables (e.g. code modularity and software security). The proposed framework consists of two models: 1) a system dynamic model coupled with a meta-heuristic to obtain an optimal schedule of software development projects considering their attributes (e.g. priority, effort, duration) and 2) an agent based model to represent the development community as a social network, where development managers form an optimal team for each project and balance the workload among multiple scheduled projects based on the optimal schedule obtained from the system dynamic model. To illustrate the proposed framework, a software enhancement request process in Kuali foundation is used as a case study. Survey data collected from the Kuali development managers, project managers and actual historical enhancement requests have been used to construct the proposed models. Extensive experiments are conducted to demonstrate the impact of varying parameters on the considered efficiency and quality.


title: BargainNet: Background-Guided Domain Translation for Image Harmonization

abstract: Image composition is a fundamental operation in image editing field. However, unharmonious foreground and background downgrade the quality of composite image. Image harmonization, which adjusts the foreground to improve the consistency, is an essential yet challenging task. Previous deep learning based methods mainly focus on directly learning the mapping from composite image to real image, while ignoring the crucial guidance role that background plays. In this work, with the assumption that the foreground needs to be translated to the same domain as background, we formulate image harmonization task as background-guided domain translation. Therefore, we propose an image harmonization network with a novel domain code extractor and well-tailored triplet losses, which could capture the background domain information to guide the foreground harmonization. Extensive experiments on the existing image harmonization benchmark demonstrate the effectiveness of our proposed method. Code is available at https://github.com/bcmi/BargainNet.


title: Optimizing Away JavaScript Obfuscation

abstract: JavaScript is a popular attack vector for releasing malicious payloads on unsuspecting Internet users. Authors of this malicious JavaScript often employ numerous obfuscation techniques in order to prevent the automatic detection by antivirus and hinder manual analysis by professional malware analysts. Consequently, this paper presents SAFE-Deobs, a JavaScript deobfuscation tool that we have built. The aim of SAFE-Deobs is to automatically deobfuscate JavaScript malware such that an analyst can more rapidly determine the malicious script's intent. This is achieved through a number of static analyses, inspired by techniques from compiler theory. We demonstrate the utility of SAFE-Deobs through a case study on real-world JavaScript malware, and show that it is a useful addition to a malware analyst's toolset.


title: Stochastic Threshold Model Trees: A Tree-Based Ensemble Method for Dealing with Extrapolation

abstract: In the field of chemistry, there have been many attempts to predict the properties of unknown compounds from statistical models constructed using machine learning. In an area where many known compounds are present (the interpolation area), an accurate model can be constructed. In contrast, data in areas where there are no known compounds (the extrapolation area) are generally difficult to predict. However, in the development of new materials, it is desirable to search this extrapolation area and discover compounds with unprecedented physical properties. In this paper, we propose Stochastic Threshold Model Trees (STMT), an extrapolation method that reflects the trend of the data, while maintaining the accuracy of conventional interpolation methods. The behavior of STMT is confirmed through experiments using both artificial and real data. In the case of the real data, although there is no significant overall improvement in accuracy, there is one compound for which the prediction accuracy is notably improved, suggesting that STMT reflects the data trends in the extrapolation area. We believe that the proposed method will contribute to more efficient searches in situations such as new material development.


title: Few-shot learning using pre-training and shots, enriched by pre-trained samples

abstract: We use the EMNIST dataset of handwritten digits to test a simple approach for few-shot learning. A fully connected neural network is pre-trained with a subset of the 10 digits and used for few-shot learning with untrained digits. Two basic ideas are introduced: during few-shot learning the learning of the first layer is disabled, and for every shot a previously unknown digit is used together with four previously trained digits for the gradient descend, until a predefined threshold condition is fulfilled. This way we reach about 90% accuracy after 10 shots.


title: Nominal Compound Chain Extraction: A New Task for Semantic-enriched Lexical Chain

abstract: Lexical chain consists of cohesion words in a document, which implies the underlying structure of a text, and thus facilitates downstream NLP tasks. Nevertheless, existing work focuses on detecting the simple surface lexicons with shallow syntax associations, ignoring the semantic-aware lexical compounds as well as the latent semantic frames, (e.g., topic), which can be much more crucial for real-world NLP applications. In this paper, we introduce a novel task, Nominal Compound Chain Extraction (NCCE), extracting and clustering all the nominal compounds that share identical semantic topics. In addition, we model the task as a two-stage prediction (i.e., compound extraction and chain detection), which is handled via a proposed joint framework. The model employs the BERT encoder to yield contextualized document representation. Also, HowNet is exploited as external resources for offering rich sememe information. The experiments are based on our manually annotated corpus, and the results prove the necessity of the NCCE task as well as the effectiveness of our joint approach.


title: Aggressive Language Detection with Joint Text Normalization via Adversarial Multi-task Learning

abstract: Aggressive language detection (ALD), detecting the abusive and offensive language in texts, is one of the crucial applications in NLP community. Most existing works treat ALD as regular classification with neural models, while ignoring the inherent conflicts of social media text that they are quite unnormalized and irregular. In this work, we target improving the ALD by jointly performing text normalization (TN), via an adversarial multi-task learning framework. The private encoders for ALD and TN focus on the task-specific features retrieving, respectively, and the shared encoder learns the underlying common features over two tasks. During adversarial training, a task discriminator distinguishes the separate learning of ALD or TN. Experimental results on four ALD datasets show that our model outperforms all baselines under differing settings by large margins, demonstrating the necessity of joint learning the TN with ALD. Further analysis is conducted for a better understanding of our method.


title: On the Boundary Value Problems of {\Psi} -Hilfer Fractional Differential Equations

abstract: In the current paper, we derive the comparison results for the homogeneous and non-homogeneous linear initial value problem (IVP) for $\Psi$-Hilfer fractional differential equations. In the presence of upper and lower solutions, the obtained comparison results and the location of roots theorem utilized to prove the existence and uniqueness of the solution for the linear $\Psi$-Hilfer boundary value problem (BVP) through the linear non-homogeneous $\Psi$-Hilfer IVP. Assuming the existence of lower solution $w_0 $ and upper solution $z_0 $, we establish the existence of minimal and maximal solutions for the nonlinear $\Psi$-Hilfer BVP in the line segment $[w_0,\,z_0]$ of the weighted space $C_{1-\,\gamma ;\, \Psi }\left( J,\,\R\right)$. Further, it demonstrated that the iterative Picard type sequences that began with lower and upper solutions respectively converges to a minimal and maximal solutions, and that started with any point on a line segment converge to the exact solution of nonlinear $\Psi$-Hilfer BVP. Finally, an example is provided in support of the main results we acquired.


title: Causal Discovery with Multi-Domain LiNGAM for Latent Factors

abstract: Discovering causal structures among latent factors from observed data is a particularly challenging problem. Despite some efforts for this problem, existing methods focus on the single-domain data only. In this paper, we propose Multi-Domain Linear Non-Gaussian Acyclic Models for Latent Factors (MD-LiNA), where the causal structure among latent factors of interest is shared for all domains, and we provide its identification results. The model enriches the causal representation for multi-domain data. We propose an integrated two-phase algorithm to estimate the model. In particular, we first locate the latent factors and estimate the factor loading matrix. Then to uncover the causal structure among shared latent factors of interest, we derive a score function based on the characterization of independence relations between external influences and the dependence relations between multi-domain latent factors and latent factors of interest. We show that the proposed method provides locally consistent estimators. Experimental results on both synthetic and real-world data demonstrate the efficacy and robustness of our approach.


title: Optimal Estimation of the Number of Communities

abstract: In network analysis, how to estimate the number of communities $K$ is a fundamental problem. We consider a broad setting where we allow severe degree heterogeneity and a wide range of sparsity levels, and propose Stepwise Goodness-of-Fit (StGoF) as a new approach. This is a stepwise algorithm, where for $m = 1, 2, \ldots$, we alternately use a community detection step and a goodness-of-fit (GoF) step. We adapt SCORE \cite{SCORE} for community detection, and propose a new GoF metric. We show that at step $m$, the GoF metric diverges to $\infty$ in probability for all $m < K$ and converges to $N(0,1)$ if $m = K$. This gives rise to a consistent estimate for $K$. Also, we discover the right way to define the signal-to-noise ratio (SNR) for our problem and show that consistent estimates for $K$ do not exist if $\mathrm{SNR} \goto 0$, and StGoF is uniformly consistent for $K$ if $\mathrm{SNR} \goto \infty$. Therefore, StGoF achieves the optimal phase transition. Similar stepwise methods (e.g., \cite{wang2017likelihood, ma2018determining}) are known to face analytical challenges. We overcome the challenges by using a different stepwise scheme in StGoF and by deriving sharp results that are not available before. The key to our analysis is to show that SCORE has the {\it Non-Splitting Property (NSP)}. Primarily due to a non-tractable rotation of eigenvectors dictated by the Davis-Kahan $\sin(\theta)$ theorem, the NSP is non-trivial to prove and requires new techniques we develop.


title: Spherically symmetric density and potential of a hydrogen molecule

abstract: Using a hydrogen molecule as a test system we demonstrate how to compute the effective potential according to the formalism of the new density functional theory (DFT), in which the basic variable is the set of spherically averaged densities instead of the total density, used in the traditional DFT. The effective potential together the external potential, nuclear Coulomb potential, can be substituted in the Schr\"odinger like differential equation to obtain the spherically averaged electron density of the system. In the new method instead of one three-dimensional low symmetry equation one has to solve as many spherically symmetric equations as there are atoms in the system.


title: Recognizing Micro-Expression in Video Clip with Adaptive Key-Frame Mining

abstract: As a spontaneous expression of emotion on face, micro-expression reveals the underlying emotion that cannot be controlled by human. In micro-expression, facial movement is transient and sparsely localized through time. However, the existing representation based on various deep learning techniques learned from a full video clip is usually redundant. In addition, methods utilizing the single apex frame of each video clip require expert annotations and sacrifice the temporal dynamics. To simultaneously localize and recognize such fleeting facial movements, we propose a novel end-to-end deep learning architecture, referred to as adaptive key-frame mining network (AKMNet). Operating on the video clip of micro-expression, AKMNet is able to learn discriminative spatio-temporal representation by combining spatial features of self-learned local key frames and their global-temporal dynamics. Theoretical analysis and empirical evaluation show that the proposed approach improved recognition accuracy in comparison with state-of-the-art methods on multiple benchmark datasets.


title: Screening of a test charge in a free-electron gas at warm dense matter and dense non-ideal plasma conditions

abstract: The screening of a test charge by partially degenerate non-ideal free electrons at conditions related to warm dense matter and dense plasmas is investigated using linear response theory and the local field correction based on ab inito Quantum Monte-Carlo simulations data. The analysis of the obtained results is performed by comparing to the random phase approximation and the Singwi-Tosi-Land-Sj\"olander approximation. The applicability of the long-wavelength approximation for the description of screening is investigated. The impact of electronic exchange-correlations effects on structural properties and the applicability of the screened potential from linear response theory for the simulation of the dynamics of ions are discussed.


title: Virtual bending method to calculate bending rigidity, saddle-splay modulus, and spontaneous curvature of thin fluid membrane

abstract: A method to calculate the bending rigidity $\kappa$, saddle-splay modulus $\bar{\kappa}$, and spontaneous curvature $C_0$ of a fluid membrane is proposed. Virtual work for the bending deformations into cylindrical and spherical shapes is calculated for a flat membrane. This method does not require a force decomposition, unlike the existing stress-profile method. The first derivative of the deformation gives $\kappa C_0$ and is a discrete form of the first moment of the stress profile. The second derivatives give $\kappa$ and $\bar{\kappa}$, and include the variance terms of the first derivatives, which are not accounted for in the stress-profile method. This method is examined for a solvent-free meshless membrane model and a dissipative-particle-dynamics two-bead amphiphilic molecular model. It is concluded that $\kappa$ and $\bar{\kappa}$ of a thin membrane can be accurately calculated, whereas for a thick membrane or one with an explicit solvent, a further extension to include the volume-fluctuation effects is required for an accurate estimation. The amplitude of the volume-fluctuation effects can be evaluated using the parameter dependence in the present method.


title: ENAS4D: Efficient Multi-stage CNN Architecture Search for Dynamic Inference

abstract: Dynamic inference is a feasible way to reduce the computational cost of convolutional neural network(CNN), which can dynamically adjust the computation for each input sample. One of the ways to achieve dynamic inference is to use multi-stage neural network, which contains a sub-network with prediction layer at each stage. The inference of a input sample can exit from early stage if the prediction of the stage is confident enough. However, design a multi-stage CNN architecture is a non-trivial task. In this paper, we introduce a general framework, ENAS4D, which can efficiently search for optimal multi-stage CNN architecture for dynamic inference in a well-designed search space. Firstly, we propose a method to construct the search space with multi-stage convolution. The search space include different numbers of layers, different kernel sizes and different numbers of channels for each stage and the resolution of input samples. Then, we train a once-for-all network that supports to sample diverse multi-stage CNN architecture. A specialized multi-stage network can be obtained from the once-for-all network without additional training. Finally, we devise a method to efficiently search for the optimal multi-stage network that trades the accuracy off the computational cost taking the advantage of once-for-all network. The experiments on the ImageNet classification task demonstrate that the multi-stage CNNs searched by ENAS4D consistently outperform the state-of-the-art method for dyanmic inference. In particular, the network achieves 74.4% ImageNet top-1 accuracy under 185M average MACs.


title: The area minimizing problem in conformal cones, II

abstract: In this paper we continue to study the connection among the area minimizing problem, certain area functional and the Dirichlet problem of minimal surface equations in a class of conformal cones with a similar motivation from \cite{GZ20}. These cones are certain generalizations of hyperbolic spaces. We describe the structure of area minimizing $n$-nteger multiplicity currents in bounded $C^2$ conformal cones with prescribed $C^1$ graphical boundary via a minimizing problem of these area functionals. As an application we solve the corresponding Dirichlet problem of minimal surface equations under a mean convex type assumption. We also extend the existence and uniqueness of a local area minimizing integer multiplicity current with star-shaped infinity boundary in hyperbolic spaces into a large class of complete conformal manifolds.


title: Random vibrations of stress-driven nonlocal beams with external damping

abstract: Stochastic flexural vibrations of small-scale Bernoulli-Euler beams with external damping are investigated by stress-driven nonlocal mechanics. Damping effects are simulated considering viscous interactions between beam and surrounding environment. Loadings are modeled by accounting for their random nature. Such a dynamic problem is characterized by a stochastic partial differential equation in space and time governing time-evolution of the relevant displacement field. Differential eigenanalyses are performed to evaluate modal time coordinates and mode shapes, providing a complete stochastic description of response solutions. Closed-form expressions of power spectral density, correlation function, stationary and non-stationary variances of displacement fields are analytically detected. Size-dependent dynamic behaviour is assessed in terms of stiffness, variance and power spectral density of displacements. The outcomes can be useful for design and optimization of structural components of modern small-scale devices, such as Micro- and Nano-Electro-Mechanical-Systems (MEMS and NEMS).


title: A Unified Approach to Uniform Signal Recovery From Non-Linear Observations

abstract: Recent advances in quantized compressed sensing and high-dimensional estimation have shown that signal recovery is even feasible under strong non-linear distortions in the observation process. An important characteristic of associated guarantees is uniformity, i.e., recovery succeeds for an entire class of structured signals with a fixed measurement ensemble. However, despite significant results in various special cases, a general understanding of uniform recovery from non-linear observations is still missing. This paper develops a unified approach to this problem under the assumption of i.i.d. sub-Gaussian measurement vectors. Our main result shows that a simple least-squares estimator with any convex constraint can serve as a universal recovery strategy, which is outlier robust and does not require explicit knowledge of the underlying non-linearity. Based on empirical process theory, a key technical novelty is an approximative increment condition that can be implemented for all common types of non-linear models. This flexibility allows us to apply our approach to a variety of problems in non-linear compressed sensing and high-dimensional statistics, leading to several new and improved guarantees. Each of these applications is accompanied by a conceptually simple and systematic proof, which does not rely on any deeper properties of the observation model. On the other hand, known local stability properties can be incorporated into our framework in a plug-and-play manner, thereby implying near-optimal error bounds.


title: Instability and no-hair paradigm in d-dimensional charged-AdS black holes

abstract: Is it possible the no-hair paradigm is violated when a black hole undergoes an instability? Employing massless charged scalar perturbations, we address this question within the context of conformally invariant Einstein-Maxwell theory for some allowed $d$-dimensional ($d=4n+4$ with conformal parameter $n=0,1,2,...$ ) topological small AdS black-holes. We provide numerical analyses that show the non trivial scalar hairy black hole solutions to include planar and spherical horizon topologies in higher dimensions with an even conformal parameter $n$. It is also shown that the solutions presented here cannot be considered as scalar hairs for a Reissner-Nordstrom background. As a result, for $d$-dimensional small AdS black holes in the presence of a conformally invariant Maxwell source, the no-scalar hair paradigm seems to be supported.


title: Inferring, Predicting, and Denoising Causal Wave Dynamics

abstract: The novel DISTributed Artificial neural Network Architecture (DISTANA) is a generative, recurrent graph convolution neural network. It implements a grid or mesh of locally parameterizable laterally connected network modules. DISTANA is specifically designed to identify the causality behind spatially distributed, non-linear dynamical processes. We show that DISTANA is very well-suited to denoise data streams, given that re-occurring patterns are observed, significantly outperforming alternative approaches, such as temporal convolution networks and ConvLSTMs, on a complex spatial wave propagation benchmark. It produces stable and accurate closed-loop predictions even over hundreds of time steps. Moreover, it is able to effectively filter noise -- an ability that can be improved further by applying denoising autoencoder principles or by actively tuning latent neural state activities retrospectively. Results confirm that DISTANA is ready to model real-world spatio-temporal dynamics such as brain imaging, supply networks, water flow, or soil and weather data patterns.


title: On nonlocal mechanics of curved elastic beams

abstract: Curved beams are basic structural components of Nano-Electro-Mechanical-Sistems (NEMS) whose design requires appropriate modelling of scale effects. In the present paper, the size-dependent static behaviour of curved elastic nano-beams is investigated by stress-driven nonlocal continuum mechanics. Axial strain and flexural curvature fields are integral convolutions between equilibrated axial force and bending moment fields and an averaging kernel. The nonlocal integral methodology formulated here is the generalization to curved structures of the treatment in [Int. J. Eng. Science 115 (2017) 14-27] confined to straight beams. The corresponding nonlocal differential problem, supplemented with non-standard boundary conditions, is highlighted and shown to lead to mathematically well-posed problems of nano-engineering. The theoretical predictions, exhibiting stiffening nonlocal behaviours, are therefore appropriate to significantly model a wide range of small-scale devices of nanotechnological interest. The nonlocal approach is exploited by analytically establishing size-dependent responses of curved elastic nano-sensors and nano-actuators that are driven by the small-scale characteristic parameter.


title: Dynamical characterization of Weyl nodes in Floquet Weyl semimetal phases

abstract: Due to studies in nonequilibrium (periodically-driven) topological matter, it is now understood that some topological invariants used to classify equilibrium states of matter do not suffice to describe their nonequilibrium counterparts. Indeed, in Floquet systems the additional gap arising from the periodicity of the quasienergy Brillouin zone often leads to unique topological phenomena without equilibrium analogues. In the context of Floquet Weyl semimetal, Weyl points may be induced at both quasienergy zero and $\pi/T$ ($T$ being the driving period) and these two types of Weyl points can be very close to each other in the momentum space. Because of their momentum-space proximity, the chirality of each individual Weyl point may become hard to characterize in both theory and experiments, thus making it challenging to determine the system's overall topology. In this work, inspired by the construction of dynamical winding numbers in Floquet Chern insulators, we propose a dynamical invariant capable of characterizing and distinguishing between Weyl points at different quasienergy values, thus advancing one step further in the topological characterization of Floquet Weyl semimetals. To demonstrate the usefulness of such a dynamical topological invariant, we consider a variant of the periodically kicked Harper model (the very first model in studies of Floquet topological phases) that exhibits many Weyl points, with the number of Weyl points rising unlimitedly with the strength of some system parameters. Furthermore, we investigate the two-terminal transport signature associated with the Weyl points. Theoretical findings of this work pave the way for experimentally probing the rich topological band structures of some seemingly simple Floquet semimetal systems.


title: Schedule Sequence Design for Broadcast in Multi-channel Ad Hoc Networks

abstract: We consider a single-hop ad hoc network in which each node aims to broadcast packets to its neighboring nodes by using multiple slotted, TDD collision channels. There is no cooperation among the nodes. To ensure successful broadcast, we propose to pre-assign each node a periodic sequence to schedule transmissions and receptions at each time slot. These sequences are referred to as schedule sequences. Since each node starts its transmission schedule independently, there exist relative time offsets among the schedule sequences they use. Our objective is to design schedule sequences such that each node can transmit at least one packet to each of its neighbors successfully within a common period, no matter what the time offsets are. The sequence period should be designed as short as possible. In this paper, we analyze the lower bound on sequence period, and propose a sequence construction method by which the period can achieve the same order as the lower bound. We also consider the random scheme in which each node transmits or receives on a channel at each time slot with a pre-determined probability. The frame length and broadcast completion time under different schemes are compared by numerical studies.


title: OpenAttack: An Open-source Textual Adversarial Attack Toolkit

abstract: Textual adversarial attacking has received wide and increasing attention in recent years. Various attack models have been proposed, which are enormously distinct and implemented with different programming frameworks and settings. These facts hinder quick utilization and fair comparison of attack models. In this paper, we present an open-source textual adversarial attack toolkit named OpenAttack to solve these issues. Compared with existing other textual adversarial attack toolkits, OpenAttack has its unique strengths in support for all attack types, multilinguality, and parallel processing. Currently, OpenAttack includes 15 typical attack models that cover all attack types. Its highly inclusive modular design not only supports quick utilization of existing attack models, but also enables great flexibility and extensibility. OpenAttack has broad uses including comparing and evaluating attack models, measuring robustness of a model, assisting in developing new attack models, and adversarial training. Source code and documentation can be obtained at https://github.com/thunlp/OpenAttack.


title: Learning to Attack: Towards Textual Adversarial Attacking in Real-world Situations

abstract: Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model. Among them, the attack models that only require the output of the victim model are more fit for real-world situations of adversarial attacking. However, to achieve high attack performance, these models usually need to query the victim model too many times, which is neither efficient nor viable in practice. To tackle this problem, we propose a reinforcement learning based attack model, which can learn from attack history and launch attacks more efficiently. In experiments, we evaluate our model by attacking several state-of-the-art models on the benchmark datasets of multiple tasks including sentiment analysis, text classification and natural language inference. Experimental results demonstrate that our model consistently achieves both better attack performance and higher efficiency than recently proposed baseline methods. We also find our attack model can bring more robustness improvement to the victim model by adversarial training. All the code and data of this paper will be made public.


title: A Review of Visual Odometry Methods and Its Applications for Autonomous Driving

abstract: The research into autonomous driving applications has observed an increase in computer vision-based approaches in recent years. In attempts to develop exclusive vision-based systems, visual odometry is often considered as a key element to achieve motion estimation and self-localisation, in place of wheel odometry or inertial measurements. This paper presents a recent review to methods that are pertinent to visual odometry with an emphasis on autonomous driving. This review covers visual odometry in their monocular, stereoscopic and visual-inertial form, individually presenting them with analyses related to their applications. Discussions are drawn to outline the problems faced in the current state of research, and to summarise the works reviewed. This paper concludes with future work suggestions to aid prospective developments in visual odometry.


title: The Saito module and the moduli of a germ of curve in $\left(\mathbb{C}^{2},0\right)$

abstract: We study properties of the module of vector fields tangent to a given germ of curve in the complex plane $\mathbb{C}^{2}$. As a consequence, we obtain a conjectural algorithm to compute the generic dimension of its moduli space. For some families of curves, we proved that this algorithm provides the correct dimension.


title: Centers of categorified endomorphism rings

abstract: We prove that for a large class of well-behaved cocomplete categories $\mathcal C$ the weak and strong Drinfeld centers of the monoidal category $\mathcal{E}$ of cocontinuous endofunctors of $\mathcal{C}$ coincide. This generalizes similar results in the literature, where $\mathcal{C}$ is the category of modules over a ring $A$ and hence $\mathcal{E}$ is the category of $A$-bimodules.


title: Multi-Level Graph Convolutional Network with Automatic Graph Learning for Hyperspectral Image Classification

abstract: Nowadays, deep learning methods, especially the Graph Convolutional Network (GCN), have shown impressive performance in hyperspectral image (HSI) classification. However, the current GCN-based methods treat graph construction and image classification as two separate tasks, which often results in suboptimal performance. Another defect of these methods is that they mainly focus on modeling the local pairwise importance between graph nodes while lack the capability to capture the global contextual information of HSI. In this paper, we propose a Multi-level GCN with Automatic Graph Learning method (MGCN-AGL) for HSI classification, which can automatically learn the graph information at both local and global levels. By employing attention mechanism to characterize the importance among spatially neighboring regions, the most relevant information can be adaptively incorporated to make decisions, which helps encode the spatial context to form the graph information at local level. Moreover, we utilize multiple pathways for local-level graph convolution, in order to leverage the merits from the diverse spatial context of HSI and to enhance the expressive power of the generated representations. To reconstruct the global contextual relations, our MGCN-AGL encodes the long range dependencies among image regions based on the expressive representations that have been produced at local level. Then inference can be performed along the reconstructed graph edges connecting faraway regions. Finally, the multi-level information is adaptively fused to generate the network output. In this means, the graph learning and image classification can be integrated into a unified framework and benefit each other. Extensive experiments have been conducted on three real-world hyperspectral datasets, which are shown to outperform the state-of-the-art methods.


title: Weak-shot Fine-grained Classification via Similarity Transfer

abstract: Recognizing fine-grained categories remains a challenging task, due to the subtle distinctions among different subordinate categories, which results in the need of abundant annotated samples. To alleviate the data-hungry problem, we consider the problem of learning novel categories from web data with the support of a clean set of base categories, which is referred to as weak-shot learning. In this setting, we propose a method called SimTrans to transfer pairwise semantic similarity from base categories to novel categories. Specifically, we firstly train a similarity net on clean data, and then leverage the transferred similarity to denoise web training data using two simple yet effective strategies. In addition, we apply adversarial loss on similarity net to enhance the transferability of similarity. Comprehensive experiments demonstrate the effectiveness of our weak-shot setting and our SimTrans method. Datasets and codes are available at https://github.com/bcmi/SimTrans-Weak-Shot-Classification.


title: On the implementation of the Universal Basic Income as a response to technological unemployment

abstract: The effects of automation on our economy and society are more palpable than ever, with nearly half of jobs at risk of being fully executed by machines over the next decade or two. Policymakers and scholars alike have championed the Universal Basic Income (UBI) as a catch-all solution to this problem. This paper examines the shortcomings of UBI in addressing the automation-led large-scale displacement of labor by analyzing empirical data from previous UBI-comparable experiments and presenting theoretical projections that highlight disappointing impacts of UBI in the improvement of relevant living standards and employability metrics among pensioners. Finally, a recommendation shall be made for the retainment of existing means-tested welfare programs while bolstering funding and R&D for more up-to-date worker training schemes as a more effective solution to technological unemployment.


title: Novel magnetic and ferroelectric behaviors observed in alpha Fe2O3 particles

abstract: Alpha Fe2O3 powders have been prepared by the reduction reaction method with NaHB4 as reducing agent and followed a conventional sintering process. The XRD pattern with Rietveld refinement profile reveal that the prepared Fe2O3 with corundum structure (hematite). VSM loop exhibits obvious room-temperature weak ferromagnetism, a pinched hysteresis loop may introduced by the shape anisotropy effect. The simultaneous ferroelectric behavior of {\alpha}-Fe2O3 with "five-fold" ferroelectric hysteresis loops approves that this structured Fe2O3 can be known as a novel multiferroic material.


title: Epidemiological Forecasting with Model Reduction of Compartmental Models. Application to the COVID-19 pandemic

abstract: We propose a forecasting method for predicting epidemiological health series on a two-week horizon at the regional and interregional resolution. The approach is based on model order reduction of parametric compartmental models, and is designed to accommodate small amount of sanitary data. The efficiency of the method is shown in the case of the prediction of the number of infected and removed people during the two pandemic waves of COVID-19 in France, which have taken place approximately between February and November 2020. Numerical results illustrate the promising potential of the approach.


title: Inverse relations and reciprocity laws involving partial Bell polynomials and related extensions

abstract: The objective of this paper is, in the main, twofold: Firstly, to develop an algebraic setting for dealing with Bell polynomials and related extensions. Secondly, based on the author's previous work on multivariate Stirling polynomials (2015), to present a number of new results related to different types of inverse relationships, among these (1) the use of multivariable Lah polynomials for characterizing self-orthogonal families of polynomials that can be represented by Bell polynomials, (2) the introduction of `generalized Lagrange inversion polynomials' that invert functions characterized in a specific way by sequences of constants, (3) a general reciprocity theorem according to which, in particular, the partial Bell polynomials $B_{n,k}$ and their orthogonal companions $A_{n,k}$ belong to one single class of Stirling polynomials: $A_{n,k}=(-1)^{n-k}B_{-k,-n}$. Moreover, of some numerical statements (such as Stirling inversion, Schl\"omilch-Schl\"afli formulas) generalized polynomial versions are established. A number of well-known theorems (Jabotinsky, Mullin-Rota, Melzak, Comtet) are given new proofs.


title: Italian Domination and Perfect Italian Domination on Sierpinski Graphs

abstract: An Italian dominating function (IDF) of a graph G is a function $ f: V(G) \rightarrow \{0,1,2\} $ satisfying the condition that for every $ v\in V $ with $ f(v) = 0$, $\sum_{ u\in N(v)} f(u) \geq 2. $ The weight of an IDF on $G$ is the sum $ f(V)= \sum_{v\in V}f(v) $ and the Italian domination number, $ \gamma_I(G) $, is the minimum weight of an IDF. An IDF is a perfect Italian dominating function (PID) on $G$, if for every vertex $ v \in V(G) $ with $ f(v) = 0 $ the total weight assigned by $f$ to the neighbours of $ v $ is exactly 2, i.e., all the neighbours of $u$ are assigned the weight 0 by $f$ except for exactly one vertex $v$ for which $ f(v) = 2 $ or for exactly two vertices $v$ and $w$ for which $ f(v) = f(w) = 1 $. The weight of a PID- function is $f(V)=\sum_{u \in V(G)}f(u)$. The perfect Italian domination number of $G$, denoted by $ \gamma^{p}_{I}(G), $ is the minimum weight of a PID-function of $G$. In this paper we obtain the Italian domination number and perfect Italian domination number of Sierpi\'{n}ski graphs.


title: An equidistribution theorem for biraitonal maps of $\mathbb{P}^k$

abstract: We prove an equidistribution theorem of positive closed currents for a certain class of birational maps $f_+:\mathbb{P}^k\to\mathbb{P}^k$ of algebraic degree $d\geq 2$ satisfying $\bigcup_{n\geq 0}f_-^n(I^+)\cap \bigcup_{n\geq 0}f_+^n(I^-)=\emptyset$, where $f_-$ is the inverse of $f_+$ and $I^\pm$ are the sets of indeterminacy for $f_\pm$, respectively.


title: Frequency-explicit a posteriori error estimates for finite element discretizations of Maxwell's equations

abstract: We consider residual-based a posteriori error estimators for Galerkin-type discretizations of time-harmonic Maxwell's equations. We focus on configurations where the frequency is high, or close to a resonance frequency, and derive reliability and efficiency estimates. In contrast to previous related works, our estimates are frequency-explicit. In particular, our key contribution is to show that even if the constants appearing in the reliability and efficiency estimates may blow up on coarse meshes, they become independent of the frequency for sufficiently refined meshes. Such results were previously known for the Helmholtz equation describing scalar wave propagation problems and we show that they naturally extend, at the price of many technicalities in the proofs, to Maxwell's equations. Our mathematical analysis is performed in the 3D case, and covers conforming N\'ed\'elec discretizations of the first and second family, as well as first-order (and hybridizable) discontinuous Galerkin schemes. We also present numerical experiments in the 2D case, where Maxwell's equations are discretized with N\'ed\'elec elements of the first family. These illustrating examples perfectly fit our key theoretical findings, and suggest that our estimates are sharp.


title: Adversarial Rain Attack and Defensive Deraining for DNN Perception

abstract: Rain often poses inevitable threats to deep neural network (DNN) based perception systems, and a comprehensive investigation of the potential risks of the rain to DNNs is of great importance. However, it is rather difficult to collect or synthesize rainy images that can represent all rain situations that would possibly occur in the real world. To this end, in this paper, we start from a new perspective and propose to combine two totally different studies, i.e., rainy image synthesis and adversarial attack. We first present an adversarial rain attack, with which we could simulate various rain situations with the guidance of deployed DNNs and reveal the potential threat factors that can be brought by rain. In particular, we design a factor-aware rain generation that synthesizes rain streaks according to the camera exposure process and models the learnable rain factors for adversarial attack. With this generator, we perform the adversarial rain attack against the image classification and object detection. To defend the DNNs from the negative rain effect, we also present a defensive deraining strategy, for which we design an adversarial rain augmentation that uses mixed adversarial rain layers to enhance deraining models for downstream DNN perception. Our large-scale evaluation on various datasets demonstrates that our synthesized rainy images with realistic appearances not only exhibit strong adversarial capability against DNNs, but also boost the deraining models for defensive purposes, building the foundation for further rain-robust perception studies.


title: DEAP Cache: Deep Eviction Admission and Prefetching for Cache

abstract: Recent approaches for learning policies to improve caching, target just one out of the prefetching, admission and eviction processes. In contrast, we propose an end to end pipeline to learn all three policies using machine learning. We also take inspiration from the success of pretraining on large corpora to learn specialized embeddings for the task. We model prefetching as a sequence prediction task based on past misses. Following previous works suggesting that frequency and recency are the two orthogonal fundamental attributes for caching, we use an online reinforcement learning technique to learn the optimal policy distribution between two orthogonal eviction strategies based on them. While previous approaches used the past as an indicator of the future, we instead explicitly model the future frequency and recency in a multi-task fashion with prefetching, leveraging the abilities of deep networks to capture futuristic trends and use them for learning eviction and admission. We also model the distribution of the data in an online fashion using Kernel Density Estimation in our approach, to deal with the problem of caching non-stationary data. We present our approach as a "proof of concept" of learning all three components of cache strategies using machine learning and leave improving practical deployment for future work.


title: Quantum footprints of Liouville integrable systems

abstract: We discuss the problem of recovering geometric objects from the spectrum of a quantum integrable system. In the case of one degree of freedom, precise results exist. In the general case, we report on the recent notion of good labellings of asymptotic lattices.


title: The quantum Ising chain for beginners

abstract: We present here various techniques to work with clean and disordered quantum Ising chains, for the benefit of students and non-experts. Starting from the Jordan-Wigner transformation, which maps spin-1/2 systems into fermionic ones, we review some of the basic approaches to deal with the superconducting correlations that naturally emerge in this context. In particular, we analyse the form of the ground state and excitations of the model, relating them to the symmetry-breaking physics, and illustrate aspects connected to calculating dynamical quantities, thermal averages, correlation functions and entanglement entropy. A few problems provide simple applications of the techniques.


title: MSR-DARTS: Minimum Stable Rank of Differentiable Architecture Search

abstract: In neural architecture search (NAS), differentiable architecture search (DARTS) has recently attracted much attention due to its high efficiency. It defines an over-parameterized network with mixed edges, each of which represents all operator candidates, and jointly optimizes the weights of the network and its architecture in an alternating manner. However, this method finds a model with the weights converging faster than the others, and such a model with fastest convergence often leads to overfitting. Accordingly, the resulting model cannot always be well-generalized. To overcome this problem, we propose a method called minimum stable rank DARTS (MSR-DARTS), for finding a model with the best generalization error by replacing architecture optimization with the selection process using the minimum stable rank criterion. Specifically, a convolution operator is represented by a matrix, and MSR-DARTS selects the one with the smallest stable rank. We evaluated MSR-DARTS on CIFAR-10 and ImageNet datasets. It achieves an error rate of 2.54% with 4.0M parameters within 0.3 GPU-days on CIFAR-10, and a top-1 error rate of 23.9% on ImageNet. The official code is available at https://github.com/mtaecchhi/msrdarts.git.


title: A framework for effective corporate communication after cyber security incidents

abstract: A major cyber security incident can represent a cyber crisis for an organisation, in particular because of the associated risk of substantial reputational damage. As the likelihood of falling victim to a cyberattack has increased over time, so too has the need to understand exactly what is effective corporate communication after an attack, and how best to engage the concerns of customers, partners and other stakeholders. This research seeks to tackle this problem through a critical, multi-faceted investigation into the efficacy of crisis communication and public relations following a data breach. It does so by drawing on academic literature, obtained through a systematic literature review, and real-world case studies. Qualitative data analysis is used to interpret and structure the results, allowing for the development of a new, comprehensive framework for corporate communication to support companies in their preparation and response to such events. The validity of this framework is demonstrated by its evaluation through interviews with senior industry professionals, as well as a critical assessment against relevant practice and research. The framework is further refined based on these evaluations, and an updated version defined. This research represents the first grounded, comprehensive and evaluated proposal for characterising effective corporate communication after cyber security incidents.


title: Revisiting Groeneveld's approach to the virial expansion

abstract: A generalized version of Groeneveld's convergence criterion for the virial expansion and generating functionals for weighted $2$-connected graphs is proven. The criterion works for inhomogeneous systems and yields bounds for the density expansions of the correlation functions $\rho_s$ (a.k.a. distribution functions or factorial moment measures) of grand-canonical Gibbs measures with pairwise interactions. The proof is based on recurrence relations for graph weights related to the Kirkwood-Salsburg integral equation for correlation functions. The proof does not use an inversion of the density-activity expansion, however a Moebius inversion on the lattice of set partitions enters the derivation of the recurrence relations.

categories: math-ph cond-mat.stat-mech math.MP math.PR


title: Enhanced Ferromagnetism of CrI3 Bilayer by Self-Intercalation

abstract: Two-dimensional (2D) ferromagnets with high Curie temperature have long been the pursuit for electronic and spintronic applications. CrI3 is a rising star of intrinsic 2D ferromagnets, however, it suffers from weak exchange coupling. Here we propose a general strategy of self-intercalation to achieve enhanced ferromagnetism in bilayer CrI3. We showed that filling either Cr or I atoms into the van der Waals gap of stacked and twisted CrI3 bilayers can induce the double exchange effect and significantly strengthen the interlayer ferromagnetic coupling. According to our first-principles calculations, the intercalated native atoms act as covalent bridge between two CrI3 layers and lead to discrepant oxidation states for the Cr atoms. These theoretical results offer a facile route to achieve high-Curie-temperature 2D magnets for device implementation.


title: Dodging DeepFake Detection via Implicit Spatial-Domain Notch Filtering

abstract: The current high-fidelity generation and high-precision detection of DeepFake images are at an arms race. We believe that producing DeepFakes that are highly realistic and 'detection evasive' can serve the ultimate goal of improving future generation DeepFake detection capabilities. In this paper, we propose a simple yet powerful pipeline to reduce the artifact patterns of fake images without hurting image quality by performing implicit spatial-domain notch filtering. We first demonstrate that frequency-domain notch filtering, although famously shown to be effective in removing periodic noise in the spatial domain, is infeasible for our task at hand due to the manual designs required for the notch filters. We, therefore, resort to a learning-based approach to reproduce the notch filtering effects, but solely in the spatial domain. We adopt a combination of adding overwhelming spatial noise for breaking the periodic noise pattern and deep image filtering to reconstruct the noise-free fake images, and we name our method DeepNotch. Deep image filtering provides a specialized filter for each pixel in the noisy image, producing filtered images with high fidelity compared to their DeepFake counterparts. Moreover, we also use the semantic information of the image to generate an adversarial guidance map to add noise intelligently. Our large-scale evaluation on 3 representative state-of-the-art DeepFake detection methods (tested on 16 types of DeepFakes) has demonstrated that our technique significantly reduces the accuracy of these 3 fake image detection methods, 36.79% on average and up to 97.02% in the best case.


title: Coherent transfer matrix analysis of the transmission spectra of Rydberg excitons in Cuprous Oxide

abstract: In this study we analyze the transmission spectrum of a thin plate of Cuprous Oxide in the range of the absorption of the yellow exciton states with the coherent transfer matrix method. We demonstrate that, in contrast to the usual analysis using Beer's law, which turns out to be a rather good approximation only in the spectral region of high principal quantum numbers, a consistent quantitative description over the whole spectral range under consideration is possible. This leads to new and more accurate parameters not only for the Rydberg exciton states, but also for the strengths of indirect transitions. Furthermore, the results have consequences on the determination of the density of electron-hole pairs after optical excitation.


title: Faster Smarter Induction in Isabelle/HOL

abstract: Proof by induction plays a critical role in formal verification and mathematics at large. However, its automation remains as one of the long-standing challenges in Computer Science. To address this problem, we developed sem_ind. Given inductive problem, sem_ind recommends what arguments to pass to the induct method. To improve the accuracy of sem_ind, we introduced definitional quantifiers, a new kind of quantifiers that allow us to investigate not only the syntactic structures of inductive problems but also the definitions of relevant constants in a domain-agnostic style. Our evaluation shows that compared to its predecessor sem_ind improves the accuracy of recommendation from 20.1% to 38.2% for the most promising candidates within 5.0 seconds of timeout while decreasing the median value of execution time from 2.79 seconds to 1.06 seconds.


title: Tests for circular symmetry of complex-valued random vectors

abstract: We propose tests for the null hypothesis that the law of a complex-valued random vector is circularly symmetric. The test criteria are formulated as $L^2$-type criteria based on empirical characteristic functions, and they are convenient from the computational point of view. Asymptotic as well as Monte-Carlo results are presented. Applications on real data are also reported. An R package called CircSymTest is available from the authors.


title: A Joint introduction to Gaussian Processes and Relevance Vector Machines with Connections to Kalman filtering and other Kernel Smoothers

abstract: The expressive power of Bayesian kernel-based methods has led them to become an important tool across many different facets of artificial intelligence, and useful to a plethora of modern application domains, providing both power and interpretability via uncertainty analysis. This article introduces and discusses two methods which straddle the areas of probabilistic Bayesian schemes and kernel methods for regression: Gaussian Processes and Relevance Vector Machines. Our focus is on developing a common framework with which to view these methods, via intermediate methods a probabilistic version of the well-known kernel ridge regression, and drawing connections among them, via dual formulations, and discussion of their application in the context of major tasks: regression, smoothing, interpolation, and filtering. Overall, we provide understanding of the mathematical concepts behind these models, and we summarize and discuss in depth different interpretations and highlight the relationship to other methods, such as linear kernel smoothers, Kalman filtering and Fourier approximations. Throughout, we provide numerous figures to promote understanding, and we make numerous recommendations to practitioners. Benefits and drawbacks of the different techniques are highlighted. To our knowledge, this is the most in-depth study of its kind to date focused on these two methods, and will be relevant to theoretical understanding and practitioners throughout the domains of data-science, signal processing, machine learning, and artificial intelligence in general.

categories: cs.LG cs.AI cs.NA math.NA stat.CO stat.ML


title: Misinformation and its stakeholders in Europe: a web-based analysis

abstract: The rise of the internet and computational power in recent years allowed for the exponential growth of misinformation phenomena. An issue that was a non-issue a decade ago, became a challenge for societal cohesion. The emergence of this new threat has led many stakeholders, especially in Europe, to act in order to tackle this phenomenon. This paper provides in its first part a literature review on misinformation in Europe, and in its second part a webometrics analysis on the identified key stakeholders. In the results we discuss who those stakeholders are, what actions do they perform to limit misinformation and whether those actions have an impact.


title: Dichotomy of Baryons as Quantum Hall Droplets and Skyrmions In Compact-Star Matter

abstract: We review the recent exploration of a possible "domain-wall structure" of compressed baryonic matter in massive compact stars in terms of fractional quantum Hall droplets and skyrmions for baryons in medium. The theoretical framework is anchored on an effective nuclear effective field theory that incorporates two hidden symmetries, flavor local symmetry and scale symmetry conjectured to be dual to the gluons and quarks of QCD. It hints at a basically different, hitherto undiscovered structure of nuclear matter at low as well as high densities. Hidden "genuine dilaton (GD)" symmetry and hidden local symmetry (HLS) gauge-equivalent at low density to nonlinear sigma model capturing chiral symmetry, put together in nuclear effective field theory, are seen to play an increasingly important role in providing hadron-quark duality in baryonic matter. This strongly motivates incorporating both symmetries in formulating "first-principles" approaches to nuclear dynamics encompassing from the nuclear matter density to the highest density stable in the Universe.


title: DM halo morphological types of MW-like galaxies in the TNG50 simulation: Simple, Twisted, or Stretched

abstract: We present a comprehensive analysis of the shape of dark matter (DM) halos in a sample of 25 Milky Way-like galaxies in TNG50 simulation. Using an Enclosed Volume Iterative Method (EVIM), we infer an oblate-to-triaxial shape for the DM halo with the median $T \simeq 0.24 $. We group DM halos in 3 different categories. Simple halos (32% of population) establish principal axes whose ordering in magnitude does not change with radius and whose orientations are almost fixed throughout the halo. Twisted halos (32% of population), experience levels of gradual rotations throughout their radial profiles. Finally, stretched halos (36% of population) demonstrate a stretching in their principal axes lengths where the ordering of different eigenvalues change with radius. Subsequently, the halo experiences a "rotation" of $\sim$90 deg where the stretching occurs. Visualizing the 3D ellipsoid of each halo, for the first time, we report signs of re-orienting ellipsoid in twisted and stretched halos. We examine the impact of baryonic physics on DM halo shape through a comparison to dark matter only (DMO) simulations. This suggests a triaxial (prolate) halo. We analyze the impact of substructure on DM halo shape in both hydro and DMO simulations and confirm that their impacts are subdominant. We study the distribution of satellites in our sample. In simple and twisted halos, the angle of satellites' angular momentum with galaxy's angular momentum grows with radius. However, stretched halos show a flat distribution of angles. Overlaying our theoretical outcome on the observational results presented in the literature establishes a fair agreement.

categories: astro-ph.GA astro-ph.CO astro-ph.HE hep-ph


title: Iterated Minkowski sums, horoballs and north-south dynamics

abstract: Given a finite generating set $A$ for a group $\Gamma$, we study the map $W \mapsto WA$ as a topological dynamical system -- a continuous self-map of the compact metrizable space of subsets of $\Gamma$. If the set $A$ generates $\Gamma$ as a semigroup and contains the identity, there are precisely two fixed points, one of which is attracting. This supports the initial impression that the dynamics of this map is rather trivial. Indeed, at least when $\Gamma= \mathbb{Z}^d$ and $A \subseteq \mathbb{Z}^d$ a finite positively generating set containing the natural invertible extension of the map $W \mapsto W+A$ is always topologically conjugate to the unique "north-south" dynamics on the Cantor set. In contrast to this, we show that various natural "geometric" properties of the finitely generated group $(\Gamma,A)$ can be recovered from the dynamics of this map, in particular, the growth type and amenability of $\Gamma$. When $\Gamma = \mathbb{Z}^d$, we show that the volume of the convex hull of the generating set $A$ is also an invariant of topological conjugacy. Our study introduces, utilizes and develops a certain convexity structure on subsets of the group $\Gamma$, related to a new concept which we call the sheltered hull of a set. We also relate this study to the structure of horoballs in finitely generated groups, focusing on the abelian case.


title: Tracking GDP in real-time using electricity market data: insights from the first wave of COVID-19 across Europe

abstract: This paper develops a methodology for tracking in real time the impact of shocks (such as natural disasters, financial crises or pandemics) on gross domestic product (GDP) by analyzing high-frequency electricity market data. As an illustration, we estimate the GDP loss caused by COVID-19 in twelve European countries during the first wave of the pandemic. Our results are almost indistinguishable from the official statistics of the recession during the first two quarters of 2020 (correlation coefficient of 0.98) and are validated by several robustness tests. However, they are also more chronologically disaggregated and up-to-date than standard macroeconomic indicators and, therefore, can provide crucial and timely information for policy evaluation. Our results show that delaying intervention and pursuing 'herd immunity' have not been successful strategies so far, since they increased both economic disruption and mortality. We also find that coordinating policies internationally is fundamental for minimizing spillover effects from NPIs across countries.


title: BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition

abstract: In recent years, with the growing amount of biomedical documents, coupled with advancement in natural language processing algorithms, the research on biomedical named entity recognition (BioNER) has increased exponentially. However, BioNER research is challenging as NER in the biomedical domain are: (i) often restricted due to limited amount of training data, (ii) an entity can refer to multiple types and concepts depending on its context and, (iii) heavy reliance on acronyms that are sub-domain specific. Existing BioNER approaches often neglect these issues and directly adopt the state-of-the-art (SOTA) models trained in general corpora which often yields unsatisfactory results. We propose biomedical ALBERT (A Lite Bidirectional Encoder Representations from Transformers for Biomedical Text Mining) bioALBERT, an effective domain-specific language model trained on large-scale biomedical corpora designed to capture biomedical context-dependent NER. We adopted a self-supervised loss used in ALBERT that focuses on modelling inter-sentence coherence to better learn context-dependent representations and incorporated parameter reduction techniques to lower memory consumption and increase the training speed in BioNER. In our experiments, BioALBERT outperformed comparative SOTA BioNER models on eight biomedical NER benchmark datasets with four different entity types. We trained four different variants of BioALBERT models which are available for the research community to be used in future research.


title: Detecting Malicious URLs of COVID-19 Pandemic using ML technologies

abstract: Throughout the COVID-19 outbreak, malicious attacks have become more pervasive and damaging than ever. Malicious intruders have been responsible for most cybercrimes committed recently and are the cause for a growing number of cyber threats, including identity and IP thefts, financial crimes, and cyber-attacks to critical infrastructures. Machine learning (ML) has proven itself as a prominent field of study over the past decade by solving many highly complex and sophisticated real-world problems. This paper proposes an ML-based classification technique to detect the growing number of malicious URLs, due to the COVID-19 pandemic, which is currently considered a threat to IT users. We have used a large volume of Open Source data and preprocessed it using our developed tool to generate feature vectors and we trained the ML model using the apprehensive malicious threat weight. Our ML model has been tested, with and without entropy to forecast the threatening factors of COVID-19 URLs. The empirical evidence proves our methods to be a promising mechanism to mitigate COVID-19 related threats early in the attack lifecycle.


title: On the three ball theorem for solutions of the Helmholtz equation

abstract: Let $u_k$ be a solution of the Helmholtz equation with the wave number $k$, $\Delta u_k+k^2 u_k=0$, on a small ball in either $\mathbb{R}^n$, $\mathbb{S}^n$, or $\mathbb{H}^n$. For a fixed point $p$, we define $M_{u_k}(r)=\max_{d(x,p)\le r}|u_k(x)|.$ The following three ball inequality $M_{u_k}(2r)\le C(k,r,\alpha)M_{u_k}(r)^{\alpha}M_{u_k}(4r)^{1-\alpha}$ is well known, it holds for some $\alpha\in (0,1)$ and $C(k,r,\alpha)>0$ independent of $u_k$. We show that the constant $C(k,r,\alpha)$ grows exponentially in $k$ (when $r$ is fixed and small). We also compare our result with the increased stability for solutions of the Cauchy problem for the Helmholtz equation on Riemannian manifolds.


title: Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect

abstract: Recommender systems aim to provide item recommendations for users, and are usually faced with data sparsity problem (e.g., cold start) in real-world scenarios. Recently pre-trained models have shown their effectiveness in knowledge transfer between domains and tasks, which can potentially alleviate the data sparsity problem in recommender systems. In this survey, we first provide a review of recommender systems with pre-training. In addition, we show the benefits of pre-training to recommender systems through experiments. Finally, we discuss several promising directions for future research for recommender systems with pre-training.


title: Koopman analysis in oscillator synchronization

abstract: Synchronization is an important dynamical phenomenon in coupled nonlinear systems, which has been studied extensively in recent years. However, analysis focused on individual orbits seems hard to extend to complex systems while a global statistical approach is overly cursory. Koopman operator technique seems to well balance the two approaches. In this paper, we extend Koopman analysis to the study of synchronization of coupled oscillators by extracting important eigenvalues and eigenfunctions from the observed time series. A renormalization group analysis is designed to derive an analytic approximation of the eigenfunction in case of weak coupling that dominates the oscillation. For moderate or strong couplings, numerical computation further confirms the importance of the average frequencies and the associated eigenfunctions. The synchronization transition points could be located with quite high accuracy by checking the correlation of neighbouring eigenfunctions at different coupling strengths, which is readily applied to other nonlinear systems.


title: CP Violating $hW^+W^-$ Coupling in the Standard Model and Beyond

abstract: Inspired by the recent development in determining the property of the observed Higgs boson, we explore the $CP$-violating (CPV) $- c_{\rm CPV} h W^{+\, \mu\nu}\tilde{W}^{-}_{\mu\nu}/v$ coupling in the Standard Model (SM) and beyond, where $W^{\pm \, \mu \nu}$ and $\tilde{W}^{\pm\,\mu\nu}$ denote the $W$-boson field strength and its dual. To begin with, we show that the leading-order SM contribution to this CPV vertex appears at two-loop level. By summing over the quark flavor indices in the two loop integrals analytically, we can estimate the order of the corresponding Wilson coefficient to be $c^{\rm SM}_{\rm CPV} \sim {\cal O}(10^{-23})$, which is obviously too small to be probed at the LHC and planned future colliders. Then we investigate this CPV $hW^+ W^-$ interaction in two Beyond the Standard Model benchmark models: the left-right model and the complex 2-Higgs doublet model (C2HDM). Unlike what happens for the SM, the dominant contributions in both models arise at the one-loop level, and the corresponding Wilson coefficient can be as large as of ${\cal O}(10^{-9})$ in the former model and of ${\cal O}(10^{-3})$ for the latter. In light of such a large CPV effect in the $hW^+W^-$ coupling, we also give the formulae for the leading one-loop contribution to the related CPV $hZZ$ effective operator in the C2HDM. The order of magnitude of the Wilson coefficients in the C2HDM may be within reach of the high-luminosity LHC or planned future colliders.


title: Detailed Dynamic Model of Antagonistic PAM System and its Experimental Validation: Sensor-less Angle and Torque Control with UKF

abstract: This study proposes a detailed nonlinear mathematical model of an antagonistic pneumatic artificial muscle (PAM) actuator system for estimating the joint angle and torque using an unscented Kalman filter (UKF). The proposed model is described in a hybrid state-space representation. It includes the contraction force of the PAM, joint dynamics, fluid dynamics of compressed air, mass flows of a valve, and friction models. A part of the friction models is modified to obtain a novel form of Coulomb friction depending on the inner pressure of the PAM. For model validation, offline and online UKF estimations and sensor-less tracking control of the joint angle and torque are conducted to evaluate the estimation accuracy and tracking control performance. The estimation accuracy is less than 7.91 %, and the steady-state tracking control performance is more than 94.75 %. These results confirm that the proposed model is detailed and could be used as the state estimator of an antagonistic PAM system.


title: Simplifying Reinforced Feature Selection via Restructured Choice Strategy of Single Agent

abstract: Feature selection aims to select a subset of features to optimize the performances of downstream predictive tasks. Recently, multi-agent reinforced feature selection (MARFS) has been introduced to automate feature selection, by creating agents for each feature to select or deselect corresponding features. Although MARFS enjoys the automation of the selection process, MARFS suffers from not just the data complexity in terms of contents and dimensionality, but also the exponentially-increasing computational costs with regard to the number of agents. The raised concern leads to a new research question: Can we simplify the selection process of agents under reinforcement learning context so as to improve the efficiency and costs of feature selection? To address the question, we develop a single-agent reinforced feature selection approach integrated with restructured choice strategy. Specifically, the restructured choice strategy includes: 1) we exploit only one single agent to handle the selection task of multiple features, instead of using multiple agents. 2) we develop a scanning method to empower the single agent to make multiple selection/deselection decisions in each round of scanning. 3) we exploit the relevance to predictive labels of features to prioritize the scanning orders of the agent for multiple features. 4) we propose a convolutional auto-encoder algorithm, integrated with the encoded index information of features, to improve state representation. 5) we design a reward scheme that take into account both prediction accuracy and feature redundancy to facilitate the exploration process. Finally, we present extensive experimental results to demonstrate the efficiency and effectiveness of the proposed method.


title: Adversarial Exposure Attack on Diabetic Retinopathy Imagery

abstract: Diabetic retinopathy (DR) is a leading cause of vision loss in the world and numerous cutting-edge works have built powerful deep neural networks (DNNs) to automatically classify the DR cases via the retinal fundus images (RFIs). However, RFIs are usually affected by the widely existing camera exposure while the robustness of DNNs to the exposure is rarely explored. In this paper, we study this problem from the viewpoint of adversarial attack and identify a totally new task, i.e., adversarial exposure attack generating adversarial images by tuning image exposure to mislead the DNNs with significantly high transferability. To this end, we first implement a straightforward method, i.e., multiplicative-perturbation-based exposure attack, and reveal the big challenges of this new task. Then, to make the adversarial image naturalness, we propose the adversarial bracketed exposure fusion that regards the exposure attack as an element-wise bracketed exposure fusion problem in the Laplacian-pyramid space. Moreover, to realize high transferability, we further propose the convolutional bracketed exposure fusion where the element-wise multiplicative operation is extended to the convolution. We validate our method on the real public DR dataset with the advanced DNNs, e.g., ResNet50, MobileNet, and EfficientNet, showing our method can achieve high image quality and success rate of the transfer attack. Our method reveals the potential threats to the DNN-based DR automated diagnosis and can definitely benefit the development of exposure-robust automated DR diagnosis method in the future.


title: Learned Low Precision Graph Neural Networks

abstract: Deep Graph Neural Networks (GNNs) show promising performance on a range of graph tasks, yet at present are costly to run and lack many of the optimisations applied to DNNs. We show, for the first time, how to systematically quantise GNNs with minimal or no loss in performance using Network Architecture Search (NAS). We define the possible quantisation search space of GNNs. The proposed novel NAS mechanism, named Low Precision Graph NAS (LPGNAS), constrains both architecture and quantisation choices to be differentiable. LPGNAS learns the optimal architecture coupled with the best quantisation strategy for different components in the GNN automatically using back-propagation in a single search round. On eight different datasets, solving the task of classifying unseen nodes in a graph, LPGNAS generates quantised models with significant reductions in both model and buffer sizes but with similar accuracy to manually designed networks and other NAS results. In particular, on the Pubmed dataset, LPGNAS shows a better size-accuracy Pareto frontier compared to seven other manual and searched baselines, offering a 2.3 times reduction in model size but a 0.4% increase in accuracy when compared to the best NAS competitor. Finally, from our collected quantisation statistics on a wide range of datasets, we suggest a W4A8 (4-bit weights, 8-bit activations) quantisation strategy might be the bottleneck for naive GNN quantisations.


title: Tunable and saturated structural colors from carbon nanotubes incorporated highly ordered photonic opals

abstract: Synthetic opals, based on self-assembly of polymeric nanoparticles generally produces fainted/pale structural colors due to too many lattice flaws in the structures. Here we produces carbon nanotubes (CNTs) incorporated high quality 3D photonic opals (PC-CNT) by evaporative self-assembly. Although the CNTs make up only 0.01% of the fabricated photonic opal, their controlled incorporation has dramatic effect to change the color of the photonic crystals from milky white to intense red. Microscopic study suggest that CNT incorporation did not affect the lattice ordering of the photonic crystals. The tunability of structural colors, as a function of incident angle, were tested and varied against Bragg-Snell law. Furthermore, we tested mechanochromic sensing of the photonic opals, demonstrating their potential as visual indicators. This tunable PC-CNT brings many possibilities including strain sensing or structural health care monitoring, as well as being of fundamental interest.


title: Shimon the Rapper: A Real-Time System for Human-Robot Interactive Rap Battles

abstract: We present a system for real-time lyrical improvisation between a human and a robot in the style of hip hop. Our system takes vocal input from a human rapper, analyzes the semantic meaning, and generates a response that is rapped back by a robot over a musical groove. Previous work with real-time interactive music systems has largely focused on instrumental output, and vocal interactions with robots have been explored, but not in a musical context. Our generative system includes custom methods for censorship, voice, rhythm, rhyming and a novel deep learning pipeline based on phoneme embeddings. The rap performances are accompanied by synchronized robotic gestures and mouth movements. Key technical challenges that were overcome in the system are developing rhymes, performing with low-latency and dataset censorship. We evaluated several aspects of the system through a survey of videos and sample text output. Analysis of comments showed that the overall perception of the system was positive. The model trained on our hip hop dataset was rated significantly higher than our metal dataset in coherence, rhyme quality, and enjoyment. Participants preferred outputs generated by a given input phrase over outputs generated from unknown keywords, indicating that the system successfully relates its output to its input.


title: Open-Ended Fine-Grained 3D Object Categorization by Combining Shape and Texture Features in Multiple Colorspaces

abstract: As a consequence of an ever-increasing number of service robots, there is a growing demand for highly accurate real-time 3D object recognition. Considering the expansion of robot applications in more complex and dynamic environments,it is evident that it is not possible to pre-program all object categories and anticipate all exceptions in advance. Therefore, robots should have the functionality to learn about new object categories in an open-ended fashion while working in the environment.Towards this goal, we propose a deep transfer learning approach to generate a scale- and pose-invariant object representation by considering shape and texture information in multiple colorspaces. The obtained global object representation is then fed to an instance-based object category learning and recognition,where a non-expert human user exists in the learning loop and can interactively guide the process of experience acquisition by teaching new object categories, or by correcting insufficient or erroneous categories. In this work, shape information encodes the common patterns of all categories, while texture information is used to describes the appearance of each instance in detail.Multiple color space combinations and network architectures are evaluated to find the most descriptive system. Experimental results showed that the proposed network architecture out-performed the selected state-of-the-art approaches in terms of object classification accuracy and scalability. Furthermore, we performed a real robot experiment in the context of serve-a-beer scenario to show the real-time performance of the proposed approach.


title: Effect of dimensionality on the vortex-dynamics in type-II superconductor

abstract: We explore the effects of sample dimensionality on vortex pinning in a type-II, low-$T_C$, s-wave superconductor, NbN, in the presence of a perpendicular magnetic field, $H$. We find significant differences in the phase diagrams in the magnetic field--temperature plane between 3-dimensional (3D) and 2-dimensional (2D) NbN films. The differences are most striking close to the normal-superconductor phase transition. We establish that these variances have their origin in the differing pinning properties in two different dimensions. We obtain the pinning strength quantitatively in both the dimensions from two independent transport measurements performed in two different regimes of vortex-motion -- (i) thermally assisted flux-flow (TAFF) regime and (ii) flux flow (FF) regime. Both the measurements consistently show that both the pinning potential and the zero-field free-energy barrier to depinning in the 3D superconductor are at least an order of magnitude stronger than that in the 2D superconductor. Further, we probed the dynamics of pinning in both 2D and 3D superconductor through voltage fluctuation spectroscopy. We find that the mechanism of vortex pinning-depinning is qualitatively similar for the 3D and 2D superconductors. The voltage-fluctuations arising from vortex-motion are found to be correlated only in the 2D superconductor. We establish this to be due to the presence of long-range phase fluctuations near the Berezinskii-Kosterlitz-Thouless (BKT) type superconducting transition in 2-dimensional superconductors.


title: AAA: Adaptive Aggregation of Arbitrary Online Trackers with Theoretical Performance Guarantee

abstract: For visual object tracking, it is difficult to realize an almighty online tracker due to the huge variations of target appearance depending on an image sequence. This paper proposes an online tracking method that adaptively aggregates arbitrary multiple online trackers. The performance of the proposed method is theoretically guaranteed to be comparable to that of the best tracker for any image sequence, although the best expert is unknown during tracking. The experimental study on the large variations of benchmark datasets and aggregated trackers demonstrates that the proposed method can achieve state-of-the-art performance. The code is available at https://github.com/songheony/AAA-journal.