title: Multimodal Deep Models for Predicting Affective Responses Evoked by Movies

abstract: The goal of this study is to develop and analyze multimodal models for predicting experienced affective responses of viewers watching movie clips. We develop hybrid multimodal prediction models based on both the video and audio of the clips. For the video content, we hypothesize that both image content and motion are crucial features for evoked emotion prediction. To capture such information, we extract features from RGB frames and optical flow using pre-trained neural networks. For the audio model, we compute an enhanced set of low-level descriptors including intensity, loudness, cepstrum, linear predictor coefficients, pitch and voice quality. Both visual and audio features are then concatenated to create audio-visual features, which are used to predict the evoked emotion. To classify the movie clips into the corresponding affective response categories, we propose two approaches based on deep neural network models. The first one is based on fully connected layers without memory on the time component, the second incorporates the sequential dependency with a long short-term memory recurrent neural network (LSTM). We perform a thorough analysis of the importance of each feature set. Our experiments reveal that in our set-up, predicting emotions at each time step independently gives slightly better accuracy performance than with the LSTM. Interestingly, we also observe that the optical flow is more informative than the RGB in videos, and overall, models using audio features are more accurate than those based on video features when making the final prediction of evoked emotions.


title: The socle module of a monomial ideal

abstract: For any ideal $I$ in a Noetherian local ring or any graded ideal $I$ in a standard graded $K$-algebra over a field $K$, we introduce the socle module $\mathrm{Soc}(I)$, whose graded components give us the socle of the powers of $I$. It is observed that $\mathrm{Soc}(I)$ is a finitely generated module over the fiber cone of $I$. In the case that $S$ is the polynomial ring and all powers of $I\subseteq S$ have linear resolution, we define the module $\mathrm{Soc}^*(I)$ which is a module over the Rees ring of $I$. For the edge ideal of a graph and for classes of polymatroidal ideals we study the module structure of their socle modules.


title: Feeling Anxious? Perceiving Anxiety in Tweets using Machine Learning

abstract: This study provides a predictive measurement tool to examine perceived anxiety from a longitudinal perspective, using a non-intrusive machine learning approach to scale human rating of anxiety in microblogs. Results suggest that our chosen machine learning approach depicts perceived user state-anxiety fluctuations over time, as well as mean trait anxiety. We further find a reverse relationship between perceived anxiety and outcomes such as social engagement and popularity. Implications on the individual, organizational, and societal levels are discussed.


title: Regularization parameter selection for low rank matrix recovery

abstract: Low rank matrix recovery is the focus of many applications, but it is a NP-hard problem. A popular way to deal with this problem is to solve its convex relaxation, the nuclear norm regularized minimization problem (NRM), which includes LASSO as a special case. There are some regularization parameter selection results for LASSO in vector case, such as screening rules, which improve the efficiency of the algorithms. However, there are no corresponding parameter selection results for NRM in matrix case. In this paper, we build up a novel rule to choose the regularization parameter for NRM under the help of duality theory. This rule claims that the regularization parameter can be easily chosen by feasible points of NRM and its dual problem, when the rank of the desired solution is no more than a given constant. In particular, we apply this idea to NRM with least square and Huber functions, and establish the easily calculated formula of regularization parameters. Finally, we report numerical results on some signal shapes, which state that our proposed rule shrinks the interval of the regularization parameter efficiently.


title: VeriML: Enabling Integrity Assurances and Fair Payments for Machine Learning as a Service

abstract: Machine Learning as a Service (MLaaS) allows clients with limited resources to outsource their expensive ML tasks to powerful servers. Despite the huge benefits, current MLaaS solutions still lack strong assurances on: 1) service correctness (i.e., whether the MLaaS works as expected); 2) trustworthy accounting (i.e., whether the bill for the MLaaS resource consumption is correctly accounted); 3) fair payment (i.e., whether a client gets the entire MLaaS result before making the payment). Without these assurances, unfaithful service providers can return improperly-executed ML task results or partially trained ML models while asking for over-claimed rewards. Moreover, it is hard to argue for wide adoption of MLaaS to both the client and the service provider, especially in the open market without a trusted third party. In this paper, we present VeriML, a novel and efficient framework to bring integrity assurances and fair payments to MLaaS. With VeriML, clients can be assured that ML tasks are correctly executed on an untrusted server and the resource consumption claimed by the service provider equals to the actual workload. We strategically use succinct non-interactive arguments of knowledge (SNARK) on randomly-selected iterations during the ML training phase for efficiency with tunable probabilistic assurance. We also develop multiple ML-specific optimizations to the arithmetic circuit required by SNARK. Our system implements six common algorithms: linear regression, logistic regression, neural network, support vector machine, Kmeans and decision tree. The experimental results have validated the practical performance of VeriML.


title: Dynamic Pricing and Fleet Management for Electric Autonomous Mobility on Demand Systems

abstract: The proliferation of ride sharing systems is a major drive in the advancement of autonomous and electric vehicle technologies. This paper considers the joint routing, battery charging, and pricing problem faced by a profit-maximizing transportation service provider that operates a fleet of autonomous electric vehicles. We first establish the static planning problem by considering time-invariant system parameters and determine the optimal static policy. While the static policy provides stability of customer queues waiting for rides even if consider the system dynamics, we see that it is inefficient to utilize a static policy as it can lead to long wait times for customers and low profits. To accommodate for the stochastic nature of trip demands, renewable energy availability, and electricity prices and to further optimally manage the autonomous fleet given the need to generate integer allocations, a real-time policy is required. The optimal real-time policy that executes actions based on full state information of the system is the solution of a complex dynamic program. However, we argue that it is intractable to exactly solve for the optimal policy using exact dynamic programming methods and therefore apply deep reinforcement learning to develop a near-optimal control policy. The two case studies we conducted in Manhattan and San Francisco demonstrate the efficacy of our real-time policy in terms of network stability and profits, while keeping the queue lengths up to 200 times less than the static policy.


title: Stochastic Dynamic Games in Belief Space

abstract: Information gathering while interacting with other agents under sensing and motion uncertainty is critical in domains such as driving, service robots, racing, or surveillance. The interests of agents may be at odds with others, resulting in a stochastic non-cooperative dynamic game. Agents must predict others' future actions without communication, incorporate their actions into these predictions, account for uncertainty and noise in information gathering, and consider what information their actions reveal. Our solution uses local iterative dynamic programming in Gaussian belief space to solve a game-theoretic continuous POMDP. Solving a quadratic game in the backward pass of a game-theoretic belief-space variant of iLQG achieves a runtime polynomial in the number of agents and linear in the planning horizon. Our algorithm yields linear feedback policies for our robot, and predicted feedback policies for other agents. We present three applications: active surveillance, guiding eyes for a blind agent, and autonomous racing. Agents with game-theoretic belief-space planning win 44% more races than without game theory and 34% more than without belief-space planning.


title: DASNet: Dynamic Activation Sparsity for Neural Network Efficiency Improvement

abstract: To improve the execution speed and efficiency of neural networks in embedded systems, it is crucial to decrease the model size and computational complexity. In addition to conventional compression techniques, e.g., weight pruning and quantization, removing unimportant activations can reduce the amount of data communication and the computation cost. Unlike weight parameters, the pattern of activations is directly related to input data and thereby changes dynamically. To regulate the dynamic activation sparsity (DAS), in this work, we propose a generic low-cost approach based on winners-take-all (WTA) dropout technique. The network enhanced by the proposed WTA dropout, namely \textit{DASNet}, features structured activation sparsity with an improved sparsity level. Compared to the static feature map pruning methods, DASNets provide better computation cost reduction. The WTA technique can be easily applied in deep neural networks without incurring additional training variables. More importantly, DASNet can be seamlessly integrated with other compression techniques, such as weight pruning and quantization, without compromising on accuracy. Our experiments on various networks and datasets present significant run-time speedups with negligible accuracy loss.


title: Better AI through Logical Scaffolding

abstract: We describe the concept of logical scaffolds, which can be used to improve the quality of software that relies on AI components. We explain how some of the existing ideas on runtime monitors for perception systems can be seen as a specific instance of logical scaffolds. Furthermore, we describe how logical scaffolds may be useful for improving AI programs beyond perception systems, to include general prediction systems and agent behavior models.


title: Perspective-Guided Convolution Networks for Crowd Counting

abstract: In this paper, we propose a novel perspective-guided convolution (PGC) for convolutional neural network (CNN) based crowd counting (i.e. PGCNet), which aims to overcome the dramatic intra-scene scale variations of people due to the perspective effect. While most state-of-the-arts adopt multi-scale or multi-column architectures to address such issue, they generally fail in modeling continuous scale variations since only discrete representative scales are considered. PGCNet, on the other hand, utilizes perspective information to guide the spatially variant smoothing of feature maps before feeding them to the successive convolutions. An effective perspective estimation branch is also introduced to PGCNet, which can be trained in either supervised setting or weakly-supervised setting when the branch has been pre-trained. Our PGCNet is single-column with moderate increase in computation, and extensive experimental results on four benchmark datasets show the improvements of our method against the state-of-the-arts. Additionally, we also introduce Crowd Surveillance, a large scale dataset for crowd counting that contains 13,000+ high-resolution images with challenging scenarios.


title: Curvature Spinors in Locally Inertial Frame and the Relations with Sedenion

abstract: In the 2-spinor formalism, the gravity can be dealt with curvature spinors with four spinor indices. Here we show a new effective method to express the components of curvature spinors in the rank-2 $4 \times 4$ tensor representation for the gravity in a locally inertial frame. In the process we have developed a few manipulating techniques, through which the roles of each component of Riemann curvature tensor are revealed. We define a new algebra `sedon', whose structure is almost the same as sedenion except the basis multiplication rule. Finally we also show that curvature spinors can be represented in the sedon form and observe the chiral structure in curvature spinors. A few applications of the sedon representation, which includes the quaternion form of differential Binanchi indentity, are also presented.


title: Separability of the Klein-Gordon equation for rotating spacetimes obtained from Newman-Janis algorithm

abstract: In the literature, the Newman-Janis algorithm (NJA) has been widely used to construct stationary and axisymmetric spacetimes to describe rotating black holes. In addition, it has been recently shown that the general stationary and axisymmetric spacetime generated through NJA allows the complete separability of the null geodesic equations. In fact, the Hamilton-Jacobi equation in this spacetime is also separable if one of the metric functions is additively separable. In this work, we further study the conditions for a separable Klein-Gordon equation in such a general spacetime. The relations between the NJA spacetime and other parameterized axially symmetric spacetimes in the literature are also discussed.


title: Link homology theories and ribbon concordances

abstract: It was recently proved by several authors that ribbon concordances induce injective maps in knot Floer homology, Khovanov homology, and the Heegaard Floer homology of the branched double cover. We give a simple proof of a similar statement in a more general setting, which includes knot Floer homology, Khovanov-Rozansky homologies, and all conic strong Khovanov-Floer theories. This gives a philosophical answer to the question of which aspects of a link TQFT make it injective under ribbon concordances.


title: A few filters are enough: Convolutional Neural Network for P300 Detection

abstract: Over the past decade, convolutional neural networks (CNNs) have become the driving force of an ever-increasing set of applications, achieving state-of-the-art performance. Most of the modern CNN architectures are composed of many convolutional and fully connected layers and typically require thousands or millions of parameters to learn. CNNs have also been effective in the detection of Event-Related Potentials from electroencephalogram (EEG) signals, notably the P300 component which is frequently employed in Brain-Computer Interfaces (BCIs). However, for this task, the increase in detection rates compared to approaches based on human-engineered features has not been as impressive as in other areas and might not justify such a large number of parameters. In this paper, we study the performances of existing CNN architectures with diverse complexities for single-trial within-subject and cross-subject P300 detection on four different datasets. We also proposed SepConv1D, a very simple CNN architecture consisting of a single depthwise separable 1D convolutional layer followed by a fully connected Sigmoid classification neuron. We found that with as few as four filters in its convolutional layer and a small overall number of parameters, SepConv1D obtained competitive performances in the four datasets. We believe this may represent an important step towards building simpler, cheaper, faster, and more portable BCIs.


title: Universal scaling of three-dimensional dimerized quantum antiferromagnets on bipartite lattices

abstract: Using the first principles quantum Monte Carlo (QMC) calculations, we investigate the previously established universal scaling between the N\'eel temperature $T_N$ and the staggered magnetization density $M_s$ of three-dimensional (3D) dimerized quantum antiferromagnets. Particularly, the calculations are done on both the stacked honeycomb and the cubic lattices. In addition to simulating models with two types of antiferromagnetic couplings (bonds) like those examined in earlier studies, here a tunable parameter controlling the strength of third type of bond is introduced. Interestingly, while the data of models with two types of bonds obtained here fall on top of the universal scaling curves determined previously, the effects due to microscopic details do appear. Moreover, the most striking result suggested in our study is that with the presence of three kinds of bonds in the investigated models, the considered scaling relations between $T_N$ and $M_s$ can be classified by the coordinate number of the underlying lattice geometries. The findings presented here broaden the applicability of the associated classification schemes formerly discovered. In particular, these results are not only interesting from a theoretical point of view, but also can serve as useful guidelines for the relevant experiments.


title: Joint Beamforming Design in Multi-Cluster MISO NOMA Intelligent Reflecting Surface-Aided Downlink Communication Networks

abstract: Considering intelligent reflecting surface (IRS), we study a multi-cluster multiple-input-single-output (MISO) non-orthogonal multiple access (NOMA) downlink communication network. In the network, an IRS assists the communication from the base station (BS) to all users by passive beamforming. Our goal is to minimize the total transmit power by jointly optimizing the transmit beamforming vectors at the BS and the reflection coefficient vector at the IRS. Because of the restrictions on the IRS reflection amplitudes and phase shifts, the formulated quadratically constrained quadratic problem is highly non-convex. For the aforementioned problem, the conventional semidefinite programming (SDP) based algorithm has prohibitively high computational complexity and deteriorating performance. Here, we propose an effective second-order cone programming (SOCP)-alternating direction method of multipliers (ADMM) based algorithm to obtain the locally optimal solution. To reduce the computational complexity, we also propose a low-complexity zero-forcing (ZF) based suboptimal algorithm. It is shown through simulation results that our proposed SOCP-ADMM based algorithm achieves significant performance gain over the conventional SDP based algorithm. Furthermore, when the number of passive reflection elements is relatively high, our proposed ZF-based suboptimal algorithm also outperforms the SDP based algorithm.


title: Isomorphisms between determinantal point processes with translation invariant kernels and Poisson point processes

abstract: We prove the Bernoulli property for determinantal point processes on $ \mathbb{R}^d $ with translation-invariant kernels. For the determinantal point processes on $ \mathbb{Z}^d $ with translation-invariant kernels, the Bernoulli property was proved by Lyons and Steif and Shirai and Takahashi. As its continuum version, we prove an isomorphism between the translation-invariant determinantal point processes on $ \mathbb{R}^d $ with translation-invariant kernels and homogeneous Poisson point processes. For this purpose, we also prove the Bernoulli property for the tree representations of the determinantal point processes.


title: The combinatorics of plane curve singularities. How Newton polygons blossom into lotuses

abstract: This survey may be seen as an introduction to the use of toric and tropical geometry in the analysis of plane curve singularities, which are germs $(C,o)$ of complex analytic curves contained in a smooth complex analytic surface $S$. The embedded topological type of such a pair $(S, C)$ is usually defined to be that of the oriented link obtained by intersecting $C$ with a sufficiently small oriented Euclidean sphere centered at the point $o$, defined once a system of local coordinates $(x,y)$ was chosen on the germ $(S,o)$. If one works more generally over an arbitrary algebraically closed field of characteristic zero, one speaks instead of the combinatorial type of $(S, C)$. One may define it by looking either at the Newton-Puiseux series associated to $C$ relative to a generic local coordinate system $(x,y)$, or at the set of infinitely near points which have to be blown up in order to get the minimal embedded resolution of the germ $(C,o)$ or, thirdly, at the preimage of this germ by the resolution. Each point of view leads to a different encoding of the combinatorial type by a decorated tree: an Eggers-Wall tree, an Enriques diagram, or a weighted dual graph. The three trees contain the same information, which in the complex setting is equivalent to the knowledge of the embedded topological type. There are known algorithms for transforming one tree into another. In this paper we explain how a special type of two-dimensional simplicial complex called a lotus allows to think geometrically about the relations between the three types of trees. Namely, all of them embed in a natural lotus, their numerical decorations appearing as invariants of it. This lotus is constructed from the finite set of Newton polygons created during any process of resolution of $(C,o)$ by successive toric modifications.


title: Coverage Analysis of Integrated Sub-6GHz-mmWave Cellular Networks with Hotspots

abstract: Deploying Sub-6GHz networks together with millimeter wave (mmWave) is a promising solution to achieve high data rates in traffic hotspots while guaranteeing sufficient coverage, where mmWave small cells are densely deployed to provide high quality of service. In this paper, we propose an analytical framework to investigate the integrated Sub-6GHz-mmWave cellular networks, in which the Sub-6GHz base stations (BSs) are modeled as a Poisson point process, and the mmWave BSs are clustered following a Poisson cluster process in traffic hotspots. We conduct stochastic geometry-based analysis and derive the performance metrics including the association probability, signal-to-interference-plus-noise ratio coverage probability and average achievable rate, which are validated to be accurate by Monte Carlo simulations. We analyze the impact of various deployment parameters on the network performance to give insights on the network design. In particular, it is shown that deploying mmWave small cells in traffic hotspots will outperform both traditional Sub-6GHz heterogeneous network and isolated mmWave system in terms of the coverage probability. It can also be shown that extremely high and extremely small association weight for mmWave BSs will deteriorate the performance for cell edge users and cell interior users, respectively. Moreover, there exists an optimal pre-decided dispersion parameter of mmWave BSs that contributes to the maximum coverage probability.


title: Virtual Guide Dog: Next Generation Pedestrian Signal for the Visually Impaired

abstract: Accessible pedestrian signal (APS) was proposed as a mean to achieve the same level of service that is set forth by the American with Disability Act (ADA) for the visually impaired. One of the major issues of existing APSs is the failure to deliver adequate crossing information for the visually impaired. This paper presents a mobile-based APS application, namely Virtual Guide Dog (VGD). Integrating intersection information and onboard sensors (e.g., GPS, compass, accelerometer, and gyroscope sensor) of modern smartphones, the VGD application can notify the visually impaired: 1) the close proximity of an intersection and 2) the street information for crossing. By employing a screen tapping interface, VGD can remotely place a pedestrian crossing call to the controller, without the need of using a push button. In addition, VGD informs VIs the start of a crossing phase by using text-to-speech technology. The proof-of-concept test shows that VGD keeps the users informed about the remaining distance as their approaching the intersection. It was also found that the GPS-only mode is accompanied by greater distance deviation compared to the mode jointly operating with both GPS and cellular positioning.


title: Preliminary Exploration on Digital Twin for Power Systems: Challenges, Framework, and Applications

abstract: Digital twin (DT) is one of the most promising enabling technologies for realizing smart grids. Characterized by seamless and active---data-driven, real-time, and closed-loop---integration between digital and physical spaces, a DT is much more than a blueprint, simulation tool, or cyber-physical system (CPS). Numerous state-of-the-art technologies such as internet of things (IoT), 5G, big data, and artificial intelligence (AI) serve as a basis for DT. DT for power systems aims at situation awareness and virtual test to assist the decision-making on power grid operation and management under normal or urgent conditions. This paper, from both science paradigms and engineering practice, outlines the backgrounds, challenges, framework, tools, and possible directions of DT as a preliminary exploration. To our best knowledge, it is also the first exploration on DT in the context of power systems. Starting from the fundamental and most frequently used power flow (PF) analysis, some typical application scenarios are presented. Our work is expected to contribute some novel discoveries, as well as some high-dimensional analytics, to the engineering community. Besides, the connection of DT with big data analytics and AI may has deep impact on data science.


title: Interpreting and Improving Adversarial Robustness of Deep Neural Networks with Neuron Sensitivity

abstract: Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing insights into the weakness and blind-spots of DNNs. Thus, the interpretability of a DNN in the adversarial setting aims to explain the rationale behind its decision-making process and makes deeper understanding which results in better practical applications. To address this issue, we try to explain adversarial robustness for deep models from a new perspective of neuron sensitivity which is measured by neuron behavior variation intensity against benign and adversarial examples. In this paper, we first draw the close connection between adversarial robustness and neuron sensitivities, as sensitive neurons make the most non-trivial contributions to model predictions in the adversarial setting. Based on that, we further propose to improve adversarial robustness by constraining the similarities of sensitive neurons between benign and adversarial examples which stabilizes the behaviors of sensitive neurons towards adversarial noises. Moreover, we demonstrate that state-of-the-art adversarial training methods improve model robustness by reducing neuron sensitivities which in turn confirms the strong connections between adversarial robustness and neuron sensitivity as well as the effectiveness of using sensitive neurons to build robust models. Extensive experiments on various datasets demonstrate that our algorithm effectively achieves excellent results.


title: Visuomotor Understanding for Representation Learning of Driving Scenes

abstract: Dashboard cameras capture a tremendous amount of driving scene video each day. These videos are purposefully coupled with vehicle sensing data, such as from the speedometer and inertial sensors, providing an additional sensing modality for free. In this work, we leverage the large-scale unlabeled yet naturally paired data for visual representation learning in the driving scenario. A representation is learned in an end-to-end self-supervised framework for predicting dense optical flow from a single frame with paired sensing data. We postulate that success on this task requires the network to learn semantic and geometric knowledge in the ego-centric view. For example, forecasting a future view to be seen from a moving vehicle requires an understanding of scene depth, scale, and movement of objects. We demonstrate that our learned representation can benefit other tasks that require detailed scene understanding and outperforms competing unsupervised representations on semantic segmentation.


title: kPAM-SC: Generalizable Manipulation Planning using KeyPoint Affordance and Shape Completion

abstract: Manipulation planning is the task of computing robot trajectories that move a set of objects to their target configuration while satisfying physically feasibility. In contrast to existing works that assume known object templates, we are interested in manipulation planning for a category of objects with potentially unknown instances and large intra-category shape variation. To achieve it, we need an object representation with which the manipulation planner can reason about both the physical feasibility and desired object configuration, while being generalizable to novel instances. The widely-used pose representation is not suitable, as representing an object with a parameterized transformation from a fixed template cannot capture large intra-category shape variation. Hence, we propose a new hybrid object representation consisting of semantic keypoint and dense geometry (a point cloud or mesh) as the interface between the perception module and motion planner. Leveraging advances in learning-based keypoint detection and shape completion, both dense geometry and keypoints can be perceived from raw sensor input. Using the proposed hybrid object representation, we formulate the manipulation task as a motion planning problem which encodes both the object target configuration and physical feasibility for a category of objects. In this way, many existing manipulation planners can be generalized to categories of objects, and the resulting perception-to-action manipulation pipeline is robust to large intra-category shape variation. Extensive hardware experiments demonstrate our pipeline can produce robot trajectories that accomplish tasks with never-before-seen objects.


title: Universal proofs of entropic continuity bounds via majorization flow

abstract: We introduce a notion of majorization flow, and demonstrate it to be a powerful tool for deriving simple and universal proofs of continuity bounds for entropic functions relevant in information theory. In particular, for the case of the alpha-R\'enyi entropy, whose connections to thermodynamics are discussed in this article, majorization flow yields a Lipschitz continuity bound for the case alpha > 1, thus resolving an open problem and providing a substantial improvement over previously known bounds.


title: Framelet Representation of Tensor Nuclear Norm for Third-Order Tensor Completion

abstract: The main aim of this paper is to develop a framelet representation of the tensor nuclear norm for third-order tensor completion. In the literature, the tensor nuclear norm can be computed by using tensor singular value decomposition based on the discrete Fourier transform matrix, and tensor completion can be performed by the minimization of the tensor nuclear norm which is the relaxation of the sum of matrix ranks from all Fourier transformed matrix frontal slices. These Fourier transformed matrix frontal slices are obtained by applying the discrete Fourier transform on the tubes of the original tensor. In this paper, we propose to employ the framelet representation of each tube so that a framelet transformed tensor can be constructed. Because of framelet basis redundancy, the representation of each tube is sparsely represented. When the matrix slices of the original tensor are highly correlated, we expect the corresponding sum of matrix ranks from all framelet transformed matrix frontal slices would be small, and the resulting tensor completion can be performed much better. The proposed minimization model is convex and global minimizers can be obtained. Numerical results on several types of multi-dimensional data (videos, multispectral images, and magnetic resonance imaging data) have tested and shown that the proposed method outperformed the other testing methods.


title: A Self-Attentional Neural Architecture for Code Completion with Multi-Task Learning

abstract: Code completion, one of the most useful features in the Integrated Development Environments (IDEs), can accelerate software development by suggesting the libraries, APIs, and method names in real-time. Recent studies have shown that statistical language models can improve the performance of code completion tools through learning from large-scale software repositories. However, these models suffer from three major drawbacks: a) The hierarchical structural information of the programs is not fully utilized in the program's representation; b) In programs, the semantic relationships can be very long. Existing recurrent neural networks based language models are not sufficient to model the long-term dependency. c) Existing approaches perform a specific task in one model, which leads to the underuse of the information from related tasks. To address these challenges, in this paper, we propose a self-attentional neural architecture for code completion with multi-task learning. To utilize the hierarchical structural information of the programs, we present a novel method that considers the path from the predicting node to the root node. To capture the long-term dependency in the input programs, we adopt a self-attentional architecture based network as the base language model. To enable the knowledge sharing between related tasks, we creatively propose a Multi-Task Learning (MTL) framework to learn two related tasks in code completion jointly. Experiments on three real-world datasets demonstrate the effectiveness of our model when compared with state-of-the-art methods.


title: Inference for multiple object tracking: A Bayesian nonparametric approach

abstract: In recent years, multi object tracking (MOT) problem has drawn attention to it and has been studied in various research areas. However, some of the challenging problems including time dependent cardinality, unordered measurement set, and object labeling remain unclear. In this paper, we propose robust nonparametric methods to model the state prior for MOT problem. These models are shown to be more flexible and robust compared to existing methods. In particular, the overall approach estimates time dependent object cardinality, provides object labeling, and identifies object associated measurements. Moreover, our proposed framework dynamically contends with the birth/death and survival of the objects through dependent nonparametric processes. We present Inference algorithms that demonstrate the utility of the dependent nonparametric models for tracking. We employ Monte Carlo sampling methods to demonstrate the proposed algorithms efficiently learn the trajectory of objects from noisy measurements. The computational results display the performance of the proposed algorithms and comparison not only between one another, but also between proposed algorithms and labeled multi Bernoulli tracker.


title: A Kronecker-Based Sparse Compressive Sensing Matrix for Millimeter Wave Beam Alignment

abstract: Millimeter wave beam alignment (BA) is a challenging problem especially for large number of antennas. Compressed sensing (CS) tools have been exploited due to the sparse nature of such channels. This paper presents a novel deterministic CS approach for BA. Our proposed sensing matrix which has a Kronecker-based structure is sparse, which means it is computationally efficient. We show that our proposed sensing matrix satisfies the restricted isometry property (RIP) condition, which guarantees the reconstruction of the sparse vector. Our approach outperforms existing random beamforming techniques in practical low signal to noise ratio (SNR) scenarios.


title: Effects of $P_{\mathrm{tot}}$ gates and velocity gates on light-particle momentum correlation in intermediate-energy heavy-ion collisions

abstract: Momentum correlation functions at small relative momenta are calculated for light particles $\left(n, p, d, t\right)$ emitted from $^{197}$Au + $^{197}$Au collisions at different impact parameters and beam energies within the framework of the isospin-dependent quantum molecular dynamics model complemented by the $Lednick\acute{y}$ and $Lyuboshitz$ analytical method. We first make sure our model is able to reproduce the FOPI data of proton-proton momentum correlation in a wide energy range from 0.4$A$ GeV to 1.5$A$ GeV. Then we explore more physics insights through the emission times and momentum correlations among different light particles. The specific emphasize is the effects of total pair momentum among different light particles, impact parameters and in-medium nucleon-nucleon cross section. Both two-deuteron and two-triton correlation functions are anti-correlation due to the final state interaction, and they are affected by in-medium nucleon-nucleon cross section for the higher total momentum of the particle pairs, but not for the lower ones. In addition, impact parameter and in-medium nucleon-nucleon cross section dependences of the emission source radii are extracted by fitting the momentum correlation functions. The results indicate that momentum correlation functions gating with total pair momentum is stronger for the smaller in-medium nucleon-nucleon cross section factor $\left(\eta\right)$ or impact parameter $\left(b\right)$. Non-identical particle correlations ($np, pd, pt, $ and $dt$) are also investigated by the velocity-gated correlation functions which can give information of the particles' emission sequence, and the result indicates that heavier ones $\left(deuteron/triton\right)$ are, one the average, emitted earlier than protons, in the small relative momentum region.


title: Automatic Generation of Pull Request Descriptions

abstract: Enabled by the pull-based development model, developers can easily contribute to a project through pull requests (PRs). When creating a PR, developers can add a free-form description to describe what changes are made in this PR and/or why. Such a description is helpful for reviewers and other developers to gain a quick understanding of the PR without touching the details and may reduce the possibility of the PR being ignored or rejected. However, developers sometimes neglect to write descriptions for PRs. For example, in our collected dataset with over 333K PRs, more than 34% of the PR descriptions are empty. To alleviate this problem, we propose an approach to automatically generate PR descriptions based on the commit messages and the added source code comments in the PRs. We regard this problem as a text summarization problem and solve it using a novel sequence-to-sequence model. To cope with out-of-vocabulary words in software artifacts and bridge the gap between the training loss function of the sequence-to-sequence model and the evaluation metric ROUGE, which has been shown to correspond to human evaluation, we integrate the pointer generator and directly optimize for ROUGE using reinforcement learning and a special loss function. We build a dataset with over 41K PRs and evaluate our approach on this dataset through ROUGE and a human evaluation. Our evaluation results show that our approach outperforms two baselines by significant margins.


title: Explicit near-Ramanujan graphs of every degree

abstract: For every constant $d \geq 3$ and $\epsilon > 0$, we give a deterministic $\mathrm{poly}(n)$-time algorithm that outputs a $d$-regular graph on $\Theta(n)$ vertices that is $\epsilon$-near-Ramanujan; i.e., its eigenvalues are bounded in magnitude by $2\sqrt{d-1} + \epsilon$ (excluding the single trivial eigenvalue of~$d$).


title: Unsupervised Eyeglasses Removal in the Wild

abstract: Eyeglasses removal is challenging in removing different kinds of eyeglasses, e.g., rimless glasses, full-rim glasses and sunglasses, and recovering appropriate eyes. Due to the large visual variants, the conventional methods lack scalability. Most existing works focus on the frontal face images in the controlled environment, such as the laboratory, and need to design specific systems for different eyeglass types. To address the limitation, we propose a unified eyeglass removal model called Eyeglasses Removal Generative Adversarial Network (ERGAN), which could handle different types of glasses in the wild. The proposed method does not depend on the dense annotation of eyeglasses location but benefits from the large-scale face images with weak annotations. Specifically, we study the two relevant tasks simultaneously, i.e., removing and wearing eyeglasses. Given two facial images with and without eyeglasses, the proposed model learns to swap the eye area in two faces. The generation mechanism focuses on the eye area and invades the difficulty of generating a new face. In the experiment, we show the proposed method achieves a competitive removal quality in terms of realism and diversity. Furthermore, we evaluate ERGAN on several subsequent tasks, such as face verification and facial expression recognition. The experiment shows that our method could serve as a pre-processing method for these tasks.


title: Testing claims of the GW170817 binary neutron star inspiral affecting $\beta$-decay rates

abstract: On August 17, 2017, the first gravitational wave signal from a binary neutron star inspiral (GW170817) was detected by Advanced LIGO and Advanced VIRGO. Here we present radioactive $\beta$-decay rates of three independent sources $^{44}$Ti, $^{60}$Co and $^{137}$Cs, monitored during the same period by a precision experiment designed to investigate the decay of long-lived radioactive sources. We do not find any significant correlations between decay rates in a 5\,h time interval following the GW170817 observation. This contradicts a previous claim published in this journal of an observed 2.5$\sigma$ Pearson Correlation between fluctuations in the number of observed decays from two $\beta$-decaying isotopes ($^{32}$Si and $^{36}$Cl) in the same time interval. By correcting for the choice of an arbitrary time interval, we find no evidence of a correlation above 1.5$\sigma$ confidence. In addition, we argue that such analyses on correlations in arbitrary time intervals should always correct for the so-called Look-Elsewhere effect by quoting the global significance.


title: Global gradient estimates for very singular quasilinear elliptic equations with measure data

abstract: This paper continues the development of regularity results for quasilinear measure data problems \begin{align*} \begin{cases} -\mathrm{div}(A(x,\nabla u)) &= \mu \quad \text{in} \ \ \Omega, \\ \quad \quad \qquad u &=0 \quad \text{on} \ \ \partial \Omega, \end{cases} \end{align*} in Lorentz and Lorentz-Morrey spaces, where $\Omega \subset \mathbb{R}^n$ ($n \ge 2$), $\mu$ is a finite Radon measure on $\Omega$, and $A$ is a monotone Carath\'eodory vector valued operator acting between $W^{1,p}_0(\Omega)$ and its dual $W^{-1,p'}(\Omega)$. It emphasizes that this paper studies the `very singular' case $1<p \le \frac{3n-2}{2n-1}$ and the problem is considered under the weak assumption, where the $p$-capacity uniform thickness condition is imposed on the complement of domain $\Omega$. There are two main results obtained in our study pertaining to the global gradient estimates of solutions in Lorentz and Lorentz-Morrey spaces involving the use of maximal and fractional maximal operators. The idea for writing this working paper comes directly from the recent results by others in the same research topic, where global estimates for gradient of solutions for the `very singular' case still remains a challenge, specifically related to Lorentz and Lorentz-Morrey spaces.


title: Energy staggering parameters in nuclear magnetic rotational bands

abstract: The systematics of energy staggering for the magnetic rotational bands with $M1$ and $E2$ transition properties strictly consistent with the features of good candidates of magnetic rotational bands in the $A\sim80$, 110, 130 and 190 mass regions are presented. The regularities exhibited by these bands concerning the staggering parameter which increases with increasing spin are in agreement with the semiclassical description of shears mechanism. In addition, the abnormal behaviours in the backbend regions or close to band termination have also been discussed. Taking the magnetic dipole bands with same configuration in three $N=58$ isotones, i.e., $^{103}$Rh, $^{105}$Ag, and~$^{107}$In, as examples, the transition from chiral rotation to magnetic rotation with the proton number approaching $Z=50$ is presented. Moreover, the self-consistent tilted axis cranking and principle axis cranking relativistic mean-field theories are applied to investigate the rotational mechanism in dipole band of $^{105}$Ag.


title: Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

abstract: Machines are a long way from robustly solving open-world perception-control tasks, such as first-person view (FPV) aerial navigation. While recent advances in end-to-end Machine Learning, especially Imitation and Reinforcement Learning appear promising, they are constrained by the need of large amounts of difficult-to-collect labeled real-world data. Simulated data, on the other hand, is easy to generate, but generally does not render safe behaviors in diverse real-life scenarios. In this work we propose a novel method for learning robust visuomotor policies for real-world deployment which can be trained purely with simulated data. We develop rich state representations that combine supervised and unsupervised environment data. Our approach takes a cross-modal perspective, where separate modalities correspond to the raw camera data and the system states relevant to the task, such as the relative pose of gates to the drone in the case of drone racing. We feed both data modalities into a novel factored architecture, which learns a joint low-dimensional embedding via Variational Auto Encoders. This compact representation is then fed into a control policy, which we trained using imitation learning with expert trajectories in a simulator. We analyze the rich latent spaces learned with our proposed representations, and show that the use of our cross-modal architecture significantly improves control policy performance as compared to end-to-end learning or purely unsupervised feature extractors. We also present real-world results for drone navigation through gates in different track configurations and environmental conditions. Our proposed method, which runs fully onboard, can successfully generalize the learned representations and policies across simulation and reality, significantly outperforming baseline approaches. Supplementary video: https://youtu.be/VKc3A5HlUU8


title: Spinors and Descartes configurations of disks

abstract: We define spinors for pairs of tangent disks in the Euclidean plane and prove a number of theorems, one of which may be interpreted as a "square root of Descartes Theorem". In any Apollonian disk packing, spinors form a network. In the Apollonian Window, a special case of Apollonian disk packing, all spinors are integral.


title: Note on S-channel factorization in multitrace Berenstein-Maldacena-Nastase correlators

abstract: In a previous paper we proposed a factorization principle for the correlation functions of Berenstein-Maldacena-Nastase (BMN) operators in free $\mathcal{N}=4$ super-Yang-Mills theory. These correlators are conjectured to described physical string amplitudes in an infinitely curved Ramond-Ramond pp-wave background. There was a puzzle that the factorization seems to break down for $S$-channel in the $2\rightarrow 2$ scattering process. Here we resolve this puzzle by including some diagrams missed in the previous paper. We also observe some interesting relations which further support the interpretation of higher genus correlators as physical string loop amplitudes.


title: A Data-driven Dynamic Rating Forecast Method and Application for Power Transformer Long-term Planning

abstract: This paper presents a data-driven method for producing annual continuous dynamic rating of power transformers to serve the long-term planning purpose. Historically, research works on dynamic rating have been focused on real-time/near-future system operations. There has been a lack of research for long-term planning oriented applications. Currently, most utility companies still rely on static rating numbers when planning power transformers for the next few years. In response, this paper proposes a novel and comprehensive method to analyze the past 5-year temperature, loading and load composition data of existing power transformers in a planning region. Based on such data and the forecasted area load composition, a future power transformer loading profile can be constructed by using Gaussian Mixture Model. Then according to IEEE std. C57.91-2011, a power transformer thermal aging model can be established to incorporate future loading and temperature profiles. As a result, annual continuous dynamic rating profiles under different temperature scenarios can be determined. The profiles can reflect the long-term thermal overloading risk in a much more realistic and granular way, which can significantly improve the accuracy of power transformer planning. A real utility application example in Canada has been presented to demonstrate the practicality and usefulness of this method.


title: MVDLite: a Fast Validation Algorithm for Model View Definition Rules

abstract: Model View Definition (MVD) is the standard methodology to define the data exchange requirements and rule constraints for Building Information Models (BIMs). In this paper, the MVDLite algorithm is proposed for the fast validation of MVD rules. A "rule chain" structure is introduced to combine the data templates, constraint statements, and logical interconnections in an input mvdXML ruleset, which leads to fast filtering of data nodes through the rule chain. By establishing the correspondence of each prefix of the rule chain with a string, the deep-caching strategy further improves efficiency. The outperforming experimental results show that our algorithm significantly reduces the running time of MVD validation on large real-world BIMs.


title: Real-time 3-D Mapping with Estimating Acoustic Materials

abstract: This paper proposes a real-time system integrating an acoustic material estimation from visual appearance and an on-the-fly mapping in the 3-dimension. The proposed method estimates the acoustic materials of surroundings in indoor scenes and incorporates them to a 3-D occupancy map, as a robot moves around the environment. To estimate the acoustic material from the visual cue, we apply the state-of-the-art semantic segmentation CNN network based on the assumption that the visual appearance and the acoustic materials have a strong association. Furthermore, we introduce an update policy to handle the material estimations during the online mapping process. As a result, our environment map with acoustic material can be used for sound-related robotics applications, such as sound source localization taking into account various acoustic propagation (e.g., reflection).


title: Learning Residual Flow as Dynamic Motion from Stereo Videos

abstract: We present a method for decomposing the 3D scene flow observed from a moving stereo rig into stationary scene elements and dynamic object motion. Our unsupervised learning framework jointly reasons about the camera motion, optical flow, and 3D motion of moving objects. Three cooperating networks predict stereo matching, camera motion, and residual flow, which represents the flow component due to object motion and not from camera motion. Based on rigid projective geometry, the estimated stereo depth is used to guide the camera motion estimation, and the depth and camera motion are used to guide the residual flow estimation. We also explicitly estimate the 3D scene flow of dynamic objects based on the residual flow and scene depth. Experiments on the KITTI dataset demonstrate the effectiveness of our approach and show that our method outperforms other state-of-the-art algorithms on the optical flow and visual odometry tasks.


title: Direct images of pluricanonical bundles and Frobenius stable canonical rings of fibers

abstract: In this paper, we study an algebraic fiber space in positive characteristic whose generic fiber $F$ has finitely generated canonical ring and sufficiently large Frobenius stable canonical ring. An example of such a case is when $F$ is $F$-pure and its dualizing sheaf is invertible and ample. We treat a Fujita-type conjecture due to Popa and Schnell concerning direct images of pluricanonical bundles, and prove it under some additional hypotheses. As an application, we show the subadditivity of Kodaira dimensions in some new cases.


title: Rotational disruption of dust grains by mechanical torques for high-velocity gas-grain collisions

abstract: Dust grains moving at hypersonic velocities of $v_{d}\gtrsim 100\rm km~s^{-1}$ through an ambient gas are known to be destroyed by nonthermal sputtering. Yet, previous studies of nonthermal sputtering disregarded the fact that dust grains can be spun-up to suprathermal rotation by stochastic mechanical torques from gas-grain collisions. In this paper, we show that such grain suprathermal rotation can disrupt a small grain into small fragments because induced centrifugal stress exceeds the maximum tensile strength of grain material, $S_{\rm max}$. We term this mechanism {\it MEchanical Torque Disruption} (METD). We find that METD is more efficient than nonthermal sputtering in destroying smallest grains ($a<10$ nm) of nonideal structures moving with velocities of $v_{d}<500 \rm km~s^{-1}$. The ratio of rotational disruption to sputtering time is $\tau_{\rm disr}/\tau_{\rm sp}\sim 0.7(S_{\rm max}/10^{9}\rm erg~cm^{-3})(\bar{A}_{\rm sp}/12)(Y_{\rm sp}/0.1)(a/0.01\mu m)^{3}(300\rm km~s^{-1}/v_{d})^{2}$ where $a$ is the radius of spherical grains, and $Y_{\rm sp}$ is sputtering yield. We also consider the high-energy regime and find that the rate of METD is reduced and becomes less efficient than sputtering for $v_{d}>500\rm km~s^{-1}$ because impinging particles only transfer part of their momentum to the grain. We finally discuss implications of the METD mechanism for the destruction of hypersonic grains accelerated by radiation pressure as well as grains in fast shocks. Our results suggest that the destruction of small grains by METD in fast shocks of supernova remnants may be more efficient than previously predicted by nonthermal sputtering, depending on grain internal structures.

categories: astro-ph.GA astro-ph.EP astro-ph.HE physics.space-ph


title: Surface-plasmon-polariton-driven narrow linewidth magneto-optics in Ni nanodisk arrays

abstract: Magnetoplasmonics exploits interactions between light and magnetic matter at the nanoscale for light manipulation and resonant magneto-optics. One of the great challenges of this field is overcoming optical losses in magnetic metals. Here we exploit surface plasmon polaritons (SPPs) excited at the interface of a SiO2/Au bilayer to induce strong magneto-optical responses on the Ni nanodisks of a periodic array. Using a reference system made of Au nanodisks, we show that optical losses in Ni do hardly broaden the linewidth of SPP-driven magneto-optical signals. Loss mitigation is attained because the free electrons in the Ni nanodisks are driven into forced oscillations away from their plasmon resonance. By varying the SiO2 layer thickness and lattice constant of the Ni nanodisk array, we demonstrate tailoring of intense magneto-optical Kerr effects with a spectral linewidth down to ~25 nm. Our results provide important hints on how to circumvent losses and enhance magneto-optical signals via the design of off-resonance magnetoplasmonic driving mechanisms.


title: Time reversed optical waves by arbitrary vector spatiotemporal field generation

abstract: Lossless linear wave propagation is symmetric in time, a principle which can be used to create time reversed waves. Such waves are special 'pre-scattered' spatiotemporal fields, which propagate through a complex medium as if observing a scattering process in reverse, entering the medium as a complicated spatiotemporal field and arriving after propagation as a desired target field, such as a spatiotemporal focus. Time reversed waves have previously been demonstrated for relatively low frequency phenomena such as acoustics, water waves and microwaves. Many attempts have been made to extend these techniques into optics. However, the much higher frequencies of optics make for very different requirements. A fully time reversed wave is a volumetric field with arbitrary amplitude, phase and polarisation at every point in space and time. The creation of such fields has not previously been possible in optics. We demonstrate time reversed optical waves with a device capable of independently controlling all of light's classical degrees of freedom simultaneously. Such a class of ultrafast wavefront shaper is capable of generating a sequence of arbitrary 2D spatial/polarisation wavefronts at a bandwidth limited rate of 4.4 THz. This ability to manipulate the full field of an optical beam could be used to control both linear and nonlinear optical phenomena.


title: On uniform distribution of $\alpha\beta$-orbits

abstract: Let $\alpha, \beta \in (0,1)$ such that at least one of them is irrational. We take a random walk on the real line such that the choice of $\alpha$ and $\beta$ has equal probability $1/2$. We prove that almost surely the $\alpha\beta$-orbit is uniformly distributed module one, and the exponential sums along its orbit has the square root cancellation. We also show that the exceptional set in the probability space, which does not have the property of uniform distribution modulo one, is large in the terms of topology and Hausdorff dimension.


title: KorQuAD1.0: Korean QA Dataset for Machine Reading Comprehension

abstract: Machine Reading Comprehension (MRC) is a task that requires machine to understand natural language and answer questions by reading a document. It is the core of automatic response technology such as chatbots and automatized customer supporting systems. We present Korean Question Answering Dataset(KorQuAD), a large-scale Korean dataset for extractive machine reading comprehension task. It consists of 70,000+ human generated question-answer pairs on Korean Wikipedia articles. We release KorQuAD1.0 and launch a challenge at https://KorQuAD.github.io to encourage the development of multilingual natural language processing research.


title: Experimental Confirmation of Quantum Hall Ferromagnetic State in an Organic Dirac Fermion System

abstract: We have experimentally confirmed the quantum Hall ferromagnetic state with Chern number \nu=0, characterized by the helical edge state, in a layered organic Dirac fermion system \alpha-(BEDT-TTF)_2I_3. The interlayer resistance saturates at low temperatures and high magnetic fields. It does not scale with the sample cross-sectional area in the saturating region, and resonantly depends on the magnetic field direction. These results strongly suggest that the helical edge state dominates transport. This is the first observation of the topological phase in organic molecular crystals.


title: Asymptotics of $d$-Dimensional Visibility

abstract: We consider the space $[0,n]^3$, imagined as a three dimensional, axis-aligned grid world partitioned into $n^3$ $1\times 1 \times 1$ unit cubes. Each cube is either considered to be empty, in which case a line of sight can pass through it, or obstructing, in which case no line of sight can pass through it. From a given position, some of these obstructing cubes block one's view of other obstructing cubes, leading to the following extremal problem: What is the largest number of obstructing cubes that can be simultaneously visible from the surface of an observer cube, over all possible choices of which cubes of $[0,n]^3$ are obstructing? We construct an example of a configuration in which $\Omega\big(n^\frac{8}{3}\big)$ obstructing cubes are visible, and generalize this to an example with $\Omega\big(n^{d-\frac{1}{d}}\big)$ visible obstructing hypercubes for dimension $d>3$. Using Fourier analytic techniques, we prove an $O\big(n^{d-\frac{1}{d}}\log n\big)$ upper bound in a reduced visibility setting.


title: Fine-grained rim formation -- high speed, kinetic dust aggregation in the early Solar System

abstract: Type 3 chondritic meteorites often contain chondrules and refractory inclusions that are coated with accretionary, fine-grained rims (FGRs). FGRs are of low porosity, were subject to centrally directed pressure, may contain high temperature products like microchondrules and there is a linear relationship between the rim thickness and the radius of the enclosed object. FGRs are thought to have formed by the gentle adhesion of dust onto the central object with the subsequent compression of this fluffy rim within the parent body. However, this model does not explain the low porosity, micro-chondrules and centralized pressure. This model also has difficulties explaining the linear relationship between rim thickness and object size including the existence of a non-zero constant in that linear relationship. We propose that FGRs formed by the relatively high-speed interaction between dust and the object, where high initial impact speed produced abrasion and, possibly, microchondrules. FGR formation occurred over a range of lower speeds aided by vacuum adhesion of fragments from the impacting dust particles. This model naturally produces the rim thickness linear relationship with non-zero constant, low porosity and centrally directed pressure. We call this process kinetic dust aggregation (KDA), which is another name for the aerosol deposition processes used in industry. KDA may be a tentative, part explanation of how dust aggregation occurs in protostellar disks on the pathway from dust to planets.


title: Bridging the domain gap in cross-lingual document classification

abstract: The scarcity of labeled training data often prohibits the internationalization of NLP models to multiple languages. Recent developments in cross-lingual understanding (XLU) has made progress in this area, trying to bridge the language barrier using language universal representations. However, even if the language problem was resolved, models trained in one language would not transfer to another language perfectly due to the natural domain drift across languages and cultures. We consider the setting of semi-supervised cross-lingual understanding, where labeled data is available in a source language (English), but only unlabeled data is available in the target language. We combine state-of-the-art cross-lingual methods with recently proposed methods for weakly supervised learning such as unsupervised pre-training and unsupervised data augmentation to simultaneously close both the language gap and the domain gap in XLU. We show that addressing the domain gap is crucial. We improve over strong baselines and achieve a new state-of-the-art for cross-lingual document classification.


title: Cyclic sieving phenomenon on dominant maximal weights over affine Kac-Moody algebras

abstract: We construct a (bi)cyclic sieving phenomenon on the union of dominant maximal weights for level $\ell$ highest weight modules over an affine Kac-Moody algebra with exactly one highest weight being taken for each equivalence class, in a way not depending on types, ranks and levels. In order to do that, we introduce $\textbf{\textit{S}}$-evaluation on the set of dominant maximal weights for each highest modules, and generalize Sagan's action by considering the datum on each affine Kac-Moody algebra. As consequences, we obtain closed and recursive formulae for cardinality of the number of dominant maximal weights for every highest weight module and observe level-rank duality on the cardinalities.


title: The impact of (n,$\gamma$) reaction rate uncertainties on the predicted abundances of i-process elements with $32\leq Z\leq 48$ in the metal-poor star HD94028

abstract: Several anomalous elemental abundance ratios have been observed in the metal-poor star HD94028. We assume that its high [As/Ge] ratio is a product of a weak intermediate (i) neutron-capture process. Given that observational errors are usually smaller than predicted nuclear physics uncertainties, we have first set up a benchmark one-zone i-process nucleosynthesis simulation results of which provide the best fit to the observed abundances. We have then performed Monte Carlo simulations in which 113 relevant (n,$\gamma$) reaction rates of unstable species were randomly varied within Hauser-Feshbach model uncertainty ranges for each reaction to estimate the impact on the predicted stellar abundances. One of the interesting results of these simulations is a double-peaked distribution of the As abundance, which is caused by the variation of the $^{75}$Ga (n,$\gamma$) cross section. This variation strongly anti-correlates with the predicted As abundance, confirming the necessity for improved theoretical or experimental bounds on this cross section. The $^{66}$Ni (n,$\gamma$) reaction is found to behave as a major bottleneck for the i-process nucleosynthesis. Our analysis finds the Pearson product-moment correlation coefficient $r_\mathrm{P} > 0.2$ for all of the i-process elements with $32 \leq Z \leq 42$, with significant changes in their predicted abundances showing up when the rate of this reaction is reduced to its theoretically constrained lower bound. Our results are applicable to any other stellar nucleosynthesis site with the similar i-process conditions, such as Sakurai's object (V4334 Sagittarii) or rapidly-accreting white dwarfs.


title: Constraining the $^{12}$C+$^{12}$C astrophysical S-factors with the $^{12}$C+$^{13}$C measurements at very low energies

abstract: We use an underground counting lab with an extremely low background to perform an activity measurement for the $^{12}$C+$^{13}$C system with energies down to $E\rm_{c.m.}$=2.323 MeV, at which the $^{12}$C($^{13}$C,$p$)$^{24}$Na cross section is found to be 0.22(7) nb. The $^{12}$C+$^{13}$C fusion cross section is derived with a statistical model calibrated using experimental data. Our new result of the $^{12}$C+$^{13}$C fusion cross section is the first decisive evidence in the carbon isotope systems which rules out the existence of the astrophysical S-factor maximum predicted by the phenomenological hindrance model, while confirming the rising trend of the S-factor towards lower energies predicted by other models, such as CC-M3Y+Rep, DC-TDHF, KNS, SPP and ESW. After normalizing the model predictions with our data, a more reliable upper limit is established for the $^{12}$C+$^{12}$C fusion cross sections at stellar energies.


title: Proceedings of the 27th International Symposium on Graph Drawing and Network Visualization (GD 2019)

abstract: This is the arXiv index for the electronic proceedings of GD 2019, which contains the peer-reviewed and revised accepted papers with an optional appendix. Proceedings (without appendices) are also to be published by Springer in the Lecture Notes in Computer Science series.


title: The W-subtype active contact binary PZ UMa with a possible more massive tertiary component

abstract: Two sets of multiple-color ($B, V, R_c, I_c$) light curves of PZ UMa were observed in dependently with the 2.4 meter telescope at the Thai National Observatory and the 1 meter telescope at Yunnan Observatories. The light curves were analyzed with the Wilson-Devinney program and the two sets of light curves produced consistent results, which show that PZ UMa is a W-subtype contact binary with an extreme mass ratio ($M_{1}/M_{2} = 0.18)$. The basic physical parameters of PZ UMa were determined to be $M_{2} = 0.77(2)M_\odot$, $M_{1} = 0.14(1)M_\odot$, $R_{2} = 0.92(1)R_\odot$, $R_{1} = 0.43(1)R_\odot$, $L_{2} = 0.46(2)L_\odot$ and $L_{1} = 0.15(3)L_\odot$. The orbital period analysis of PZ UMa revealed a 13.22 year periodicity, which implies that there may be a tertiary component orbiting around the binary system. The mass and orbital radius of the tertiary component were calculated to be $M_{3} = 0.88 M_\odot$ and $a_{3} = 3.67 AU$, if the orbit was coplanar with the central binary system. It is interesting that the minimum mass of the tertiary was calculated to be $M_{3min} = 0.84 M_\odot$, which means the tertiary component is even larger than the primary star and the secondary one of PZ UMa. PZ UMa is a late-type contact binary with stellar activity. The O'Connell effect appeared on its light curves when it was observed on April 2016. However, the O'Connell effect reversed when the target was observed again on December 2016. The changes of the O'Connell effect in such a short time-scale strongly support the occurrence of rapidly changing magnetic activity on this W UMa binary.


title: Lie symmetries, reduction and exact solutions of the (1+2)-dimensional nonlinear problem

abstract: The well known nonlinear model for describing the solid tumour growth [Byrne HM., et al. Appl Math Letters 2003;16:567-74] is under study using an approach based on Lie symmetries. It is shown that the model in the two-dimensional (in space) approximation forms a (1+2)-dimensional boundary value problem, which admits a highly nontrivial Lie symmetry. The special case involving the power-law nonlinearities is examined in details. The symmetries derived are applied for the reduction of the nonlinear boundary value problem in question to problems of lower dimensionality. Finally, the reduced problems with correctly-specified coefficients were exactly solved and the exact solutions derived were analysed, in particular, some plots were build in order to understand the time-space behaviour of these solutions and to discuss their biological interpretation.


title: Describing the Jelonek set of polynomial maps via Newton polytopes

abstract: Let $\K=\C$, or $\R$, and $S_f$ be the set of points in $\K^n$ at which a polynomial map $f:\K^n\rightarrow\K^n$ is non-proper. Jelonek proved that $S_f$ is a semi-algebraic set that is ruled by polynomial curves, with $\dim S_f\leq n-1$, and provided a method to compute $S_f$ for $\K = \C$. However, such methods do not exist for $\K = \R$. In this paper, we establish a straightforward description of $S_f$ for a large family of non-proper maps $f$ using the Newton polytopes of the polynomials appearing in $f$. Thus resulting in a new method for computing $S_f$ that works for $\K=\R$, and highlights an interplay between the geometry of polytopes and that of $S_f$. As an application, we recover some of Jelonek's results, and provide conditions on (non-)properness of $f$. Moreover, we discover another large family of maps $f$ whose $S_f$ has dimension $n-1$ (even for $\K=\R$), satisfies an explicit stratification, and weak smoothness properties. This novel description allows our tools to be extended to all non-proper maps.


title: Junctions of mass-deformed nonlinear sigma models on $SO(2N)/U(N)$ and $Sp(N)/U(N)$ I

abstract: We construct on-shell ${\mathcal{N}}=2$ nonlinear sigma models on $SO(2N)/U(N)$ and $Sp(N)/U(N)$ by holomorphically embedding the models in the hyper-K\"{a}hler nonlinear sigma model on the cotangent bundle of the Grassmann manifold $T^\ast G_{2N,N}$ in the ${\mathcal{N}}=1$ superspace formalism. We apply the moduli matrix formalism to the mass-deformed nonlinear sigma models on the quadrics to study three-pronged junctions by using a recently proposed diagram method.


title: Gumbel-softmax Optimization: A Simple General Framework for Combinatorial Optimization Problems on Graphs

abstract: Many problems in real life can be converted to combinatorial optimization problems (COPs) on graphs, that is to find a best node state configuration or a network structure such that the designed objective function is optimized under some constraints. However, these problems are notorious for their hardness to solve because most of them are NP-hard or NP-complete. Although traditional general methods such as simulated annealing (SA), genetic algorithms (GA) and so forth have been devised to these hard problems, their accuracy and time consumption are not satisfying in practice. In this work, we proposed a simple, fast, and general algorithm framework called Gumbel-softmax Optimization (GSO) for COPs. By introducing Gumbel-softmax technique which is developed in machine learning community, we can optimize the objective function directly by gradient descent algorithm regardless of the discrete nature of variables. We test our algorithm on four different problems including Sherrington-Kirkpatrick (SK) model, maximum independent set (MIS) problem, modularity optimization, and structural optimization problem. High-quality solutions can be obtained with much less time consuming compared to traditional approaches.


title: Two-dimensional transition metal oxides Mn2O3 realized quantum anomalous Hall effect

abstract: The quantum anomalous Hall effect is a intriguing topological nontrivial phase arising from spontaneous magnetization and spin-orbit coupling. However, the tremendously harsh realizing requirements of the quantum anomalous Hall effects in magnetic topological insulators of Cr or V-doped (Bi,Sb)2Te3 film, hinder its practical applications. Here, we use first principles calculations to predict that the three Mn2O3 structure is an intrinsic ferromagnetic Chern insulator. Remarkably, a quantum anomalous Hall phase of Chern number C = -2 is found, and there are two corresponding gapless chiral edge states appearing inside the bulk gap. More interestingly, only a small tensile strain is needed to induce the phase transition from Cmm2 and C222 phase to P6/mmm phase. Meanwhile, a topological quantum phase transition between a quantum anomalous Hall phase and a trivial insulating phase can be realize. The combination of these novel properties renders the two-dimensional ferromagnet a promising platform for high effciency electronic and spintronic applications.


title: 2-knot homology and Yoshikawa move

abstract: Ng constructed an invariant of knots in ${\mathbb{R}}^3$, a combinatorial knot contact homology. Extending his study, we construct an invariant of surface-knots in ${\mathbb{R}}^4$ using marked graph diagrams.


title: Circular Cumulant Reductions for Macroscopic Dynamics of Kuramoto Ensemble with Multiplicative Intrinsic Noise

abstract: We demonstrate the application of the circular cumulant approach for thermodynamically large populations of phase elements, where the Ott-Antonsen properties are violated by a multiplicative intrinsic noise. The infinite cumulant equation chain is derived for the case of a sinusoidal sensitivity of the phase to noise. For inhomogeneous populations, a Lorentzian distribution of natural frequencies is adopted. Two-cumulant model reductions, which serve as a generalization of the Ott-Antonsen ansatz, are reported. The accuracy of these model reductions and the macroscopic collective dynamics of the system are explored for the case of a Kuramototype global coupling. The Ott-Antonsen ansatz and the Gaussian approximation are found to be not uniformly accurate for non-high frequencies.


title: A local input-to-state stability result w.r.t. attractors of nonlinear reaction-diffusion equations

abstract: We establish the local input-to-state stability of a large class of disturbed nonlinear reaction-diffusion equations w.r.t. the global attractor of the respective undisturbed system.


title: The dimension of the image of the Abel map associated with normal surface singularities

abstract: Let $(X,o)$ be a complex normal surface singularity with rational homology sphere link and let $\widetilde{X}$ be one of its good resolutions. Fix an effective cycle $Z$ supported on the exceptional curve and also a possible Chern class $l'\in H^2(\widetilde{X},\mathbb{Z})$. Define ${\rm Eca}^{l'}(Z)$ as the space of effective Cartier divisors on $Z$ and $c^{l'}(Z):{\rm Eca}^{l'}(Z)\to {\rm Pic}^{l'}(Z)$, the corresponding Abel map. In this note we provide two algorithms, which provide the dimension of the image of the Abel map. Usually, $\dim {\rm Pic}^{l'}(Z)=p_g$, $\dim\,{\rm Im} (c^{l'}(Z))$ and ${\rm codim}\,{\rm Im} (c^{l'}(Z))$ are not topological, they are in subtle relationship with cohomologies of certain line bundles. However, we provide combinatorial formulae for them whenever the analytic structure on $\widetilde{X}$ is generic. The ${\rm codim}\,{\rm Im} (c^{l'}(Z))$ is related with $\{h^1(\widetilde{X},\mathcal{L})\}_{\mathcal{L}\in {\rm Im} (c^{l'}(Z))}$; in order to treat the `twisted' family $\{h^1(\widetilde{X},\mathcal{L}_0\otimes \mathcal{L})\}_{\mathcal{L}\in {\rm Im} (c^{l'}(Z))}$ we need to elaborate a generalization of the Picard group and of the Abel map. The above algorithms are also generalized.


title: 2-knot homology and Roseman move

abstract: Ng constructed an invariant of knots in ${\mathbb{R}}^3$, a combinatorial knot contact homology. Extending his study, we construct an invariant of surface-knots in ${\mathbb{R}}^4$ using diagrams in ${\mathbb{R}}^3$.


title: Dirac and Lagrange algebraic constraints in nonlinear port-Hamiltonian systems

abstract: After recalling standard nonlinear port-Hamiltonian systems and their algebraic constraint equations, called here Dirac algebraic constraints, an extended class of port-Hamiltonian systems is introduced. This is based on replacing the Hamiltonian function by a general Lagrangian submanifold of the cotangent bundle of the state space manifold, motivated by developments in Barbero-Linan et al., and extending the linear theory as developed in Van der Schaft et al., Beattie et al.. The resulting new type of algebraic constraints equations are called Lagrange constraints. It is shown how Dirac algebraic constraints can be converted into Lagrange algebraic constraints by the introduction of extra state variables, and, conversely, how Lagrange algebraic constraints can be converted into Dirac algebraic constraints by the use of Morse families.


title: On the Hurwitz zeta function with an application to the beta-exponential distribution

abstract: We prove a monotonicity property of the Hurwitz zeta function which, in turn, translates into a chain of inequalities for polygamma functions of different orders. We provide a probabilistic interpretation of our result by exploiting a connection between Hurwitz zeta function and the cumulants of the beta-exponential distribution.


title: Towards phonon routing: Controlling propagating acoustic waves in the quantum regime

abstract: We explore routing of propagating phonons in analogy with previous experiments on photons. Surface acoustic waves (SAWs) in the microwave regime are scattered by a superconducting transmon qubit. The transmon can be tuned on or off resonance with the incident SAW field using an external magnetic field or the Autler-Townes effect, and thus the reflection and transmission of the SAW field can be controlled in time. We observe 80% extinction in the transmission of the low power continuous signal and a 40 ns rise time of the router. The slow propagation speed of SAWs on solid surfaces allows for in-flight manipulations of the propagating phonons. The ability to route short, 100 ns, pulses enables new functionality, for instance to catch an acoustic phonon between two qubits and then release it in a controlled direction.


title: Energy Dependence of Light Nuclei ($d$, $t$) Production at STAR

abstract: In high-energy nuclear collisions, the production of light nuclei is sensitive to the temperature and phase-space density of the system at freeze-out. In addition, the phase transition from QGP to the hadronic phase will lead to large baryon density fluctuation, which will be reflected in the light nuclei production. For example, the ratio of proton ($N(p)$) and triton ($N(t)$) to deuteron ($N(d)$) yields, which is defined as $N(t)$$\cdot$$N(p)$/$N^2(d)$, may be used as a sensitive observable to search for the QCD critical point. In this paper, we will report the energy dependence of light nuclei ($d$, $t$) production in Au+Au collisions at $\sqrt{s_{NN}}$ =7.7, 11.5, 14.5, 19.6, 27, 39, 62.4, and 200 GeV measured by the STAR experiment at RHIC. We will present the beam energy dependence for the coalescence parameter $B_2(d)$ and $B_3(t)$, particle ratios ($d/p$, $t/p$, and $t/d$), and the yield ratio of $N(t)$$\cdot$$N(p)$/$N^2(d)$. Their physics implications will be discussed.


title: Performance limitation of Si Nanowire solar cells: Effects of nanowire length and surface defects

abstract: In Si nanowire (SiNW) solar cells enhanced light confinement property in addition to decoupling of charge carrier collection and light absorption directions plays a significant role to resolve the draw backs of bulk Si solar cells. In this report we have studied the dependence of the phovoltaic properties of Si NW array solar cells on the SiNW length and enhanced surface defect states as a result of enhanced surface area of the NWs. The SiNW arrays have been fabricated using metal catalyzed electroless etching (MCEE) technique. p-n junction has been produced by spin-on-dopant technique followed by thermal diffusion process. Front and rear electrodes have been deposited by e-beam evaporation techniques. SiNW lengths have been controlled from ~ 320 nm to 6.4 micro meter by controlling the parameters of MCEE technique. Photovoltaic properties of the solar cells have been characterized by measuring quantum efficiency and photocurrent density vs. voltage characteristics. Morphological studies have been carried out by using scanning electron microscopy. Reduction in light trapping capability comes at the benefit of reduced surface defects. The reduction of surface defects has been proved to be more advantageous in comparison to the decrement of light trapping capability. The major contribution to the changes in cell efficiency comes from the enhancement of short circuit current density with a very weak dependence on open circuit voltage. This work is beneficial for the production commercial Si solar cell where SiNW arrays could be used as a antireflection coating instead of using separate antireflection layers and thus could reduced the production cost.


title: Eigenstate thermalization and ensemble equivalence in few-body fermionic systems

abstract: We investigate eigenstate thermalization from the point of view of vanishing particle and heat currents between a few-body fermionic Hamiltonian prepared in one of its eigenstates and an external, weakly coupled Fermi-Dirac gas. The latter acts as a thermometric probe, with its temperature and chemical potential set so that there is neither particle nor heat current between the two subsystems. We argue that the probe temperature can be attributed to the few-fermion eigenstate in the sense that (i) it varies smoothly with energy from eigenstate to eigenstate, (ii) it is equal to the temperature obtained from a thermodynamic relation in a wide energy range, (iii) it is independent of details of the coupling between the two systems in a finite parameter range, (iv) it satisfies the transitivity condition underlying the zeroth law of thermodynamics and (v) it is consistent with Carnot's theorem. These conditions are essentially independent of the interaction between the few fermions. When the interaction strength is weak, however, orbital occupancies in the few fermion system differ from the Fermi-Dirac distribution so that partial currents from or to the probe will eventually change its state. We find that (vi) above a certain critical interaction strength, orbital occupancies become close to the Fermi-Dirac distribution, leading to a true equilibrium between the few-fermion system and the probe. We conclude that for few-body systems with sufficiently strong interaction, the eigenstate thermalization hypothesis of Deutsch and Srednicki is complemented by ensemble equivalence: individual many-body eigenstates define a microcanonical ensemble that is equivalent to a canonical ensemble.


title: Multi-person Pose Tracking using Sequential Monte Carlo with Probabilistic Neural Pose Predictor

abstract: It is an effective strategy for the multi-person pose tracking task in videos to employ prediction and pose matching in a frame-by-frame manner. For this type of approach, uncertainty-aware modeling is essential because precise prediction is impossible. However, previous studies have relied on only a single prediction without incorporating uncertainty, which can cause critical tracking errors if the prediction is unreliable. This paper proposes an extension to this approach with Sequential Monte Carlo (SMC). This naturally reformulates the tracking scheme to handle multiple predictions (or hypotheses) of poses, thereby mitigating the negative effect of prediction errors. An important component of SMC, i.e., a proposal distribution, is designed as a probabilistic neural pose predictor, which can propose diverse and plausible hypotheses by incorporating epistemic uncertainty and heteroscedastic aleatoric uncertainty. In addition, a recurrent architecture is introduced to our neural modeling to utilize time-sequence information of poses to manage difficult situations, such as the frequent disappearance and reappearances of poses. Compared to existing baselines, the proposed method achieves a state-of-the-art MOTA score on the PoseTrack2018 validation dataset by reducing approximately 50% of tracking errors from a state-of-the art baseline method.


title: Flexibility of measure-theoretic entropy of boundary maps associated to Fuchsian groups

abstract: Given a closed, oriented, compact surface $S$ of constant negative curvature and genus $g \ge 2$, we study the measure-theoretic entropy of the Bowen-Series boundary map with respect to its smooth invariant measure. We obtain an explicit formula for the entropy that only depends on the perimeter of the $(8g-4)$-sided fundamental polygon of the surface $S$ and its genus. Using this, we analyze how the entropy changes in the Teichm\"uller space of $S$ and prove the following flexibility result: the measure-theoretic entropy takes all values between $0$ and a maximum that is achieved on the surface that admits a regular $(8g-4)$-sided fundamental polygon. We also compare the measure-theoretic entropy to the topological entropy of these maps and show that the smooth invariant measure is not the measure of maximal entropy.


title: Can shadows reflect phase structures of black holes?

abstract: The relation between the black hole shadow and the black hole thermodynamics is investigated. We find that the phase structure can be reflected by the shadow radius for the spherically symmetric black hole. We also find that the shadow size gives correct information but the distortion of the shadow gives wrong information of the phase structure for the axially symmetric black hole.


title: Discrimination of heavy elements originating from Pop III stars in z = 3 intergalactic medium

abstract: We investigate the distribution of metals in the cosmological volume at $z\sim3$, in particular, provided by massive population III (Pop III) stars using a cosmological $N$-body simulation in which a model of Pop III star formation is implemented. Owing to the simulation, we can choose minihaloes where Pop III star formation occurs at $z>10$ and obtain the spatial distribution of the metals at lower-redshifts. To evaluate the amount of heavy elements provided by Pop III stars, we consider metal yield of pair-instability or core-collapse supernovae (SNe) explosions of massive stars. By comparing our results to the Illustris-1 simulation, we find that heavy elements provided by Pop III stars often dominate those from galaxies in low density regions. The median value of the volume averaged metallicity is $Z\sim 10^{-4.5 - -2} Z_{\odot}$ at the regions. Spectroscopic observations with the next generation telescopes are expected to detect the metals imprinted on quasar spectra.


title: Study of the lateral distribution functions of electron and muon bundles using Trasgo detectors

abstract: Some of the main features of the new generation Trasgo detectors are their capability in measuring the incoming direction and the arrival time of secondary cosmic particles. They also offer the identification capability between muon and electrons and a rough calorimetry for electrons. Using ground-based stations, these properties allow for the development of new tools for the measurement of primary cosmic ray fluxes. In order to verify and quantify the suitability of Trasgo detectors, whether a single one or arrays of them, to provide reliable information of the properties (mass, energy, incoming direction) of primary cosmic rays we have started an initiative for the systematic study of the 'lateral distributions' displayed by electrons and muons, or by bundles of those particles, using MonteCarlo simulations. In a first approach, electrons and muons were produced in vertical showers from primary H, He, C and Fe nuclei, and with incoming energies limited to a maximum of 10$^{15}$ eV per nucleon. This choice represents a significant component of all secondary particles, which can be measured on Earth's surface. The lateral distributions study has been done at the two locations of Santiago de Compostela (Spain) and Livingston Island (Antarctica), where Trasgo detectors are either in operation, or will be operative in the near future.


title: Towards Distributed Logic Programming based on Computability Logic

abstract: {\em Computability logic} (CoL) is a powerful computational model which views computational problems as games played by a machine and its environment. In this paper, we show that CoL naturally supports multiagent programming models with distributed control. To be specific, we discuss a distributed logic programming model based on CoL (CL1 to be exact), which we call CL1^{\Omega}. The key feature of this model is that it supports $dynamic/evolving$ knowledgebase of an agent. This model turns out to be a promising approach to reaching both general AI and future computing model.


title: Weak forms of $\ddb-$Lemma on compact complex manifolds

abstract: This paper is devoted to give a complete unified study of several weak forms of $\ddb-$Lemma on compact complex manifolds.


title: Boosting Real-Time Driving Scene Parsing with Shared Semantics

abstract: Real-time scene parsing is a fundamental feature for autonomous driving vehicles with multiple cameras. In this letter we demonstrate that sharing semantics between cameras with different perspectives and overlapped views can boost the parsing performance when compared with traditional methods, which individually process the frames from each camera. Our framework is based on a deep neural network for semantic segmentation but with two kinds of additional modules for sharing and fusing semantics. On the one hand, a semantics sharing module is designed to establish the pixel-wise mapping between the input images. Features as well as semantics are shared by the map to reduce duplicated workload which leads to more efficient computation. On the other hand, feature fusion modules are designed to combine different modal of semantic features, which leverage the information from both inputs for better accuracy. To evaluate the effectiveness of the proposed framework, we have applied our network to a dual-camera vision system for driving scene parsing. Experimental results show that our network outperforms the baseline method on the parsing accuracy with comparable computations.


title: Toward a Blockchain-based Platform to Manage Cybersecurity Certification of IoT devices

abstract: The goal of this paper is to propose a blockchain-based platform to enhance transparency and traceability of cybersecurity certification information motivated by the recently adopted EU Cybersecurity Act. The proposed platform is generic and intended to support the trusted exchange of cybersecurity certification information for any electronic product, service, or process. However, for the purposes of this paper, we focus on the case study of the cybersecurity certification of IoT devices, which are explicitly referenced in the recently adopted Cybersecurity Act as one of the main domains where it is highlighted the need for an increased level of trust.


title: Bayesian Optimization under Heavy-tailed Payoffs

abstract: We consider black box optimization of an unknown function in the nonparametric Gaussian process setting when the noise in the observed function values can be heavy tailed. This is in contrast to existing literature that typically assumes sub-Gaussian noise distributions for queries. Under the assumption that the unknown function belongs to the Reproducing Kernel Hilbert Space (RKHS) induced by a kernel, we first show that an adaptation of the well-known GP-UCB algorithm with reward truncation enjoys sublinear $\tilde{O}(T^{\frac{2 + \alpha}{2(1+\alpha)}})$ regret even with only the $(1+\alpha)$-th moments, $\alpha \in (0,1]$, of the reward distribution being bounded ($\tilde{O}$ hides logarithmic factors). However, for the common squared exponential (SE) and Mat\'{e}rn kernels, this is seen to be significantly larger than a fundamental $\Omega(T^{\frac{1}{1+\alpha}})$ lower bound on regret. We resolve this gap by developing novel Bayesian optimization algorithms, based on kernel approximation techniques, with regret bounds matching the lower bound in order for the SE kernel. We numerically benchmark the algorithms on environments based on both synthetic models and real-world data sets.


title: Exact solutions for geodesic distance on treelike models with some constraints

abstract: Geodesic distance, commonly called shortest path length, has proved useful in a great variety of disciplines. It has been playing a significant role in search engine at present and so attracted considerable attention at the last few decades, particularly, almost all data structures and corresponding algorithms suitable to searching information generated based on treelike models. Hence, we, in this paper, study in detail geodesic distance on some treelike models which can be generated by three different types of operations, including first-order subdivision, ($1,m$)-star-fractal operation and $m$-vertex-operation. Compared to the most best used approaches for calculating geodesic distance on graphs, for instance, enumeration method and matrix multiplication, we take useful advantage of a novel method consisting in spirit of the concept of vertex cover in the language of graph theory and mapping. For each kind of treelike model addressed here, we certainly obtain an exact solution for its geodesic distance using our method. With the help of computer simulations, we confirm that the analytical results are in perfect agreement with simulations. In addition, we also report some intriguing structure properties on treelike models of two types among them. The one obeys exponential degree distribution seen in many complex networks, by contrast, the other possesses all but leaf vertices with identical degree and shows more homogeneous topological structure than the former. Besides that, the both have, in some sense, self-similar feature but instead the latter exhibits fractal property.


title: Microstructure synthesis using style-based generative adversarial network

abstract: Work considers the usage of StyleGAN architecture for the task of microstructure synthesis. The task is the following: given number of samples of structure we try to generate similar samples at the same time preserving its properties. Since the considered architecture is not able to produce samples of sizes larger than the training images, we propose to use image quilting to merge fixed-sized samples. One of the key features of the considered architecture is that it uses multiple image resolutions. We also investigate the necessity of such an approach.


title: $360^o$ Surface Regression with a Hyper-Sphere Loss

abstract: Omnidirectional vision is becoming increasingly relevant as more efficient $360^o$ image acquisition is now possible. However, the lack of annotated $360^o$ datasets has hindered the application of deep learning techniques on spherical content. This is further exaggerated on tasks where ground truth acquisition is difficult, such as monocular surface estimation. While recent research approaches on the 2D domain overcome this challenge by relying on generating normals from depth cues using RGB-D sensors, this is very difficult to apply on the spherical domain. In this work, we address the unavailability of sufficient $360^o$ ground truth normal data, by leveraging existing 3D datasets and remodelling them via rendering. We present a dataset of $360^o$ images of indoor spaces with their corresponding ground truth surface normal, and train a deep convolutional neural network (CNN) on the task of monocular 360 surface estimation. We achieve this by minimizing a novel angular loss function defined on the hyper-sphere using simple quaternion algebra. We put an effort to appropriately compare with other state of the art methods trained on planar datasets and finally, present the practical applicability of our trained model on a spherical image re-lighting task using completely unseen data by qualitatively showing the promising generalization ability of our dataset and model. The dataset is available at: vcl3d.github.io/HyperSphereSurfaceRegression.


title: Flare Activity and Magnetic Feature Analysis of the Flare Stars

abstract: We analyze the light curve of 1740 flare stars to study the relationship between the magnetic feature characteristics and the identified flare activity. Coverage and stability of magnetic features are inspired by rotational modulation of light curve variations and flare activity of stars are obtained using our automated flare detection algorithm. The results show that (i) Flare time occupation ratio (or flare frequency) and total power of flares increase by increasing relative magnetic feature coverage and contrast in F-M type stars (ii) Magnetic feature stability is highly correlated with the coverage and the contrast of the magnetic structures as this is the case for the Sun (iii) Stability, coverage and contrast of the magnetic features, time occupation ratio and total power of flares increases for G, K and M-type stars by decreasing Rossby number due to the excess of produced magnetic field from dynamo procedure until reaching to saturation level.