title: About the possibility of an international ground-based Very High Energy particle detector experiment in Ecuador

abstract: We discuss the possibility of hosting a big Astrophysics ground-based experiment in Ecuador aimed to detect VHE particles. Ecuador location makes possible to see both the Northern and Southern sky. An additional geographic feature is the presence of one of the highest American mountains, the Chimborazo (6310 m.a.s.l.), that happen to be the highest point on Earth measured from the center of the planet. In the last decade Ecuadorian government has invested resources in higher education and research, with an important policy of training abroad. The effect has been that now many researchers in Physics, Astrophysics, and Engineering are working in universities across the country and collaborating with important experiments like CMS at CERN, Pierre Auger in Argentina, HAWK in Mexico and in LAGO project. All these features make Ecuador an ideal place to host a big VHE particle detector experiment in South America.


title: Continued Fractions and Factoring

abstract: Legendre found that the continued fraction expansion of $\sqrt N$ having odd period leads directly to an explicit representation of $N$ as the sum of two squares. Similarly, it is shown here that the continued fraction expansion of $\sqrt N$ having even period directly produces a factor of a composite $N$. Shanks' infrastructural method is then revisited, and some consequences of its application to factorization by means of the continued fraction expansion of $\sqrt N$ are derived.


title: Modeling treatment events in disease progression

abstract: Ability to quantify and predict progression of a disease is fundamental for selecting an appropriate treatment. Many clinical metrics cannot be acquired frequently either because of their cost (e.g. MRI, gait analysis) or because they are inconvenient or harmful to a patient (e.g. biopsy, x-ray). In such scenarios, in order to estimate individual trajectories of disease progression, it is advantageous to leverage similarities between patients, i.e. the covariance of trajectories, and find a latent representation of progression. Most of existing methods for estimating trajectories do not account for events in-between observations, what dramatically decreases their adequacy for clinical practice. In this study, we develop a machine learning framework named Coordinatewise-Soft-Impute (CSI) for analyzing disease progression from sparse observations in the presence of confounding events. CSI is guaranteed to converge to the global minimum of the corresponding optimization problem. Experimental results also demonstrates the effectiveness of CSI using both simulated and real dataset.


title: Interactive Differentiable Simulation

abstract: Intelligent agents need a physical understanding of the world to predict the impact of their actions in the future. While learning-based models of the environment dynamics have contributed to significant improvements in sample efficiency compared to model-free reinforcement learning algorithms, they typically fail to generalize to system states beyond the training data, while often grounding their predictions on non-interpretable latent variables. We introduce Interactive Differentiable Simulation (IDS), a differentiable physics engine, that allows for efficient, accurate inference of physical properties of rigid-body systems. Integrated into deep learning architectures, our model is able to accomplish system identification using visual input, leading to an interpretable model of the world whose parameters have physical meaning. We present experiments showing automatic task-based robot design and parameter estimation for nonlinear dynamical systems by automatically calculating gradients in IDS. When integrated into an adaptive model-predictive control algorithm, our approach exhibits orders of magnitude improvements in sample efficiency over model-free reinforcement learning algorithms on challenging nonlinear control domains.


title: Dynamical Casimir effect via four- and five-photon transitions using a strongly detuned atom

abstract: The scenario of a single-mode cavity with harmonically modulated frequency is revisited in the presence of strongly detuned qubit or cyclic qutrit. It is found that when the qubit frequency is close to $3\nu $ there is a peak in the photon generation rate via four-photon transitions for the modulation frequency $4\nu $, where $\nu $ is the average cavity frequency. Effective five-photon processes can occur for the modulation frequency $5\nu $ in the presence of a cyclic qutrit, and the corresponding transition rates exhibit series of peaks. Closed analytical description is derived for the unitary evolution, and numeric simulations indicate the feasibility of multi-photon dynamical Casimir effect under weak dissipation.


title: Underwater Fish Detection with Weak Multi-Domain Supervision

abstract: Given a sufficiently large training dataset, it is relatively easy to train a modern convolution neural network (CNN) as a required image classifier. However, for the task of fish classification and/or fish detection, if a CNN was trained to detect or classify particular fish species in particular background habitats, the same CNN exhibits much lower accuracy when applied to new/unseen fish species and/or fish habitats. Therefore, in practice, the CNN needs to be continuously fine-tuned to improve its classification accuracy to handle new project-specific fish species or habitats. In this work we present a labelling-efficient method of training a CNN-based fish-detector (the Xception CNN was used as the base) on relatively small numbers (4,000) of project-domain underwater fish/no-fish images from 20 different habitats. Additionally, 17,000 of known negative (that is, missing fish) general-domain (VOC2012) above-water images were used. Two publicly available fish-domain datasets supplied additional 27,000 of above-water and underwater positive/fish images. By using this multi-domain collection of images, the trained Xception-based binary (fish/not-fish) classifier achieved 0.17% false-positives and 0.61% false-negatives on the project's 20,000 negative and 16,000 positive holdout test images, respectively. The area under the ROC curve (AUC) was 99.94%.


title: Demand Forecasting from Spatiotemporal Data with Graph Networks and Temporal-Guided Embedding

abstract: Short-term demand forecasting models commonly combine convolutional and recurrent layers to extract complex spatiotemporal patterns in data. Long-term histories are also used to consider periodicity and seasonality patterns as time series data. In this study, we propose an efficient architecture, Temporal-Guided Network (TGNet), which utilizes graph networks and temporal-guided embedding. Graph networks extract invariant features to permutations of adjacent regions instead of convolutional layers. Temporal-guided embedding explicitly learns temporal contexts from training data and is substituted for the input of long-term histories from days/weeks ago. TGNet learns an autoregressive model, conditioned on temporal contexts of forecasting targets from temporal-guided embedding. Finally, our model achieves competitive performances with other baselines on three spatiotemporal demand dataset from real-world, but the number of trainable parameters is about 20 times smaller than a state-of-the-art baseline. We also show that temporal-guided embedding learns temporal contexts as intended and TGNet has robust forecasting performances even to atypical event situations.


title: Fixing Bias in Reconstruction-based Anomaly Detection with Lipschitz Discriminators

abstract: Anomaly detection is of great interest in fields where abnormalities need to be identified and corrected (e.g., medicine and finance). Deep learning methods for this task often rely on autoencoder reconstruction error, sometimes in conjunction with other errors. We show that this approach exhibits intrinsic biases that lead to undesirable results. Reconstruction-based methods are sensitive to training-data outliers and simple-to-reconstruct points. Instead, we introduce a new unsupervised Lipschitz anomaly discriminator that does not suffer from these biases. Our anomaly discriminator is trained, similar to the ones used in GANs, to detect the difference between the training data and corruptions of the training data. We show that this procedure successfully detects unseen anomalies with guarantees on those that have a certain Wasserstein distance from the data or corrupted training set. These additions allow us to show improved performance on MNIST, CIFAR10, and health record data.


title: DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstruction

abstract: Reconstructing 3D shapes from single-view images has been a long-standing research problem. In this paper, we present DISN, a Deep Implicit Surface Network which can generate a high-quality detail-rich 3D mesh from an 2D image by predicting the underlying signed distance fields. In addition to utilizing global image features, DISN predicts the projected location for each 3D point on the 2D image, and extracts local features from the image feature maps. Combining global and local features significantly improves the accuracy of the signed distance field prediction, especially for the detail-rich areas. To the best of our knowledge, DISN is the first method that constantly captures details such as holes and thin structures present in 3D shapes from single-view images. DISN achieves the state-of-the-art single-view reconstruction performance on a variety of shape categories reconstructed from both synthetic and real images. Code is available at https://github.com/xharlie/DISN The supplementary can be found at https://xharlie.github.io/images/neurips_2019_supp.pdf


title: A nanoscale vacuum-tube diode triggered by few-cycle laser pulses

abstract: We propose and demonstrate a nanoscale vacuum-tube diode triggered by few-cycle near-infrared laser pulses. It represents an ultrafast electronic device based on light fields, exploiting near-field optical enhancement at surfaces of two metal nanotips. The sharper of the two tips displays a stronger field-enhancement, resulting in larger photoemission yields at its surface. One laser pulse with a peak intensity of $4.7\times 10^{11}$ W/cm$^2$ triggers photoemission of ${\sim }16$ electrons from the sharper cathode tip, while emission from the blunter anode tip is suppressed by $19$ dB to ${\sim }0.2$ electrons per pulse. Thus, the laser-triggered current between two tips exhibit a rectifying behavior, in analogy to classical vacuum-tube diodes. According to the kinetic energy of the emitted electrons and the distance between tips, the total operation time of this laser-triggered nanoscale diode is estimated to be below 1 ps.


title: Field-aware Calibration: A Simple and Empirically Strong Method for Reliable Probabilistic Predictions

abstract: It is often observed that the probabilistic predictions given by a machine learning model can disagree with averaged actual outcomes on specific subsets of data, which is also known as the issue of miscalibration. It is responsible for the unreliability of practical machine learning systems. For example, in online advertising, an ad can receive a click-through rate prediction of 0.1 over some population of users where its actual click rate is 0.15. In such cases, the probabilistic predictions have to be fixed before the system can be deployed. In this paper, we first introduce a new evaluation metric named field-level calibration error that measures the bias in predictions over the sensitive input field that the decision-maker concerns. We show that existing post-hoc calibration methods have limited improvements in the new field-level metric and other non-calibration metrics such as the AUC score. To this end, we propose Neural Calibration, a simple yet powerful post-hoc calibration method that learns to calibrate by making full use of the field-aware information over the validation set. We present extensive experiments on five large-scale datasets. The results showed that Neural Calibration significantly improves against uncalibrated predictions in common metrics such as the negative log-likelihood, Brier score and AUC, as well as the proposed field-level calibration error.


title: Dual Averaging Method for Online Graph-structured Sparsity

abstract: Online learning algorithms update models via one sample per iteration, thus efficient to process large-scale datasets and useful to detect malicious events for social benefits, such as disease outbreak and traffic congestion on the fly. However, existing algorithms for graph-structured models focused on the offline setting and the least square loss, incapable for online setting, while methods designed for online setting cannot be directly applied to the problem of complex (usually non-convex) graph-structured sparsity model. To address these limitations, in this paper we propose a new algorithm for graph-structured sparsity constraint problems under online setting, which we call \textsc{GraphDA}. The key part in \textsc{GraphDA} is to project both averaging gradient (in dual space) and primal variables (in primal space) onto lower dimensional subspaces, thus capturing the graph-structured sparsity effectively. Furthermore, the objective functions assumed here are generally convex so as to handle different losses for online learning settings. To the best of our knowledge, \textsc{GraphDA} is the first online learning algorithm for graph-structure constrained optimization problems. To validate our method, we conduct extensive experiments on both benchmark graph and real-world graph datasets. Our experiment results show that, compared to other baseline methods, \textsc{GraphDA} not only improves classification performance, but also successfully captures graph-structured features more effectively, hence stronger interpretability.


title: Graph Attention Auto-Encoders

abstract: Auto-encoders have emerged as a successful framework for unsupervised learning. However, conventional auto-encoders are incapable of utilizing explicit relations in structured data. To take advantage of relations in graph-structured data, several graph auto-encoders have recently been proposed, but they neglect to reconstruct either the graph structure or node attributes. In this paper, we present the graph attention auto-encoder (GATE), a neural network architecture for unsupervised representation learning on graph-structured data. Our architecture is able to reconstruct graph-structured inputs, including both node attributes and the graph structure, through stacked encoder/decoder layers equipped with self-attention mechanisms. In the encoder, by considering node attributes as initial node representations, each layer generates new representations of nodes by attending over their neighbors' representations. In the decoder, we attempt to reverse the encoding process to reconstruct node attributes. Moreover, node representations are regularized to reconstruct the graph structure. Our proposed architecture does not need to know the graph structure upfront, and thus it can be applied to inductive learning. Our experiments demonstrate competitive performance on several node classification benchmark datasets for transductive and inductive tasks, even exceeding the performance of supervised learning baselines in most cases.


title: Algorithmic and geometric aspects of data depth with focus on $\beta$-skeleton depth

abstract: The statistical rank tests play important roles in univariate non-parametric data analysis. If one attempts to generalize the rank tests to a multivariate case, the problem of defining a multivariate order will occur. It is not clear how to define a multivariate order or statistical rank in a meaningful way. One approach to overcome this problem is to use the notion of data depth which measures the centrality of a point with respect to a given data set. In other words, a data depth can be applied to indicate how deep a point is located with respect to a given data set. Using data depth, a multivariate order can be defined by ordering the data points according to their depth values. Various notions of data depth have been introduced over the last decades. In this thesis, we discuss three depth functions: two well-known depth functions halfspace depth and simplicial depth, and one recently defined depth function named as $\beta$-skeleton depth, $\beta\geq 1$. The $\beta$-skeleton depth is equivalent to the previously defined spherical depth and lens depth when $\beta=1$ and $\beta=2$, respectively. Our main focus in this thesis is to explore the geometric and algorithmic aspects of $\beta$-skeleton depth.


title: Black Hole Spin Signature in the Black Hole Shadow of M87 in the Flaring State

abstract: Imaging the immediate vicinity of supermassive black holes (SMBH) and extracting a BH-spin signature is one of the grand challenges in astrophysics. M87 is known as one of the best targets for imaging the BH shadow and it can be partially thick against synchrotron self-absorption (SSA), particularly in a flaring state with high mass accretion rate. However, little is known about influences of the SSA-thick region on BH shadow images. Here we investigate BH shadow images of M87 at 230 GHz properly taking into account the SSA-thick region. When the BH has a high spin value, the corresponding BH shadow image shows the positional offset between the center of the photon ring and that of the SSA-thick ring at the innermost stable circular orbit (ISCO) due to the frame-dragging effect in the Kerr spacetime. As a result, we find that a dark-crescent structure is generally produced between the photon ring and the SSA-thick ISCO ring in the BH shadow image. The scale size of the dark-crescent increase with BH spin: its width reaches up to $\sim 2$ gravitational radius when the BH spin is 99.8% of its maximum value. The dark crescent is regarded as a new signature of a highly spinning BH. This feature is expected to appear in flaring states with relatively high mass accretion rate rather than the quiescent states. We have simulated the image reconstruction of our theoretical image by assuming the current and future Event Horizon Telescope (EHT) array, and have found that the future EHT including space-very long baseline interferometry in 2020s can detect the dark crescent.


title: Hashing based Answer Selection

abstract: Answer selection is an important subtask of question answering (QA), where deep models usually achieve better performance. Most deep models adopt question-answer interaction mechanisms, such as attention, to get vector representations for answers. When these interaction based deep models are deployed for online prediction, the representations of all answers need to be recalculated for each question. This procedure is time-consuming for deep models with complex encoders like BERT which usually have better accuracy than simple encoders. One possible solution is to store the matrix representation (encoder output) of each answer in memory to avoid recalculation. But this will bring large memory cost. In this paper, we propose a novel method, called hashing based answer selection (HAS), to tackle this problem. HAS adopts a hashing strategy to learn a binary matrix representation for each answer, which can dramatically reduce the memory cost for storing the matrix representations of answers. Hence, HAS can adopt complex encoders like BERT in the model, but the online prediction of HAS is still fast with a low memory cost. Experimental results on three popular answer selection datasets show that HAS can outperform existing models to achieve state-of-the-art performance.


title: Regularity of bounded tri-linear and the fourth adjiont of tri-derivation

abstract: In this Article, we give a simple criterion for the regularity of a tri-linear mapping. We provide if $f:X\times Y\times Z\longrightarrow W $ is a bounded tri-linear mapping and $h:W\longrightarrow S$ is a bounded linear mapping, then $f$ is regular if and only if $hof$ is regular. We also shall give some necessary and sufficient conditions such the fourth adjoint $D^{***}$ of a tri-derivation $D$ is again tri-derivation.


title: Gated Group Self-Attention for Answer Selection

abstract: Answer selection (answer ranking) is one of the key steps in many kinds of question answering (QA) applications, where deep models have achieved state-of-the-art performance. Among these deep models, recurrent neural network (RNN) based models are most popular, typically with better performance than convolutional neural network (CNN) based models. Nevertheless, it is difficult for RNN based models to capture the information about long-range dependency among words in the sentences of questions and answers. In this paper, we propose a new deep model, called gated group self-attention (GGSA), for answer selection. GGSA is inspired by global self-attention which is originally proposed for machine translation and has not been explored in answer selection. GGSA tackles the problem of global self-attention that local and global information cannot be well distinguished. Furthermore, an interaction mechanism between questions and answers is also proposed to enhance GGSA by a residual structure. Experimental results on two popular QA datasets show that GGSA can outperform existing answer selection models to achieve state-of-the-art performance. Furthermore, GGSA can also achieve higher accuracy than global self-attention for the answer selection task, with a lower computation cost.


title: Extension of order bounded operators

abstract: Assume that a normed lattice $E$ is order dense majorizing of a vector lattice $E^t$. There is an extension norm $\Vert.\Vert_t$ for $E^t$ and we extend some lattice and topological properties of normed lattice $(E,\Vert.\Vert)$ to new normed lattice $(E^t,\Vert.\Vert_t$). For a Dedekind complete Banach lattice $F$, $T^t$ is an extension of $T$ from $E^t$ into $F$ whenever $T$ is an order bounded operator from $E$ into $F$. For each positive operator $T$, we have $\Vert T\Vert=\Vert T^t\Vert$ and we show that $T^t$ is a lattice homomorphism from $E^t$ into $F$ and moreover $T^t\in \mathcal{L}_n(E^t,F)$ whenever $0\leq T\in \mathcal{L}_n(E,F)$ and $T(x\wedge y)=Tx \wedge Ty$ for each $0\leq x,y\in E$. We also extend some lattice and topological properties of $T\in \mathcal{L}_b(E,F)$ to the extension operator $T^t\in \mathcal{L}_b(E^t,F)$.


title: A geometric property of closed geodesics on hyperbolic surfaces

abstract: We study closed geodesics on hyperbolic surfaces, and give bounds for their angles of intersection and self-intersection, and for the sides of the polygons that they form, depending only on the lengths of the geodesics


title: TEE-aided Write Protection Against Privileged Data Tampering

abstract: Unauthorized data alteration has been a longstanding threat since the emergence of malware. System and application software can be reinstalled and hardware can be replaced, but user data is priceless in many cases. Especially in recent years, ransomware has become high-impact due to its direct monetization model. State-of-the-art defenses are mostly based on known signature or behavior analysis, and more importantly, require an uncompromised OS kernel. However, malware with the highest software privileges has shown its obvious existence. We propose to move from current detection/recovery based mechanisms to data loss prevention, where the focus is on armoring data instead of counteracting malware. Our solution, Inuksuk, relies on today's Trusted Execution Environments (TEEs), as available both on the CPU and storage device, to achieve programmable write protection. We back up a copy of user-selected files as write-protected at all times, and subsequent updates are written as new versions securely through TEE. We implement Inuksuk on Windows 7 and 10, and Linux (Ubuntu); our core design is OS and application agnostic, and incurs no run-time performance penalty for applications. File transfer disruption can be eliminated or alleviated through access modes and customizable update policies (e.g., interval, granularity). For Inuksuk's adoptability in modern OSes, we have also ported Flicker (EuroSys 2008), a defacto standard tool for in-OS privileged TEE management, to the latest 64-bit Windows.


title: Empirical determination of the simulation capacity of a near-term quantum computer

abstract: Experimentally realizable quantum computers are rapidly approaching the threshold of quantum supremacy. Quantum Hamiltonian simulation promises to be one of the first practical applications for which such a device could demonstrate an advantage over all classical systems. However, these early devices will inevitably remain both noisy and small, precluding the use of quantum error correction. We use high-performance classical tools to construct, optimize, and simulate quantum circuits subject to realistic error models in order to empirically determine the "simulation capacity" of near-term simulation experiments implemented via quantum signal processing (QSP), describing the relationship between simulation time, system size, and resolution of QSP circuits which are optimally configured to balance algorithmic precision and external noise. From simulation capacity models, we estimate maximum tolerable error rate for meaningful simulation experiments on a near-term quantum computer. By exploiting symmetry inherent to the QSP circuit, we further demonstrate that its capacity for quantum simulation can be increased by at least two orders of magnitude if errors are systematic and unitary. We find that a device with $\epsilon^2=10^{-5}$ systematic amplitude errors could meaningfully simulate systems up to $n\approx16$ with an expected failure rate below $10\%$, whereas the largest system a device with a stochastic error rate of $p_\epsilon=10^{-5}$ could meaningfully simulate with the same rate of failure is between $n=3$ and $n=5$ (depending on the stochastic channel). Extrapolating from empirical results, we estimate that one would typically need a stochastic error rate below $p_\epsilon=10^{-8}$ to perform a meaningful $n=50$ simulation experiment with a failure rate below $10\%$, while the same experiment could tolerate systematic unitary errors with strength $\epsilon^2\approx10^{-6}$.


title: Efficient Weingarten Map and Curvature Estimation on Manifolds

abstract: In this paper, we propose an efficient method to estimate the Weingarten map for point cloud data sampled from manifold embedded in Euclidean space. A statistical model is established to analyze the asymptotic property of the estimator. In particular, we show the convergence rate as the sample size tends to infinity. We verify the convergence rate through simulated data and apply the estimated Weingarten map to curvature estimation and point cloud simplification to multiple real data sets.


title: SemBleu: A Robust Metric for AMR Parsing Evaluation

abstract: Evaluating AMR parsing accuracy involves comparing pairs of AMR graphs. The major evaluation metric, SMATCH (Cai and Knight, 2013), searches for one-to-one mappings between the nodes of two AMRs with a greedy hill-climbing algorithm, which leads to search errors. We propose SEMBLEU, a robust metric that extends BLEU (Papineni et al., 2002) to AMRs. It does not suffer from search errors and considers non-local correspondences in addition to local ones. SEMBLEU is fully content-driven and punishes situations where a system's output does not preserve most information from the input. Preliminary experiments on both sentence and corpus levels show that SEMBLEU has slightly higher consistency with human judgments than SMATCH. Our code is available at http://github.com/freesunshine0316/sembleu.


title: Crystallization seeds favour crystallization only during initial growth

abstract: Crystallization represents the prime example of a disorder order transition. In realistic situations, however, container walls and impurities are frequently present and hence crystallization is heterogeneously seeded. Rarely the seeds are perfectly compatible with the thermodynamically favoured crystal structure and thus induce elastic distortions, which impede further crystal growth. Here we use a colloidal model system, which not only allows us to quantitatively control the induced distortions but also to visualize and follow heterogeneous crystallization with single-particle resolution. We determine the sequence of intermediate structures by confocal microscopy and computer simulations, and develop a theoretical model that describes our findings. The crystallite first grows on the seed but then, on reaching a critical size, detaches from the seed. The detached and relaxed crystallite continues to grow, except close to the seed, which now prevents crystallization. Hence, crystallization seeds facilitate crystallization only during initial growth and then act as impurities.


title: Programming with Applicative-like expressions

abstract: The fact that Applicative type class allows one to express simple parsers in a variable-less combinatorial style is well appreciated among Haskell programmers for its conceptual simplicity, ease of use, and usefulness for semi-automated code generation (metaprogramming). We notice that such Applicative computations can be interpreted as providing a mechanism to construct a data type with "ports" "pluggable" by subcomputations. We observe that it is this property that makes them so much more convenient in practice than the usual way of building the same computations using conventional composition. We distill this observation into a more general algebraic structure of (and/or technique for expressing) "Applicative-like" computations and demonstrate several other instances of this structure. Our interest in all of this comes from the fact that the aforementioned instances allow us to express arbitrary transformations between simple data types of a single constructor (similarly to how Applicative parsing allows to transform from streams of Chars to such data types) using a style that closely follows conventional Applicative computations, thus greatly simplifying (if not completely automating away) a lot of boiler-plate code present in many functional programs.


title: Purifying Adversarial Perturbation with Adversarially Trained Auto-encoders

abstract: Machine learning models are vulnerable to adversarial examples. Iterative adversarial training has shown promising results against strong white-box attacks. However, adversarial training is very expensive, and every time a model needs to be protected, such expensive training scheme needs to be performed. In this paper, we propose to apply iterative adversarial training scheme to an external auto-encoder, which once trained can be used to protect other models directly. We empirically show that our model outperforms other purifying-based methods against white-box attacks, and transfers well to directly protect other base models with different architectures.


title: Deep Learning-Enhanced Variational Monte Carlo Method for Quantum Many-Body Physics

abstract: Artificial neural networks have been successfully incorporated into variational Monte Carlo method (VMC) to study quantum many-body systems. However, there have been few systematic studies of exploring quantum many-body physics using deep neural networks (DNNs), despite of the tremendous success enjoyed by DNNs in many other areas in recent years. One main challenge of implementing DNN in VMC is the inefficiency of optimizing such networks with large number of parameters. We introduce an importance sampling gradient optimization (ISGO) algorithm, which significantly improves the computational speed of training DNN in VMC. We design an efficient convolutional DNN architecture to compute the ground state of a one-dimensional (1D) SU($N$) spin chain. Our numerical results of the ground-state energies with up to 16 layers of DNN show excellent agreement with the Bethe-Ansatz exact solution. Furthermore, we also calculate the loop correlation function using the wave function obtained. Our work demonstrates the feasibility and advantages of applying DNNs to numerical quantum many-body calculations.


title: Multiuser MISO UAV Communications in Uncertain Environments with No-fly Zones: Robust Trajectory and Resource Allocation Design

abstract: In this paper, we investigate robust resource allocation algorithm design for multiuser downlink multiple-input single-output (MISO) unmanned aerial vehicle (UAV) communication systems, where we account for the various uncertainties that are unavoidable in such systems and, if left unattended, may severely degrade system performance. We jointly optimize the two-dimensional (2-D) trajectory and the transmit beamforming vector of the UAV for minimization of the total power consumption. The algorithm design is formulated as a non-convex optimization problem taking into account the imperfect knowledge of the angle of departure (AoD) caused by UAV jittering, user location uncertainty, wind speed uncertainty, and polygonal no-fly zones (NFZs). Despite the non-convexity of the optimization problem, we solve it optimally by employing monotonic optimization theory and semidefinite programming relaxation which yields the optimal 2-D trajectory and beamforming policy. Since the developed optimal resource allocation algorithm entails a high computational complexity, we also propose a suboptimal iterative low-complexity scheme based on successive convex approximation to strike a balance between optimality and computational complexity. Our simulation results reveal not only the significant power savings enabled by the proposed algorithms compared to two baseline schemes, but also confirm their robustness with respect to UAV jittering, wind speed uncertainty, and user location uncertainty. Moreover, our results unveil that the joint presence of wind speed uncertainty and NFZs has a considerable impact on the UAV trajectory. Nevertheless, by counteracting the wind speed uncertainty with the proposed robust design, we can simultaneously minimize the total UAV power consumption and ensure a secure trajectory that does not trespass any NFZ.


title: Characterizations of a class of Pilipovi{\'c} spaces by powers of harmonic oscillator

abstract: We show that a smooth function $f$ on $\mathbf R^d$ belongs to the Pilipovi{\'c} space $\mathcal H_{\flat _\sigma}(\mathbf R^d)$ or the Pilipovi{\'c} space $\mathcal H_{0,\flat _\sigma}(\mathbf R^d)$, if and only if the $L^p$ norm of $H_d^Nf$ for $N\ge 0$, satisfy certain types of estimates. Here $H_d=|x|^2-\Delta _x$ is the harmonic oscillator.


title: A unified construction for series representations and finite approximations of completely random measures

abstract: Infinite-activity completely random measures (CRMs) have become important building blocks of complex Bayesian nonparametric models. They have been successfully used in various applications such as clustering, density estimation, latent feature models, survival analysis or network science. Popular infinite-activity CRMs include the (generalized) gamma process and the (stable) beta process. However, except in some specific cases, exact simulation or scalable inference with these models is challenging and finite-dimensional approximations are often considered. In this work, we propose a general and unified framework to derive both series representations and finite-dimensional approximations of CRMs. Our framework can be seen as an extension of constructions based on size-biased sampling of Poisson point process [Perman1992]. It includes as special cases several known series representations as well as novel ones. In particular, we show that one can get novel series representations for the generalized gamma process and the stable beta process. We also provide some analysis of the truncation error.


title: Electric circuit simulations of $n$th-Chern insulators in $2n$-dimensional space and their non-Hermitian generalizations for arbitral $n$

abstract: We show that topological phases of the Dirac system in arbitral even dimensional space are simulated by $LC$ electric circuits with operational amplifiers. The lattice Hamiltonian for the hypercubic lattice in $2n$ dimensional space is characterized by the $n$-th Chern number. The boundary state is described by the Weyl theory in $2n-1$ dimensional space. They are well observed by measuring the admittance spectrum. They are different from the disentangled $n$-th Chern insulators previously reported, where the $n$-th Chern number is a product of the first Chern numbers. The results are extended to non-Hermitian systems with complex Dirac masses. The non-Hermitian $n$-th Chern number remains to be quantized for the complex Dirac mass.


title: Two-body bound state of ultracold Fermi atoms with two-dimensional spin-orbit coupling

abstract: In a recent experiment, a two-dimensional spin-orbit coupling (SOC) was realized for fermions in the continuum [Nat. Phys. 12, 540 (2016)], which represents an important step forward in the study of synthetic gauge field using cold atoms. In the experiment, it was shown that a Raman-induced two-dimensional SOC exists in the dressed-state basis close to a Dirac point of the single-particle spectrum. By contrast, the short-range inter-atomic interactions of the system are typically expressed in the hyperfine-spin basis. The interplay between synthetic SOC and interactions can potentially lead to interesting few- and many-body phenomena but has so far eluded theoretical attention. Here we study in detail properties of two-body bound states of such a system. We find that, due to the competition between SOC and interaction, the stability region of the two-body bound state is in general reduced. Particularly, the threshold of the lowest two-body bound state is shifted to a positive, SOC-dependent scattering length. Furthermore, the center-of-mass momentum of the lowest two-body bound state becomes nonzero, suggesting the emergence of Fulde-Ferrell pairing states in a many-body setting. Our results reveal the critical difference between the experimentally realized two-dimensional SOC and the more symmetric Rashba or Dresselhaus SOCs in an interacting system, and paves the way for future characterizations of topological superfluid states in the experimentally relevant systems.


title: The semigroup of star partial homeomorphisms of a finite deminsional Euclidean space

abstract: In the paper the notion of a star partial homeomorphism of a finite dimensional Euclidean space $\mathbb{R}^n$ is introduced. We describe the structure of the semigroup $\mathbf{PStH}_{\mathbb{R}^n}$ of star partial homeomorphisms of the space $\mathbb{R}^n.$ The structure of the band of $\mathbf{PStH}_{\mathbb{R}^n}$ and Green's relations on $\mathbf{PStH}_{\mathbb{R}^n}$ are described. We show that $\mathbf{PStH}_{\mathbb{R}^n}$ is a bisimple inverse semigroup and every non-unit congruence on $\mathbf{PStH}_{\mathbb{R}^n}$ is a group congruence.


title: Revisiting Feller Diffusion: Derivation and Simulation

abstract: We propose a simpler derivation of the probability density function of Feller Diffusion using the Fourier Transform and solving the resulting equation via the Method of Characteristics. We also discuss simulation algorithms and confirm key properties related to hitting time probabilities via the simulation.


title: Interacting Urns on a Finite Directed Graph

abstract: We introduce a general two colour interacting urn model on a finite directed graph, where each urn at a node, reinforces all the urns in its out-neighbours according to a fixed, non-negative and balanced reinforcement matrix. We show that the fraction of balls of either colour converges almost surely to a deterministic limit if either the reinforcement is not of P\'olya type or if the graph is such that every vertex with non-zero in-degree can be reached from some vertex with zero in-degree. We also obtain joint central limit theorems, with appropriate scaling, around the vector of limiting proportion. Further, in the remaining case when there are no vertices with zero in-degree and the reinforcement is of P\'olya type, we restrict our analysis to a regular graph and show that the fraction of balls of either colour converges almost surely to a finite random limit, which is the same across all the urns.


title: Connecting galaxy structure and star formation: the role of environment in formation of S0 galaxies

abstract: In this work, we investigate the reason behind the increased occurrence of S0 galaxies in high density environments. Our sample comprises of $\sim$ 2500 spiral and $\sim$ 2000 S0 galaxies spanning a wide range of environments. Dividing the galaxies into categories of classical and pseudobulge hosting spiral and S0 galaxies, we have studied their properties as a function of the environment. We find that the fraction of pseudobulge hosting disc galaxies decreases with increase in density. The classical bulge hosting spirals and S0 galaxies follow a similar trend in less dense environments but towards higher densities, we observe an increase in the fraction of classical bulge host S0 galaxies at the expense of spirals. Comparing the structural and the star formation properties of galaxies on the size-mass and $NUV-r$ colour-mass planes respectively, we infer that classical bulge hosting spirals are likely to get transformed into S0 morphology. We notice a trend of galaxy structure with environment such that the fraction of classical bulge hosting spiral galaxies is found to increase with environment density. We also find that among classical bulge hosting spirals, the fraction of quenched galaxies increases in denser environments. We surmise that the existence of more classical bulge hosting spirals galaxies and more efficient quenching leads to the observed increased occurrence of S0 galaxies in high density environments. The relation between galaxy structure and environment also exists for the disc galaxies irrespective of their visual morphology, which is driven mainly by halo mass.


title: Complexity of Hyperscaling Violating Theories at Finite Cutoff

abstract: Using the complexity equals action proposal we study holographic complexity for hyperscaling violating theories in the presence of a finite cutoff that, in turns, requires to obtain all counter terms needed to have finite boundary energy momentum tensor. These terms could give non-trivial contributions to the complexity. We observe that having a finite UV cutoff would enforce us to have a cutoff behind the horizon whose value is fixed by the UV cutoff; moreover, certain counter term should be defined on the cutoff behind the horizon too.


title: Statistics of Lagrangian Trajectories in a Rotating Turbulent Flow

abstract: We investigate the Lagrangian statistics of three-dimensional rotating turbulent flows through direct numerical simulations. We find that the emergence of coherent vortical structures because of the Coriolis force leads to a suppression of the "flight-crash" events reported by Xu, et al. [Proc. Natl. Acad. Sci. (U.S.A) 111, 7558 (2014)]. We perform systematic studies to trace the origins of this suppression in the emergent geometry of the flow and show why such a Lagrangian measure of irreversibility may fail in the presence of rotation.


title: Disentangling Style and Content in Anime Illustrations

abstract: Existing methods for AI-generated artworks still struggle with generating high-quality stylized content, where high-level semantics are preserved, or separating fine-grained styles from various artists. We propose a novel Generative Adversarial Disentanglement Network which can disentangle two complementary factors of variations when only one of them is labelled in general, and fully decompose complex anime illustrations into style and content in particular. Training such model is challenging, since given a style, various content data may exist but not the other way round. Our approach is divided into two stages, one that encodes an input image into a style independent content, and one based on a dual-conditional generator. We demonstrate the ability to generate high-fidelity anime portraits with a fixed content and a large variety of styles from over a thousand artists, and vice versa, using a single end-to-end network and with applications in style transfer. We show this unique capability as well as superior output to the current state-of-the-art.


title: Non-Random Behaviour in Sums of Modular Symbols

abstract: We give explicit expressions for the Fourier coefficients of Eisenstein series twisted by Dirichlet characters and modular symbols on $\Gamma_0(N)$ in the case where $N$ is prime and equal to the conductor of the Dirichlet character. We obtain these expressions by computing the spectral decomposition of automorphic functions closely related to these Eisenstein series. As an application, we then evaluate certain sums of modular symbols in a way which parallels past work of Goldfeld, O'Sullivan, Petridis, and Risager. In one case we find less cancellation in this sum than would be predicted by the common phenomenon of ``square root cancellation'', while in another case we find more cancellation.


title: Variational Bayes: A report on approaches and applications

abstract: Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model uncertainty. Variational methods have been used for approximating intractable integrals that arise in Bayesian inference for neural networks. In this report, we review the major variational inference concepts pertinent to Bayesian neural networks and compare various approximation methods used in literature. We also talk about the applications of variational bayes in Reinforcement learning and continual learning.


title: Exponentially suppressed cosmological constant with enhanced gauge symmetry in heterotic interpolating models

abstract: A few nine-dimensional interpolating models with two parameters are constructed and the massless spectra are studied by considering compactification of heterotic strings on a twisted circle with Wilson line. It is found that there are some conditions between radius R and Wilson line A under which the gauge symmetry is enhanced. In particular, when the gauge symmetry is enhanced to SO(18) \times SO(14), the cosmological constant is exponentially suppressed. We also construct a non-supersymmetric string model which is tachyon-free in all regions of moduli space and whose gauge symmetry involves E_8.


title: Stability of two-fluid galactic disc under the influence of an external tidal field

abstract: We consider the dynamics of rotationally supported thin galactic disc composed of stars and gas under the influence of external tidal field and derive the coupled differential equations governing the evolution of instabilities. Further linearising the governing equation a modified dispersion relation and stability criterion for appraising the stability of the two fluid galactic disc under the influence of external tidal field is obtained. Possible applications and method for the same are discussed.


title: On the monotone complexity of the shift operator

abstract: We show that the complexity of minimal monotone circuits implementing a monotone version of the permutation operator on $n$ boolean vectors of length $q$ is $\Theta(qn\log n)$. In particular, we obtain an alternative way to prove the known complexity bound $\Theta(n\log n)$ for the monotone shift operator on $n$ boolean inputs.


title: Learning Smooth Representation for Unsupervised Domain Adaptation

abstract: Typical adversarial-training-based unsupervised domain adaptation methods are vulnerable when the source and target datasets are highly-complex or exhibit a large discrepancy between their data distributions. Recently, several Lipschitz-constraint-based methods have been explored. The satisfaction of Lipschitz continuity guarantees a remarkable performance on a target domain. However, they lack a mathematical analysis of why a Lipschitz constraint is beneficial to unsupervised domain adaptation and usually perform poorly on large-scale datasets. In this paper, we take the principle of utilizing a Lipschitz constraint further by discussing how it affects the error bound of unsupervised domain adaptation. A connection between them is built and an illustration of how Lipschitzness reduces the error bound is presented. A \textbf{local smooth discrepancy} is defined to measure Lipschitzness of a target distribution in a pointwise way. When constructing a deep end-to-end model, to ensure the effectiveness and stability of unsupervised domain adaptation, three critical factors are considered in our proposed optimization strategy, i.e., the sample amount of a target domain, dimension and batchsize of samples. Experimental results demonstrate that our model performs well on several standard benchmarks. Our ablation study shows that the sample amount of a target domain, the dimension and batchsize of samples indeed greatly impact Lipschitz-constraint-based methods' ability to handle large-scale datasets. Code is available at https://github.com/CuthbertCai/SRDA.


title: Dynamics of Charge-Resolved Entanglement after a Local Quench

abstract: Quantum entanglement and its main quantitative measures, the entanglement entropy and entanglement negativity, play a central role in many body physics. An interesting twist arises when the system considered has symmetries leading to conserved quantities: Recent studies introduced a way to define, represent in field theory, calculate for 1+1D conformal systems, and measure, the contribution of individual charge sectors to the entanglement measures between different parts of a system in its ground state. In this paper, we apply these ideas to the time evolution of the charge-resolved contributions to the entanglement entropy and negativity after a local quantum quench. We employ conformal field theory techniques and find that the known dependence of the total entanglement on time after a quench, $S_A \sim \log(t)$, results from $\sim\sqrt{\log(t)}$ significant charge sectors, each of which contributes $\sim\sqrt{\log(t)}$ to the entropy. We compare our calculation to numerical results obtained by the time-dependent density matrix renormalization group algorithm and exact solution in the noninteracting limit, finding good agreement between all these methods.

categories: cond-mat.stat-mech cond-mat.str-el hep-th quant-ph


title: ViterbiNet: A Deep Learning Based Viterbi Algorithm for Symbol Detection

abstract: Symbol detection plays an important role in the implementation of digital receivers. In this work, we propose ViterbiNet, which is a data-driven symbol detector that does not require channel state information (CSI). ViterbiNet is obtained by integrating deep neural networks (DNNs) into the Viterbi algorithm. We identify the specific parts of the Viterbi algorithm that are channel-model-based, and design a DNN to implement only those computations, leaving the rest of the algorithm structure intact. We then propose a meta-learning based approach to train ViterbiNet online based on recent decisions, allowing the receiver to track dynamic channel conditions without requiring new training samples for every coherence block. Our numerical evaluations demonstrate that the performance of ViterbiNet, which is ignorant of the CSI, approaches that of the CSI-based Viterbi algorithm, and is capable of tracking time-varying channels without needing instantaneous CSI or additional training data. Moreover, unlike conventional Viterbi detection, ViterbiNet is robust to CSI uncertainty, and it can be reliably implemented in complex channel models with constrained computational burden. More broadly, our results demonstrate the conceptual benefit of designing communication systems to that integrate DNNs into established algorithms.


title: Auditory Separation of a Conversation from Background via Attentional Gating

abstract: We present a model for separating a set of voices out of a sound mixture containing an unknown number of sources. Our Attentional Gating Network (AGN) uses a variable attentional context to specify which speakers in the mixture are of interest. The attentional context is specified by an embedding vector which modifies the processing of a neural network through an additive bias. Individual speaker embeddings are learned to separate a single speaker while superpositions of the individual speaker embeddings are used to separate sets of speakers. We first evaluate AGN on a traditional single speaker separation task and show an improvement of 9% with respect to comparable models. Then, we introduce a new task to separate an arbitrary subset of voices from a mixture of an unknown-sized set of voices, inspired by the human ability to separate a conversation of interest from background chatter at a cafeteria. We show that AGN is the only model capable of solving this task, performing only 7% worse than on the single speaker separation task.


title: TIGS: An Inference Algorithm for Text Infilling with Gradient Search

abstract: Text infilling is defined as a task for filling in the missing part of a sentence or paragraph, which is suitable for many real-world natural language generation scenarios. However, given a well-trained sequential generative model, generating missing symbols conditioned on the context is challenging for existing greedy approximate inference algorithms. In this paper, we propose an iterative inference algorithm based on gradient search, which is the first inference algorithm that can be broadly applied to any neural sequence generative models for text infilling tasks. We compare the proposed method with strong baselines on three text infilling tasks with various mask ratios and different mask strategies. The results show that our proposed method is effective and efficient for fill-in-the-blank tasks, consistently outperforming all baselines.


title: Finite-size effect of critical penetration of Pearl vortices in narrow superconducting flat rings

abstract: We revisit the critical penetration of Pearl vortices in narrow superconducting flat rings cooled in magnetic fields. Scanning superconducting quantum interference device microscopy measurements showed how magnetic field penetrates and vortices are trapped in flat rings made of amorphous MoGe thin films. Counting the number of trapped vortices for each image, we found that the vortices are completely excluded from the ring annulus when the applied field $H$ is below a threshold field $H_{\rm{p}}$: Above this field, the vortices increase linearly with field. The obtained values of $H_{\rm{p}}$ depend on the annulus width $w_{\rm{ring}}$ and follow the relation $\mu_0H_{\rm{p}} = (1.9 \pm 0.1) \Phi_0/w_{\rm{ring}}^2$ with the superconducting flux quantum $\Phi_0$. This relationship provides an insight into the effect of the net-current circulating in the annular region, and also leads to a precise control to trap or eliminate vortices in flat rings.


title: On $e$-cuspidal pairs of finite groups of exceptional Lie Type

abstract: Let $G$ be a simple, simply connected algebraic group of exceptional type defined over $\mathbb{F}_q$ with Frobenius endomorphism $F: G \to G$. Let $\ell \nmid q$ be a good prime for $G$. We determine the number of irreducible Brauer characters in the quasi-isolated $\ell$-blocks of $G^F$. This is done by proving that generalized $e$-Harish-Chandra theory holds for the Lusztig series associated to quasi-isolated elements of $G^{*F}$.


title: A sparse domination for the Marcinkiewicz integral with rough kernel and applications

abstract: Let $\Omega$ be homogeneous of degree zero, have mean value zero and integrable on the unit sphere, and $\mu_{\Omega}$ be the higher-dimensional Marcinkiewicz integral defined by $$\mu_\Omega(f)(x)= \Big(\int_0^\infty\Big|\int_{|x-y|\leq t}\frac{\Omega(x-y)}{|x-y|^{n-1}}f(y)dy\Big|^2\frac{dt}{t^3}\Big)^{1/2}. $$ In this paper, the authors establish a bilinear sparse domination for $\mu_{\Omega}$ under the assumption $\Omega\in L^{\infty}(S^{n-1})$. As applications, some quantitative weighted bounds for $\mu_{\Omega}$ are obtained.


title: Selective Transfer with Reinforced Transfer Network for Partial Domain Adaptation

abstract: One crucial aspect of partial domain adaptation (PDA) is how to select the relevant source samples in the shared classes for knowledge transfer. Previous PDA methods tackle this problem by re-weighting the source samples based on their high-level information (deep features). However, since the domain shift between source and target domains, only using the deep features for sample selection is defective. We argue that it is more reasonable to additionally exploit the pixel-level information for PDA problem, as the appearance difference between outlier source classes and target classes is significantly large. In this paper, we propose a reinforced transfer network (RTNet), which utilizes both high-level and pixel-level information for PDA problem. Our RTNet is composed of a reinforced data selector (RDS) based on reinforcement learning (RL), which filters out the outlier source samples, and a domain adaptation model which minimizes the domain discrepancy in the shared label space. Specifically, in the RDS, we design a novel reward based on the reconstruct errors of selected source samples on the target generator, which introduces the pixel-level information to guide the learning of RDS. Besides, we develope a state containing high-level information, which used by the RDS for sample selection. The proposed RDS is a general module, which can be easily integrated into existing DA models to make them fit the PDA situation. Extensive experiments indicate that RTNet can achieve state-of-the-art performance for PDA tasks on several benchmark datasets.


title: Stochastic Gradient Methods with Block Diagonal Matrix Adaptation

abstract: Adaptive gradient approaches that automatically adjust the learning rate on a per-feature basis have been very popular for training deep networks. This rich class of algorithms includes Adagrad, RMSprop, Adam, and recent extensions. All these algorithms have adopted diagonal matrix adaptation, due to the prohibitive computational burden of manipulating full matrices in high-dimensions. In this paper, we show that block-diagonal matrix adaptation can be a practical and powerful solution that can effectively utilize structural characteristics of deep learning architectures, and significantly improve convergence and out-of-sample generalization. We present a general framework with block-diagonal matrix updates via coordinate grouping, which includes counterparts of the aforementioned algorithms, prove their convergence in non-convex optimization, highlighting benefits compared to diagonal versions. In addition, we propose an efficient spectrum-clipping scheme that benefits from superior generalization performance of Sgd. Extensive experiments reveal that block-diagonal approaches achieve state-of-the-art results on several deep learning tasks, and can outperform adaptive diagonal methods, vanilla Sgd, as well as a modified version of full-matrix adaptation proposed very recently.


title: Pure Nash Equilibria and Best-Response Dynamics in Random Games

abstract: In finite games mixed Nash equilibria always exist, but pure equilibria may fail to exist. To assess the relevance of this nonexistence, we consider games where the payoffs are drawn at random. In particular, we focus on games where a large number of players can each choose one of two possible strategies, and the payoffs are i.i.d. with the possibility of ties. We provide asymptotic results about the random number of pure Nash equilibria, such as fast growth and a central limit theorem, with bounds for the approximation error. Moreover, by using a new link between percolation models and game theory, we describe in detail the geometry of Nash equilibria and show that, when the probability of ties is small, a best-response dynamics reaches a Nash equilibrium with a probability that quickly approaches one as the number of players grows. We show that a multitude of phase transitions depend only on a single parameter of the model, that is, the probability of having ties.


title: HadaNets: Flexible Quantization Strategies for Neural Networks

abstract: On-board processing elements on UAVs are currently inadequate for training and inference of Deep Neural Networks. This is largely due to the energy consumption of memory accesses in such a network. HadaNets introduce a flexible train-from-scratch tensor quantization scheme by pairing a full precision tensor to a binary tensor in the form of a Hadamard product. Unlike wider reduced precision neural network models, we preserve the train-time parameter count, thus out-performing XNOR-Nets without a train-time memory penalty. Such training routines could see great utility in semi-supervised online learning tasks. Our method also offers advantages in model compression, as we reduce the model size of ResNet-18 by 7.43 times with respect to a full precision model without utilizing any other compression techniques. We also demonstrate a 'Hadamard Binary Matrix Multiply' kernel, which delivers a 10-fold increase in performance over full precision matrix multiplication with a similarly optimized kernel.


title: DARec: Deep Domain Adaptation for Cross-Domain Recommendation via Transferring Rating Patterns

abstract: Cross-domain recommendation has long been one of the major topics in recommender systems. Recently, various deep models have been proposed to transfer the learned knowledge across domains, but most of them focus on extracting abstract transferable features from auxilliary contents, e.g., images and review texts, and the patterns in the rating matrix itself is rarely touched. In this work, inspired by the concept of domain adaptation, we proposed a deep domain adaptation model (DARec) that is capable of extracting and transferring patterns from rating matrices {\em only} without relying on any auxillary information. We empirically demonstrate on public datasets that our method achieves the best performance among several state-of-the-art alternative cross-domain recommendation models.


title: ProbAct: A Probabilistic Activation Function for Deep Neural Networks

abstract: Activation functions play an important role in training artificial neural networks. The majority of currently used activation functions are deterministic in nature, with their fixed input-output relationship. In this work, we propose a novel probabilistic activation function, called ProbAct. ProbAct is decomposed into a mean and variance and the output value is sampled from the formed distribution, making ProbAct a stochastic activation function. The values of mean and variances can be fixed using known functions or trained for each element. In the trainable ProbAct, the mean and the variance of the activation distribution is trained within the back-propagation framework alongside other parameters. We show that the stochastic perturbation induced through ProbAct acts as a viable generalization technique for feature augmentation. In our experiments, we compare ProbAct with well-known activation functions on classification tasks on different modalities: Images(CIFAR-10, CIFAR-100, and STL-10) and Text (Large Movie Review). We show that ProbAct increases the classification accuracy by +2-3% compared to ReLU or other conventional activation functions on both original datasets and when datasets are reduced to 50% and 25% of the original size. Finally, we show that ProbAct learns an ensemble of models by itself that can be used to estimate the uncertainties associated with the prediction and provides robustness to noisy inputs.


title: A Staged Approach to Evolving Real-world UAV Controllers

abstract: A testbed has recently been introduced that evolves controllers for arbitrary hover-capable UAVs, with evaluations occurring directly on the robot. To prepare the testbed for real-world deployment, we investigate the effects of state-space limitations brought about by physical tethering (which prevents damage to the UAV during stochastic tuning), on the generality of the evolved controllers. We identify generalisation issues in some controllers, and propose an improved method that comprises two stages: in the first stage, controllers are evolved as normal using standard tethers, but experiments are terminated when the population displays basic flight competency. Optimisation then continues on a much less restrictive tether, effectively free-flying, and is allowed to explore a larger state-space envelope. We compare the two methods on a hover task using a real UAV, and show that more general solutions are generated in fewer generations using the two-stage approach. A secondary experiment undertakes a sensitivity analysis of the evolved controllers.


title: ENIGMA: Evolutionary Non-Isometric Geometry Matching

abstract: In this paper we propose a fully automatic method for shape correspondence that is widely applicable, and especially effective for non isometric shapes and shapes of different topology. We observe that fully-automatic shape correspondence can be decomposed as a hybrid discrete/continuous optimization problem, and we find the best sparse landmark correspondence, whose sparse-to-dense extension minimizes a local metric distortion. To tackle the combinatorial task of landmark correspondence we use an evolutionary genetic algorithm, where the local distortion of the sparse-to-dense extension is used as the objective function. We design novel geometrically guided genetic operators, which, when combined with our objective, are highly effective for non isometric shape matching. Our method outperforms state of the art methods for automatic shape correspondence both quantitatively and qualitatively on challenging datasets.


title: Lepskii Principle in Supervised Learning

abstract: In the setting of supervised learning using reproducing kernel methods, we propose a data-dependent regularization parameter selection rule that is adaptive to the unknown regularity of the target function and is optimal both for the least-square (prediction) error and for the reproducing kernel Hilbert space (reconstruction) norm error. It is based on a modified Lepskii balancing principle using a varying family of norms.


title: Simpson-Mochizuki Correspondence for $\lambda$-Flat Bundles

abstract: The notion of flat $\lambda$-connections as the interpolation of usual flat connections and Higgs fields was suggested by Deligne and further studied by Simpson. Mochizuki established the Kobayashi--Hitchin-type theorem for $\lambda$-flat bundles ($\lambda\neq 0$), which is called the Mochizuki correspondence. In this paper, on the one hand, we generalize Mochizuki's result to the case when the base being a compact balanced manifold, more precisely, we prove the existence of harmonic metrics on stable $\lambda$-flat bundles ($\lambda\neq 0$). On the other hand, we study two applications of the Simpson--Mochizuki correspondence to moduli spaces. More concretely, we show this correspondence provides a homeomorphism between the moduli space of (semi)stable $\lambda$-flat bundles over a complex projective manifold and the Dolbeault moduli space, and also provides dynamical systems with two parameters on the latter moduli space. We investigate such dynamical systems, in particular, we calculate the first variation, the fixed points and discuss the asymptotic behaviour.


title: On coupling constant thresholds in one dimension

abstract: The threshold behaviour of negative eigenvalues for Schr\"{o}dinger operators of the type $$ H_\lambda=-\frac{d^2}{dx^2}+U(x)+\lambda\alpha_\lambda V(\alpha_\lambda x) $$ is considered. The potentials $U$ and $V$ are real-valued bounded functions of compact support, $\lambda$ is a positive parameter, and positive sequence $\alpha_\lambda$ has a finite or infinite limit as $\lambda\to 0$. Under certain conditions on the potentials there exists a bound state of $H_\lambda$ which is absorbed at the bottom of the continuous spectrum. For several cases of the limiting behaviour of sequence $\alpha_\lambda$, asymptotic formulas for the bound states are proved and the first order terms are computed explicitly.


title: Neutron stars in general relativity and scalar-tensor theory of gravity

abstract: The masses and radii of neutron stars are discussed in general relativity and scalar-tensor theory of gravity and the differences are compared with the current uncertainties stemming from the nuclear equation of state in the relativistic mean-field framework. It is shown that astrophysical and gravitational waves observations of radii of neutron stars with masses $M \lesssim 1.4 M_{\odot}$ constrain only the nuclear equation of state, and in particular the density dependence of the nuclear symmetry energy. Future observations of massive neutron stars may constrain the coupling parameters of the scalar-tensor theory provided that a general consensus on the dense nuclear matter equation of state is reached.


title: Precision-Recall Curves Using Information Divergence Frontiers

abstract: Despite the tremendous progress in the estimation of generative models, the development of tools for diagnosing their failures and assessing their performance has advanced at a much slower pace. Recent developments have investigated metrics that quantify which parts of the true distribution is modeled well, and, on the contrary, what the model fails to capture, akin to precision and recall in information retrieval. In this paper, we present a general evaluation framework for generative models that measures the trade-off between precision and recall using R\'enyi divergences. Our framework provides a novel perspective on existing techniques and extends them to more general domains. As a key advantage, this formulation encompasses both continuous and discrete models and allows for the design of efficient algorithms that do not have to quantize the data. We further analyze the biases of the approximations used in practice.


title: A Flexible Generative Framework for Graph-based Semi-supervised Learning

abstract: We consider a family of problems that are concerned about making predictions for the majority of unlabeled, graph-structured data samples based on a small proportion of labeled samples. Relational information among the data samples, often encoded in the graph/network structure, is shown to be helpful for these semi-supervised learning tasks. However, conventional graph-based regularization methods and recent graph neural networks do not fully leverage the interrelations between the features, the graph, and the labels. In this work, we propose a flexible generative framework for graph-based semi-supervised learning, which approaches the joint distribution of the node features, labels, and the graph structure. Borrowing insights from random graph models in network science literature, this joint distribution can be instantiated using various distribution families. For the inference of missing labels, we exploit recent advances of scalable variational inference techniques to approximate the Bayesian posterior. We conduct thorough experiments on benchmark datasets for graph-based semi-supervised learning. Results show that the proposed methods outperform the state-of-the-art models in most settings.


title: Secure Wireless Communication via Intelligent Reflecting Surface

abstract: An intelligent reflecting surface (IRS) can adaptively adjust the phase shifts of its reflecting units to strengthen the desired signal and/or suppress the undesired signal. In this letter, we investigate an IRS-aided secure wireless communication system where a multi-antenna access point (AP) sends confidential messages to a single-antenna user in the presence of a single-antenna eavesdropper. In particular, we consider the challenging scenario where the eavesdropping channel is stronger than the legitimate communication channel and they are also highly correlated in space. We maximize the secrecy rate of the legitimate communication link by jointly designing the AP's transmit beamforming and the IRS's reflect beamforming. While the resultant optimization problem is difficult to solve, we propose an efficient algorithm to obtain high-quality suboptimal solution for it by applying the alternating optimization and semidefinite relaxation methods. Simulation results show that the proposed design significantly improves the secrecy communication rate for the considered setup over the case without using the IRS, and outperforms a heuristic scheme.


title: The Fourth Catalog of Active Galactic Nuclei Detected by the Fermi Large Area Telescope

abstract: The fourth catalog of active galactic nuclei (AGNs) detected by the Fermi Gamma-ray Space Telescope Large Area Telescope (4LAC) between 2008 August 4 and 2016 August 2 contains 2863 objects located at high Galactic latitudes (|b|>10{\deg}). It includes 85% more sources than the previous 3LAC catalog based on 4 years of data. AGNs represent at least 79% of the high-latitude sources in the fourth Fermi-Large Area Telescope Source Catalog (4FGL), which covers the energy range from 50 MeV to 1 TeV. In addition, 344 gamma-ray AGNs are found at low Galactic latitudes. Most of the 4LAC AGNs are blazars (98%), while the remainder are other types of AGNs. The blazar population consists of 24% Flat Spectrum Radio Quasars (FSRQs), 38% BL Lac-type objects (BL Lacs), and 38% blazar candidates of unknown types (BCUs). On average, FSRQs display softer spectra and stronger variability in the gamma-ray band than BL Lacs do, confirming previous findings. All AGNs detected by ground-based atmospheric Cherenkov telescopes are also found in the 4LAC.


title: A class of linear sets in PG(1,q^5)

abstract: The maximum scattered linear sets in $PG(1,q^n)$ have been completely classified for $n \le 4$ by Csajb\'ok-Zanella and Lavrauw-Van de Voorde. Here a wide class of linear sets in $PG(1,q^5)$ is studied which depends on two parameters. Conditions for the existence, in this class, of possible new maximum scattered linear sets in $PG(1,q^5)$ are exhibited.


title: Grothendieck's Dessins d'Enfants in a Web of Dualities

abstract: In this paper we show that counting Grothendieck's dessins d'enfants is universal in the sense that some other enumerative problems are either special cases or directly related to it. Such results provide concrete examples that support a proposal made in the paper to study various dualities from the point of view of group actions on the moduli space of theories. Connections to differential equations of hypergeometric type can be made transparent from this approach, suggesting a connection to mirror symmetry.


title: Justifications of Welfare Guarantees under Normalized Utilities

abstract: It is standard in computational social choice to analyse welfare considerations under the assumptions of normalized utilities. In this note, we summarize some common reasons for this approach. We then mention another justification which is ignored but has solid normative appeal. The central concept used in the `new' justification can also be used more widely as a social objective.


title: Deterministic Distributed Dominating Set Approximation in the CONGEST Model

abstract: We develop deterministic approximation algorithms for the minimum dominating set problem in the CONGEST model with an almost optimal approximation guarantee. For $\epsilon>1/{\text{{poly}}}\log \Delta$ we obtain two algorithms with approximation factor $(1+\epsilon)(1+\ln (\Delta+1))$ and with runtimes $2^{O(\sqrt{\log n \log\log n})}$ and $O(\Delta\cdot\text{poly}\log \Delta +\text{poly}\log \Delta \log^{*} n)$, respectively. Further we show how dominating set approximations can be deterministically transformed into a connected dominating set in the \CONGEST model while only increasing the approximation guarantee by a constant factor. This results in a deterministic $O(\log \Delta)$-approximation algorithm for the minimum connected dominating set with time complexity $2^{O(\sqrt{\log n \log\log n})}$.


title: Molecular Beam Epitaxy Grown $Cr_2Te_3$ Thin Films with Tunable Curie Temperatures

abstract: Materials with perpendicular magnetic anisotropy (PMA) effect with high Curie temperature ($T_C$) is essential in applications. In this work, $Cr_2Te_3$ thin films showing PMA with $T_C$ ranging from 165 K to 295 K were successfully grown on $Al_2O_3$ by the molecular beam epitaxy (MBE) technique. The structural analysis, magneto-transport and magnetic characterizations were conducted to study the physical origin of the improved $T_C$. In particular, ferromagnetic (FM) and antiferromagnetic (AFM) ordering competition were investigated. A phenomenological model based on the coupling degree between FM and AFM ordering was proposed to explain the observed $T_C$ enhancement. Our findings indicate that the $T_C$ of $Cr_2Te_3$ thin film can be tuned, which make it hold the potential for various magnetic applications.


title: Cross-Resolution Face Recognition via Prior-Aided Face Hallucination and Residual Knowledge Distillation

abstract: Recent deep learning based face recognition methods have achieved great performance, but it still remains challenging to recognize very low-resolution query face like 28x28 pixels when CCTV camera is far from the captured subject. Such face with very low-resolution is totally out of detail information of the face identity compared to normal resolution in a gallery and hard to find corresponding faces therein. To this end, we propose a Resolution Invariant Model (RIM) for addressing such cross-resolution face recognition problems, with three distinct novelties. First, RIM is a novel and unified deep architecture, containing a Face Hallucination sub-Net (FHN) and a Heterogeneous Recognition sub-Net (HRN), which are jointly learned end to end. Second, FHN is a well-designed tri-path Generative Adversarial Network (GAN) which simultaneously perceives facial structure and geometry prior information, i.e. landmark heatmaps and parsing maps, incorporated with an unsupervised cross-domain adversarial training strategy to super-resolve very low-resolution query image to its 8x larger ones without requiring them to be well aligned. Third, HRN is a generic Convolutional Neural Network (CNN) for heterogeneous face recognition with our proposed residual knowledge distillation strategy for learning discriminative yet generalized feature representation. Quantitative and qualitative experiments on several benchmarks demonstrate the superiority of the proposed model over the state-of-the-arts. Codes and models will be released upon acceptance.


title: Strategyproof Multi-Item Exchange Under Single-Minded Dichotomous Preferences

abstract: We consider multi-item exchange markets in which agents want to receive one of their target bundles of resources. The model encompasses well-studied markets for kidney exchange, lung exchange, and multi-organ exchange. We identify a general and sufficient condition called weak consistency for the exchange mechanisms to be strategyproof even if we impose any kind of distributional, diversity, or exchange cycle constraints. Within the class of weakly consistent and strategyproof mechanisms, we highlight two important ones that satisfy constrained Pareto optimality and strong individual rationality. Several results in the literature follow from our insights. We also derive impossibility results when constrained Pareto optimality is defined with respect to more permissive individual rationality requirements.


title: The star formation history in the solar neighborhood as told by massive white dwarfs

abstract: White dwarfs are the remnants of low and intermediate mass stars. Because of electron degeneracy, their evolution is just a simple gravothermal process of cooling. Recently, thanks to Gaia data, it has been possible to construct the luminosity function of massive (0.9 < M/Msun < 1.1) white dwarfs in the solar neighborhood (d < 100 pc). Since the lifetime of their progenitors is very short, the birth times of both, parents and daughters, are very close and allow to reconstruct the (effective) star formation rate. This rate started growing from zero during the early Galaxy and reached a maximum 6-7 Gyr ago. It declined and ~5 Gyr ago started to climb once more reaching a maximum 2 - 3 Gyr in the past and decreased since then. There are some traces of a recent star formation burst, but the method used here is not appropriate for recently born white dwarfs.


title: DNA size in confined environments

abstract: For short DNA molecules in crowded environments, we evaluate macroscopic parameters such as the average end-to-end distance and the twist conformation by tuning the strength of the site specific confinement driven by the crowders. The ds-DNA is modeled by a mesoscopic Hamiltonian which accounts for the three dimensional helical structure and incorporates fluctuational effects at the level of the base pair. The computational method assumes that the base pair fluctuations are temperature dependent trajectories whose amplitudes can be spatially modulated according to the crowders distribution. We show that the molecule elongation, as measured by the end-to-end distance varies non-monotonically with the strength of the confinement. Furthermore it is found that, if the crowders mostly confine the DNA mid-chain, the helix over-twists and its end-to-end distance grows in the strong confinement regime. Instead, if the crowders mostly pin one chain end, the helix untwists while the molecule stretches for large confinement strengths. Thus, our results put forward a peculiar relation between stretching and twisting which significantly depends on the crowders profile. The method could be applied to disegn specific DNA shapes by controlling the environment which constrains the molecule.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.chem-ph


title: On the minimum degree of the power graph of a finite cyclic group

abstract: The power graph $\mathcal{P}(G)$ of a finite group $G$ is the simple undirected graph whose vertex set is $G$, in which two distinct vertices are adjacent if one of them is an integral power of the other. For an integer $n\geq 2$, let $C_n$ denote the cyclic group of order $n$ and let $r$ be the number of distinct prime divisors of $n$. The minimum degree $\delta(\mathcal{P}(C_n))$ of $\mathcal{P}(C_n)$ is known for $r\in\{1,2\}$, see [18]. For $r\geq 3$, under certain conditions involving the prime divisors of $n$, we identify at most $r-1$ vertices such that $\delta(\mathcal{P}(C_n))$ is equal to the degree of at least one of these vertices. If $r=3$ or if $n$ is a product of distinct primes, we are able to identify two such vertices without any condition on the prime divisors of $n$.


title: Study on Estimating Quantum Discord by Neural Network with Prior Knowledge

abstract: Machine learning has achieved success in many areas because of its powerful fitting ability, so we hope it can help us to solve some significant physical quantitative problems, such as quantum correlation. In this research we will use neural networks to predict the value of quantum discord. Quantum discord is a measure of quantum correlation which is defined as the difference between quantum mutual information and classical correlation for a bipartite system. Since the definition contains an optimization term, it makes analytically solving hard. For some special cases and small systems, such as two-qubit systems and some X-states, the explicit solutions have been calculated. However, for general cases, we still know very little. Therefore, we study the feasibility of estimating quantum discord by machine learning method on two-qubit systems. In order to get an interpretable and high performance model, we modify the ordinary neural network by introducing some prior knowledge which come from the analysis about quantum discord. Our results show that prior knowledge actually improve the performance of neural network.


title: Dynamical Jahn-Teller effect in the first excited C$_{60}^-$

abstract: The Jahn-Teller effect of C$_{60}$ anions in the first electronically excited states was theoretically investigated. The orbital vibronic coupling parameters for the $t_{1g}$ next lowest unoccupied molecular orbitals were derived from the Kohn-Sham orbital levels with hybrid B3LYP functional by using the frozen phonon approach. With the use of these coupling parameters, the vibronic states of the first excited C$_{60}^-$ were derived by exactly diagonalizing the dynamical Jahn-Teller Hamiltonian. The dynamical Jahn-Teller stabilization energy of the first excited C$_{60}^-$ is stronger than that of the ground electronic states.


title: Impact of facial landmark localization on facial expression recognition

abstract: Although facial landmark localization (FLL) approaches are becoming increasingly accurate for characterizing facial regions, one question remains unanswered: what is the impact of these approaches on subsequent related tasks? In this paper, the focus is put on facial expression recognition (FER), where facial landmarks are used for face registration, which is a common usage. Since the most used datasets for facial landmark localization do not allow for a proper measurement of performance according to the different difficulties (e.g., pose, expression, illumination, occlusion, motion blur), we also quantify the performance of recent approaches in the presence of head pose variations and facial expressions. Finally, a study of the impact of these approaches on FER is conducted. We show that the landmark accuracy achieved so far optimizing the conventional Euclidean distance does not necessarily guarantee a gain in performance for FER. To deal with this issue, we propose a new evaluation metric for FLL adapted to FER.


title: A submultiplicative property of the Carath\'eodory metric on planar domains

abstract: Given a pair of smoothly bounded domains $D_1, D_2 \subset \mathbb C$, the purpose of this note is to obtain an inequality that relates the Carath\'{e}odory metrics on $D_1, D_2, D_1 \cap D_2$ and $D_1 \cup D_2$.


title: On the parallels between Paxos and Raft, and how to port optimizations

abstract: In recent years, Raft has overtaken Paxos as the consensus algorithm of choice. [53] While many have pointed out similarities between the two protocols, no one has formally mapped out their relationships. In this paper, we show how Raft and Paxos are formally related despite their surface differences. Based on the formal mapping between the two protocols, we show how to automatically port a certain class of optimizations from Paxos to Raft with guaranteed correctness. As case studies, we port and evaluate two optimizations, Mencius and Paxos Quorum Lease to Raft.


title: Inducing Sparsity and Shrinkage in Time-Varying Parameter Models

abstract: Time-varying parameter (TVP) models have the potential to be over-parameterized, particularly when the number of variables in the model is large. Global-local priors are increasingly used to induce shrinkage in such models. But the estimates produced by these priors can still have appreciable uncertainty. Sparsification has the potential to reduce this uncertainty and improve forecasts. In this paper, we develop computationally simple methods which both shrink and sparsify TVP models. In a simulated data exercise we show the benefits of our shrink-then-sparsify approach in a variety of sparse and dense TVP regressions. In a macroeconomic forecasting exercise, we find our approach to substantially improve forecast performance relative to shrinkage alone.


title: Directional Transport of Propelled Brownian Particles Confined in a Smooth Corrugated Channel with Colored Noise

abstract: The transport phenomenon(directional movement) of self-propelled Brownian particles moving in a smooth corrugated confined channel is investigated. It is found that large $x$ direction noise intensity should reduce particles directional movement when the angle Gaussian noise intensity is small. The average velocity has a maximum with increasing $x$ direction noise intensity when angle Gaussian noise intensity is large. $y$ directional noise has negligible effect on $x$ directional movement. Large angle Gaussian noise intensity should weaken the directional transport. Interestingly, the movement direction changes more than once with increasing periodic force amplitude.


title: How Rotating Solar Atmospheric Jets Become Kelvin--Helmholtz Unstable

abstract: Recent observations support the propagation of a number of magnetohydrodynamic (MHD) modes which, under some conditions, can become unstable and the developing instability is the Kelvin--Helmholtz instability (KHI). In its nonlinear stage the KHI can trigger the occurrence of wave turbulence which is considered as a candidate mechanism for coronal heating. We review the modeling of tornado-like phenomena in the solar chromosphere and corona as moving weakly twisted and spinning cylindrical flux tubes, showing that the KHI rises at the excitation of high-mode MHD waves. The instability occurs within a wavenumber range whose width depends on the MHD mode number \emph{m}, the plasma density contrast between the rotating jet and its environment, and also on the twists of the internal magnetic field and the jet velocity. We have studied KHI in two twisted spinning solar polar coronal hole jets, in a twisted rotating jet emerging from a filament eruption, and in a rotating macrospicule. The theoretically calculated KHI development times of a few minutes for wavelengths comparable to the half-widths of the jets are in good agreement with the observationally determined growth times only for high order (10 $\mathrm{\leqslant}$ \emph{m} $\mathrm{\leqslant}$ 65) MHD modes. Therefore, we expect that the observed KHI in these cases is due to unstable high-order MHD modes.


title: Calibrations and null-Lagrangians for nonlocal perimeters and an application to the viscosity theory

abstract: For nonnegative even kernels $K$, we consider the $K$-nonlocal perimeter functional acting on sets. Assuming the existence of a foliation of space made of solutions of the associated $K$-nonlocal mean curvature equation in an open set $\Omega\subset\mathbb{R}^n$, we built a calibration for the nonlocal perimeter inside $\Omega\subset\mathbb{R}^n$. The calibrating functional is a nonlocal null-Lagrangian. As a consequence, we conclude the minimality in $\Omega$ of each leaf of the foliation. As an application, we prove the minimality of $K$-nonlocal minimal graphs and that they are the unique minimizers subject to their own exterior data. As a second application of the calibration, we give a simple proof of an important result from the seminal paper of Caffarelli, Roquejoffre, and Savin, stating that minimizers of the fractional perimeter are viscosity solutions.


title: Imaging viscous flow of the Dirac fluid in graphene

abstract: The electron-hole plasma in charge-neutral graphene is predicted to realize a quantum critical system whose transport features a universal hydrodynamic description, even at room temperature. This quantum critical "Dirac fluid" is expected to have a shear viscosity close to a minimum bound, with an inter-particle scattering rate saturating at the Planckian time $\hbar/(k_B T)$. While electrical transport measurements at finite carrier density are consistent with hydrodynamic electron flow in graphene, a "smoking gun" of viscous behavior remains elusive. In this work, we directly image viscous Dirac fluid flow in graphene at room temperature via measurement of the associated stray magnetic field. Nanoscale magnetic imaging is performed using quantum spin magnetometers realized with nitrogen vacancy (NV) centers in diamond. Scanning single-spin and wide-field magnetometry reveals a parabolic Poiseuille profile for electron flow in a graphene channel near the charge neutrality point, establishing the viscous transport of the Dirac fluid. This measurement is in contrast to the conventional uniform flow profile imaged in an Ohmic conductor. Via combined imaging-transport measurements, we obtain viscosity and scattering rates, and observe that these quantities are comparable to the universal values expected at quantum criticality. This finding establishes a nearly-ideal electron fluid in neutral graphene at room temperature. Our results pave the way to study hydrodynamic transport in quantum critical fluids relevant to strongly-correlated electrons in high-$T_c$ superconductors. This work also highlights the capability of quantum spin magnetometers to probe correlated-electronic phenomena at the nanoscale.


title: Ensemble Decision Systems for General Video Game Playing

abstract: Ensemble Decision Systems offer a unique form of decision making that allows a collection of algorithms to reason together about a problem. Each individual algorithm has its own inherent strengths and weaknesses, and often it is difficult to overcome the weaknesses while retaining the strengths. Instead of altering the properties of the algorithm, the Ensemble Decision System augments the performance with other algorithms that have complementing strengths. This work outlines different options for building an Ensemble Decision System as well as providing analysis on its performance compared to the individual components of the system with interesting results, showing an increase in the generality of the algorithms without significantly impeding performance.


title: Unsupervised Intuitive Physics from Past Experiences

abstract: We are interested in learning models of intuitive physics similar to the ones that animals use for navigation, manipulation and planning. In addition to learning general physical principles, however, we are also interested in learning ``on the fly'', from a few experiences, physical properties specific to new environments. We do all this in an unsupervised manner, using a meta-learning formulation where the goal is to predict videos containing demonstrations of physical phenomena, such as objects moving and colliding with a complex background. We introduce the idea of summarizing past experiences in a very compact manner, in our case using dynamic images, and show that this can be used to solve the problem well and efficiently. Empirically, we show via extensive experiments and ablation studies, that our model learns to perform physical predictions that generalize well in time and space, as well as to a variable number of interacting physical objects.


title: Results from proton-lead and fixed-target collisions at LHCb

abstract: The latest results obtained by the LHCb collaboration from proton-lead and proton-gas fixed-target collisions are presented. Results related to charm and beauty flavour hadron and quarkonia production in proton-lead collisions, being clean probes for Cold Nuclear Matter effects, are compatible to predictions based on initial-state effects. Indications of significant final-state effects in excited $\Upsilon(nS)$ resonances production are reported. The first cross-section measurement of $c\bar{c}$ and antiproton production in fixed-target proton-helium collisions at 100 GeV energy scale are also presented. More results will come from the latest Run 2 and future Run 3 data.


title: Laser damage attack against optical attenuators in quantum key distribution

abstract: Many quantum key distribution systems employ a laser followed by an optical attenuator to prepare weak coherent states in the source. Their mean photon number must be pre-calibrated to guarantee the security of key distribution. Here we experimentally show that this calibration can be broken with a high-power laser attack. We have tested four fiber-optic attenuator types used in quantum key distribution systems, and found that two of them exhibit a permanent decrease in attenuation after laser damage. This results in higher mean photon numbers in the prepared states and may allow an eavesdropper to compromise the key.


title: Online Deep Learning for Improved Trajectory Tracking of Unmanned Aerial Vehicles Using Expert Knowledge

abstract: This work presents an online learning-based control method for improved trajectory tracking of unmanned aerial vehicles using both deep learning and expert knowledge. The proposed method does not require the exact model of the system to be controlled, and it is robust against variations in system dynamics as well as operational uncertainties. The learning is divided into two phases: offline (pre-)training and online (post-)training. In the former, a conventional controller performs a set of trajectories and, based on the input-output dataset, the deep neural network (DNN)-based controller is trained. In the latter, the trained DNN, which mimics the conventional controller, controls the system. Unlike the existing papers in the literature, the network is still being trained for different sets of trajectories which are not used in the training phase of DNN. Thanks to the rule-base, which contains the expert knowledge, the proposed framework learns the system dynamics and operational uncertainties in real-time. The experimental results show that the proposed online learning-based approach gives better trajectory tracking performance when compared to the only offline trained network.


title: Why do These Match? Explaining the Behavior of Image Similarity Models

abstract: Explaining a deep learning model can help users understand its behavior and allow researchers to discern its shortcomings. Recent work has primarily focused on explaining models for tasks like image classification or visual question answering. In this paper, we introduce Salient Attributes for Network Explanation (SANE) to explain image similarity models, where a model's output is a score measuring the similarity of two inputs rather than a classification score. In this task, an explanation depends on both of the input images, so standard methods do not apply. Our SANE explanations pairs a saliency map identifying important image regions with an attribute that best explains the match. We find that our explanations provide additional information not typically captured by saliency maps alone, and can also improve performance on the classic task of attribute recognition. Our approach's ability to generalize is demonstrated on two datasets from diverse domains, Polyvore Outfits and Animals with Attributes 2. Code available at: https://github.com/VisionLearningGroup/SANE