title: MoVi: A Large Multipurpose Motion and Video Dataset

abstract: Human movements are both an area of intense study and the basis of many applications such as character animation. For many applications, it is crucial to identify movements from videos or analyze datasets of movements. Here we introduce a new human Motion and Video dataset MoVi, which we make available publicly. It contains 60 female and 30 male actors performing a collection of 20 predefined everyday actions and sports movements, and one self-chosen movement. In five capture rounds, the same actors and movements were recorded using different hardware systems, including an optical motion capture system, video cameras, and inertial measurement units (IMU). For some of the capture rounds, the actors were recorded when wearing natural clothing, for the other rounds they wore minimal clothing. In total, our dataset contains 9 hours of motion capture data, 17 hours of video data from 4 different points of view (including one hand-held camera), and 6.6 hours of IMU data. In this paper, we describe how the dataset was collected and post-processed; We present state-of-the-art estimates of skeletal motions and full-body shape deformations associated with skeletal motion. We discuss examples for potential studies this dataset could enable.


title: Meta Cyclical Annealing Schedule: A Simple Approach to Avoiding Meta-Amortization Error

abstract: The ability to learn new concepts with small amounts of data is a crucial aspect of intelligence that has proven challenging for deep learning methods. Meta-learning for few-shot learning offers a potential solution to this problem: by learning to learn across data from many previous tasks, few-shot learning algorithms can discover the structure among tasks to enable fast learning of new tasks. However, a critical challenge in few-shot learning is task ambiguity: even when a powerful prior can be meta-learned from a large number of prior tasks, a small dataset for a new task can simply be very ambiguous to acquire a single model for that task. The Bayesian meta-learning models can naturally resolve this problem by putting a sophisticated prior distribution and let the posterior well regularized through Bayesian decision theory. However, currently known Bayesian meta-learning procedures such as VERSA suffer from the so-called {\it information preference problem}, that is, the posterior distribution is degenerated to one point and is far from the exact one. To address this challenge, we design a novel meta-regularization objective using {\it cyclical annealing schedule} and {\it maximum mean discrepancy} (MMD) criterion. The cyclical annealing schedule is quite effective at avoiding such degenerate solutions. This procedure includes a difficult KL-divergence estimation, but we resolve the issue by employing MMD instead of KL-divergence. The experimental results show that our approach substantially outperforms standard meta-learning algorithms.


title: On Mochizuki's idea of Anabelomorphy and its applications

abstract: I coined the term anabelomorphy (pronounced as anabel-o-morphy) as a concise way of expressing Mochizuki's idea of "anabelian way of changing ground field, rings etc." which was he has introduced in his work on his Inter-Universal Teichmuller Theory. This paper demonstrates the usefulness of this idea by studying its ramifications in the more familiar arithmetic contexts such as the theory of Galois representations, automorphic forms and related areas and establish a number of results which are of independent arithmetic interest. I also introduce the notion of anabelomorphically connected number fields in which two number fields are related by the existence of topological isomorphism between the local Galois groups at a finite list of primes of both the number fields and prove some results illustrating arithmetic consequences of this notion. The Introduction provides a detailed discussion and summary of all the results proved in this paper.


title: Adaptive Online Distributed Optimal Control of Very-Large-Scale Robotic Systems

abstract: This paper presents an adaptive online distributed optimal control approach that is applicable to optimal planning for very-large-scale robotics systems in highly uncertain environments. This approach is developed based on the optimal mass transport theory. It is also viewed as an online reinforcement learning and approximate dynamic programming approach in the Wasserstein-GMM space, where a novel value functional is defined based on the probability density functions of robots and the time-varying obstacle map functions describing the changing environmental information. The proposed approach is demonstrated on the path planning problem of very-largescale robotic systems where the approximated layout of obstacles in the workspace is incrementally updated by the observations of robots, and compared with some existing state-of-the-art approaches. The numerical simulation results show that the proposed approach outperforms these approaches in aspects of the average traveling distance and the energy cost.


title: Fast Adaptively Weighted Matrix Factorization for Recommendation with Implicit Feedback

abstract: Recommendation from implicit feedback is a highly challenging task due to the lack of the reliable observed negative data. A popular and effective approach for implicit recommendation is to treat unobserved data as negative but downweight their confidence. Naturally, how to assign confidence weights and how to handle the large number of the unobserved data are two key problems for implicit recommendation models. However, existing methods either pursuit fast learning by manually assigning simple confidence weights, which lacks flexibility and may create empirical bias in evaluating user's preference; or adaptively infer personalized confidence weights but suffer from low efficiency. To achieve both adaptive weights assignment and efficient model learning, we propose a fast adaptively weighted matrix factorization (FAWMF) based on variational auto-encoder. The personalized data confidence weights are adaptively assigned with a parameterized neural network (function) and the network can be inferred from the data. Further, to support fast and stable learning of FAWMF, a new specific batch-based learning algorithm fBGD has been developed, which trains on all feedback data but its complexity is linear to the number of observed data. Extensive experiments on real-world datasets demonstrate the superiority of the proposed FAWMF and its learning algorithm fBGD.


title: Incorporating electronic information into Machine Learning potential energy surfaces via approaching the ground-state electronic energy as a function of atom-based electronic populations

abstract: Machine Learning (ML) approximations to Density Functional Theory (DFT) potential energy surfaces (PESs) are showing great promise for reducing the computational cost of accurate molecular simulations, but at present they are not applicable to varying electronic states, and in particular, they are not well suited for molecular systems in which the local electronic structure is sensitive to the medium to long-range electronic environment. With this issue as the focal point, we present a new Machine Learning approach called bpopNN for obtaining efficient approximations to DFT PESs. The methodology is based on approaching the true DFT energy as a function of electron populations on atoms, which may be realized in practice with constrained DFT (CDFT). The new approach creates approximations to this function with deep neural networks. These approximations thereby incorporate electronic information naturally into a ML approach, and optimizing the model energy with respect to populations allows the electronic terms to self-consistently adapt to the environment, as in DFT. We confirm the effectiveness of this approach with a variety of calculations on Li$_n$H$_n$ clusters.


title: GarmentGAN: Photo-realistic Adversarial Fashion Transfer

abstract: The garment transfer problem comprises two tasks: learning to separate a person's body (pose, shape, color) from their clothing (garment type, shape, style) and then generating new images of the wearer dressed in arbitrary garments. We present GarmentGAN, a new algorithm that performs image-based garment transfer through generative adversarial methods. The GarmentGAN framework allows users to virtually try-on items before purchase and generalizes to various apparel types. GarmentGAN requires as input only two images, namely, a picture of the target fashion item and an image containing the customer. The output is a synthetic image wherein the customer is wearing the target apparel. In order to make the generated image look photo-realistic, we employ the use of novel generative adversarial techniques. GarmentGAN improves on existing methods in the realism of generated imagery and solves various problems related to self-occlusions. Our proposed model incorporates additional information during training, utilizing both segmentation maps and body key-point information. We show qualitative and quantitative comparisons to several other networks to demonstrate the effectiveness of this technique.


title: Double Backpropagation for Training Autoencoders against Adversarial Attack

abstract: Deep learning, as widely known, is vulnerable to adversarial samples. This paper focuses on the adversarial attack on autoencoders. Safety of the autoencoders (AEs) is important because they are widely used as a compression scheme for data storage and transmission, however, the current autoencoders are easily attacked, i.e., one can slightly modify an input but has totally different codes. The vulnerability is rooted the sensitivity of the autoencoders and to enhance the robustness, we propose to adopt double backpropagation (DBP) to secure autoencoder such as VAE and DRAW. We restrict the gradient from the reconstruction image to the original one so that the autoencoder is not sensitive to trivial perturbation produced by the adversarial attack. After smoothing the gradient by DBP, we further smooth the label by Gaussian Mixture Model (GMM), aiming for accurate and robust classification. We demonstrate in MNIST, CelebA, SVHN that our method leads to a robust autoencoder resistant to attack and a robust classifier able for image transition and immune to adversarial attack if combined with GMM.


title: Numerical simulation of knotted solutions for Maxwell equations

abstract: In this work, we use the finite differences in time domain (FDTD) numerical method to compute and assess the validity of Hopf solutions, or hopfions, for the electromagnetic field equations. In these solutions, field lines form closed loops characterized by different knot topologies which are preserved during their time evolution. Hopfions have been studied extensively in the past from an analytical perspective but never, to the best of our knowledge, from a numerical approach. The implementation and validation of this technique eases the study of more complex cases of this phenomena; e.g. how these fields could interact with materials (e.g. anisotropic or non-linear), their coupling with other physical systems (e.g. plasmas), and also opens the path on their artificial generation by different means (e.g. antenna arrays or lasers).


title: Optimal Regularization Can Mitigate Double Descent

abstract: Recent empirical and theoretical studies have shown that many learning algorithms -- from linear regression to neural networks -- can have test performance that is non-monotonic in quantities such the sample size and model size. This striking phenomenon, often referred to as "double descent", has raised questions of if we need to re-think our current understanding of generalization. In this work, we study whether the double-descent phenomenon can be avoided by using optimal regularization. Theoretically, we prove that for certain linear regression models with isotropic data distribution, optimally-tuned $\ell_2$ regularization achieves monotonic test performance as we grow either the sample size or the model size. We also demonstrate empirically that optimally-tuned $\ell_2$ regularization can mitigate double descent for more general models, including neural networks. Our results suggest that it may also be informative to study the test risk scalings of various algorithms in the context of appropriately tuned regularization.


title: Enhanced flow rate by the concentration mechanism of Tetris particles when discharged from a hopper with an obstacle

abstract: We apply a holistic 2D Tetris-like model, where particles move based on prescribed rules, to investigate the flow rate enhancement from a hopper. This phenomenon was originally reported in the literature as a feature of placing an obstacle at an optimal location near the exit of a hopper discharging athermal granular particles under gravity. We find that this phenomenon is limited to a system of sufficiently many particles. In addition to the waiting room effect, another mechanism able to explain and create the flow rate enhancement is the concentration mechanism of particles on their way to reaching the hopper exit after passing the obstacle. We elucidate the concentration mechanism by decomposing the flow rate into its constituent variables: the local area packing fraction $\phi_l^E$ and the averaged particle velocity $v_y^E$ at the hopper exit. In comparison to the case without an obstacle, our results show that an optimally placed obstacle can create a net flow rate enhancement of relatively weakly driven particles, caused by the exit-bottleneck coupling if $\phi_l^E > \phi_o^c$, where $\phi_o^c$ is a characteristic area packing fraction marking a transition from fast to slow flow regimes of Tetris particles. Utilizing the concentration mechanism by artificially guiding particles into the central sparse space under the obstacle or narrowing the hopper exit angle under the obstacle, we can create a man-made flow rate peak of relatively strongly-driven particles that initially exhibit no flow rate peak. Additionally, the enhanced flow rate can be maximized by an optimal obstacle shape, particle acceleration rate towards the hopper exit, or exit geometry of the hopper.


title: Robust Active Preference Elicitation

abstract: We study the problem of eliciting the preferences of a decision-maker through a moderate number of pairwise comparison queries to make them a high quality recommendation for a specific problem. We are motivated by applications in high stakes domains, such as when choosing a policy for allocating scarce resources to satisfy basic needs (e.g., kidneys for transplantation or housing for those experiencing homelessness) where a consequential recommendation needs to be made from the (partially) elicited preferences. We model uncertainty in the preferences as being set based and} investigate two settings: a) an offline elicitation setting, where all queries are made at once, and b) an online elicitation setting, where queries are selected sequentially over time in an adaptive fashion. We propose robust optimization formulations of these problems which integrate the preference elicitation and recommendation phases with aim to either maximize worst-case utility or minimize worst-case regret, and study their complexity. For the offline case, where active preference elicitation takes the form of a two and half stage robust optimization problem with decision-dependent information discovery, we provide an equivalent reformulation in the form of a mixed-binary linear program which we solve via column-and-constraint generation. For the online setting, where active preference learning takes the form of a multi-stage robust optimization problem with decision-dependent information discovery, we propose a conservative solution approach. Numerical studies on synthetic data demonstrate that our methods outperform state-of-the art approaches from the literature in terms of worst-case rank, regret, and utility. We showcase how our methodology can be used to assist a homeless services agency in choosing a policy for allocating scarce housing resources of different types to people experiencing homelessness.


title: Minimum Enclosing Parallelogram with Outliers

abstract: We study the problem of minimum enclosing rectangle with outliers, which asks to find, for a given set of $n$ planar points, a rectangle with minimum area that encloses at least $(n-t)$ points. The uncovered points are regarded as outliers. We present an exact algorithm with $O(kt^3+ktn+n^2\log n)$ runtime, assuming that no three points lie on the same line. Here $k$ denotes the number of points on the first $(t+1)$ convex layers. We further propose a sampling algorithm with runtime $O(n+\mbox{poly}(\log{n}, t, 1/\epsilon))$, which with high probability finds a rectangle covering at least $(1-\epsilon)(n-t)$ points with at most the exact optimal area.


title: Learning Fast Adaptation on Cross-Accented Speech Recognition

abstract: Local dialects influence people to pronounce words of the same language differently from each other. The great variability and complex characteristics of accents creates a major challenge for training a robust and accent-agnostic automatic speech recognition (ASR) system. In this paper, we introduce a cross-accented English speech recognition task as a benchmark for measuring the ability of the model to adapt to unseen accents using the existing CommonVoice corpus. We also propose an accent-agnostic approach that extends the model-agnostic meta-learning (MAML) algorithm for fast adaptation to unseen accents. Our approach significantly outperforms joint training in both zero-shot, few-shot, and all-shot in the mixed-region and cross-region settings in terms of word error rate.


title: Notes on Randomized Algorithms

abstract: Lecture notes for the Yale Computer Science course CPSC 469/569 Randomized Algorithms. Suitable for use as a supplementary text for an introductory graduate or advanced undergraduate course on randomized algorithms. Discusses tools from probability theory, including random variables and expectations, union bound arguments, concentration bounds, applications of martingales and Markov chains, and the Lov\'asz Local Lemma. Algorithmic topics include analysis of classic randomized algorithms such as Quicksort and Hoare's FIND, randomized tree data structures, hashing, Markov chain Monte Carlo sampling, randomized approximate counting, derandomization, quantum computing, and some examples of randomized distributed algorithms.


title: Existence and uniqueness of solutions to the damped Navier-Stokes equations with Navier boundary conditions for three dimensional incompressible fluid

abstract: In this article, we study the solutions of the damped Navier--Stokes equation with Navier boundary condition in a bounded domain $\Omega$ in $\mathbb{R}^3$ with smooth boundary. The existence of the solutions is global with the damped term $\vartheta |u|^{\beta-1}u, \vartheta >0.$ The regularity and uniqueness of solutions with Navier boundary condition is also studied. This extends the existing results in literature.


title: Multidimensional Analysis of Excitonic Spectra of Monolayers of Tungsten Disulphide: Towards Computer Aided Identification of Structural and Environmental Perturbations of 2D Materials

abstract: Despite 2D materials holding great promise for a broad range of applications, the proliferation of devices and their fulfillment of real-life demands are still far from being realized. Experimentally obtainable samples commonly experience a wide range of perturbations (ripples and wrinkles, point and line defects, grain boundaries, strain field, doping, water intercalation, oxidation, edge reconstructions) significantly deviating the properties from idealistic models. These perturbations, in general, can be entangled or occur in groups with each group forming a complex perturbation making the interpretations of observable physical properties and the disentanglement of simultaneously acting effects a highly non-trivial task even for an experienced researcher. Here we generalise statistical correlation analysis of excitonic spectra of monolayer WS2, acquired by hyperspectral absorption and photoluminescence imaging, to a multidimensional case, and examine multidimensional correlations via unsupervised machine learning algorithms. Using principle component analysis we are able to identify 4 dominant components that are correlated with tensile strain, disorder induced by adsorption or intercalation of environmental molecules, multi-layer regions and charge doping, respectively. This approach has the potential to determine the local environment of WS2 monolayers or other 2D materials from simple optical measurements, and paves the way towards advanced, machine-aided, characterisation of monolayer matter.


title: Odds-Ratio Thompson Sampling to Control for Time-Varying Effect

abstract: Multi-armed bandit methods have been used for dynamic experiments particularly in online services. Among the methods, thompson sampling is widely used because it is simple but shows desirable performance. Many thompson sampling methods for binary rewards use logistic model that is written in a specific parameterization. In this study, we reparameterize logistic model with odds ratio parameters. This shows that thompson sampling can be used with subset of parameters. Based on this finding, we propose a novel method, "Odds-ratio thompson sampling", which is expected to work robust to time-varying effect. Use of the proposed method in continuous experiment is described with discussing a desirable property of the method. In simulation studies, the novel method works robust to temporal background effect, while the loss of performance was only marginal in case with no such effect. Finally, using dataset from real service, we showed that the novel method would gain greater rewards in practical environment.


title: Sporadic Ultra-Time-Critical Crowd Messaging in V2X

abstract: Life-critical warning message, abbreviated as warning message, is a special event-driven message that carries emergency warning information in Vehicle-to-Everything (V2X). Three important characteristics that distinguish warning messages from ordinary vehicular messages are sporadicity, crowding, and ultra-time-criticality. In other words, warning messages come only once in a while in a sporadic manner; however, when they come, they tend to come as a crowd and they need to be delivered in short order. This paper puts forth a medium-access control (MAC) protocol for warning messages. To circumvent potential inefficiency arising from sporadicity, we propose an override network architecture whereby warning messages are delivered on the spectrum of the ordinary vehicular messages. Specifically, a vehicle with a warning message first sends an interrupt signal to pre-empt the transmission of ordinary messages, so that the warning message can use the wireless spectrum originally allocated to ordinary messages. In this way, no exclusive spectrum resources need to be pre-allocated to the sporadic warning messages. To meet the crowding and ultra-time-criticality aspects, we use advanced channel access techniques to ensure highly reliable delivery of warning messages within an ultra-short time in the order of 10 ms. In short, the overall MAC protocol operates by means of interrupt-and-access.


title: Turbulence Enrichment using Physics-informed Generative Adversarial Networks

abstract: Generative Adversarial Networks (GANs) have been widely used for generating photo-realistic images. A variant of GANs called super-resolution GAN (SRGAN) has already been used successfully for image super-resolution where low resolution images can be upsampled to a $4\times$ larger image that is perceptually more realistic. However, when such generative models are used for data describing physical processes, there are additional known constraints that models must satisfy including governing equations and boundary conditions. In general, these constraints may not be obeyed by the generated data. In this work, we develop physics-based methods for generative enrichment of turbulence. We incorporate a physics-informed learning approach by a modification to the loss function to minimize the residuals of the governing equations for the generated data. We have analyzed two trained physics-informed models: a supervised model based on convolutional neural networks (CNN) and a generative model based on SRGAN: Turbulence Enrichment GAN (TEGAN), and show that they both outperform simple bicubic interpolation in turbulence enrichment. We have also shown that using the physics-informed learning can also significantly improve the model's ability in generating data that satisfies the physical governing equations. Finally, we compare the enriched data from TEGAN to show that it is able to recover statistical metrics of the flow field including energy metrics and well as inter-scale energy dynamics and flow morphology.


title: Denoised Smoothing: A Provable Defense for Pretrained Classifiers

abstract: We present a method for provably defending any pretrained image classifier against $\ell_p$ adversarial attacks. This method, for instance, allows public vision API providers and users to seamlessly convert pretrained non-robust classification services into provably robust ones. By prepending a custom-trained denoiser to any off-the-shelf image classifier and using randomized smoothing, we effectively create a new classifier that is guaranteed to be $\ell_p$-robust to adversarial examples, without modifying the pretrained classifier. Our approach applies to both the white-box and the black-box settings of the pretrained classifier. We refer to this defense as denoised smoothing, and we demonstrate its effectiveness through extensive experimentation on ImageNet and CIFAR-10. Finally, we use our approach to provably defend the Azure, Google, AWS, and ClarifAI image classification APIs. Our code replicating all the experiments in the paper can be found at: https://github.com/microsoft/denoised-smoothing.


title: High-Performance Atomically-Thin Room-Temperature NO2 Sensor

abstract: The development of room-temperature sensing devices for detecting small concentrations of molecular species is imperative for a wide range of low-power sensor applications. We demonstrate a room-temperature, highly sensitive, selective, and reversible chemical sensor based on a monolayer of the transition metal dichalcogenide Re0.5Nb0.5S2. The sensing device exhibits thickness dependent carrier type, and upon exposure to NO2 molecules, its electrical resistance considerably increases or decreases depending on the layer number. The sensor is selective to NO2 with only minimal response to other gases such as NH3, CH2O, and CO2. In the presence of humidity, not only are the sensing properties not deteriorated, but also the monolayer sensor shows complete reversibility with fast recovery at room temperature. We present a theoretical analysis of the sensing platform and identify the atomically-sensitive transduction mechanism.


title: Quantum Experiments and Hypergraphs: Multi-Photon Sources for Quantum Interference, Quantum Computation and Quantum Entanglement

abstract: We introduce the concept of hypergraphs to describe quantum optical experiments with probabilistic multi-photon sources. Every hyperedge represents a correlated photon source, and every vertex stands for an optical output path. Such general graph description provides new insights for producing complex high-dimensional multi-photon quantum entangled states, which go beyond limitations imposed by pair creation via spontaneous parametric down-conversion. Furthermore, properties of hypergraphs can be investigated experimentally. For example, the NP-Complete problem of deciding whether a hypergraph has a perfect matchin can be answered by experimentally detecting multi-photon events in quantum experiments. By introducing complex weights in hypergraphs, we show a general many-particle quantum interference and manipulating entanglement in a pictorial way. Our work paves the path for the development of multi-photon high-dimensional state generation and might inspire new applications of quantum computations using hypergraph mappings.


title: Multiwaveband Quasi--periodic Oscillation in the Blazar 3C 454.3

abstract: We report the detection ($>4\sigma$) of a Quasi-Periodic Oscillation (QPO) in the $\gamma$-ray light curve of 3C 454.3 along with a simultaneous marginal QPO detection ($>2.4\sigma$) in the optical light curves. Periodic flux modulations were detected in both of these wavebands with a dominant period of $\sim 47$ days. The $\gamma$-ray QPO lasted for over 450 days (from MJD 56800 to 57250) resulting in over nine observed cycles which is among the highest number of periods ever detected in a blazar light curve. The optical light curve was not well sampled for almost half of the $\gamma$-ray QPO span due to the daytime transit of the source, which could explain the lower significance of the optical QPO. Autoregressive Integrated Moving Average (ARIMA) modelling of the light curve revealed a significant, exponentially decaying, trend in the light curve during the QPO, along with the $47$ days periodicity. We explore several physical models to explain the origin of this transient quasi-periodic modulation and the overall trend in the observed flux with a month-like period. These scenarios include a binary black hole system, a hotspot orbiting close to the innermost stable circular orbit of the supermassive black hole, and precessing jets. We conclude that the most likely scenario involves a region of enhanced emission moving helically inside a curved jet. The helical motion gives rise to the QPO and the curvature ($\sim 0.05^{\circ}$ pc$^{-1}$) of the jet is responsible for the observed trend in the light curve.


title: Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks

abstract: The main source of information regarding ancient Mesopotamian history and culture are clay cuneiform tablets. Despite being an invaluable resource, many tablets are fragmented leading to missing information. Currently these missing parts are manually completed by experts. In this work we investigate the possibility of assisting scholars and even automatically completing the breaks in ancient Akkadian texts from Achaemenid period Babylonia by modelling the language using recurrent neural networks.


title: Reveal of Domain Effect: How Visual Restoration Contributes to Object Detection in Aquatic Scenes

abstract: Underwater robotic perception usually requires visual restoration and object detection, both of which have been studied for many years. Meanwhile, data domain has a huge impact on modern data-driven leaning process. However, exactly indicating domain effect, the relation between restoration and detection remains unclear. In this paper, we generally investigate the relation of quality-diverse data domain to detection performance. In the meantime, we unveil how visual restoration contributes to object detection in real-world underwater scenes. According to our analysis, five key discoveries are reported: 1) Domain quality has an ignorable effect on within-domain convolutional representation and detection accuracy; 2) low-quality domain leads to higher generalization ability in cross-domain detection; 3) low-quality domain can hardly be well learned in a domain-mixed learning process; 4) degrading recall efficiency, restoration cannot improve within-domain detection accuracy; 5) visual restoration is beneficial to detection in the wild by reducing the domain shift between training data and real-world scenes. Finally, as an illustrative example, we successfully perform underwater object detection with an aquatic robot.


title: Conic Formation in Presence of Faulty Robots

abstract: Pattern formation is one of the most fundamental problems in distributed computing, which has recently received much attention. In this paper, we initiate the study of distributed pattern formation in situations when some robots can be \textit{faulty}. In particular, we consider the well-established \textit{look-compute-move} model with oblivious, anonymous robots. We first present lower bounds and show that any deterministic algorithm takes at least two rounds to form simple patterns in the presence of faulty robots. We then present distributed algorithms for our problem which match this bound, \textit{for conic sections}: in at most two rounds, robots form lines, circles and parabola tolerating $f=2,3$ and $4$ faults, respectively. For $f=5$, the target patterns are parabola, hyperbola and ellipse. We show that the resulting pattern includes the $f$ faulty robots in the pattern of $n$ robots, where $n \geq 2f+1$, and that $f < n < 2f+1$ robots cannot form such patterns. We conclude by discussing several relaxations and extensions.


title: Enhancement of Giant Rashba Splitting in BiTeI under Asymmetric Interlayer Interaction

abstract: We carry out density functional theory calculation to enhance the Rashba spin splitting (RSS) of BiTeI by modifying the interlayer interaction. It is shown that RSS increases as the Te layer approaches to adjacent Bi layer or the I layer recedes from the Bi layer. Our results indicate that the RSS can be sensitively increased by introducing a vacancy on the Te site to make effective Bi-Te distance shorter. It is also found that the difference of Te p orbital character between two spin-split bands increases when the RSS is developed along crystal momentum, which supports asymmetric interlayer interaction in the spin-split bands. Our work suggests that the modification of interlayer interaction is an effective approach in the modeling of the RSS in BiTeI and other layered materials.


title: Optimal Deep Learning for Robot Touch

abstract: This article illustrates the application of deep learning to robot touch by considering a basic yet fundamental capability: estimating the relative pose of part of an object in contact with a tactile sensor. We begin by surveying deep learning applied to tactile robotics, focussing on optical tactile sensors, which help bridge from deep learning for vision to touch. We then show how deep learning can be used to train accurate pose models of 3D surfaces and edges that are insensitive to nuisance variables such as motion-dependent shear. This involves including representative motions as unlabelled perturbations of the training data and using Bayesian optimization of the network and training hyperparameters to find the most accurate models. Accurate estimation of pose from touch will enable robots to safely and precisely control their physical interactions, underlying a wide range of object exploration and manipulation tasks.


title: Learning to Hash with Graph Neural Networks for Recommender Systems

abstract: Graph representation learning has attracted much attention in supporting high quality candidate search at scale. Despite its effectiveness in learning embedding vectors for objects in the user-item interaction network, the computational costs to infer users' preferences in continuous embedding space are tremendous. In this work, we investigate the problem of hashing with graph neural networks (GNNs) for high quality retrieval, and propose a simple yet effective discrete representation learning framework to jointly learn continuous and discrete codes. Specifically, a deep hashing with GNNs (HashGNN) is presented, which consists of two components, a GNN encoder for learning node representations, and a hash layer for encoding representations to hash codes. The whole architecture is trained end-to-end by jointly optimizing two losses, i.e., reconstruction loss from reconstructing observed links, and ranking loss from preserving the relative ordering of hash codes. A novel discrete optimization strategy based on straight through estimator (STE) with guidance is proposed. The principal idea is to avoid gradient magnification in back-propagation of STE with continuous embedding guidance, in which we begin from learning an easier network that mimic the continuous embedding and let it evolve during the training until it finally goes back to STE. Comprehensive experiments over three publicly available and one real-world Alibaba company datasets demonstrate that our model not only can achieve comparable performance compared with its continuous counterpart but also runs multiple times faster during inference.


title: Deutsch paths and their enumeration

abstract: A variation of Dyck paths allows for down-steps of arbitrary length, not just one. Credits for this invention are given to Emeric Deutsch. Surprisingly, the enumeration of them is somewhat akin to the analysis of Motzkin-paths; the last section contains a bijection.


title: The rarity of repeating fast radio bursts from binary neutron star mergers

abstract: Fast radio bursts (FRBs) are extragalactic, bright pulses of emission at radio frequency with milliseconds duration. Observationally, FRBs can be divided into two classes, repeating FRBs and non-repeating FRBs. At present, twenty repeating FRBs have been discovered with unknown physical origins. Localization of the first repeating FRB 121102 and discovery of an associated persistent radio source support that FRBs are powered by young millisecond magnetars, which could be formed by core-collapses of massive stars or binary neutron stars mergers. These two formation channels can be distinguished by gravitational waves generated by binary neutron stars mergers. We first calculate the lower limit of the local formation rate of repeating FRBs observed by the Canadian Hydrogen Intensity Mapping Experiment (CHIME) . Then we show that only a small fraction ($6\%$) of repeating FRBs is produced by young magnetars from binary neutron star mergers, basing on the gravitational wave detections by the third observing run (O3) of Advanced LIGO/Virgo gravitational-wave detectors. Therefore, we believe that repeating FRBs are more likely produced by the magnetars newborn from the core-collapses of massive stars rather than the magnetars from the binary neutron stars mergers.


title: ETRI-Activity3D: A Large-Scale RGB-D Dataset for Robots to Recognize Daily Activities of the Elderly

abstract: Deep learning, based on which many modern algorithms operate, is well known to be data-hungry. In particular, the datasets appropriate for the intended application are difficult to obtain. To cope with this situation, we introduce a new dataset called ETRI-Activity3D, focusing on the daily activities of the elderly in robot-view. The major characteristics of the new dataset are as follows: 1) practical action categories that are selected from the close observation of the daily lives of the elderly; 2) realistic data collection, which reflects the robot's working environment and service situations; and 3) a large-scale dataset that overcomes the limitations of the current 3D activity analysis benchmark datasets. The proposed dataset contains 112,620 samples including RGB videos, depth maps, and skeleton sequences. During the data acquisition, 100 subjects were asked to perform 55 daily activities. Additionally, we propose a novel network called four-stream adaptive CNN (FSA-CNN). The proposed FSA-CNN has three main properties: robustness to spatio-temporal variations, input-adaptive activation function, and extension of the conventional two-stream approach. In the experiment section, we confirmed the superiority of the proposed FSA-CNN using NTU RGB+D and ETRI-Activity3D. Further, the domain difference between both groups of age was verified experimentally. Finally, the extension of FSA-CNN to deal with the multimodal data was investigated.


title: The Absent-Minded Passengers Problem: A Motivating Challenge Solved by Computer Algebra

abstract: In (S.B. Ekhad and D. Zeilberger, 2020) an exciting case study has been initiated in which experimental mathematics and symbolic computation are utilized to discover new properties concerning the so-called Absent-Minded Passengers Problem. Based on these results, Doron Zeilberger raised some challenging tasks to gain further probabilistic insight. In this note we report on this enterprise. In particular, we demonstrate how the computer algebra packages of RISC can be used to carry out the underlying heavy calculations.


title: Taking a hint: How to leverage loss predictors in contextual bandits?

abstract: We initiate the study of learning in contextual bandits with the help of loss predictors. The main question we address is whether one can improve over the minimax regret $\mathcal{O}(\sqrt{T})$ for learning over $T$ rounds, when the total error of the predictor $\mathcal{E} \leq T$ is relatively small. We provide a complete answer to this question, including upper and lower bounds for various settings: adversarial versus stochastic environments, known versus unknown $\mathcal{E}$, and single versus multiple predictors. We show several surprising results, such as 1) the optimal regret is $\mathcal{O}(\min\{\sqrt{T}, \sqrt{\mathcal{E}}T^\frac{1}{4}\})$ when $\mathcal{E}$ is known, a sharp contrast to the standard and better bound $\mathcal{O}(\sqrt{\mathcal{E}})$ for non-contextual problems (such as multi-armed bandits); 2) the same bound cannot be achieved if $\mathcal{E}$ is unknown, but as a remedy, $\mathcal{O}(\sqrt{\mathcal{E}}T^\frac{1}{3})$ is achievable; 3) with $M$ predictors, a linear dependence on $M$ is necessary, even if logarithmic dependence is possible for non-contextual problems. We also develop several novel algorithmic techniques to achieve matching upper bounds, including 1) a key action remapping technique for optimal regret with known $\mathcal{E}$, 2) implementing Catoni's robust mean estimator efficiently via an ERM oracle leading to an efficient algorithm in the stochastic setting with optimal regret, 3) constructing an underestimator for $\mathcal{E}$ via estimating the histogram with bins of exponentially increasing size for the stochastic setting with unknown $\mathcal{E}$, and 4) a self-referential scheme for learning with multiple predictors, all of which might be of independent interest.


title: A versatile numerical approach for calculating the fracture toughness and R-curves of cellular materials

abstract: We develop a numerical methodology for the calculation of mode-I R-curves of brittle and elastoplastic lattice materials, and unveil the impact of lattice topology, relative density and constituent material behavior on the toughening response of 2D isotropic lattices. The approach is based on finite element calculations of the J-integral on a single-edge-notch-bend (SENB) specimen, with individual bars modeled as beams having a linear elastic or a power-law elasto-plastic constitutive behavior and a maximum strain-based damage model. Results for three 2D isotropic lattice topologies (triangular, hexagonal and kagome) and two constituent materials (representative of a brittle ceramic (silicon carbide) and a strain hardening elasto-plastic metal (titanium alloy)) are presented. We extract initial fracture toughness and R-curves for all lattices and show that (i) elastic brittle triangular lattices exhibit toughening (rising R-curve), and (ii) elasto-plastic triangular lattices display significant toughening, while elasto-plastic hexagonal lattices fail in a brittle manner. We show that the difference in such failure behavior can be explained by the size of the plastic zone that grows upon crack propagation, and conclude that the nature of crack propagation in lattices (brittle vs ductile) depends both on the constituent material and the lattice architecture. While results are presented for 2D truss-lattices, the proposed approach can be easily applied to 3D truss and shell-lattices, as long as the crack tip lies within the empty space of a unit cell.


title: GraphTTS: graph-to-sequence modelling in neural text-to-speech

abstract: This paper leverages the graph-to-sequence method in neural text-to-speech (GraphTTS), which maps the graph embedding of the input sequence to spectrograms. The graphical inputs consist of node and edge representations constructed from input texts. The encoding of these graphical inputs incorporates syntax information by a GNN encoder module. Besides, applying the encoder of GraphTTS as a graph auxiliary encoder (GAE) can analyse prosody information from the semantic structure of texts. This can remove the manual selection of reference audios process and makes prosody modelling an end-to-end procedure. Experimental analysis shows that GraphTTS outperforms the state-of-the-art sequence-to-sequence models by 0.24 in Mean Opinion Score (MOS). GAE can adjust the pause, ventilation and tones of synthesised audios automatically. This experimental conclusion may give some inspiration to researchers working on improving speech synthesis prosody.


title: Explicit bound for the number of primes in arithmetic progressions assuming the Generalized Riemann Hypothesis

abstract: We prove an explicit error term for the $\psi(x,\chi)$ function assuming the Generalized Riemann Hypothesis. Using this estimate, we prove a conditional explicit bound for the number of primes in arithmetic progressions.


title: Transformation Importance with Applications to Cosmology

abstract: Machine learning lies at the heart of new possibilities for scientific discovery, knowledge generation, and artificial intelligence. Its potential benefits to these fields requires going beyond predictive accuracy and focusing on interpretability. In particular, many scientific problems require interpretations in a domain-specific interpretable feature space (e.g. the frequency domain) whereas attributions to the raw features (e.g. the pixel space) may be unintelligible or even misleading. To address this challenge, we propose TRIM (TRansformation IMportance), a novel approach which attributes importances to features in a transformed space and can be applied post-hoc to a fully trained model. TRIM is motivated by a cosmological parameter estimation problem using deep neural networks (DNNs) on simulated data, but it is generally applicable across domains/models and can be combined with any local interpretation method. In our cosmology example, combining TRIM with contextual decomposition shows promising results for identifying which frequencies a DNN uses, helping cosmologists to understand and validate that the model learns appropriate physical features rather than simulation artifacts.


title: DefogGAN: Predicting Hidden Information in the StarCraft Fog of War with Generative Adversarial Nets

abstract: We propose DefogGAN, a generative approach to the problem of inferring state information hidden in the fog of war for real-time strategy (RTS) games. Given a partially observed state, DefogGAN generates defogged images of a game as predictive information. Such information can lead to create a strategic agent for the game. DefogGAN is a conditional GAN variant featuring pyramidal reconstruction loss to optimize on multiple feature resolution scales.We have validated DefogGAN empirically using a large dataset of professional StarCraft replays. Our results indicate that DefogGAN can predict the enemy buildings and combat units as accurately as professional players do and achieves a superior performance among state-of-the-art defoggers.


title: Coded Caching with Uneven Channels: A Quality of Experience Approach

abstract: The rate performance of wireless coded caching schemes is typically limited by the lowest achievable per-user rate in the given multicast group, during each transmission time slot. In this paper, we provide a new coded caching scheme, alleviating this worst-user effect for the prominent case of multimedia applications. In our scheme, instead of maximizing the symmetric rate among all served users, we maximize the total quality of experience (QoE); where QoE at each user is defined as the video quality perceived by that user. We show the new scheme requires solving an NP-hard optimization problem. Thus, we provide two heuristic algorithms to solve it in an approximate manner; and numerically demonstrate the near-optimality of the proposed approximations. Our approach allows flexible allocation of distinct video quality for each user, making wireless coded caching schemes more suitable for real-world implementations.


title: Ballistic transport in disordered Dirac and Weyl semimetals

abstract: We study the dynamics of Dirac and Weyl electrons in disordered point-node semimetals. The ballistic feature of the transport is demonstrated by simulating the wave-packet dynamics on lattice models. We show that the ballistic transport survives under a considerable strength of disorder up to the semimetal-metal transition point, which indicates the robustness of point-node semimetals against disorder. We also visualize the robustness of the nodal points and linear dispersion under broken translational symmetry. The speed of the wave packets slows down with increasing disorder strength, and vanishes toward the critical strength of disorder, hence becoming the order parameter. The obtained critical behavior of the speed of the wave packets is consistent with that predicted by the scaling conjecture.


title: Reconstructed Discontinuous Approximation to Stokes Equation in A Sequential Least Squares Formulation

abstract: We propose a new least squares finite element method to solve the Stokes problem with two sequential steps. The approximation spaces are constructed by patch reconstruction with one unknown per element. For the first step, we reconstruct an approximation space consisting of piecewise curl-free polynomials with zero trace. By this space, we minimize a least squaresfunctional toobtain thenumericalapproximationstothe gradientof thevelocityand the pressure. In the second step, we minimize another least squares functional to give the solution to the velocity in the reconstructed piecewise divergence-free space. We derive error estimates for all unknowns under L2 norms and energy norms. Numerical results in two dimensions and three dimensions verify the convergence rates and demonstrate the great flexibility of our method.


title: Particle-size-dependent acoustophoretic motion and depletion of micro- and nanoparticles at long time scales

abstract: We present three-dimensional measurements of size-dependent acoustophoretic motion of microparticles with diameters from 4.8 um down to 0.5 um suspended in either homogeneous or inhomogeneous fluids inside a glass-silicon microchannel and exposed to a standing ultrasound wave. To study the cross-over from radiation force dominated to streaming dominated motion as the particle size is decreased, we extend previous studies to long time scales, where the particles smaller than the cross-over size move over distances comparable to the channel width. We observe a particle-size-dependent particle depletion at late times for the particles smaller than the cross-over size. The mechanisms behind this depletion in homogeneous fluids are rationalized by numerical simulations which take the Brownian motion into account. Experimentally, the particle trajectories in inhomogeneous fluids show focusing in the bulk of the microchannel at early times, even for the particles below the critical size, which clearly demonstrates the potential to manipulate submicrometer particles.


title: The generalized covariant Hamilton system in complex coordinates

abstract: Imitating methods of working on the GCHS and GSPB defined on ${{\mathbb{R}}^{r}}$ in real coordinates, an attempt to follow this way in complex coordinates is considered, then we try to generalize the PB on ${{\mathbb{C}}^{n}}$ in complex coordinates to the GSPB with zero restriction of the non-degeneracy expressed in complex coordinates that is compatible with the real case in formulas. Thusly, then the GCHS in complex coordinates defined by the GSPB is self-consistent to the real situation. Meanwhile, we find some difference of the GCHS between the real and complex case in formula. Much of what distinguishes a GCHS in real coordinates from a GCHS in complex coordinates is that the TGHS in complex form has an extra expression.


title: Distributed Optimization With Event-triggered Communication via Input Feedforward Passivity

abstract: In this work, we address the distributed optimization problem with event-triggered communication by the notion of input feedforward passivity (IFP). First, we analyze the distributed continuous-time algorithm over uniformly jointly strongly connected balanced digraphs in an IFP-based framework. Then, we propose a distributed event-triggered communication mechanism for this algorithm. Next, we discretize the continuous-time algorithm by the forward Euler method with a constant stepsize irrelevant to network size, and show that the discretization can be seen as a stepsize-dependent passivity degradation of the input feedforward passivity. Thus, the discretized system preserves the IFP property and enables the same event-triggered communication mechanism but without Zeno behavior due to the discrete-time nature. Finally, a numerical example is presented to illustrate our results.


title: Extended Cuscuton as Dark Energy

abstract: Late-time cosmology in the extended cuscuton theory is studied, in which gravity is modified while one still has no extra dynamical degrees of freedom other than two tensor modes. We present a simple example admitting analytic solutions for the cosmological background evolution that mimics $\Lambda$CDM cosmology. We argue that the extended cuscuton as dark energy can be constrained, like usual scalar-tensor theories, by the growth history of matter density perturbations and the time variation of Newton's constant.


title: Intuitionistic Mathematics and Logic

abstract: The first seeds of mathematical intuitionism germinated in Europe over a century ago in the constructive tendencies of Borel, Baire, Lebesque, Poincar\'e, Kronecker and others. The flowering was the work of one man, Luitzen Egbertus Jan Brouwer, who taught mathematics at the University of Amsterdam from 1909 until 1951. By proving powerful theorems on topological invariants and fixed points of continuous mappings, Brouwer quickly build a mathematical reputation strong enough to support his revolutionary ideas about the nature of mathematical activity. These ideas influenced Hilbert and G\"odel and established intuitionistic logic and mathematics as subjects worthy of independent study. Our aim is to describe the development of Brouwer's intuitionism, from his rejection of the classical law of excluded middle to his controversial theory of the continuum, with fundamental consequences for logic and mathematics. We borrow Kleene's formal axiomatic systems (incorporating earlier attempts by Kolmogorov, Glivenko, Heyting and Peano) for intuitionistic logic and arithmetic as subtheories of the corresponding classical theories, and sketch his use of g\"odel numbers of recursive functions to realize sentences of intuitionistic arithmetic including a form of Church's Thesis. Finally, we present Kleene and Vesley's axiomatic treatment of Brouwer's continuum, with the function-realizability interpretation which establishes its consistency.


title: Automatic Signboard Detection and Localization in Densely Populated Developing Cities

abstract: Most city establishments of developing cities are digitally unlabeled because of the lack of automatic annotation systems. Hence location and trajectory services such as Google Maps, Uber etc remain underutilized in such cities. Accurate signboard detection in natural scene images is the foremost task for error-free information retrieval from such city streets. Yet, developing accurate signboard localization system is still an unresolved challenge because of its diverse appearances that include textual images and perplexing backgrounds. We present a novel object detection approach that can detect signboards automatically and is suitable for such cities. We use Faster R-CNN based localization by incorporating two specialized pretraining methods and a run time efficient hyperparameter value selection algorithm. We have taken an incremental approach in reaching our final proposed method through detailed evaluation and comparison with baselines using our constructed SVSO (Street View Signboard Objects) signboard dataset containing signboard natural scene images of six developing countries. We demonstrate state-of-the-art performance of our proposed method on both SVSO dataset and Open Image Dataset. Our proposed method can detect signboards accurately (even if the images contain multiple signboards with diverse shapes and colours in a noisy background) achieving 0.90 mAP (mean average precision) score on SVSO independent test set. Our implementation is available at: https://github.com/sadrultoaha/Signboard-Detection


title: The interval greedy algorithm for discrete optimization problems with interval objective function

abstract: We consider a wide class of the discrete optimization problems with interval objective function. We give a generalization of the greedy algorithm for the problems. Using the algorithm, we obtain the set of all possible greedy solutions and the set of all possible values of the objective function for the solutions. For a given probability distribution on intervals of objective function' coefficients, we compute probabilities of the solutions, compute expected values of the objective function for them and other probabilistic characteristics of the problem.


title: High-purity free-electron momentum states prepared by three-dimensional optical phase modulation

abstract: We demonstrate the quantized transfer of photon energy and transverse momentum to a high-coherence electron beam. In an ultrafast transmission electron microscope, a three-dimensional phase modulation of the electron wavefunction is induced by transmitting the beam through a laser-illuminated thin graphite sheet. This all-optical free-electron phase space control results in high-purity superpositions of linear momentum states, providing an elementary component for optically programmable electron phase plates and beam splitters.

categories: physics.optics cond-mat.mes-hall physics.ins-det quant-ph


title: Band Gap Estimation of Multilayer 2D Semiconductor Channels Using Thin Graphite Contact

abstract: Band gap of monolayer and few layers in two dimensional (2D) semiconductors has usually been measured by optical probing such as photoluminescence (PL). However, if their exfoliated thickness is as large as a few nm (multilayer over ~5L), PL measurements become less effective and inaccurate because the optical transition of 2D semiconductor is changed from direct to indirect mode. Here, we introduce another way to estimate the bandgap of multilayer 2D van der Waals semiconductors; that is utilizing field effect transistor (FET) as a platform. We used graphene (thin graphite or multilayer graphene) contact for multilayer van der Waals channels in FET, because graphene contact would secure ambipolar behavior and enable Schottky contact barrier tuning of FETs with the assistance of top passivation. As a result, the bandgaps of multilayer transition metal dichalcogenides and black phosphorus in unknown thickness were successfully estimated through measuring the temperature-dependent transfer curve characteristics of prepared 2D FETs with graphene contact.


title: Zero frequency zonal flow excitation by energetic electron driven beta-induced Alfven eigenmode

abstract: Zero frequency zonal flow (ZFZF) excitation by trapped energetic electron driven beta-induced Alfven eigenmode (eBAE) is investigated using nonlinear gyrokinetic theory. It is found that, during the linear growth stage of eBAE, resonant energetic electrons (EEs) not only effectively drive eBAE unstable, but also contribute to the nonlinear coupling, leading to ZFZF excitation. The trapped EE contribution to ZFZF generation is dominated by EE responses to eBAE in the ideal region, and is comparable to thermal plasma contribution to Reynolds and Maxwell stresses.


title: Gaussianization Flows

abstract: Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that enables both efficient computation of likelihoods and efficient inversion for sample generation. We demonstrate that these models, named Gaussianization flows, are universal approximators for continuous probability distributions under some regularity conditions. Because of this guaranteed expressivity, they can capture multimodal target distributions without compromising the efficiency of sample generation. Experimentally, we show that Gaussianization flows achieve better or comparable performance on several tabular datasets compared to other efficiently invertible flow models such as Real NVP, Glow and FFJORD. In particular, Gaussianization flows are easier to initialize, demonstrate better robustness with respect to different transformations of the training data, and generalize better on small training sets.


title: Holevo Capacity of Discrete Weyl Channels

abstract: Holevo capacity is the maximum rate at which a quantum channel can reliably transmit classical information without entanglement. However, calculating the Holevo capacity of arbitrary quantum channels is a nontrivial and computationally expensive task since it requires the numerical optimization over all possible input quantum states. In this paper, we consider discrete Weyl channels (DWCs) and exploit their symmetry properties to model DWC as a classical symmetric channel. We characterize lower and upper bounds on the Holevo capacity of DWCs using simple computational formulae. Then, we provide a sufficient and necessary condition where the upper and lower bounds coincide. The framework in this paper enables us to characterize the exact Holevo capacity for most of the known special cases of DWCs.


title: Machine Learning of Mechanical Properties of Steels

abstract: The mechanical properties are essential for structural materials. The analyzed 360 data on four mechanical properties of steels, viz. fatigue strength, tensile strength, fracture strength, and hardness, are selected from the NIMS database, including carbon steels, and low-alloy steels. Five machine learning algorithms were applied on the 360 data to predict the mechanical properties and random forest regression illustrates the best performance. The feature selection was conducted by random forest and symbolic regressions, leading to the four most important features of tempering temperature, and alloying elements of carbon, chromium, and molybdenum to the mechanical properties of steels. Besides, mathematic expressions were generated via symbolic regression, and the expressions explicitly predict how each of the four mechanical properties varies quantitatively with the four most important features. The present work demonstrates the great potential of symbolic regression in the discovery of novel advanced materials.


title: Semixup: In- and Out-of-Manifold Regularization for Deep Semi-Supervised Knee Osteoarthritis Severity Grading from Plain Radiographs

abstract: Knee osteoarthritis (OA) is one of the highest disability factors in the world. This musculoskeletal disorder is assessed from clinical symptoms, and typically confirmed via radiographic assessment. This visual assessment done by a radiologist requires experience, and suffers from moderate to high inter-observer variability. The recent literature has shown that deep learning methods can reliably perform the OA severity assessment according to the gold standard Kellgren-Lawrence (KL) grading system. However, these methods require large amounts of labeled data, which are costly to obtain. In this study, we propose the Semixup algorithm, a semi-supervised learning (SSL) approach to leverage unlabeled data. Semixup relies on consistency regularization using in- and out-of-manifold samples, together with interpolated consistency. On an independent test set, our method significantly outperformed other state-of-the-art SSL methods in most cases. Finally, when compared to a well-tuned fully supervised baseline that yielded a balanced accuracy (BA) of $70.9\pm0.8%$ on the test set, Semixup had comparable performance -- BA of $71\pm0.8%$ $(p=0.368)$ while requiring $6$ times less labeled data. These results show that our proposed SSL method allows building fully automatic OA severity assessment tools with datasets that are available outside research settings.


title: A mean-field game price model with noise

abstract: In this paper, we propose a mean-field game model for the price formation of a commodity whose production is subjected to random fluctuations. The model generalizes existing deterministic price formation models. Agents seek to minimize their average cost by choosing their trading rates with a price that is characterized by a balance between supply and demand. The supply and the price processes are assumed to follow stochastic differential equations. Here, we show that, for linear dynamics and quadratic costs, the optimal trading rates are determined in feedback form. Hence, the price arises as the solution to a stochastic differential equation, whose coefficients depend on the solution of a system of ordinary differential equations.


title: Alleviating confounding in spatio-temporal areal models with an application on crimes against women in India

abstract: Assessing associations between a response of interest and a set of covariates in spatial areal models is the leitmotiv of ecological regression. However, the presence of spatially correlated random effects can mask or even bias estimates of such associations due to confounding effects if they are not carefully handled. Though potentially harmful, confounding issues have often been ignored in practice leading to wrong conclusions about the underlying associations between the response and the covariates. In spatio-temporal areal models, the temporal dimension may emerge as a new source of confounding, and the problem may be even worse. In this work, we propose two approaches to deal with confounding of fixed effects by spatial and temporal random effects, while obtaining good model predictions. In particular, restricted regression and an apparently -- though in fact not -- equivalent procedure using constraints are proposed within both fully Bayes and empirical Bayes approaches. The methods are compared in terms of fixed-effect estimates and model selection criteria. The techniques are used to assess the association between dowry deaths and certain socio-demographic covariates in the districts of Uttar Pradesh, India.


title: ADRN: Attention-based Deep Residual Network for Hyperspectral Image Denoising

abstract: Hyperspectral image (HSI) denoising is of crucial importance for many subsequent applications, such as HSI classification and interpretation. In this paper, we propose an attention-based deep residual network to directly learn a mapping from noisy HSI to the clean one. To jointly utilize the spatial-spectral information, the current band and its $K$ adjacent bands are simultaneously exploited as the input. Then, we adopt convolution layer with different filter sizes to fuse the multi-scale feature, and use shortcut connection to incorporate the multi-level information for better noise removal. In addition, the channel attention mechanism is employed to make the network concentrate on the most relevant auxiliary information and features that are beneficial to the denoising process best. To ease the training procedure, we reconstruct the output through a residual mode rather than a straightforward prediction. Experimental results demonstrate that our proposed ADRN scheme outperforms the state-of-the-art methods both in quantitative and visual evaluations.


title: Adaptation in Online Social Learning

abstract: This work studies social learning under non-stationary conditions. Although designed for online inference, classic social learning algorithms perform poorly under drifting conditions. To mitigate this drawback, we propose the Adaptive Social Learning (ASL) strategy. This strategy leverages an adaptive Bayesian update, where the adaptation degree can be modulated by tuning a suitable step-size parameter. The learning performance of the ASL algorithm is examined by means of a steady-state analysis. It is shown that, under the regime of small step-sizes: i) consistent learning is possible; ii) an accurate prediction of the performance can be furnished in terms of a Gaussian approximation.


title: The rate of convergence of harmonic explorer to SLE4

abstract: Using the estimate of the difference between the discrete harmonic function and its corresponding continuous version we derive a rate of convergence of the Loewner driving function for the harmonic explorer to the Brownian motion with speed 4 on the real line. Based on this convergence rate, the derivative estimate for chordal $\mbox{SLE}_4$, and the estimate of tip structure modulus for harmonic explorer paths, we obtain an explicit power-law rate of convergence of the harmonic explorer paths to the trace of chordal $\mbox{SLE}_4$ in the supremum distance.


title: AlignTTS: Efficient Feed-Forward Text-to-Speech System without Explicit Alignment

abstract: Targeting at both high efficiency and performance, we propose AlignTTS to predict the mel-spectrum in parallel. AlignTTS is based on a Feed-Forward Transformer which generates mel-spectrum from a sequence of characters, and the duration of each character is determined by a duration predictor.Instead of adopting the attention mechanism in Transformer TTS to align text to mel-spectrum, the alignment loss is presented to consider all possible alignments in training by use of dynamic programming. Experiments on the LJSpeech dataset show that our model achieves not only state-of-the-art performance which outperforms Transformer TTS by 0.03 in mean option score (MOS), but also a high efficiency which is more than 50 times faster than real-time.


title: Multiclass classification by sparse multinomial logistic regression

abstract: In this paper we consider high-dimensional multiclass classification by sparse multinomial logistic regression. We propose first a feature selection procedure based on penalized maximum likelihood with a complexity penalty on the model size and derive the nonasymptotic bounds for misclassification excess risk of the resulting classifier. We establish also their tightness by deriving the corresponding minimax lower bounds. In particular, we show that there exist two regimes corresponding to small and large number of classes. The bounds can be reduced under the additional low noise condition. To find a penalized maximum likelihood solution with a complexity penalty requires, however, a combinatorial search over all possible models. To design a feature selection procedure computationally feasible for high-dimensional data, we propose multinomial logistic group Lasso and Slope classifiers and show that they also achieve the minimax order.


title: On Convergent Poincar\'e-Moser Reduction for Levi Degenerate Embedded $5$-Dimensional CR Manifolds

abstract: Applying Lie's theory, we show that any $\mathcal{C}^\omega$ hypersurface $M^5 \subset \mathbb{C}^3$ in the class $\mathfrak{C}_{2,1}$ carries Cartan-Moser chains of orders $1$ and $2$. Integrating and straightening any order $2$ chain at any point $p \in M$ to be the $v$-axis in coordinates $(z, \zeta, w = u + i\, v)$ centered at $p$, we show that there exists a (unique up to 5 parameters) convergent change of complex coordinates fixing the origin in which $\gamma$ is the $v$-axis so that $M = \{u=F(z,\zeta,\overline{z},\overline{\zeta},v)\}$ has Poincar\'e-Moser reduced equation: \begin{align} u & = z\overline{z} + \tfrac{1}{2}\,\overline{z}^2\zeta + \tfrac{1}{2}\,z^2\overline{\zeta} + z\overline{z}\zeta\overline{\zeta} + \tfrac{1}{2}\,\overline{z}^2\zeta\zeta\overline{\zeta} + \tfrac{1}{2}\,z^2\overline{\zeta}\zeta\overline{\zeta} + z\overline{z}\zeta\overline{\zeta}\zeta\overline{\zeta} \\ & + 2{\rm Re} \{ z^3\overline{\zeta}^2 F_{3,0,0,2}(v) + \zeta\overline{\zeta} ( 3\,{z}^2\overline{z}\overline{\zeta} F_{3,0,0,2}(v) ) \} \\ & + 2{\rm Re} \{ z^5\overline{\zeta} F_{5,0,0,1}(v) + z^4\overline{\zeta}^2 F_{4,0,0,2}(v) + z^3\overline{z}^2\overline{\zeta} F_{3,0,2,1}(v) + z^3\overline{z}\overline{\zeta}^2 F_{3,0,1,2}(v) + z^3{\overline{\zeta}}^3 F_{3,0,0,3}(v) \} \\ & + z^3\overline{z}^3 {\rm O}_{z,\overline{z}}(1) + 2{\rm Re} ( \overline{z}^3\zeta {\rm O}_{z,\zeta,\overline{z}}(3) ) + \zeta\overline{\zeta}\, {\rm O}_{z,\zeta,\overline{z},\overline{\zeta}}(5). \end{align} The values at the origin of Pocchiola's two primary invariants are: \[ W_0 = 4\overline{F_{3,0,0,2}(0)}, \quad\quad J_0 = 20\, F_{5,0,0,1}(0). \] The proofs are detailed, accessible to non-experts. The computer-generated aspects (upcoming) have been reduced to a minimum.


title: Limit distribution of a time-dependent quantum walk on the half line

abstract: We focus on a 2-period time-dependent quantum walk on the half line in this paper. The quantum walker launches at the edge of the half line in a localized superposition state and its time evolution is carried out with two unitary operations which are alternately cast to the quantum walk. As a result, long-time limit finding probabilities of the quantum walk turn to be determined by either one of the two operations, but not both. More interestingly, the limit finding probabilities are independent from the localized initial state. We will approach the appreciated features via a quantum walk on the line which is able to reproduce the time-dependent walk on the half line.


title: Relative Visual Localization for Unmanned Aerial Systems

abstract: Cooperative Unmanned Aerial Systems (UASs) in GPS-denied environments demand an accurate pose-localization system to ensure efficient operation. In this paper we present a novel visual relative localization system capable of monitoring a 360$^o$ Field-of-View (FoV) in the immediate surroundings of the UAS using a spherical camera. Collaborating UASs carry a set of fiducial markers which are detected by the camera-system. The spherical image is partitioned and rectified into a set of square images. An algorithm is proposed to select the number of images that balances the computational load while maintaining a minimum tracking-accuracy level. The developed system tracks UASs in the vicinity of the spherical camera and experimental studies using two UASs are offered to validate the performance of the relative visual localization against that of a motion capture system.


title: A Robust Speaker Clustering Method Based on Discrete Tied Variational Autoencoder

abstract: Recently, the speaker clustering model based on aggregation hierarchy cluster (AHC) is a common method to solve two main problems: no preset category number clustering and fix category number clustering. In general, model takes features like i-vectors as input of probability and linear discriminant analysis model (PLDA) aims to form the distance matric in long voice application scenario, and then clustering results are obtained through the clustering model. However, traditional speaker clustering method based on AHC has the shortcomings of long-time running and remains sensitive to environment noise. In this paper, we propose a novel speaker clustering method based on Mutual Information (MI) and a non-linear model with discrete variable, which under the enlightenment of Tied Variational Autoencoder (TVAE), to enhance the robustness against noise. The proposed method named Discrete Tied Variational Autoencoder (DTVAE) which shortens the elapsed time substantially. With experience results, it outperforms the general model and yields a relative Accuracy (ACC) improvement and significant time reduction.


title: The contribution of Brownian motion to the stress in a colloidal suspension

abstract: The deviatoric stresses of colloidal suspensions are routinely calculated using the expression introduced by Batchelor [J. Fluid Mech. 83, 97--117 (1977)]. We show by example that the central feature in its derivation, the thermodynamic force driving particles down the density gradient, is inconsistent with the motion of the colloids. A new expression for the stress is proposed.


title: Estimating the Final Spin of Binary Black Holes Merger in STU Supergravity

abstract: In this paper, we adopt the so-called Buonanno-Kidder-Lehner (BKL) recipe to estimate the final spin of a rotating binary black hole merger in STU supergravity. According to the BKL recipe, the final spin can be viewed as the sum of the individual spins plus the orbital angular momentum of the binary system which could be approximated as the angular momentum of a test particle orbiting at the innermost stable circular orbit around the final black hole. Unlike previous works, we consider the contribution of the orbital angular momentum of the binary system to the final spin by requiring the test particle to preserve the scaling symmetry in the Lagrangian of supergravity. We find some subtle differences between two cases corresponding to whether the symmetry is taken into account or not. In the equal initial spin configuration, when the initial black holes are non-spinning, the final spin of the merger is always larger than that in the case in which the symmetry is not imposed although the general behaviors are similar. The difference increases firstly and then decreases as the initial mass ratio approaches unity. Besides, as the initial spins exceed a threshold, the final spin is always smaller than that in the case where the scaling symmetry is not considered. The difference decreases constantly as the equal initial mass limit is approached. All these features exist in the merger of a binary STU black hole with different charge configurations. We also study the final spin's difference between different charge configurations and different initial spin configurations.


title: ASMD: an automatic framework for compiling multimodal datasets with audio and scores

abstract: This paper describes an open-source Python framework for handling datasets for music processing tasks, built with the aim of improving the reproducibility of research projects in music computing and assessing the generalization abilities of machine learning models. The framework enables the automatic download and installation of several commonly used datasets for multimodal music processing. Specifically, we provide a Python API to access the datasets through Boolean set operations based on particular attributes, such as intersections and unions of composers, instruments, and so on. The framework is designed to ease the inclusion of new datasets and the respective ground-truth annotations so that one can build, convert, and extend one's own collection as well as distribute it by means of a compliant format to take advantage of the API. All code and ground-truth are released under suitable open licenses.


title: A note on smooth forms on analytic spaces

abstract: We prove that any smooth mapping between reduced analytic spaces induces a natural pullback operation on smooth differential forms.


title: Occlusion Aware Unsupervised Learning of Optical Flow From Video

abstract: In this paper, we proposed an unsupervised learning method for estimating the optical flow between video frames, especially to solve the occlusion problem. Occlusion is caused by the movement of an object or the movement of the camera, defined as when certain pixels are visible in one video frame but not in adjacent frames. Due to the lack of pixel correspondence between frames in the occluded area, incorrect photometric loss calculation can mislead the optical flow training process. In the video sequence, we found that the occlusion in the forward ($t\rightarrow t+1$) and backward ($t\rightarrow t-1$) frame pairs are usually complementary. That is, pixels that are occluded in subsequent frames are often not occluded in the previous frame and vice versa. Therefore, by using this complementarity, a new weighted loss is proposed to solve the occlusion problem. In addition, we calculate gradients in multiple directions to provide richer supervision information. Our method achieves competitive optical flow accuracy compared to the baseline and some supervised methods on KITTI 2012 and 2015 benchmarks. This source code has been released at https://github.com/jianfenglihg/UnOpticalFlow.git.


title: Trade-offs In Quasi-Decentralized Massive MIMO

abstract: Typical massive multiple-input multiple-output (MIMO) architectures consider a centralized approach, in which all baseband data received by each antenna has to be sent to a central processing unit (CPU) to be processed. Due to the enormous amount of antennas expected in massive MIMO base stations (BSs), the number of connections to the CPU required in centralized massive MIMO is not scalable. In recent literature decentralized approaches have been proposed to reduce the number of connections between the antennas and the CPU. However, the reduction in the connections to the CPU requires more outputs per antenna to be generated. We study the trade-off between number of connections to the CPU and number of outputs per antenna. We propose a generalized architecture that allows exploitation of this trade-off, and we define a novel matrix decomposition that allows lossless linear equalization within our proposed architecture.


title: On spatial and spatio-temporal multi-structure point process models

abstract: Spatial and spatio-temporal single-structure point process models are widely used in epidemiology, biology, ecology, seismology... . However, most natural phenomena present multiple interaction structure or exhibit dependence at multiple scales in space and/or time, leading to define new spatial and spatio-temporal multi-structure point process models. In this paper, we investigate and review such multi-structure point process models mainly based on Gibbs and Cox processes.


title: Two-dimensional CoSe structures: Intrinsic magnetism, strain-tunable anisotropic valleys, magnetic Weyl point, and antiferromagnetic metal state

abstract: The interplay between magnetism, band topology, and electronic correlation in low dimensions has been a fascinating subject of research. Here, we propose two-dimensional (2D) material systems which demonstrate such an interesting interplay. Based on first-principles calculations and structural search algorithms, we identify three lowest energy 2D CoSe structures, termed as the $\alpha$-, $\beta$-, and $\gamma$-CoSe. {We show that $\alpha$- and $\beta$-CoSe are two rare examples of 2D antiferromagnetic metals, which are related to their Fermi surfaces nesting features, and meanwhile, $\gamma$-CoSe is a ferromagnetic metal. They possess a range of interesting physical properties, including anisotropic valleys connected by crystalline symmetries, strain-tunable valley polarization, strain-induced metal-semiconductor and/or magnetic phase transitions, as well as topological band features such as the magnetic Weyl point and the magnetic Weyl loop. Remarkably, all the topological features here are robust against spin-orbit coupling.} Some experimental aspects of our predictions have been discussed.


title: De Finetti's construction as a categorical limit

abstract: This paper reformulates a classical result in probability theory from the 1930s in modern categorical terms: de Finetti's representation theorem is redescribed as limit statement for a chain of finite spaces in the Kleisli category of the Giry monad. This new limit is used to identify among exchangeable coalgebras the final one.


title: Breaking Resonant Chains: Destabilization of Resonant Planets due to Long-term Mass Evolution

abstract: Recent exoplanet observations reported a large number of multiple-planet systems, in which some of the planets are in a chain of resonances. The fraction of resonant systems to non-resonant systems provides clues about their formation history. We investigated the orbital stability of planets in resonant chains by considering the long-term evolution of planetary mass and stellar mass and using orbital calculations. We found that while resonant chains were stable, they can be destabilized by a change of $\sim$10% in planetary mass. Such a mass evolution can occur by atmospheric escape due to photoevaporation. We also found that resonant chains can be broken by a stellar mass loss of $\lesssim1$%, which would be explained by stellar winds or coronal mass ejections. The long-term mass change of planets and stars plays an important role in the orbital evolutions of planetary systems including super-Earths.


title: Learning for Video Compression with Hierarchical Quality and Recurrent Enhancement

abstract: In this paper, we propose a Hierarchical Learned Video Compression (HLVC) method with three hierarchical quality layers and a recurrent enhancement network. The frames in the first layer are compressed by an image compression method with the highest quality. Using these frames as references, we propose the Bi-Directional Deep Compression (BDDC) network to compress the second layer with relatively high quality. Then, the third layer frames are compressed with the lowest quality, by the proposed Single Motion Deep Compression (SMDC) network, which adopts a single motion map to estimate the motions of multiple frames, thus saving bits for motion information. In our deep decoder, we develop the Weighted Recurrent Quality Enhancement (WRQE) network, which takes both compressed frames and the bit stream as inputs. In the recurrent cell of WRQE, the memory and update signal are weighted by quality features to reasonably leverage multi-frame information for enhancement. In our HLVC approach, the hierarchical quality benefits the coding efficiency, since the high quality information facilitates the compression and enhancement of low quality frames at encoder and decoder sides, respectively. Finally, the experiments validate that our HLVC approach advances the state-of-the-art of deep video compression methods, and outperforms the "Low-Delay P (LDP) very fast" mode of x265 in terms of both PSNR and MS-SSIM. The project page is at https://github.com/RenYang-home/HLVC.


title: Sobolev Lifting over Invariants

abstract: We prove lifting theorems for complex representations $V$ of finite groups $G$. Let $\sigma=(\sigma_1,\dots,\sigma_n)$ be a minimal system of homogeneous basic invariants and let $d$ be their maximal degree. We prove that any continuous map $\overline{f} \colon {\mathbb R}^m \to V$ such that $f = \sigma \circ \overline{f}$ is of class $C^{d-1,1}$ is locally of Sobolev class $W^{1,p}$ for all $1 \le p<d/(d-1)$. In the case $m=1$ there always exists a continuous choice $\overline{f}$ for given $f\colon {\mathbb R} \to \sigma(V) \subseteq {\mathbb C}^n$. We give uniform bounds for the $W^{1,p}$-norm of $\overline{f}$ in terms of the $C^{d-1,1}$-norm of $f$. The result is optimal: in general a lifting $\overline{f}$ cannot have a higher Sobolev regularity and it even might not have bounded variation if $f$ is in a larger H\"older class.


title: Uncertainty Quantification for Data-driven Turbulence Modelling with Mondrian Forests

abstract: Data-driven turbulence modelling approaches are gaining increasing interest from the CFD community. However, the introduction of a machine learning (ML) model introduces a new source of uncertainty, the ML model itself. Quantification of this uncertainty is essential since the predictive capability of a data-driven model diminishes when predicting physics not seen during training. In this work, we explore the suitability of Mondrian forests (MF's) for data-driven turbulence modelling. MF's are claimed to possess many of the advantages of the commonly used random forest (RF) machine learning algorithm, whilst offering principled uncertainty estimates. An example test case is constructed, with a turbulence anisotropy constant derived from high fidelity turbulence resolving simulations. Shapley values, borrowed from game theory, are used to interpret the MF predictions. Predictive uncertainty is found to be large in regions where the training data is not representative. Additionally, the MF predictive uncertainty is found to exhibit stronger correlation with predictive errors compared to an a priori statistical distance measure, which indicates it is a better measure of prediction confidence. The MF predictive uncertainty is also found to be better calibrated and less computationally costly than the uncertainty estimated from applying jackknifing to random forest predictions. Finally, Mondrian forests are used to predict the Reynolds discrepancies in a convergent-divergent channel, which are subsequently propagated through a modified CFD solver. The resulting flowfield predictions are in close agreement with the high fidelity data. A procedure for sampling the Mondrian forests' uncertainties is introduced. Propagating these samples enables quantification of the uncertainty in output quantities of interest.


title: The radio pulsar population of the Small Magellanic Cloud

abstract: We model the present day, observable, normal radio pulsar population of the Small Magellanic Cloud (SMC). The pulsars are generated with SeBa, a binary population synthesis code that evolves binaries and the constituent stellar objects up to remnant formation and beyond. We define radio pulsars by selecting neutron stars that satisfy a selection of criteria defined by Galactic pulsars, and apply the detection thresholds of previous and future SMC pulsar surveys.The number of synthesised and recovered pulsars are exceptionally sensitive to the assumed star formation history and applied radio luminosity model, but is not affected extensively by the assumed common envelope model, metallicity, and neutron star kick velocity distribution. We estimate that the SMC formed (1.6$\pm$0.3)$\times 10^4$ normal pulsars during the last 100 Myrs. We study which pulsars could have been observed by the Parkes multibeam survey of the SMC, by applying the survey's specific selection effects, and recover 4.0$\pm$0.8 synthetic pulsars.This is in agreement with their five observed pulsars. We also apply a proposed MeerKAT configuration for the upcoming SMC survey, and predict that the MeerKAT survey will detect 17.2$\pm$2.5 pulsars.


title: The Varchenko Determinant of an Oriented Matroid

abstract: Varchenko introduced in 1993 a distance function on the chambers of a hyperplane arrangement that gave rise to a determinant whose entry in position $(C, D)$ is the distance between the chambers $C$ and $D$, and computed that determinant. In 2017, Aguiar and Mahajan provided a generalization of that distance function, and computed the corresponding determinant. This article extends their distance function to the topes of an oriented matroid, and computes the determinant thus defined. Oriented matroids have the nice property to be abstractions of some mathematical structures including hyperplane and sphere arrangements, polytopes, directed graphs, and even chirality in molecular chemistry. Independently and with another method, Hochst\"attler and Welker also computed in 2019 the same determinant.


title: Corruption-Tolerant Gaussian Process Bandit Optimization

abstract: We consider the problem of optimizing an unknown (typically non-convex) function with a bounded norm in some Reproducing Kernel Hilbert Space (RKHS), based on noisy bandit feedback. We consider a novel variant of this problem in which the point evaluations are not only corrupted by random noise, but also adversarial corruptions. We introduce an algorithm Fast-Slow GP-UCB based on Gaussian process methods, randomized selection between two instances labeled "fast" (but non-robust) and "slow" (but robust), enlarged confidence bounds, and the principle of optimism under uncertainty. We present a novel theoretical analysis upper bounding the cumulative regret in terms of the corruption level, the time horizon, and the underlying kernel, and we argue that certain dependencies cannot be improved. We observe that distinct algorithmic ideas are required depending on whether one is required to perform well in both the corrupted and non-corrupted settings, and whether the corruption level is known or not.


title: Variational Auto-Encoder: not all failures are equal

abstract: We claim that a source of severe failures for Variational Auto-Encoders is the choice of the distribution class used for the observation model.A first theoretical and experimental contribution of the paper is to establish that even in the large sample limit with arbitrarily powerful neural architectures and latent space, the VAE failsif the sharpness of the distribution class does not match the scale of the data.Our second claim is that the distribution sharpness must preferably be learned by the VAE (as opposed to, fixed and optimized offline): Autonomously adjusting this sharpness allows the VAE to dynamically control the trade-off between the optimization of the reconstruction loss and the latent compression. A second empirical contribution is to show how the control of this trade-off is instrumental in escaping poor local optima, akin a simulated annealing schedule.Both claims are backed upon experiments on artificial data, MNIST and CelebA, showing how sharpness learning addresses the notorious VAE blurriness issue.


title: What Does the "Mean" Really Mean?

abstract: The arithmetic average of a collection of observed values of a homogeneous collection of quantities is often taken to be the most representative observation. There are several arguments supporting this choice the moment of inertia being the most familiar. But what does this mean? In this note, we bring forth the Kolmogorov-Nagumo point of view that the arithmetic average is a special case of a sequence of functions of a special kind, the quadratic and the geometric means being some of the other cases. The median fails to belong to this class of functions. The Kolmogorov-Nagumo interpretation is the most defensible and the most definitive one for the arithmetic average, but its essence boils down to the fact that this average is merely an abstraction which has meaning only within its mathematical set-up.


title: Flow Computation in Temporal Interaction Networks

abstract: Temporal interaction networks capture the history of activities between entities along a timeline. At each interaction, some quantity of data (money, information, kbytes, etc.) flows from one vertex of the network to another. Flow-based analysis can reveal important information. For instance, financial intelligent units (FIUs) are interested in finding subgraphs in transactions networks with significant flow of money transfers. In this paper, we introduce the flow computation problem in an interaction network or a subgraph thereof. We propose and study two models of flow computation, one based on a greedy flow transfer assumption and one that finds the maximum possible flow. We show that the greedy flow computation problem can be easily solved by a single scan of the interactions in time order. For the harder maximum flow problem, we propose graph precomputation and simplification approaches that can greatly reduce its complexity in practice. As an application of flow computation, we formulate and solve the problem of flow pattern search, where, given a graph pattern, the objective is to find its instances and their flows in a large interaction network. We evaluate our algorithms using real datasets. The results show that the techniques proposed in this paper can greatly reduce the cost of flow computation and pattern enumeration.


title: Non-local scalar conservation laws with discontinuous flux

abstract: We prove the well-posedness of entropy weak solutions for a class of space-discontinuous scalar conservation laws with non-local flux arising in traffic modeling. We approximate the problem adding a viscosity term and we provide $L^\infty$ and BV estimates for the approximate solutions. We use the doubling of variable technique to prove the stability with respect to the initial data from the entropy condition.


title: Local comparisons of homological and homotopical mixed Hodge polynomials

abstract: For a simply connected complex algebraic variey $X$, by the mixed Hodge structures $(W_{\bullet}, F^{\bullet})$ and $(\tilde W_{\bullet}, \tilde F^{\bullet})$ of the homology group $H_{*}(X;\mathbb Q)$ and the homotopy groups $\pi_{*}(X)\otimes \mathbb Q$ respectively, we have the following mixed Hodge polynomials $$MH_X(t,u,v):= \sum_{k,p,q} \operatorname{dim} \Bigl ( Gr_{F^{\bullet}}^{p} Gr^{W_{\bullet}}_{p+q} H_k (X;\mathbb C) \Bigr) t^{k} u^{-p} v^{-q},$$ $$\quad \, \, MH^{\pi}_X(t,u,v):= \sum_{k,p,q} \operatorname{dim} \Bigl (Gr_{\tilde F^{\bullet}}^{p} Gr^{\tilde W_{\bullet}}_{p+q} (\pi_k(X) \otimes \mathbb C) \Bigr ) t^ku^{-p} v^{-q},$$ which are respectively called \emph{the homological mixed Hodge polynomial} and \emph{the homotopical mixed Hodge polynomial}. In this paper we discuss some inequalities concerning these two mixed Hodge polynomials.


title: A deep learning approach for computations of exposure profiles for high-dimensional Bermudan options

abstract: In this paper, we propose a neural network-based method for approximating expected exposures and potential future exposures of Bermudan options. In a first phase, the method relies on the Deep Optimal Stopping algorithm, which learns the optimal stopping rule from Monte-Carlo samples of the underlying risk factors. Cashflow-paths are then created by applying the learned stopping strategy on a new set of realizations of the risk factors. Furthermore, in a second phase the risk factors are regressed against the cashflow-paths to obtain approximations of pathwise option values. The regression step is carried out by ordinary least squares as well as neural networks, and it is shown that the latter produces more accurate approximations. The expected exposure is formulated, both in terms of the cashflow-paths and in terms of the pathwise option values and it is shown that a simple Monte-Carlo average yields accurate approximations in both cases. The potential future exposure is estimated by the empirical $\alpha$-percentile. Finally, it is shown that the expected exposures, as well as the potential future exposures can be computed under either, the risk neutral measure, or the real world measure, without having to re-train the neural networks.