Generative Adversarial Networks (GAN) can achieve promising performance on learning complex data distributions on different types of data. In this paper, we first show that a straightforward extension of an existing GAN algorithm is not applicable to point clouds, because the constraint required for discriminators is undefined for set data. We propose a two fold modification to a GAN algorithm to be able to generate point clouds (PC-GAN). First, we combine ideas from hierarchical Bayesian modeling and implicit generative models by learning a hierarchical and interpretable sampling process. A key component of our method is that we train a posterior inference network for the hidden variables. Second, PC-GAN defines a generic framework that can incorporate many existing GAN algorithms. We further propose a sandwiching objective, which results in a tighter Wasserstein distance estimate than the commonly used dual form in WGAN. We validate our claims on the ModelNet40 benchmark dataset and observe that PC-GAN trained by the sandwiching objective achieves better results on test data than existing methods. We also conduct studies on several tasks, including generalization on unseen point clouds, latent space interpolation, classification, and image to point clouds transformation, to demonstrate the versatility of the proposed PC-GAN algorithm.
Summary:
This paper proposes a generative point cloud model based on adversarial learning and definitti’s representation theorem of exchangeable variables.
The main focus in experiments and the exposition is on 3D point clouds representing object shapes (seems the surface, but could also be the interior of objects, please clarify). 
The main idea is to represent a point cloud using a global latent variable that captures the overall shape, and a collection of local latent variables that code for the position of a point on the shape.
The model consists of thee components:
(i) an “encoder” that takes a point cloud as input and maps it to a (point estimate of) the global latent variable of the shape represented by the input cloud, a point-net architecture is used here
(ii) a “decoder” that takes the estimated global latent variable, and a local latent variable, and maps it to an “output” point in the cloud to be produced by the model. 
(iii) a “discriminator” network that aims to distinguish points from a *given* shape, and the points produced by pipe-lining the encoder and decoder. Critically different from conventional GANs, the discriminator is optimized *per shape*, ie each point cloud is considered as a *distribution* over R^3 specific to that shape. 
(iv) a “shape prior” that, once the encoder-decoder model from above is trained, is used to model the distribution over the global latent variables. This model is trained, presumably, in a conventional GAN style using the global latent variable representations inferred across the different training point clouds.
As compared to prior work by Achiloptas et al (2017), the proposed approach has the advantage to allow for sampling an arbitrary number of points from the target shape, rather than a fixed pre-defined number. 
In addition, the authors propose to minimize a weighted average of a lower bound and upper bound on the Wasserstein distance between the distributions of points corresponding to given shapes. 
This approach translates to improved quantitative evaluation measures, 
Experiments are conducted on a simple toy data set, as  a proof of concept, and on data from ModelNet10 and ModelNet40. 
Two performance metrics are introduced to assess the auto-encoding ability of the model: to what extent does the encoder-decoder pipeline result in point clouds similar to the shape from which the input point-cloud is generated. 
Overall I find the idea of the paper interesting and worth publishing, but the exposition of the paper is less than ideal and needs further work. 
The experimental validation of the proposed approach can also be further improved, see more specific comments below. 
Specific comments:
- The counter example at the bottom of page 2 is limited, in the sense that the oracle assumption seems highly non-realistic, casting doubt on the relevance of the argument.
- The notation in section 3 (before 3.1) is rather sloppy. 
For example, 
- please define P and G, the elements of the divergence D(P||G) that appears in the first paragraph of section 3.
- it is not defined in which space theta lives, it is not clear what the authors intend with the notation G_theta(u) \sim p(theta). 
- what prior distributions p(z) and p(u) are used? What is the choice based on?
- abbreviation IPM is referred several times in the paper, but remains undefined in the paper until end of page 4, please define earlier. 
- The model G_theta does not appear in the training objective function (4), how is this module trained precisely?
- Lack of clarity in the following passage: “In our setting, each point xi in the point cloud can be considered to correspond to single images when we train GANs over images”
- The notion of divergence D(P|G) is not made concrete in section 3 and 3.1, which makes the notation of rather little use.
- The following paper merits a discussion in the related work section: 
“TOWARDS A NEURAL STATISTICIAN”, ICLR’17, https://openreview.net/pdf?id=HJDBUF5le
- The manuscript contains many typos. For example
 “vedio” op page 4, “circile” on page 5, “condct” on page 8, etc.
Please proof read your paper and fix these.
The refenence to  Bengio 2018 is incomplete: what do you refer to precisely?
- There seems to be no mention of the dimension of the “local” latent variables z_i. 
Please comment on the choice, and its impact on the behavior of the model.
- The quantitative evaluation in table 1 is interesting and useful. 
It is limited, however, in the sense that it (only) measures auto-encoding capabilities: to what extent can the shape be reproduced given a sample point cloud from the given shape. 
Quantitative evaluation of generative modeling performance is unfortunately missing from this paper, as it is in much of the GAN literature. 
Could you please comment on how this can/will be fixed?
- The toy data set experiments could be dropped  to make room for experiments suggested below.
- An experimental study of the effect of the mixing parameter “s” would be useful to include. 
For example, by taking s on a grid from 0 to 1, one could plot the coverage and distance-to-face measures.
- Experimental evaluation of auto-encoding using a variable number of input points is interesting to add: ie how do the two evaluation measures evolve as a function of the number of points in the input point cloud?
- Similar, it is interesting to evaluate how auto encoding performs when non-uniform decimation of the input cloud is performed, eg what happens if we “chop off” part of the input point cloud (eg the legs of the chair), does the model recover and add the removed parts? This is potentially useful to practitioners which have to deal with incomplete point clouds acquired by range scanners. 
- Analysis of shapes with different genus and dimensions would be interesting. 
Does the model manage to capture that some shapes have holes, or consists of a closed 2D surface (ball) vs an open surface (disk),  despite a simple prior on the local latent variables z?