Question: Does anyone know how to create a iTunes Playlist that shows only songs in My Library which are part of a complete album in My Library.

Essentially I want to see all my complete albums. You can in Spotify but with Apple Music every song you add to a playlist it assumes you want it added to My Library.

Answer: 
There is no way to automate this functionality in iTunes today. To do so, the system would need to know how many songs were in each album and that isn't immediately available. Plus, what if you have an album with twelve songs and you only have eleven, but you still want it in the list. Or what about singles that have only one or two songs. Are these "complete" albums?

In any case, the only way I know to do this is to mark complete albums manually.

For example, you could put a note in "Comments" like "CompleteAlbum" and build a playlist for all files with Comments that contain "CompleteAlbum". If you want to stay out of the comments, you could use the Disc X of Y, clearing the Disc # for non-album tracks and setting it to 1 (or 2 or whatever) for albums. Then, you build a playlist that looks for songs with Disc # >= 1. It's up to you.

You just have to remember to do that for each album you add, but your playlist would contain all your 'complete albums'.
Apple has released a fix for this. In Settings>Music it lets you toggle between showing playlist songs in library or not.