I want to start getting into Yu-Gi-Oh! where should I start? If I was to start watching all the series of Yu-Gi-Oh! (the orginal one), what should I start with first? 

The books or the movies? And can you please list them in order too?
If you want to start watching the series you should better start from the first anime adaptation of the manga with the same name released in 1998. 

see Yu-Gi-Oh! (1998 TV series)
It is based on chapters 1-59 of the Yu-Gi-Oh! manga series. here is a list of the first 59 episodes in the anime.

You should check this post. What's the correct order in which to watch the Yu-Gi-Oh! seasons/episodes?

For the Movies here is 5 titles. source: yugioh.wikia.com

Honestly I am a fan of the Anime and its Card-game gameplay. I even attended Conventions here in our country where dual matches were held and participated by trading card enthusiasts.