I am trying to run my code written in Python 3 with pypy, but I got an error : 

ImportError: No module named 'osgeo'

but running it with python3 test.py works (but slow) .
My installed version of python is 3.5.2 
pypy comes with it's python version 3.5.3 
Is there anyway you could tell pypy to use my own version of python, and will it resolve the problem?
Are you using PyPy3?
If you use PyPy it will execute your code with a Python 2.7 interpreter. And if you install a library for python3 it does not mean that the library is installed for python2 too. You need to specify for wich interpreter are you installing the library ( like using pip or pip3 )
How to run pypy with an existing installation of Python