Game developer David Braben creates a USB stick PC for $25
It would be better to give away cheap feature phones and a pair of headphones.  Connectivity and content is more important than the size of the display.  Even a system that can only do audio would be an amazing educational tool with the right content.  An mp3 of a story or a lesson is content rich, a small file, and very cheap to play.