Small children are bound to enjoy the merry-go-round, puppet theaters (outside July and August), and pony rides in the Jardin du Luxembourg.
The pony rides are inexpensive and are a great memory for your child.