Direct evidence is the basis of both inference and the scriptures. The scriptures can be contradicted by direct evidence. As to inference its evidence is not much.
प्रत्यक्षं ह्येतयोर्मूलं कृतान्तैतिह्ययोरपि। प्रत्यक्षेणागमो भिन्नः कृतान्तो वा न किञ्चन॥