Honest question: what does &quot;in memory&quot; mean exactly? Do traditional databases not process data using memory? Doesn&#x27;t Spark spill to disk when it reached the limit of the system memory? The in-memory thing always puzzled me.