Data Engineering, Databricks, Snowflake, Data Science, Machine Learning.
Fault Tolerance: Is my job actually resilient to failure? Meaning do I want to over-spec it just in case I get preempted or just in case there are no SPOT instances available? Scalability: Does my job scale? What if I have a spike in input data by 10x, will my job crash? Latency: Are my jobs