Snehakumari What are the best practices for optimizing performance in Databricks? Discuss caching strategies, efficient use of Spark resources, partitioning, and job execution optimization.