Databricks Data Engineer

Job Title: Databricks Data Engineer

Location: Remote

About the Role

We are looking for a skilled Databricks Data Engineerto design, develop, and optimize scalable data solutions using Databricks SQL. The ideal candidate should have strong expertise in SQL, performance tuning, and cloud-based data platforms such as AWS, Azure, or GCP.

Key Responsibilities

• Develop, maintain, and optimize SQL queries and notebooks in Databricks for data transformation, aggregation, and analytics.
• Optimize Databricks SQL workloads for performance, scalability, and cost efficiency.
• Monitor, debug, and troubleshoot SQL queries, dashboards, and workflows.
• Work with large-scale datasets in distributed computing environments.
• Collaborate with data engineers, analysts, and stakeholders to deliver data-driven solutions.
• Implement best practices for query performance tuning, caching, and indexing strategies.
• Build and maintain data pipelines using Databricks Workflows and Delta Live Tables.

Required Qualifications

• 6years of hands-on experience in SQL development and query optimization.
• Strong expertise in Databricks SQL, Delta Lake, and Lakehouse architecture.
• Experience with cloud platforms such as AWS, Azure, or GCP (preferably Azure Databricks or AWS Databricks).
• Good understanding of performance tuning, caching strategies, and query optimization techniques.
• Familiarity with ETL/ELT frameworks, Data Warehousing, and BI tools.
• Hands-on experience with:

• Databricks Notebooks
• Databricks Workflows
• Delta Live Tables
• Ability to handle large datasets and distributed systems.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience using SQL for advanced data processing and analytics.
• Knowledge of Medallion Architecture (Bronze, Silver, Gold layers).
• Exposure to data visualization tools like Power BI, Tableau, or similar.