Databricks Data Engineer

About the Role: We are seeking a talented and passionate Databricks Data Engineer to join our expanding Data & AI team Databricks Partner (50 FTE). In this role, you will be a crucial player in designing, building, and maintaining cutting-edge data solutions on the Databricks platform. You will have the opportunity to work with a variety of clients across different industries, collaborating with both internal teams and client stakeholders to deliver high-quality data pipelines and enable data-driven decision-making. Responsibilities:

• Data Pipeline Engineering: Design, develop, and deploy robust and scalable data pipelines using Databricks, incorporating data extraction from diverse sources (databases, APIs, streaming platforms), transformation and cleansing using Spark, and loading into target systems (data lakes, data warehouses, etc.). Optimize pipeline performance for efficiency and cost-effectiveness.

• Databricks Ecosystem Expertise: Utilize the full capabilities of the Databr…