Senior Databricks Engineer - AI & Data Platform

• 5+ years in data engineering or platform engineering roles.
• 3+ years hands-on experience with Azure Databricks (workspace administration, Delta Lake, Spark, Unity Catalog).
• Strong proficiency in Python and SQL.
• Databricks workspace security: Proven experience implementing and managing workspace-level security, including network security (Private Link, VNet injection, IP access lists), identity and access management, cluster policies, secrets management, and RBAC at workspace, catalog, and object levels.
• Experience building and operating production data pipelines at scale.
• Experience with Mosaic AI (AI Playground, AI Functions, Agent Framework)
• Familiarity with GenAI/LLM application patterns (RAG, prompt engineering, vector databases) is highly desirable.

Nice to HaveDatabricks certifications (Data Engineer Associate/Professional, Gen AI Engineer Associate).

· Experience with Unity Catalog governance at enterprise scale (metastore design, data access policies, lineage, audit logging).

· Hands-on experience with SAP integration , extracting data from S/4HANA into a Lakehouse platform.

· Experience leading or participating in data migration from SAP BW/4HANA to Databricks, including InfoProvider mapping, transformation logic re-implementation, data validation, and cutover planning.

· Exposure to AI/ML workflows: model training infrastructure, feature stores, MLflow, or equivalent MLOps tooling - and ability to prepare SAP-sourced datasets for downstream ML consumption.

• Strong communication skills, ability to produce architecture diagrams, design documents, and present trade-offs to technical and non-technical audiences.