Technical Lead - Databricks, Azure Data Lake, Python
iSoftTek Solutions Inc
Greenfield, indiana
We are looking for a highly experienced Data Engineering Specialist to join our team. The ideal candidate should have a strong background in cloud technologies, DevOps practices, and data engineering to support and enhance our RDAP initiatives.
Requirements
Key Responsibilities:
Databricks Lakehouse Solutions: Design, develop, and maintain Databricks-based solutions utilizing cloud platforms such as Azure Synapse and GCP.
DevOps & CI/CD: Implement and manage CI/CD pipelines using tools like GitHub while ensuring best practices in test-driven development, code reviews, and branching strategies.
Python Development: Build, manage, and optimize Python packages using tools such as setup, Poetry, wheels, and artifact registries.
Data Pipelines & Workflows: Develop and optimize workflows in Databricks (PySpark, Databricks Asset Bundles) for data ingestion, processing, and...