Job Description
Role Description: Position: Azure Databricks Engineer Client: Client/Telecommunication Location: tlanta / Alpharetta - Onsite Duration- 6 Month Responsibilities:
- Design, build, and maintain scalable and robust ETL or ELT pipelines using Databricks.
- Ingest data from various sources (databases, APIs, streaming services, cloud storage) into the Databricks environment.
- Implement data transformations and cleansing processes to ensure data quality and consistency.
- Utilize Databricks features like Delta Live Tables (DLT) for declarative pipeline development and efficient data processing.
- Manage and optimize data storage within Databricks
- Translate business needs into technical specifications for data solutions.
Skills: - Deep understanding and hands-on experience with the Databricks platform, including Databricks notebooks, clusters, jobs, Delta Lake, Unity Catalog, and Databricks Programming languages.
- Experience with major cloud provider such as Azure, as Databricks runs on these infrastructures
- Working Experience with streaming data technologies
- Solid understanding of data warehousing principles, dimensional modeling, and various ETL/ELT methodologies.
- Familiarity with Git or other version control systems for collaborative code development.
Job Tags
Work experience placement,