Description:
Data Integration and Management: Design, develop, and maintain scalable data processing pipelines using Azure Databricks and PySpark/Scala. Integrate data from various sources into Azure Data Lake and Azure SQL Data Warehouse. Developing and optimizing Apache Spark applications for data processing and analytics. Implementing data quality checks and monitoring processes. Managing and configuring the Databricks environment, including clusters and notebooks. Implement and optimize machine learning
Apr 24, 2025;
from:
dice.com