... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
4 days ago
... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
8 days ago