... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
25 days ago
... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
29 days ago