... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
26 days ago
... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
30 days ago