... design and maintain scalable data pipelines in Databricks. ... of data workflows, from ingestion to production, ensuring performance, quality, ... , SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... web scraping.Implement data quality checks, validation, a
26 days ago
... : Design and implement scalable data pipelines using Google Cloud Platform ... sources (structured and unstructured). Optimize data workflows for performance, scalability, and ... with cross-functional teams including data scientists, analysts, and backend engin
10 hours ago
... : Design and implement scalable data pipelines using Google Cloud Platform ... sources (structured and unstructured). Optimize data workflows for performance, scalability, and ... with cross-functional teams including data scientists, analysts, and backend engineer
10 hours ago