... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
4 days ago
... design and maintain scalable data pipelines in Databricks. The ... of data workflows, from ingestion to production, ensuring performance, quality, and ... PySpark, SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... and web scraping.Implement data quality chec
8 days ago
... design and maintain scalable data pipelines in Databricks. ... of data workflows, from ingestion to production, ensuring performance, quality, ... , SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... web scraping.Implement data quality checks, validation, an
19 days ago
Description: Job Description: Role: Data EngineerLocation: Dallas, TX or Malvern, ... AWS Glue for large-scale data processing.Optimize Spark jobs for ... environments.Perform data transformations, cleansing, and enrichment to ensure high data quality.Moni
26 days ago