... design and maintain scalable data pipelines in Databricks. ... of data workflows, from ingestion to production, ensuring performance, quality, ... , SQL, Delta Lake).Ingest data from databases, APIs, PDFs, ... web scraping.Implement data quality checks, validation, an
8 hours ago
Description: Job Description: Role: Data EngineerLocation: Dallas, TX or Malvern, ... AWS Glue for large-scale data processing.Optimize Spark jobs for ... environments.Perform data transformations, cleansing, and enrichment to ensure high data quality.Moni
7 days ago
Description: Role: Data EngineerLocation: Dallas, TX or Malvern, ... AWS Glue for large-scale data processing.Optimize Spark jobs for ... environments.Perform data transformations, cleansing, and enrichment to ensure high data quality.Monito
24 days ago