Description:
Job Description Create and maintain scalable data pipelines and workflows to ingest, transform, and load data into Apache Iceberg tables using Apache Spark, Python, PySpark Write SQL queries using Spark and Trino, optimize and remove performance bottlenecks for query response and resource utilization Develop and execute migration strategies and scripts to move data from Snowflake to Iceberg tables, ensuring data integrity and consistency Write reliable and maintainable code, debug complex issues
Mar 26, 2025;
from:
dice.com