Data Platform Engineer ID98943

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

We are looking for a Data Platform Engineer to modernize, migrate, and maintain reliable data-platform infrastructure across cloud and enterprise environments.

The mandatory requirements are 3+ years of senior-level production data-platform engineering experience, strong Python, Bash and SQL, AWS, Snowflake and Kafka/Confluent expertise, production migration and operations, secure access practices, troubleshooting, and upper-intermediate English. Legacy data migration experience is a plus.

- Help migrate infrastructure and data-platform workloads from the existing infrastructure to the new infrastructure.

- Help move the data-platform infrastructure and workloads to AWS us-east-2 (USE2), including required connectivity, deployment, and operational prerequisites.

- Enable secure, governed accessibility of data to data-platform consumers and downstream systems.

- Modernize the data-platform architecture, tooling, orchestration, storage, and operational practices to align with organizational standards.

- Support Snowflake, Confluent/Kafka, AWS, and data-platform infrastructure migration and operations across stage and production.

- Participate in production troubleshooting, incident response, documentation, runbook creation, and cross-team migration coordination.

- Use Terraform/IaC, GitLab, monitoring and documented processes to deliver repeatable and auditable changes.

- 3+ years of senior-level, hands-on experience in production data-platform engineering, with a platform/DevOps-leaning background and strong data experience.

- Strong Python, Bash, and SQL skills

- Production experience with both Snowflake and Confluent/Kafka, with a focus on DevOps and operations. Deep experience in one and working knowledge of the other is fine:

- Deep Snowflake and AWS, with working Kafka knowledge (topics, connectors, schemas), OR

- Deep Kafka/Confluent and AWS, with working Snowflake knowledge.

- Experience operating or migrating production systems across development, stage, and production environments.

- Strong troubleshooting, incident-response, testing, documentation, and cross-team communication skills.

- Experience with least-privilege access, change control, secrets handling, and secure operational practices.

- Strong cross-functional communication skills.

- Apache Spark and Hadoop/Hive/HQL, including modernizing or migrating legacy workloads

- Snowpark, dbt alternatives, AWS Glue, Monte Carlo, or other data-quality and catalog tools

- Migrating legacy Airflow, Hadoop or Hive workloads to cloud-native or managed platforms

- Experience working across a company migration or acquisition and aligning systems to a new organization's standards

- Familiarity with Snowflake-to-Iceberg or Snowflake-to-data-lake migration patterns.

- Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.

- Competitive compensation: USD-based pay with education, fitness, and team activity budgets.

- Exciting projects: Modern solutions with Fortune 500 and top product companies.

- Flextime: Flexible schedule with remote and office options.

Application → Coding Challenge → Video Interview → Technical Interview or Hiring Manager Interview

Each step helps us understand your skills and overall fit.

If it’s a match, you’ll receive an offer.