Data Engineer

We're Hiring: Data Engineer

We are looking for an experienced and self-motivated Data Engineer to design, develop, manage, and maintain an open-source data platform. The role focuses on building and optimizing scalable data infrastructure, including a Data Lakehouse using Amazon S3, Apache Iceberg, and ClickHouse. The ideal candidate has strong SQL and programming skills, hands-on experience with ETL/ELT pipelines and Apache Spark, and the ability to collaborate effectively with data scientists, analysts, and backend engineers.

Key Responsibilities:

• Develop a scalable data platform integrating multiple data sources for easy access.
• Design and enhance data tools, including orchestration, governance, data lakehouse, and business intelligence solutions.
• Ensure the smooth operation of data systems for analysts, data scientists, and engineers.
• Optimize data pipelines for ingestion, processing, and output within a microservices environment.
• Build, maintain, and monitor ETL/ELT processes.
• Troubleshoot and improve the performance, scalability, and reliability of data infrastructure, including Amazon S3, Apache Iceberg, and ClickHouse.
• Collaborate with data scientists, analysts, and backend engineers to understand data needs and deliver effective solutions.
• Implement and promote data quality, governance, and security best practices across the platform.
• Develop and maintain batch data processing workflows using Apache Spark or similar technologies.

Qualifications:

• Minimum of 3 years of experience as a Data Engineer or in a similar data infrastructure role.
• Strong proficiency in SQL and hands-on experience with data modeling.
• Experience with data lake and lakehouse architectures, such as Apache Iceberg, Amazon S3, or similar technologies.
• Experience with analytical or columnar databases, such as ClickHouse or equivalent platforms.
• Experience building and orchestrating ETL/ELT pipelines.
• Strong programming skills in Python and/or Scala/Java.
• Experience working with microservices architecture and cloud environments, preferably AWS.
• Hands-on experience with Apache Spark or similar technologies for large-scale data processing.
• Professional proficiency in written and spoken English.
• Strong communication and multitasking skills, with the ability to work independently and collaboratively.
• Self-motivated, detail-oriented, and committed to maintaining reliable data infrastructure
• Focus on data platform development, ETL/ELT pipelines, batch processing, and data infrastructure optimization
• This role focuses on batch data processing, not real-time streaming.

Preferred Qualifications:

• Experience working with or contributing to open-source data platforms and tools.
• Familiarity with business intelligence and visualization tools, such as Apache Superset, Looker, Tableau, or Metabase.
• Experience with containerization and orchestration technologies, including Docker and Kubernetes.
• Familiarity with infrastructure-as-code and CI/CD practices.
• Experience with AWS EMR and running Apache Spark workloads in cloud environments.
• Experience using AI-assisted development tools, such as GitHub Copilot, Cursor, or similar platforms, to improve engineering productivity.

Work Setup:

• Remote position
• Full-time position
• Shift Schedule: To be discussed

Salary:

• USD 15–16 per hour