Data Engineer - AI-Assisted Data Ingestion Platform

About Us At Twenty20 Systems, we specialize in transforming business operations through cutting-edge data integration, enterprise automation, and analytical insights—all powered by advanced AI. Our innovative MissionImpact solutions seamlessly connect disparate systems and processes, enabling organizations to harness real-time insights, streamline operations, and make confident, data-driven decisions. As an AI-driven business with robust advisory expertise, we leverage Enterprise Orchestration Platforms (EOP) and Business Operations Automation Technologies (BOAT) to empower our clients with tailored strategies. Our seasoned professionals work closely with you to design and implement strategies that eliminate inefficiencies and align every facet of your organization with your long-term vision. Supported by strategic partnerships with industry leaders including Workato, Salesforce, MuleSoft, Denodo, Snaplogic and Snowflake, we deliver secure, scalable, and innovative solutions that empower your business to thrive. Connect with Twenty20 Systems to build a seamlessly connected enterprise, ready to scale and thrive in the digital era. Learn more by filling out the form on this page or by contacting us directly: [email protected] / http://www.twenty20sys.com Careers: https://twenty20sys.com/careers/ Job Description We are looking for a Data Engineer to join our team and help build an AI-powered data ingestion platform. The platform collects data from multiple sources and loads it into analytical databases that power our B2B analytics product, BevGenie, where users can interact with their data using natural language. In this role, you will work closely with a senior data engineer and use AI coding assistants (Claude Code) to build, improve, and maintain production-grade data pipelines. You will be responsible for extracting, cleaning, transforming, and loading data from both structured and unstructured sources. Key Responsibilities: Design, build, and maintain scalable data ingestion pipelines Extract data from websites, APIs, documents (PDFs), emails, and databases Parse, clean, and transform structured and unstructured data Implement data validation, quality checks, and error handling Handle missing, duplicate, and malformed data Ensure pipelines are reliable and idempotent Orchestrate workflows using Dagster or similar tools Load data into PostgreSQL, Supabase, Snowflake, and MongoDB Collaborate with senior engineers and cross-functional teams Requirements 3–5 years of experience in Python-based development or data engineering Strong Python fundamentals (functions, classes, logging, error handling) Experience working with APIs and common data formats (JSON, CSV, XML) Strong SQL skills including joins, aggregations, CTEs, and window functions Understanding of relational database concepts, schema design, and indexing Basic knowledge of web scraping and data extraction techniques Familiarity with handling structured and unstructured data Understanding of data quality, validation, and pipeline reliability Good problem-solving and analytical skills Strong communication and collaboration skills Willingness to learn new tools and technologies Nice to Have: Experience with Dagster, Airflow, or Prefect Experience with web scraping tools (BeautifulSoup, Scrapy, Playwright) Experience with PDF extraction tools Exposure to AWS services (S3, Lambda, Glue) Knowledge of dimensional modeling or analytics data modeling Any experience using AI/LLMs for data extraction Benefits Work closely with and learn from a senior data engineer Hands-on experience building real production data pipelines Exposure to modern AI-assisted development workflows Opportunity to work with diverse data sources and technologies Remote-first and flexible work environment Competitive compensation High-impact role in a growing product-focused team