Data Engineer II

Joining Amex Tech means discovering and shaping your contribution to something big. Here, you can work alongside talented tech teams and build a unique career with the Powerful Backing of American Express. With a range of opportunities to work with the latest technologies, and a commitment to back the broader engineering community through open source, our mission is to power your success. Because Amex Tech is powered by our technology, our culture, and our colleagues. The Technology organization enables and accelerates the company’s growth strategies, delivering global capabilities and services in support of Amex’s customers and colleagues, while maintaining 24/7 servicing and availability to ensure an uninterrupted, high-quality customer experience. Technology provides the foundation for everything we do in the company while driving differentiation through building and leveraging innovative technology and data insights. At American Express, our mission is to deliver the world’s best customer experience every day. At the heart of this mission is our Information Security organization, enabling exceptional experiences built on a foundation of trust, service, and security. We leverage advanced technologies and data-driven insights to stay ahead of an evolving threat landscape. We foster a culture of passion, curiosity, and courage—empowering you to innovate, grow, and help shape the future of a Fortune 100 company. Trust. Service. Security. We are seeking a Data Engineer in the Incident Response Tooling team to design, develop and implement data pipelines to source data from internal or external sources using various technologies like API (REST / Graph), Data Brokers, ETL tools, etc. The ideal candidate will have strong analytical skills, ability to spot data anomalies in large volume of data, willingness learn new technologies, and collaborative nature to work in a team setting. Design and implement RESTful APIs to support backend data engineering pipelines and front-end functionality in case of web application. Develop data flows using ETL tools. Spot patterns, correlate data and understand its value in solving business use cases. Collaborate with the development team to define and implement CI/CD pipelines. Utilize Git for version control and collaborate on code reviews. Ensure the performance, quality, and responsiveness of data pipelines and applications. Identify and fix bugs and performance bottlenecks. Stay up-to-date with emerging technologies and industry trends. 5+ years of experience in data engineering projects and bachelor’s degree in Software Engineering, Computer Science, Mathematics, or Information Systems. At least 3+ years of experience in Python and Python Frameworks e.g. Django, FastAPI etc. Experience in developing RESTful APIs. Good experience of working on Kubernetes, Docker and containerized platform. Hands-on experience on ELK stack with experience in building logstash pipeline for a high volume data flow. Proficiency with data flow solutions like Apache Nifi, Apache Airflow, AWS Glue, Azure Data Factory or similar tools. Experience with relational database management systems such as Microsoft SQL Server, Postgres. Basic knowledge of Linux based systems Experience in building data pipeline using Google Cloud native services. Knowledge on usage of CICD tools. Soft Skills - analytical attitude, critical thinking, self-driving, proactive. Depending on factors such as business unit requirements, the nature of the position, cost and applicable laws, American Express may provide visa sponsorship for some positions.