Cloud Data Engineer II (Databricks)

About AAIS

Since 1936, American Association of Insurance Services (“AAIS”) has served the property and casualty insurance industry as the only national not-for-profit advisory organization governed by its member companies. We are committed to evolving with changes in the insurance industry, adding value to our members, regulators, and the industry with responsive products and insights.

Purpose

The Cloud Data Engineer II independently designs, builds, and supports AAIS's cloud-based data platform. This role owns complete features and work packages within the data engineering environment while contributing across related capabilities. The primary focus is on scaled data ingestion, transformation, processing, and delivery of high-quality data products.

The ideal candidate combines hands-on technical proficiency with dependable delivery. They work effectively across functions, apply engineering standards independently, identify risks early, and help improve how the team builds and operates solutions.

Responsibilities

Solution Delivery

• Independently deliver data features, integrations, pipelines, and automation from design through production support.
• Translate business and technical requirements into practical designs, implementation tasks, test plans, and support documentation.
• Estimate work, manage dependencies, communicate progress, and deliver within sprint and release commitments.

Quality, Security & Operations

• Apply coding, architecture, security, data protection, change management, and operational standards.
• Build automated tests, monitoring, alerting, deployment controls, and support procedures appropriate to the solution.
• Investigate incidents and defects, identify root causes, and implement corrective actions to reduce recurring issues.

Engineering Collaboration & Delivery

• Coordinate with engineers, business partners, vendors, and platform owners to deliver solutions successfully.
• Participate in design reviews and peer code reviews, providing constructive technical feedback.
• Contribute to Agile sprint planning, estimation, and technical documentation, with code maintained in GitHub and work tracked in Azure DevOps.
• Contribute reusable patterns, best practices, and continuous improvements to delivery practices.
• Perform additional duties as assigned or requested.

Knowledge, Skills, and Abilities

• Demonstrated experience delivering data and analytics solutions as a Data Engineer in a cloud-native environment, using Python as a primary development language.
• Recent hands-on experience developing with AWS-native capabilities, MongoDB Atlas, Databricks, and Power BI.
• Experience with API integration, CI/CD pipelines, observability, data pipelines, automation, and cloud security.
• Ability to operate independently while collaborating effectively across technical and business teams.
• Strong written and verbal communication skills, including the ability to explain technical concepts to non-technical audiences.
• Strong critical-thinking and problem-solving skills, with the ability to manage multiple priorities and meet deadlines.
• Must demonstrate a high degree of integrity, ethics, discretion, and dedication to the mission of the organization.
• Ability to work effectively both independently and in a team environment.
• Ability to communicate effectively across multiple channels and asynchronously in a remote-first working environment.

• Bachelor's degree in Computer Science, Information Systems, Engineering, Data Management, Cybersecurity, or a related discipline, or equivalent practical experience.
• 3+ years of engineering experience delivering production technology solutions.
• Demonstrated experience independently delivering complete features or work packages.
• Experience in property and casualty insurance or other regulated industries is a plus.
• The successful candidate will be required to complete an in-person leadership interview.
• Minimum travel is required for annual all-company gatherings or team design sessions (up to 5% of the time)

Minimum starting base of $80,000, with upward flexibility based on skills and experience + 10% annual bonus.

Notice of AI Use in Job Application Review

As part of our commitment in creating a fair, efficient, and consistent hiring process we may use artificial intelligence (AI) to help our recruiting teams organize, summarize, and analyze information provided by candidates, including resumes, application responses, and other materials submitted during the application process.AI may be used to identify patterns, highlight relevant skills, and experience, and assist in comparing a candidate’s qualifications with the requirement of a specific role. These tools are to improve efficiency and consistency while supporting more informed hiring decisions, which will ultimately be made by the hiring team.