Principal Data Engineer
- Salary
- $151.6K–$208.5K
- Hiring from
- United States
- Work type
- Hybrid
- Posted
625,555 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Navy Federal Credit Union currently does not provide sponsorship for this role. Applicants must be authorized to work in the United States without the need for current or future sponsorship.
The Principal Data Engineer provides senior engineering expertise, architectural direction, and technical ownership across enterprise data and analytics. The role advances Navy Federal’s data strategy by delivering trusted, governed data products and modernizing legacy platforms. The engineer will drive AI adoption across the data engineering lifecycle and make Navy Federal’s data ready for consumption by AI agents and conversational analytics, grounded in a governed semantic layer and supporting ontology.
This role will design and implement scalable data pipelines; migrate legacy data stores and BI workloads; strengthen data quality controls; automate testing, validation, and reconciliation; and enable data consumption on Navy Federal’s Databricks, Azure, and Microsoft Fabric platforms.
- Provide technical leadership and hands-on engineering expertise across data engineering, analytics, reporting, and data consumption.
- Lead the design and deployment of AI-enabled accelerators and agent-based solutions across the data engineering lifecycle, including code generation, legacy code conversion, pipeline scaffolding, and documentation.
- Establish standards and guardrails for AI-assisted development, including approved models, human review of AI-generated code, and validation against security and governance requirements.
- Lead AI-enabled test automation across data engineering initiatives, partnering with quality engineering to replace manual testing with automated unit, integration, regression, and data validation testing.
- Build reusable frameworks for ingestion, transformation, validation, reconciliation, and monitoring.
- Enable conversational analytics and consumption by AI agents by curating semantic definitions, metric views, ontology, metadata, and governed access in Unity Catalog, so that business users and agents receive accurate, explainable, and trusted answers.
- Design, develop, and optimize scalable batch, near real-time, and real-time data pipelines using Spark, Python, SQL, Databricks, and related Azure cloud services.
- Evaluate emerging AI and data engineering technologies, identify high-value enterprise use cases, and recommend adoption strategies.
- Mentor senior and mid-level engineers and guide teams through architecture reviews, design standards, coding practices, performance tuning, and operational resilience improvements.
- Modernize legacy workloads by migrating fragmented reporting and data assets into secure, standardized, governed analytics platforms.
- Define and implement API-driven and event-based data onboarding patterns using enterprise API management, integration, and streaming platforms (Gravitee, MuleSoft, Kafka).
- Enable metadata management, lineage, cataloging, and access governance through tools such as Unity Catalog, Alation, and related governance capabilities.
- Partner with data architects, analysts, product owners, business stakeholders, governance teams, and platform teams to translate business needs into scalable technical solutions.
- Ensure data solutions are secure, reliable, and compliant with Navy Federal policies, industry engineering standards, and information security, data governance, and regulatory requirements.
- Support Agile delivery, DevSecOps practices, CI/CD deployment, release readiness, defect resolution, and production support.
- Bachelor’s degree in Information Systems, Computer Science, Engineering, Data Engineering, or a related field, or the equivalent combination of education, training, and experience.
- Advanced hands-on expertise in Spark, Python, SQL, Databricks, and cloud-native data integration, transformation, and analytics solutions.
- Hands-on experience applying AI-assisted and agentic development tools, such as Databricks Genie Code, to accelerate data engineering, including code generation, reusable agent skills, and validation of AI-generated output against engineering, security, and governance standards.
- Strong experience designing, building, and supporting scalable data pipelines, lakehouse architectures, data warehouses, data marts, and analytical data stores.
- Expertise in automated data quality validation, data reconciliation, monitoring, alerting, error handling, and SLA management.
- Experience automating data pipeline testing (unit, integration/SIT, and regression) in CI/CD, including using AI agents to generate test cases, test data, and validation scripts.
- Experience with metadata management and lineage using governance and catalog platforms such as Unity Catalog.
- Experience with BI and analytics platforms such as Power BI, Tableau, Microsoft Fabric, and enterprise reporting modernization patterns.
- Working knowledge of Azure DevOps, CI/CD pipelines, Agile delivery, production deployment, and operational support practices.
- Ability to communicate complex technical concepts clearly to business stakeholders, technology leaders, engineers, and cross-functional delivery teams.
- Strong problem-solving skills, architectural judgment, ownership mindset, and ability to lead delivery in complex, highly regulated enterprise environments.
Desired Qualifications
- Master’s degree in Computer Science, Information Technology, Engineering, Analytics, or a related discipline.
- Experience with AI-ready data product design, feature preparation, data observability, and governed self-service analytics capabilities.
- Experience building and governing agentic and conversational analytics solutions such as Databricks Genie Agents, Agent Bricks, and Microsoft Fabric data agents, including curation, benchmarking and evaluation, and access controls through Unity Catalog.
- Familiarity with Databricks Lakebase and Lake Transactional/Analytical Processing (LTAP) patterns that serve operational and analytical workloads from a single governed copy of data, reducing the need for CDC and replication pipelines.
- Experience in consumer banking or credit unions.
- Knowledge of financial services data governance, regulatory traceability, audit readiness, data privacy, information security, and operational risk management expectations.
- Experience modernizing legacy BI environments, analytical data stores, and on-premises reporting platforms into Azure, Databricks, Microsoft Fabric, or similar cloud-native solutions across business, operational, risk, finance, or member domains.
Additional Information
Hours:
- Monday - Friday, 8:00AM - 4:30 PM
Location:
- 820 Follin Lane, Vienna, VA 22180
