Lead Fabric Data Engineer Consultants | Python | 100% Remote
Spyglass• Engagement Type: Contract—C2C or W-2 hourly/temporary
• Expected Commitment: 40 hours per week, Monday–Friday
• Work Schedule: Must work East Coast hours
• Initial Term: Three months, with potential to extend
• 100% Remote: Ideal candidate resides in NH, MA, RI, CT, ME, NY, or TX
Spyglass MTG is seeking experienced Lead Data Engineers who are “thinkers” and can mentor
junior developers while extending an existing codebase and building team proficiency in
Microsoft Fabric and Pyspark Python including class development and structured streaming.
Why Spyglass MTG?
• Exclusive focus on Microsoft technologies for more than 12 years
• 90% of our business comes from repeat customers
• 80% of our new business comes through Microsoft
• Five Microsoft Solutions Partner badges and 10 Advanced Specializations
• Member of Microsoft’s Partner Advisory Council for Data and AI
• Microsoft Fabric Voice member
Overview
Our client engagement is focused on Microsoft Fabric and Pyspark Python development
including class objects, structured streaming, Change Data Feed (CDF), and metadata driven
processes for our client in higher education.
The successful consultant will be a critical thinker and problem-solver who can work
independently, collaborate with client teams, and deliver high-quality, maintainable data
solutions.
The consultant will design and build python class objects focusing on developing reusable code
to load a Data Vault model from a Medallion ETL delta source. Solution supports near real time
processing using structured streaming. Collaboration and people skills are a must. This role
requires the development of production ready code as well as mentoring data engineers new to
Pyspark Python development. Use of AI, specifically GitHub Copilot, to increase productivity
and code quality is highly desired.
Key Responsibilities
• Extend and enhance an existing Python class-based codebase.
• Develop object-oriented solutions to source, transform, and load data into tables.
• Build and maintain ETL workflows using Microsoft Fabric notebooks.
• Partner closely with client resources during East Coast business hours.
• Mentor junior developers in Microsoft Fabric, Python, and object-oriented development.
• Provide hands-on technical leadership and deliver high-quality solutions.
• Promote effective development practices and maintainable code.
Required Qualifications
• Must be available to work East Coast hours.
• Fluent English communication skills.
• Strong Python development experience.
• Strong Microsoft Fabric experience, particularly with notebooks.
• Demonstrated experience with object-oriented programming and class development.
• Experience developing solutions that source, transform, and load data into tables.
• Strong ETL experience.
• Experience leading and mentoring junior developers.
• Ability to think critically, solve problems independently, and collaborate effectively with
client teams.
Preferred Qualifications
• Experience with Data Vault data models.
• Experience using AI tools to generate code or accelerate development.
• Experience working in higher education.