Lead Solution Engineer – Snowflake, Azure
- Salary
- $128.1K–$213.5K
- Moves you to
- United States
- Support
- Visa sponsorship
- Posted
75,829 relocation jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
This role is four days onsite, with the flexibility to work from home one day per week M&T Work Model - 4 Days In-Office | 1 Day Work From Home
The Bank sponsors individuals for TN and H-1B transfers on a case by case basis. Please note that this position is not open to anyone on an F-1 student visa including those eligible for CPT/OPT or the Stem OPT extension.
Overview:
Designs, develops, implements and operates highly complex data pipelines, data products and data management solutions across modern cloud, warehouse and lakehouse platforms. Applies strong software-engineering, data-modeling and distributed-processing practices to deliver solutions that are scalable, secure, resilient, observable and cost efficient. Independently resolves ambiguous engineering problems, contributes to technical direction and reusable standards, and mentors other engineers while partnering across product, architecture, governance, cybersecurity and platform teams.
Tech Stack
- Snowflake
- Databricks
- Apache Spark / PySpark
- Advanced SQL
- Python
- dbt or comparable ELT/transformation framework
- Git / CI/CD
- Cloud computing, preferably Microsoft Azure
- ETL/ELT and data pipelines
- Batch + streaming architectures
- Automic or another scheduling tool
Primary Responsibilities:
- Lead the detailed engineering design, development, testing, deployment and production support of complex data pipelines and reusable data products.
- Develop maintainable data-processing and transformation solutions using advanced SQL and programming languages such as Python.
- Engineer solutions using Snowflake, Databricks, dbt and comparable modern data platforms; select appropriate warehouse, lakehouse or hybrid patterns based on workload needs.
- Design analytical storage solutions using relational databases, cloud object storage, columnar formats and open table formats such as Apache Iceberg.
- Implement batch, micro-batch, change data capture (CDC), event-driven and streaming patterns using technologies such as Apache Kafka or comparable platforms.
- Integrate data from relational and mainframe systems, APIs, event streams, SaaS platforms, files and object storage with appropriate security and operational controls.
- Apply normalized, dimensional, denormalized and data-product-oriented modeling approaches based on access, performance and lifecycle requirements.
- Optimize Snowflake, Databricks/Spark and SQL workloads for performance, scalability, reliability and cost, including partitioning, parallelism, data movement and compute utilization.
- Build data quality, reconciliation, metadata, lineage, observability, alerting and service-level controls into production solutions.
- Design for restartability, idempotency, retry, replay, recovery and failure isolation; lead diagnosis and root-cause analysis for complex production incidents.
- Apply source control, peer review, automated testing, CI/CD, environment promotion and infrastructure/configuration automation to data engineering delivery.
- Create reusable libraries, templates, implementation patterns and reference solutions that improve consistency and engineering velocity.
- Evaluate design alternatives and clearly document tradeoffs involving security, privacy, resiliency, maintainability, performance, cost and operational complexity.
- Contribute to technical standards, identify technical debt and recommend pragmatic modernization or remediation approaches.
- Mentor engineers through design reviews, code reviews, pairing and technical problem solving; influence engineering practices across the team and adjacent teams
- Partner with product owners, architects, governance, cybersecurity, platform and consuming teams to translate business and data requirements into scalable solutions.
- Develop technical epics and stories, estimate complex work, surface dependencies and risks, and support iterative delivery through Agile practices.
Scope of Responsibilities:
Supervisory/Managerial Responsibilities:
No supervisory responsibilities.
Education and Experience Required:
- Associate’s degree and a minimum of 7 years’ systems analysis and/or application development work experience or Bachelor's degree and a minimum of 5 years' systems analysis and/or application development work experience. In lieu of a degree, a combined minimum of 9 year’s education and/or relevant work experience, including a minimum of 5 years’ system analysis and/or application development work experience.
- Advanced SQL, including complex transformations, analytical queries and workload optimization.
- Python or another general-purpose programming language used for production data engineering.
- Hands-on engineering experience with Snowflake and Databricks.· Modern ELT/ETL and transformation practices, including dbt or a comparable framework.
- Data modeling for warehouse, lakehouse and data-product use cases.
- Distributed data processing using Apache Spark/PySpark or a comparable framework.
- Git-based development, automated testing, code review and CI/CD.· Batch and streaming architectures, orchestration and production operations.
- Cloud computing and object-storage concepts, preferably in Microsoft Azure.
- Structured and semi-structured data using formats such as Parquet, JSON, Avro, CSV and XML.
- Hands-on experience in Automic or other scheduling tool
- Experience with Apache Kafka, CDC and event-driven architectures.
Education and Experience Preferred:
- Advanced production experience with Snowflake, Databricks, Apache Spark/PySpark and dbt.
- Experience implementing Apache Iceberg or another open table format, including schema evolution, partitioning, snapshots and table maintenance.
- Experience with orchestration technologies such as Apache Airflow, Azure Data Factory, Databricks Workflows or dbt orchestration.
- Experience with Infrastructure as Code and configuration automation, including Terraform or comparable tooling.
- Experience with data catalogs, metadata management, lineage, data observability and automated data-quality frameworks.
- Experience building governed enterprise data products or domain-oriented data solutions.
- Experience working in a highly regulated environment such as financial services.
We support our team members with generous benefits.
- Competitive compensation
- Health, welfare, and retirement benefits
- 401(k) match at 5%
- Work-life balance and flexible work arrangements
- Banking Officers start with 25 days PTO plus 12 paid holidays
- 40 hours paid volunteer hours per year
- Much more. For details, see: M&T Benefits Overview
M&T Bank is committed to fair, competitive, and market-informed pay for our employees. The pay range for this position is $128,100.00 - $213,500.00 Annual (USD). The successful candidate’s particular combination of knowledge, skills, and experience will inform their specific compensation.
Location
Wilmington, Delaware, United States of AmericaAbout Us
Great companies have an enduring sense of purpose. At M&T, our purpose is a simple one: make a difference in people’s lives and uplift the communities we serve. M&T Bank Corporation is a financial holding company headquartered in Buffalo, New York. M&T’s affiliates offer advice, guidance, expertise and solutions across the entire financial spectrum, combining M&T Bank’s traditional banking services with the wealth management and institutional capabilities offered by Wilmington Trust. M&T Bank has a network of over 1,000 branches and 2,200 ATMs that span 12 states from Maine to Virginia and Washington, D.C. For more than 165 years, M&T has strived to take an active role in our communities and build long-lasting relationships with our customers. We are a bank for communities—combining the capabilities of a large bank with the care of a locally focused institution.
As an employer of choice, we are proud to offer competitive benefits ranging from medical and retirement to forty hours of paid volunteer time, each year. Our core values – integrity, ownership, collaboration, curiosity, and candor – drive the work we do. We seek to further build upon our record of success by bringing in top talent and fresh skill sets while continuing to support the growth and development of all our team members. View M&T’s Human Capital Report to learn more.
Ready to join our team? Submit your application today!
If you are unable to apply through this site due to technical issues or need an accommodation to apply, please contact us at careersitesupport@mtb.com for assistance.
M&T Bank is unwavering when it comes to providing equal employment opportunities to all employees and applicants without regard to race, color, national origin, religion, ethnicity, sex, gender identity, age, disability, citizenship, pregnancy, veteran status, military status, marital status, sexual orientation, genetic information or any other characteristic protected under applicable federal, state or local laws. M&T Bank Corporation has policies and procedures in place to promote a drug free workplace.
