PCGJP00004723 : (Agile1) Data Engineer, Senior avail for ref
- Hiring from
- United States
- Work type
- Hybrid
- Posted
603,754 remote jobs, straight from company career pages
100% free · New jobs every hour
Show job descriptionHide job description
Job Description Details Requisition ID: PCGJP00004723 Requisition Title: (Agile1) Data Engineer, Senior Description: MSP Notes: Local candidates only. The role is hybrid with 1-2 days per week in office (sometimes 0) TOP THINGS: Experience with data engineering / modeling, interpersonal skills and the ability to explain technical issues to non-technical people, Snowflake / Fabric experience EQUIPMENT: PG&E laptop will be provided. In case of delay, a vendor-provided or personal laptop that can connect to Citrix/VDI may be used in the interim. All other equipment must be provided by the vendor or may use their personal • Conceptualizes and generates infrastructure that allows big data to be accessed and analyzed. • Partners with various departments to understand and incorporate standards information and requirements into work procedures. • Deploys machine learning algorithms in production environments. • Resolves application programming analysis problems of moderate to complex scope within procedural guidelines. May seek assistance from the supervisor or more skilled programmers/analysts on unusual or especially complex problems that cross multiple functional/technology areas. • Works on complex data and analytics-centric problems having moderate impact that require in-depth analysis and judgment to obtain results or solutions • Plans work to meet assigned general objectives; progress is reviewed upon completion and solutions may provide an opportunity for creative/non-standard approaches. • Communicates (oral and written) recommendations. • Mentors/provides guidance to less experienced colleagues. EDUCATION MINIMUM • BA/BS in Computer Science, Management Information Systems or related field of study, or equivalent experience. SKILLS MINIMUM • 5 years of experience with data engineering/ETL ecosystem, such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE. • Experience with Snowflake and Microsoft Fabric • Experience with machine learning algorithm deployment. • Business Intelligence and data access tool knowledge. • Knowledge of software engineering principals such as unit testing, CI/CD, source control. Requisition Start Date: 08/17/2026 Requisition End Date: 08/16/2027 SAP Organization Unit: NB Data, Analytics, Reporting, & Tools Site: Dublin Gas Safety & Innovation Center Building: Dublin Creekside Business Park Ste 200 Posting Information Requisition Owner: Comments Comments To Vendor: AgileOne will be hosting a spotlight call tomorrow, 7/22 Wed at 10:35 AM Pacific. Link will be shared via chat Requirements Spotlight Call Notes on PCGJP00004723 No Palantir needed. SQL Programing Snowflake Spark SAP PowerBI Summary New high-priority requisition opened: Job #4723, Data Engineer (Senior Level) for the New Business org unit at PG&E to manage data infrastructure for a $1.5B capital expenditure portfolio. Critical technical requirements: Expert-level SQL (hand-writing complex queries/thousands of lines of code), Python for statistical analytics and ETL (Spark) , and advanced Excel (ANOVAs and statistical modeling) . Primary objective: Migrate data infrastructure to Snowflake and build/modify complex Power BI dashboards to track 20,000+ active utility projects across 13 million customers. Key candidate traits: High proficiency in statistical analytics, intuition for "asking the right questions" to internal business users, and experience in highly regulated industries (e.g., Banking). Full Notes Requisition 4723: Senior Data Engineer Role Overview The role supports the New Business organization within PG&E, which handles infrastructure for new home construction, electric vehicle charging upgrades, and air conditioning installations. This business unit has expanded significantly due to climate trends and electrification, growing from 2-5% of PG&E's capital expenditures to 15%. The expansion represents a shift from a $500 million business to a $1.5 billion operation, requiring robust data infrastructure to track contract spending and project milestones. Eric Peltzer , the Operations Data Analyst Principal Level, will mentor the new hire and help guide problem-solving as the team fills gaps created by recent organizational changes and capacity needs. The primary objective for this position is to provide technical expertise in navigating complex data sets to identify root causes of business issues. The team currently manages approximately 20,000 in-progress jobs, each involving hundreds of individual process steps. Analytics are used to provide internal stakeholders with visibility into where jobs are stalled and how to improve customer satisfaction. Technical Requirements and Tooling Advanced SQL skills are the most critical requirement for this role , specifically the ability to write complex, ad-hoc queries by hand. The team operates on a SQL Server environment managing tens of millions of data lines and multiple gigabytes of information. SQL is used to build the massive underlying tables that feed the team's reporting dashboards. Snowflake expertise is a major priority as PG&E migrates its data infrastructure to the platform. The current team lacks deep experience with Snowflake, so the hire will be expected to share knowledge and optimize data storage structures within the new ecosystem. Python is required for executing ETL processes, data transfers, and advanced statistical analytics. The team utilizes Python to run scripts for data scrubbing, quality control, and calculating average duration for various project states. While machine learning deployment is not a formal requirement, a background in it is viewed favorably for the statistical intuition it provides. SAP serves as the primary system of record, with 95% of the team's work involving data extraction from this transactional system. Power BI and Power Apps are used for data visualization. Modifying and generating dashboards can account for 80-90% of the workload depending on the candidate's strengths and interest. Microsoft Fabric is considered a nice-to-have skill , while the team is moving away from Palantir Foundry. Candidate Profile and Operational Context The ideal candidate will have experience in banking or other highly regulated industries. Banking backgrounds are preferred because they involve similar high-transaction volumes, complex business processes, and rigorous data quality checks. The hire must be comfortable producing data for regulatory reporting for entities such as the CPC and FERC. Communications will be entirely internal, focusing on interactions with business users and project managers. The candidate must be able to translate technical mathematical concepts and statistical findings into actionable insights for non-technical stakeholders. The role requires strong listening and questioning skills to understand the nuances of the business process and the specific needs of internal users. The position offers a collaborative and creative environment with a focus on solving complicated problems through data engineering and analytics.