Senior Data Engineer

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS. Thank you! NOTICE: For Privacy Policy please review here Job Responsibilities: The Senior Data Engineer will play a critical role in our team, focusing on designing and managing data pipelines for both machine learning and business intelligence (BI) applications. This role involves leading the development and maintenance of scalable data management systems, integrating data from various sources to drive analytics initiatives. The successful candidate will have a deep understanding of data architecture, machine learning, and BI concepts, and will be comfortable dealing with large and complex data sets. TASKS AND RESPONSIBILITIES 1. Lead the design, construction, installation, testing, and maintenance of highly scalable data management systems for machine learning and BI applications. 2. Develop and optimize ETL processes and data pipeline architectures for data collection, ingestion, and storage. 3. Collaborate with data scientists and BI analysts to understand their data needs, map data fields to hypotheses, and curate, wrangle, and prepare data for use in their models. 4. Ensure the data architecture adequately supports the requirements of both the machine learning models and the BI tools. 5. Maintain data security and compliance standards while ensuring high performance and availability of the data. 6. Troubleshoot complex data-related issues and propose long-term solutions and enhancements. 7. Mentor junior data engineering team members and provide technical guidance as needed. REQUIREMENTS Education 1. Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field. A Master’s degree is preferred. Experience 1. Minimum of 5 years of experience in a data engineering role. 2. Proficiency in SQL databases and development, as well as scripting languages such as Python or Java. 3. Experience with cloud services (e.g., AWS, Google Cloud, Azure). 4. Extensive experience with big data tools (e.g., Hadoop, Spark) and familiarity with machine learning algorithms and BI tools. 5. Proven experience in building and optimizing data pipeline architectures and data sets. Skills and Knowledge 1. Deep knowledge of database structure systems, data processing, and data mining. 2. Excellent analytical skills and problem-solving abilities. 3. Strong understanding of machine-learning and BI concepts and principles. 4. Proficiency in data visualization tools (e.g., Tableau, D3.js, PowerBI). 5. Ability to lead and mentor a team in a fast-paced, team-oriented environment. 6. Excellent verbal and written communication skills. 7. Strong project management and organizational skills Additional Job Details: