Data Engineer

Overview and Summary We are Automotive Business Scientists. We empower our clients to turn overwhelming industry data into discovery, action, and measured success.  We are unique market leaders because we find and examine possibilities through the clarity of a scientific lens. To solve the toughest client challenges, we need curious, creative, and dedicated people to join our team. We search out individuals who align with our core values and who adhere to the highest standards of integrity and ethics in everything they do.  Our company is filled with the brightest minds and the biggest hearts at every level. We recognize that personal success takes on many different forms of the course of our lives – both professional and personally – so we provide a myriad of benefits and programs focused on Wellbeing, Growth, Community and Recognition.  One size does not fit all, so we encourage every Urban Scientist to discover their own formula for success including hybrid and remote work options.  If this sounds like the kind of company you would like to work with, Apply Now! POSITION OVERVIEW The Data Engineer position focuses on the curation of data so that it is useful for business functions and further analysis. There is a broad spectrum of skills and responsibilities the support this function. A Data Engineer operates within a larger Data Management function to provide technical support relevant to data to address the business needs of the organization. Within Urban Science, a Data Engineer generally deals with data that is used in products and services that Urban Science sells to its customers. That data comes from diverse sources, clients, venders and technologies, and requires considerable processing and integration to deliver the insights that are beneficial to our customers. The Data Engineer has a high level of responsibility within this data integration and processing function. In addition to knowledge of data storage tools, software development is required to create the efficient, repeatable processes for preparing and moving the data through the systems. Various technologies and commercial tooling are needed, and Data Engineers will identify opportunities, select tools and configure and/or build and deploy those tools and technologies. When appropriate, training and communications will be necessary to enable broad usage of data tooling and the data itself. Data Engineers partner with product development teams and advanced analytics functions. Essential Duties and Responsibilities ESSENTIAL DUTIES AND RESPONSIBILITIES Design and Implement Develop, implement and maintain data pipelines, including the tooling, technologies and architecture required Interface with other technology teams both within and outside of Urban Science to integrate data from a variety of sources. This includes client data source teams, DBAs, consuming application teams and the analytics department Create data sets in support of data modeling, mining and production software applications Ensure database architectures will support the functional and non-functional requirements of Urban Science products, analytics and ad hoc investigations Employ a variety of languages and tools (e.g. scripting or compiled languages) to marry systems and sources together Apply software engineering best practices, data management fundamentals, data storage principles, recent advances in distributed systems, and operational excellence best practices Innovation Automate and create efficiencies in data processing pipelines Identify and recommend ways to improve data reliability, efficiency and quality Perform research and acquire new knowledge and skills on new technologies, processes, and tools for use in data management Processing Execute ongoing and ad hoc processing of data Apply data analysis methods and tools to enhance data cleansing and readiness for use Perform data profiling and anomaly detection Managing data migrations/conversions and troubleshoot data processing issues Support Perform Tier 2 and general system support functions for data pipelines and systems Manage access control into data processing systems Standards Ensure data confidentiality and regulatory compliance Support and implement all security, regulatory and internal standards and policies in all data processes and tools Knowledge Sharing Document system architectures, design, business rules, configuration management specifics and system support approaches employed in data tooling and processes Actively support and participate in required Urban Science training programs to achieve targeted development objectives Overall Proactively communicates with upper management to provide updates and report issues in a timely manner Works with manager to complete annual goal setting and performance reviews in a timely manner Works with manager to prioritize all duties as assigned Qualifications - Education and Experience QUALIFICATIONS To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skills, abilities, and competencies required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Experience with SQL storage technologies, with a focus on Microsoft SQL server and related platform technologies. Demonstrated basic data modeling experience and knowledge of relational database modeling patterns Data integration and ETL/ELT patterns Software Engineering practices and processes Configuration management & deployment EDUCATION AND/OR EXPERIENCE Minimum Baccalaureate degree in Computer Science or related field from an accredited U.S. college or university, equivalent foreign institution, or equivalent experience. Non-technical degrees will be considered if candidate possesses appropriate level of analytical and technical knowledge required for the role 3+ years related work experience required 2+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets 2+ years with scripting and/or compiled languages (e.g. Python, C#, etc.) WORK ENVIRONMENT The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. DISCLAIMER This description is intended to describe the type and level of work being performed by a person assigned to this position. It is NOT an exhaustive list of all duties and responsibilities required by a person so classified. The job may require additional hours beyond the normal 40-hour workweek.