New AI Agent Engineer Dataiku and Snowflake Cortex

Job Title: AI Agent Engineer Dataiku and Snowflake Cortex

Job Location: Irving, TX, 75038, USA

Estimated Duration (In Months): 13

Must Have Skills/Attributes: AWS, Python, Snowflake

Experience Desired: Built agents in Dataiku & Snowflake Cortex (5 yrs); Workflow automation in Dataiku recipes & Python (5 yrs); Experience with LangGraph, Langchain, CrewAI (5 yrs)

Required Minimum Education: Bachelor’s Degree

Job Description

Education
• Bachelor's degree in AI, Data Science, or Computer Science (required)
• Internships accepted as job experience
• Acceptable equivalent technical degrees: Applied Statistics, Data Science, Business Analytics, Business Intelligence & Analytics, Computer Science, Computer Science + X, Engineering (Aerospace, Electrical, Mechanical, Computer, Industrial, Agricultural, etc.), Informatics, Information
Systems Management, Mathematics, MBA with Technical Undergrad, Predictive Analytics, Statistics
• Master's or PhD also acceptable

Experience
• 5–7 years of professional experience
• 2+ years of experience applying Python (NumPy, SciPy, pandas, etc.) to solve business challenges
• Experience with cloud technologies (AWS, Azure, Google Cloud, etc.)

Top 3 Critical Skills
• Built agents in Dataiku & Snowflake Cortex (structured data) — critical
• Workflow automation in Dataiku recipes & Python (writing programming logic)
• Experience with LangGraph, Langchain, CrewAI

Technical Requirements
• Multi-agent architecture and orchestration patterns (agent collaboration, planning, delegation, workflow orchestration)
• Reusable agent frameworks and reference architectures
• Security, access control, and governance (RBAC, personas, authorization models, guardrails)
• Auditability and compliance considerations
• Enterprise integrations (Microsoft Teams, SharePoint, email, PDFs, enterprise data sources)
• Event-driven and batch processing architectures
• API and workflow integration best practices
• Agent evaluation, testing, and observability (offline/online evaluation, groundedness, relevance, hallucination detection, task success measurement)
• Automated regression testing, monitoring, observability, and performance tracking
• Prompt engineering and agent design patterns (prompt optimization, reusable prompts, skills, tools, agent design frameworks)
• Human-in-the-loop workflows (approval processes, escalation paths, feedback loops, continuous improvement)
• Dataiku application development and UX (Dataiku WebApps, production-ready front-end development, enterprise adoption best practices)
• Deployment, operationalization, and scalability (deployment automation, monitoring, governance)
• Cost and performance optimization (LLM selection, latency, token consumption, operational cost management, performance tuning)
• MCP experience in multi-agent systems for Agent-to-Agent communication (desired)
• Advanced data analysis and statistical methods (regression, hypothesis testing, ANOVA, statistical process control) (desired)
• Machine learning techniques (Clustering, Logistic Regression, CART, Random Forests, SVM, Neural Networks) (desired)
• Design/development of heavy equipment (automotive, aerospace, engine, transmission, construction, mining, industrial) (desired)

Soft Skills
• Team player (required)
• Good communication skills (desired)
• Strong initiative
• Interpersonal skills
• Ability to communicate effectively
• Planning and organization skills
• Teamwork
• Decision-making skills
• Strong concern for customers
• Strong focus on continual learning in the Analytics field
• Strong initiative to research and apply new methods and digital technologies


Job Responsibilities — Data Scientist 3 (Caterpillar Inc.)
• Understand the objective (of the assigned project/use case)
• Write code in Snowflake & Dataiku to build AI Agents
• Test output and update code
• Build AI Agents in Dataiku & Snowflake Cortex using structured data
• Use AI Agents to create alerts and automate workflows
• Perform workflow automation in Dataiku recipes & Python (write programming logic)
• Apply multi-agent architecture and orchestration patterns (agent collaboration, planning, delegation, workflow orchestration)
• Develop reusable agent frameworks and reference architectures
• Implement security, access control, and governance (RBAC, personas, authorization models, guardrails)
• Ensure auditability and compliance considerations
• Build enterprise integrations and data access patterns (Microsoft Teams, SharePoint, email, PDFs, enterprise data sources)
• Work with event-driven and batch processing architectures
• Apply API and workflow integration best practices
• Conduct agent evaluation, testing, and observability (offline/online evaluation, groundedness, relevance, hallucination detection, task success measurement)
• Perform automated regression testing, monitoring, observability, and performance tracking
• Apply prompt engineering and agent design patterns (prompt optimization, reusable prompts, skills, tools, agent design frameworks)
• Design human-in-the-loop workflows (approval processes, escalation paths, feedback loops, continuous improvement mechanisms)
• Develop Dataiku applications and user experience (Dataiku WebApps, production-ready front-end development, enterprise adoption best practices)
• Handle deployment, operationalization, and scalability (deployment automation, monitoring, governance)
• Perform cost and performance optimization (LLM selection, latency, token consumption, operational cost management, performance tuning)
• Upskill the current team in the latest Dataiku Agentic AI technology
• Share knowledge and teach this new technology to team members
• Establish best practices reusable across multiple AI programs and use cases
• Apply theory and concept in contributing to solutions in the assigned area
• Perform data collection and analysis
• Conduct development, validation, application, and refinement of statistical models
• Apply related digital technologies in processing both inputs and outputs from models
• Participate in daily standup meetings
• Collaborate on a project with 3 other people (including project leader)

Disqualifiers / Red Flags / Overqualifications
• Remote work
• No past or additional job titles/roles that would provide comparable background