Job details

Location
Utrecht
Salary
Not stated
Experience
Not stated
Language
English
Job type
Not stated
Relocation
Not mentioned

Source: GeekSoft Consulting, direct from their site.

About the role

Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team. Requirements AI Data & Evaluation Engineer to work within a Scrum team, preparing, structuring, enriching, and validating enterprise data for AI knowledge bases and AI chatbots. Build and maintain Databricks data pipelines to process structured and unstructured data for AI knowledge bases. Prepare, clean, transform, and enrich source data to improve the quality and reliability of information used by AI assistants. Develop and maintain evaluation datasets covering realistic conversations, complex scenarios, edge cases, and multi-step workflows. Apply evaluation frameworks to test advanced chatbots across single-turn, multi-turn, simulation-based, and agentic scenarios. Implement automated testing, monitoring, and quality gates for changes to data, prompts, models, retrieval, and orchestration. Deploy and manage cloud infrastructure using Infrastructure as Code, particularly Azure Bicep and CI/CD pipelines. Analyze evaluation results and translate findings into improvements across knowledge, retrieval, prompts, tools, and application logic. Strong proficiency in Python, data engineering, and automated testing. Hands-on experience with Azure, Databricks, DevOps, CI/CD, and Infrastructure as Code, preferably Bicep. Experience building data pipelines and preparing structured and unstructured enterprise data for AI knowledge bases and RAG applications. Experience with chatbot evaluation, including multi-turn, simulated, and agentic interactions. Familiarity with Context Engineering, Agentic AI, Function Calling, retrieval strategies, and tool use. Strong engineering and data-quality mindset with an affinity for Agile development. Strong critical thinking, ownership, accountability, and problem-solving skills. Excellent communication skills and a customer-focused approach. Relevant HBO or university degree and fluency in English. Benefits A challenging, innovating environment. Opportunities for learning where needed.
Apply on GeekSoft Consulting's site

Opens their careers site in a new tab

AI Engineer - GenAI & Customer… at GeekSoft Consulting | JobThing