Gen Ai Content Evaluator And Team Lead

Are you interested in working in one of the most impactful areas of technology in the world today? Do you want to build generative AI skills while working on a project to transform the most mission-critical IT workloads for organizations that power the global economy? Come join the team that is at the intersection of cutting-edge gen AI and mainframe software development, a key strategic pillar for IBM.

As a Gen AI Content Evaluator - Architect and Team Lead, you will lead the team responsible for the evaluating and benchmarking the LLM and fine tune its performance. This may include contributions to the automated evaluation pipeline in addition to advancing techniques used to evaluate performance as well as metrics. In your role as architect, you will contribute to the design of the evaluation and benchmarking strategy and provide ongoing analysis and metrics on current performance. You will be responsible to incrementally improving our measurement and analysis over time.