Data Scientist - Ai Evaluation And Responsible Ai
h3Who We Are /h3pWe operate beyond organizational silos, combining deep expertise in data engineering and AI-driven solutions to design and deliver scalable, user-centric applications and modern data architectures.
We support a wide range of industries, including Automotive, Banking, Insurance, Telecommunications, E-commerce, and Public Services.
/ppWe operate beyond organizational silos, combining deep expertise in data engineering and AI-driven solutions to design and deliver scalable, user-centric applications and modern data architectures.
We support a wide range of industries, including Automotive, Banking, Insurance, Telecommunications, E-commerce, and Public Services.
We are looking for a Senior Data Scientist to own a shared evaluation framework, release gates and responsible-AI controls across machine learning, RAG, agent, document and vision use cases.
The role works directly with delivery teams from baseline creation through release decisions, production monitoring and quality reporting.
/ph3What You'll Be Doing /h3ulliDefine evaluation strategies, golden datasets, metrics, thresholds and release gates for ML, RAG, agent, document and vision solutions.
/liliBuild automated evaluation harnesses, regression tests, red-team and prompt-injection tests, and human-evaluation protocols.
/liliDefine responsible-AI controls covering explainability, bias, PII, human oversight, traceability and model risk.
/liliIntegrate evaluation into CI/CD and MLOps or LLMOps pipelines.
/liliSpecify monitoring, alerts, model cards and audit evidence, and investigate production quality issues.
/liliWork hands-on with use-case teams from baseline creation to release decisions and report quality against business measures.
/liliChallenge weak evidence or unsafe release decisions constructively.
/liliDeliver reusable, tested Python code, evaluation assets and governance templates.
/li /ulh3What You'll Bring Along /h3ulliAt least 10 years of professional experience preferred /lili6+ years of experience in data science, ML evaluation, model validation, experimentation or responsible AI.
/lili4+ years of strong Python and SQL experience with model, log and monitoring data.
/liliProduction experience evaluating and monitoring AI or ML systems.
/liliStrong foundation in statistics, experimental design, error analysis and calibration.
/liliExperience with RAG, LLM or agent evaluation and safety testing.
/liliAbility to challenge weak evidence or unsafe release decisions constructively.
/liliStrong technical communication, stakeholder influence, ownership, mentoring and judgment under ambiguity.
/liliExperience with adversarial testing, PII validation, Bedrock Guardrails, CloudWatch, New Relic, Langfuse or safety-sensitive applications is preferred.
/liliExcellent command of English, both written and spoken /li /ul #J-*****-Ljbffr
We support a wide range of industries, including Automotive, Banking, Insurance, Telecommunications, E-commerce, and Public Services.
/ppWe operate beyond organizational silos, combining deep expertise in data engineering and AI-driven solutions to design and deliver scalable, user-centric applications and modern data architectures.
We support a wide range of industries, including Automotive, Banking, Insurance, Telecommunications, E-commerce, and Public Services.
We are looking for a Senior Data Scientist to own a shared evaluation framework, release gates and responsible-AI controls across machine learning, RAG, agent, document and vision use cases.
The role works directly with delivery teams from baseline creation through release decisions, production monitoring and quality reporting.
/ph3What You'll Be Doing /h3ulliDefine evaluation strategies, golden datasets, metrics, thresholds and release gates for ML, RAG, agent, document and vision solutions.
/liliBuild automated evaluation harnesses, regression tests, red-team and prompt-injection tests, and human-evaluation protocols.
/liliDefine responsible-AI controls covering explainability, bias, PII, human oversight, traceability and model risk.
/liliIntegrate evaluation into CI/CD and MLOps or LLMOps pipelines.
/liliSpecify monitoring, alerts, model cards and audit evidence, and investigate production quality issues.
/liliWork hands-on with use-case teams from baseline creation to release decisions and report quality against business measures.
/liliChallenge weak evidence or unsafe release decisions constructively.
/liliDeliver reusable, tested Python code, evaluation assets and governance templates.
/li /ulh3What You'll Bring Along /h3ulliAt least 10 years of professional experience preferred /lili6+ years of experience in data science, ML evaluation, model validation, experimentation or responsible AI.
/lili4+ years of strong Python and SQL experience with model, log and monitoring data.
/liliProduction experience evaluating and monitoring AI or ML systems.
/liliStrong foundation in statistics, experimental design, error analysis and calibration.
/liliExperience with RAG, LLM or agent evaluation and safety testing.
/liliAbility to challenge weak evidence or unsafe release decisions constructively.
/liliStrong technical communication, stakeholder influence, ownership, mentoring and judgment under ambiguity.
/liliExperience with adversarial testing, PII validation, Bedrock Guardrails, CloudWatch, New Relic, Langfuse or safety-sensitive applications is preferred.
/liliExcellent command of English, both written and spoken /li /ul #J-*****-Ljbffr