Back to all jobs
Scale AI
Agentic Workflow & Evaluation Architect
REMOTEFULL TIME📍 Remote (Worldwide)$190,000 – $290,000 / year
Role Summary
Design synthetic data generation systems, reasoning benchmark suites, and multi-turn autonomous evaluation agents.
Job Description & Responsibilities
Scale AI is hiring an Agentic Workflow & Evaluation Architect to drive state-of-the-art model evaluation and synthetic task generation pipelines.
Required Technical Competencies
PythonSynthetic DataRLHFAutomated EvalsDSPyDocker
Ready to apply?
Submit your application directly to Scale AI.
About the Company
Scale AI
Visit company website ↗📍 Location: Remote (Worldwide)
💼 Employment: FULL TIME
📅 Posted: Sep 20, 2026