<h3>Role Overview</h3><p>Mercor connects elite creative and technical talent with leading AI research labs. As a DevOps Engineer - AI Model Evaluator, you will use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.</p><h3>What You Will Do</h3><p>Review model-generated implementations, identify bugs, edge cases, and reliability issues, and compare outputs from multiple frontier models.</p><h3>Why It Might Be a Fit</h3><p>You will apply professional engineering judgment to realistic infrastructure engineering scenarios and have the opportunity to work with leading AI research labs.</p><h3>Requirements</h3><ul><li>2+ years of professional DevOps, SRE, or Cloud Engineering experience</li><li>Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling</li><li>Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools</li><li>Ability to evaluate model-generated infrastructure and reliability engineering solutions</li></ul><h3>Benefits</h3><ul><li>$400 per accepted task</li><li>Compensation is tied to accepted work</li></ul><p>Originally posted on <a href="https://himalayas.app">Himalayas</a></p>