This job is no longer available
This job expired on 22/08/2026. It no longer accepts applications.
DevOps Engineer – Remote (Full‑Time)
Braintrust
Job description
About the role
We are looking for an experienced DevOps Engineer to create and validate Infrastructure‑as‑Code (IaC) tasks that simulate real‑world AWS and GCP environments. This is a hands‑on, remote position that starts with a one‑month paid trial and may extend to a longer contract.
Key responsibilities
- Author realistic IaC tasks based on AWS and GCP scenarios.
- Build ground‑truth, idempotent IaC solutions that converge to the desired state.
- Design automated graders that verify whether an AI agent has correctly completed a task.
- Review and QA tasks created by peers for correctness, difficulty, and robustness.
- Harden tasks against reward‑hacking and document intent, assumptions, edge cases, and scoring rationale.
Required profile
- 4+ years of professional DevOps or cloud engineering experience.
- Deep, hands‑on expertise with Terraform (required) and familiarity with Pulumi, CloudFormation, or CDK.
- Strong knowledge of both AWS and GCP services.
- Proficiency in scripting with Python and/or Bash for automation.
- Ability to define and implement verifiable correctness checks for infrastructure outcomes.
- Prior experience in AI evaluation, benchmarking, or expert data annotation is a plus.
- Experience with LocalStack is a plus.
Required skills
- Terraform
- Pulumi
- CloudFormation
- CDK
- AWS
- GCP
- Python
- Bash
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Pakistan.
Salaries by job title
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Braintrust