Engineering Manager - Software Security & AI Benchmark Delivery
Gramian Consulting
Job description
About the role
Gramian Consultancy is looking for an experienced Engineering Manager - Software Security to lead the development and delivery of security-focused training and evaluation tasks for frontier AI coding models. The project turns real-world software vulnerabilities into reproducible tasks that test whether AI models can identify, understand, reproduce and securely remediate vulnerabilities across programming languages and software ecosystems. You will oversee several engineering pods, own delivery performance, technical quality, team capacity and client alignment, and act as the final quality gate. This is a fully remote, 3-month contractor engagement starting next week, at 40 hours per week, with at least 4 hours of overlap with PST.
Key responsibilities
- Lead multiple engineering pods, coordinating Pod Leads and ensuring consistent delivery, quality and capacity
- Plan task batches, assign work to Pod Leads and monitor daily throughput against phase targets
- Ensure batches meet Google's expectations for volume, difficulty, quality and timelines
- Run weekly client reporting, give delivery forecasts and raise risks and dependencies early
- Identify and escalate tooling issues, rate limits, safety blocks, staffing constraints and other risks
- Work with Google to clarify requirements, scope, timelines and difficulty changes
- Review security tasks before delivery for accuracy, reproducibility and resistance to gaming
- Train Pod Leads on CWE classification, verifier robustness, task difficulty and acceptance criteria
- Interview and hire, develop Trainers into Pod Leads, forecast headcount and plan hiring waves
- Use dashboards, metrics and reports to guide delivery and staffing decisions
Required profile
- 10+ years of professional software engineering experience, with a strong software security background
- Proven experience leading technical teams against measurable delivery, quality and schedule targets
- Understanding of CWE, CVE and OWASP Top 10 across multiple languages and ecosystems
- Experience reproducing vulnerabilities, reviewing security patches and evaluating vulnerability proofs
- Experience designing or reviewing automated tests, verifiers, CI workflows or reproducible evaluation environments
- Experience managing or mentoring technical teams and communicating technical risks to clients and stakeholders
Required skills
- Proficiency in at least one major language: Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, Swift
- Git, Linux, Bash, Docker and common software security tooling
- Use of dashboards, throughput metrics and quality data for delivery decisions
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Pakistan.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 6 hours ago
Expires 1 month from now
6 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Gramian Consulting