Snr Code Reviewer - Powershell

About OpenTrain

OpenTrain is a centralized job board for data-labeling and AI-training work. We aggregate openings from many AI companies and labeling platforms so contributors can find this kind of work in one place instead of searching dozens of sites.

Creating an OpenTrain account is free and applying takes only a few minutes. This posting is for a contractor role supporting OpenTrain AI’s PowerShell code annotation work.

About AI training work

AI systems learn from examples and human review. For code-focused projects that means people evaluate, test, and correct model-generated scripts so models learn to produce safe, functional automation.

This role is part of that human-in-the-loop process: your reviews will shape how future AI produces PowerShell automation by verifying correctness, security, and alignment with prompts and quality rubrics.

The role

We’re hiring a Senior PowerShell engineer to audit annotator reviews of AI-generated PowerShell scripts. You will validate submissions in an isolated sandbox, confirm they satisfy the prompt, run correctly, and follow secure scripting and automation best practices.

Contract type: Contractor, Part-time. Time requirement: 20+ hours/week. Pay: USD $24 per hour (pay-per-hour). Location: remote, worldwide. Data type: computer code/programming; label types: computer programming/coding; labeling software: OTHER.

What you'll do

• Execute AI-generated and annotator-reviewed PowerShell scripts in sandboxed environments to verify functionality and safety.
• Confirm each script satisfies the original prompt and intended objective before approving or adjusting ratings.
• Check for automation best practices: idempotence, robust error handling (try/catch/finally), and parameter validation.
• Identify and remediate security issues: credential leaks, injection risks, unescaped inputs, and excessive privilege escalation.
• Use testing and static-analysis tools (Pester, PSScriptAnalyzer) and debugging workflows to verify correctness.
• Correct mis-ratings and provide clear, actionable feedback so every review matches the quality rubric.
• Annotate findings in ticketing or QA tools (Jira, Asana) and follow structured rubric-based scoring and checklist reviews.
• Mentor and guide annotators by delivering constructive written feedback that improves review quality over time.

Requirements and qualifications

• Experience: 5–7+ years in professional PowerShell development, automation engineering, or dedicated code-review roles.
• Language mastery: Expert knowledge of PowerShell 5.x–7.x (Core), advanced functions, modules, remoting, and pipeline patterns.
• Scripting & automation: Skilled in writing idempotent scripts, error handling, and input validation using [Validate*] attributes.
• Secure coding: Proven ability to detect and mitigate credential leaks, injection risks, unescaped inputs, and privilege escalation.
• Testing & debugging: Experience with Pester for unit testing, PSScriptAnalyzer, and common debugging tools and workflows.
• Platform integration: Familiarity with Windows and cross-platform automation, including Azure/AWS modules and CI/CD pipelines.
• Proof-of-work validation: Comfortable executing scripts in sandboxed environments to verify functional compliance.
• Structured QA practice: Skilled in rubric-based scoring, checklist reviews, and ticketing/annotation tools such as Jira or Asana.
• Communication & mentoring: Excellent written English (B2+ CEFR); able to deliver clear, constructive feedback and mentor others.
• Nice to have: Experience in LLM evaluation, RLHF pipelines, or prior AI/ML data-labeling projects.

Who should apply

Apply if you are a hands-on PowerShell engineer with deep automation and security skills who enjoys code review, quality assurance, and mentoring annotators.

This role suits people who like systematic, rubric-driven evaluation, can work autonomously as a contractor, and are comfortable executing code in sandboxes to validate functionality.

How it works

Create a free OpenTrain account and submit your application; applying typically takes only a few minutes. This role operates as a remote contractor position, scheduled at your discretion to meet the 20+ hours/week guideline.

Work will use a proprietary labeling interface (OTHER) and coordination via ticketing tools (Jira, Asana). Compensation is hourly at the stated rate and paid per the contractor arrangement.

During onboarding you may be asked to demonstrate proof-of-work by running sample scripts in a sandboxed environment and performing rubric-aligned reviews.