Freelance Agent Evaluation Engineer

As a specialist connecting with project-based AI opportunities through Mindrift, you will be focused on testing, evaluating, and improving AI systems. The participation in these projects is project-based rather than permanent employment. Key Responsibilities: - Create challenging coding test cases to push AI coding systems to their limits - Review and refine realistic coding tasks based on provided production codebases - Write comprehensive functional tests to validate actual end-to-end behavior and edge-cases - Craft challenges where AI requires complex reasoning and information scattered across files and external sources - Analyze AI failures to understand areas of struggle and mastery - Iterate based on feedback from expert QA reviewers Qualifications Required: - Degree in Computer Science, Software Engineering, or related fields - 5+ years of experience in software development, primarily Python - Background in Full-Stack development with a focus on building React-based interfaces and robust Back-end systems - Experience in writing functional and integration tests - Familiarity with Docker containers and CI/CD understanding - English proficiency at B2 level Please note that this opportunity is suitable for experienced developers, software engineers, and test automation specialists open to part-time, non-permanent projects. The tasks for this project are estimated to take approximately 20 hours to complete, and you have the flexibility to choose when and how to work. Payment details, including rates up to $12/hour, fixed project rates, individual rates, and potential incentive payments, are shared per project. Rates may vary based on expertise, skills assessment, location, project needs, and other factors. As a specialist connecting with project-based AI opportunities through Mindrift, you will be focused on testing, evaluating, and improving AI systems. The participation in these projects is project-based rather than permanent employment. Key Responsibilities: - Create challenging coding test cases to push AI coding systems to their limits - Review and refine realistic coding tasks based on provided production codebases - Write comprehensive functional tests to validate actual end-to-end behavior and edge-cases - Craft challenges where AI requires complex reasoning and information scattered across files and external sources - Analyze AI failures to understand areas of struggle and mastery - Iterate based on feedback from expert QA reviewers Qualifications Required: - Degree in Computer Science, Software Engineering, or related fields - 5+ years of experience in software development, primarily Python - Background in Full-Stack development with a focus on building React-based interfaces and robust Back-end systems - Experience in writing functional and integration tests - Familiarity with Docker containers and CI/CD understanding - English proficiency at B2 level Please note that this opportunity is suitable for experienced developers, software engineers, and test automation specialists open to part-time, non-permanent projects. The tasks for this project are estimated to take approximately 20 hours to complete, and you have the flexibility to choose when and how to work. Payment details, including rates up to $12/hour, fixed project rates, individual rates, and potential incentive payments, are shared per project. Rates may vary based on expertise, skills assessment, location, project needs, and other factors.