Software Engineer I

This is an excellent opportunity for engineers who enjoy building high-quality software, creating testing frameworks, and working at the intersection of software engineering and artificial intelligence. You will work on designing evaluation frameworks, debugging large-scale systems, developing automated testing solutions, and helping improve the performance of next-generation AI technologies.

Title: Software Engineer I
Location: Remote (United States)
Schedule: Full-Time, 40 hours/week
Type: 12-Month Contract with Possible Extension
Compensation: $75/hr
Benefits: PTO, Medical, Dental, Vision, 401(k), Life Insurance, Disability Coverage

About the Role:

We are seeking a Software Engineer to help build and evaluate advanced AI systems that interact with software and complete complex computer-based tasks. This role combines software engineering, AI/ML evaluation, testing, and infrastructure development.

The ideal candidate is passionate about coding, has strong Python development experience, and enjoys solving complex technical challenges. You will work on designing evaluation frameworks, debugging large-scale systems, developing automated testing solutions, and helping improve the performance of next-generation AI technologies.

This is an excellent opportunity for engineers who enjoy building high-quality software, creating testing frameworks, and working at the intersection of software engineering and artificial intelligence.

Main Responsibilities:

• Design, develop, and maintain software solutions used to evaluate AI model performance.
• Build and maintain automated test frameworks, benchmarks, and evaluation pipelines.
• Create reproducible experiments and analyze results to identify system improvements.
• Debug issues across applications, infrastructure, configurations, and system integrations.
• Write high-quality, well-tested code with a strong focus on software reliability and maintainability.
• Support deployment strategies, validation processes, and risk management practices.
• Collaborate with engineering, product, and research teams to improve AI system performance.
• Document technical processes, findings, and implementation details.

Education and Experience Required: 

• Bachelor's Degree in Computer Science, Software Engineering, Mathematics, Engineering, or a related field.
• Minimum 2 years of professional Python development experience.
• Strong software engineering background with experience building production-quality applications.
• Experience working with AI/ML systems, model evaluation, or machine learning development.
• Experience creating automated tests, validation frameworks, or benchmarking solutions.

Required Skills and Qualifications: 

• Python development experience (minimum 2 years required)
• PyTorch (Torch)
• Software engineering fundamentals
• Automated testing and test-driven development
• Debugging and troubleshooting complex systems
• Machine Learning and AI model evaluation
• Benchmarking and performance analysis
• Experiment design and validation
• Risk management and software quality practices
• Experience using AI coding assistants such as:
  • Claude Code
  • Cursor
  • Codex
  • GitHub Copilot
• Strong written and verbal communication skills

Preferred Skills and Qualifications: 

• Rust
• TypeScript
• Distributed Systems
• Platform Engineering
• Infrastructure Engineering
• Developer Tooling
• MLOps
• Large-Scale Testing Frameworks
• Backend Systems Development
• Evaluation Pipelines
• AI Agents / Agentic AI
• Generative AI / Large Language Models (LLMs)
• Open-source project contributions

#LI-HA1