Headquarters: India
URL: https://mindrift.ai/
Please submit your CV in English and point out your degree of English proficiency.
Mindrift connects specialists with project-based AI alternatives for main tech corporations, targeted on testing, evaluating, and bettering AI techniques. Participation is venture‑based mostly as an unbiased freelance contributor and doesn’t create an employment relationship with Toloka or our purchasers.
What this chance entails
As an unbiased freelance contributor, you select which initiatives to hitch and the way you manage your work, so long as deliverables meet the venture necessities and deadlines.
Whereas every venture entails distinctive duties, contributors could:
- Create structured check instances that simulate advanced human workflows
- Outline gold-standard habits and scoring logic to guage agent actions
- Analyze agent logs, failure modes, and determination paths
- Work with code repositories and check frameworks to validate your situations
- Iterate on prompts, directions, and check instances to enhance readability and problem
- Be sure that situations are production-ready, straightforward to run, and reusable
What we search for
This chance is an effective match for software program engineers, open to part-time, non-permanent initiatives. Ideally, contributors may have:
- 3+ of software program growth expertise with robust Python focus
- Expertise with Git and code repositories
- Comfy with structured codecs like JSON/YAML for situation description
- Understanding core LLM limitations (hallucinations, bias, context limits) and the way these have an effect on analysis design
- Familiarity with Docker
- English proficiency – B2
The way it works
Apply → Cross qualification(s) → Choose a venture → Full duties by yourself schedule inside venture timelines→ Receives a commission
Challenge time expectations
For this venture, duties are estimated to require round 6-10 hours of labor per week throughout energetic phases, relying on the duties you select to finish. That is an estimate solely and doesn’t create any minimal or assured hours.
Cost
- Paid freelance contributions, with charges which may be equal to as much as $80/hour* (venture‑ and process‑based mostly)
- Mounted venture fee or particular person charges, relying on the venture
- Some initiatives embrace incentive funds
*Be aware: Charges range based mostly on experience, expertise evaluation, location, venture wants, and different elements. Increased charges could also be supplied to extremely specialised specialists. Decrease charges could apply throughout onboarding or non-core venture phases. Cost particulars are shared per venture.
To use: https://weworkremotely.com/remote-jobs/mindrift-freelance-agent-evaluation-engineer
