AI training programs · Paid AI evaluation tasks for engineers
Hashlist
Hashlist, a Helsinki engineering marketplace (Gigarator Oy, founded 2020), runs a Data Operations Platform where engineers and domain experts take briefs from AI labs and build tasks for them: an agent prompt, a sandboxed environment, reference solutions and deliberately wrong answers, grading criteria and verifier tests. Its task templates are embedded and automotive software and desktop apps, and its computer-use briefs pay by the hour to record yourself working in professional software (its app, read 2 November 2026). It publishes no public list of briefs, and none of the nine a job aggregator showed on 2 November 2026 was clinical, so this board lists no Hashlist work; signup is open and each brief states its pay.
Is Hashlist a legitimate company to work for?
Checked Nov 2026 against 7 sourcesMostly. Behind Hashlist is Gigarator Oy, on the Finnish register since 2020 and serving carmakers, and the terms of its data platform lay out how work is checked and paid. That platform is recent, so it has no payment history yet. Money is earned only when a reviewer accepts a task. Work that is rejected earns nothing and still belongs to Hashlist, and every withdrawal goes out by hand, sometimes only after identity and tax checks. It pays Per accepted task, or per hour of accepted screen recording; each brief sets its rate (employer-stated).
Joined through its own application (it publishes no job postings)
What people praise
- A reviewer writes down why each task was accepted or turned down, so the feedback is never a bare yes or no.
- Signing up is free, by email or Google, and the new account lands in the app straight away rather than on an application form (tested 14 Oct 2026).
- This is not a fly-by-night outfit: Gigarator Oy has matched engineers to automotive clients like Stellantis and Toyota since 2020.
What people complain about
- A task that is turned down pays nothing, and the reviewer can credit less than the brief offered, for instance when only part of it was done.
- From the moment you start building, the work belongs to Hashlist, even the parts of a task it later rejects.
- Cashing out is manual: staff review each request, may first ask for ID, tax or payment-account details, and can set a USD 50 minimum.
- Its terms only date from 25 September 2026, and on 2 November 2026 Trustpilot showed 0 reviews; we could not find any written account from a worker on the platform.
Best for: Engineers in embedded, automotive and systems work able to ship a complete AI test, meaning the sandbox, a worked answer and the checks that grade it. Its sources show no clinical briefs, so few health professionals fit. Not for: Nurses, physicians and other clinicians looking for medical AI work, and anyone who needs pay for hours spent regardless of outcome or a platform with a long payment record.
Honest catches
- Pay here is employer-stated, not measured live from a job feed, so treat it as a benchmark rather than a guaranteed rate.
Sources for this review
- Hashlist DOP: Terms of Service (Gigarator Oy, last updated 25 September 2026; read 2 Nov 2026)
- Hashlist DOP: sign-up page (email and password or Google; account created 14 Oct 2026, read again 2 Nov 2026)
- Hashlist DOP: the signed-in app (briefs and their pay, Balance, screen-recording briefs), read from its public app code on 2 Nov 2026
- Finnish Trade Register (YTJ): Gigarator Oy, business ID 3153482-2 (read 2 Nov 2026)
- Hashlist: company site (100,000+ domain engineers registered, selected clients; read 2 Nov 2026)
- The Hub: Hashlist startup profile (founded 2020, seed, clients; read 2 Nov 2026)
- Trustpilot: Hashlist (0 reviews, unclaimed profile; read 2 Nov 2026)
A recruiter wrote to you in Hashlist's name?
Hashlist's own sites: hashlist.com. Its real email comes from team@hashlist.com. Paste the message or the offer and we check its links, its sender and the pay it promises.
Pay at Hashlist
Employer-stated · as of 2026-11-02Researched rate card, employer-stated, as of 2026-11-02
Hashlist publishes no rates outside its signed-in app (its public pages at dop.hashlist.com, read October 14, October 29 and November 2, 2026). Its app shows two kinds of brief (read November 2, 2026 from the app's public code): a US dollar amount per successful submission (or a custom rate) with Hashlist's estimate of the hourly equivalent, and computer-use briefs that pay an hourly rate for accepted active time recording yourself working in professional software, with an optional bonus per hour for narrating. Pay is earned only when a Hashlist administrator accepts the work (DOP Terms of Service, last updated September 25, 2026, sections 8.1 and 8.5). A job aggregator, aitrainer.work, listed 9 open briefs on November 2, 2026 (6 embedded, hardware and controls briefs at $300 per accepted task, 3 screen-recording briefs at $60 an hour of active time); those figures are a third party's copy, not shown on Hashlist's own public pages, so no number is stated here.
| Role | Researched pay |
|---|---|
| AI evaluation task builder (embedded and automotive software) | Per accepted task, set per brief (source: Hashlist listings) |
| Reference solutions and verifier tests for AI tasks | Per accepted task, set per brief (source: Hashlist listings) |
| Screen recording of professional software work (computer-use briefs) | Per hour of accepted active time, set per brief (source: Hashlist listings) |
Hashlist projects open now
Hashlist does not publish a job feed this site can read.
You apply on Hashlist directly.
Join Hashlist (opens in new tab)CareJobs.Now is free for job seekers. When you join a staffing agency, a shift app or one of the AI-training programs through a link on this site, it may pay us a referral fee. That costs you nothing and never lowers what you are paid. Hospitals and other employers cannot pay to appear here or to move up.
AI training: new openings every week
Hashlist has no careers site we can read, so we'll send you new AI training openings from the hospitals, clinics and care employers we do follow. Free, stop anytime.
Comparable AI projects open now
Hashlist has no job board we can read. These open jobs are the same kind of work at other employers, refreshed every night.
Registered Nurse (opens the job details)
micro1 · AI training · Remote · 3w agoDetails
$60–$70/hr
Orthodontist (opens the job details)
Mercor · AI training · Remote · 5d agoDetails
$150/hr
Hospitalists and Family Medicine Physicians: AI Diagnosis Review (opens the job details)
Terac · AI training · Remote · 3w agoDetails
$200/hrPhysician AI Trainer – Hospital Medicine (opens the job details)
micro1 · AI training · Remote · 2w agoDetails
$80–$125/hr
Oncology Clinical Researcher (opens the job details)
Alignerr · AI training · Remote · 3w agoDetails
$40–$80/hrInpatient Medical Coder (opens the job details)
micro1 · AI training · Remote · 1w agoDetails
$50–$70/hr
CareJobs.Now is free for job seekers. When you join a staffing agency, a shift app or one of the AI-training programs through a link on this site, it may pay us a referral fee. That costs you nothing and never lowers what you are paid. Hospitals and other employers cannot pay to appear here or to move up.
What Hashlist needs health professionals for
Open one to see the day-to-day, the requirements and what the job pays at every employer we follow.
Comparing pay? See what every kind of job pays or the highest-paying employers.
Signing up with Hashlist
Researched Nov 2026Pay reaches your Hashlist balance only for a task its reviewer accepts, and you get there by opening a free dop.hashlist.com account (email and password, or Google), taking a brief, assembling its task inside the app (prompt, files, correct answer, near misses, scored steps), pressing Proof and Publish, and waiting while AI models attempt it and a reviewer decides; balances are withdrawn to PayPal or a bank.
Eligibility
- Adults only: 18, or older where local law sets a higher age of majority, with the legal capacity to contract.
- Your home country has to let you do paid independent work and receive the money. People in, from, or living in a country under comprehensive sanctions are excluded. Hashlist can restrict access to the countries it chooses and does not publish them.
- Your account is yours alone. Sharing it is banned, and so is opening more than one, whether to take a brief twice or to refer yourself.
- Real expertise from your own job. Each task is a piece of work you actually do, and Hashlist turns away puzzles and textbook-style exercises.
- Work that matches its briefs. The briefs in its app are engineering and software work (embedded and automotive software, desktop applications) plus screen recordings of professional software use; none of its sources shows a clinical brief, so it fits few health professionals.
The sign-up steps
- 1
Sign up
Register with Google or with an email address and a password. You land in the app at once: no form to fill in and no interview.
- 2
Pick a brief
Hashlist posts its open work on your dashboard, paid when accepted. Each brief covers four things: the work, its pay (per successful submission, or a custom rate), how many submissions it accepts, and the evaluation, such as which models run it and for how many trials. Once you have read all of it, the Take this brief button adds the task to your dashboard.
- 3
Start from a real piece of your own work
What Hashlist asks for is one real assignment from your job, framed as a challenge for an AI model, with checks of yours that score how it did. Its suggestion is to begin with a moment when a model got something wrong, made something up or gave up partway, such as misreading a datasheet value, producing a configuration that the real tool would refuse, or code you had to correct in review.
- 4
Fill in the task
Its folder is created for you. Word the prompt the way a colleague would hand you the job. The Golden set then holds the answer you know is right, one or more near misses (mistakes a good colleague might make) and the steps. Steps carry 1 to 5 points each and describe a result; the app grades them three ways: a number inside a range, a phrase appearing in a line, or a judge model that reads the answer.
- 5
Run Proof, then Publish
Proof feeds three outputs through your checks (the correct one, the near miss, and nothing at all) and names whichever check failed; a near miss you linked to a step has to lose that step's points. Once Proof passes, press Publish. While a task is under review you cannot edit it.
- 6
Model runs, then a reviewer
Hashlist then sets several models on it, using your wording and a rewording, sometimes with tools and sometimes not; a mix of successes and failures is what counts as a pass. After that a person goes through it, looks for anything confidential in the files and attempts to fool the grading. Requested changes come as an in-app comment on the task, and they are usually quick to make.
- 7
Collect, then build again
The reviewer gives every task a written reason. Acceptance credits your balance with what the brief offered at the moment you handed it in, unless the reviewer records a reason to credit another amount, such as for partial work. Rejection pays nothing.
No entrance exam: each task is tested by AI models and a reviewer
Nobody interviews or tests you at the door; the first task you build is the test. Submitted tasks face a panel of AI models first and a Hashlist administrator second, and that administrator's verdict always comes with a written explanation. The sweet spot is a task the models sometimes pass and sometimes fail: all fails means too hard, all passes too easy. It also has to be genuine work rather than AI-written, resistant to cheating, consistent from run to run, and paired with a believable wrong answer.
Format
Made inside the app from five parts (prompt, supporting files, the right answer, near misses, and steps worth 1 to 5 points), validated by Proof, then by the model runs and a human review. For those who prefer it, the longer guide explains a manual build with its own environment, verifier and reference answers.
How to prepare
- Think back over your own week for a request a model got wrong, invented or left unfinished.
- Decide on the plausible wrong answer a strong colleague might give, such as a unit mix-up or a clause from an outdated version of a spec.
- Make sure the model cannot rewrite your checks or find the answer sitting in the files, and that the checks score the same way every time (fixed versions, no timing or network dependence).
- Phrase each step as a result, not an activity. If a judge model grades a step, put that reasoning in writing, in ordinary sentences, inside the answer file of your correct answer.
- Go through dop.hashlist.com/guide in full before you start: it explains each field and some rules the app never repeats, such as accepting a tolerance band rather than one exact value.
Why people get rejected
- A task written by AI: Hashlist says these are declined automatically (it advises keeping AI below 20% of a task; the builder's Ask helper and suggested checks are allowed).
- A brain-teaser or a textbook problem rather than real work.
- Every model attempt passes, or every one fails.
- Grading a model can game, or a solution it can simply find in the folder.
- Using what is not yours to use: confidential code or data from an employer, or a problem copied out of a public benchmark.
Tips to get accepted
- Every limit needs a pedigree. Name where it comes from (a specification clause, a table, a measurement) the way you would defend it to a peer, and base the task on about an hour of your real working day and real data.
- A near miss should be a believable error, not a broken file: an output with nothing in it fails for a reason that teaches the model nothing.
- Do not paste briefs, tasks or reviewer comments into outside AI tools: the Terms count unpublished briefs, your tasks and feedback as confidential.
- Keep tax paperwork handy: before a payout Hashlist can request a W-9, a W-8BEN or whatever your country uses instead.
- Every task belongs to Hashlist from creation, rejected ones included, so draw only on your own experience and never on an employer's confidential material (for a clinician, never real patient data).
- There are also computer use briefs: its DOP Recorder desktop app (macOS 12 or later, Windows 10 or later) films you doing real work in professional software while you narrate; you trim anything private and upload. Accepted active time is paid hourly, some briefs add a bonus per narrated hour, and a recording with too little active work can be rejected.
What isn't public
- Rates appear only inside the signed-in app, where each brief shows its own pay; no public Hashlist page lists the open briefs (checked 2 Nov 2026).
- Neither an acceptance rate nor a review time is published.
- Its own pages disagree on payouts (all re-read 2 Nov 2026): the Terms (last updated 25 September 2026) describe a manual transfer to PayPal or a bank aimed at 10 business days, the signed-in Balance page says 1 to 3 business days, and the first-task guide says weekly through Stripe.
- Which countries it pays is never listed; the Terms only reserve the right to restrict where the platform is offered.
- The Terms (section 6.3, last updated 25 September 2026) allow a rejected task to be revised and resubmitted, yet the app (read 2 Nov 2026) also labels some tasks Rejected with a note that they cannot be resubmitted.
- Its Terms only go back to 25 September 2026, Trustpilot held 0 reviews on 2 November 2026, and no worker has written about it anywhere we searched.
Sources (6)
- Hashlist DOP: Writing a task (its first-task guide; read 2 Nov 2026)
- Hashlist DOP: Authoring a task, from the domain expert's side (its full guide; read 2 Nov 2026)
- Hashlist DOP: Terms of Service (Gigarator Oy, last updated 25 September 2026; read 2 Nov 2026)
- Hashlist DOP: sign-up page (email and password or Google; account created 14 Oct 2026, read again 2 Nov 2026)
- Hashlist DOP: the signed-in app (Work on offer, Take this brief, pay estimates, task outcomes, Balance, computer use recording briefs), read from its app code on 2 Nov 2026
- Trustpilot: Hashlist (0 reviews, unclaimed profile; read 2 Nov 2026)
Frequently asked questions
Is Hashlist legitimate?
Mostly. Behind Hashlist is Gigarator Oy, on the Finnish register since 2020 and serving carmakers, and the terms of its data platform lay out how work is checked and paid. That platform is recent, so it has no payment history yet. Money is earned only when a reviewer accepts a task. Work that is rejected earns nothing and still belongs to Hashlist, and every withdrawal goes out by hand, sometimes only after identity and tax checks.
Could Hashlist be a scam?
No. Hashlist is a real company. A search on 2 November 2026 found no scams run in Hashlist's name. Paid tasks live only on dop.hashlist.com, and questions about your account go to team@hashlist.com. Its terms charge nothing for signing up or taking a brief, so a request to pay for access is a warning sign.
Does Hashlist really pay health professionals?
Yes. An established engineering marketplace (Gigarator Oy, Helsinki) whose supplier side serves carmakers and mobility firms such as Stellantis, Toyota Motor Europe and Applied Intuition (its site, read October 29, 2026). Its data platform for AI tasks is new and has no written worker reviews yet, so its payment record is unproven. Payouts: Withdrawal on request to PayPal or a bank account (IBAN), reviewed and sent by hand within about 10 business days; a USD 50 minimum may apply, and fees and currency conversion are yours (DOP Terms section 9). Its app gives other times: its Balance page says 1 to 3 business days and its first-task guide says weekly through Stripe (read November 2, 2026). The dollar rate is the one the brief showed at the moment you submitted, and it is only owed after an administrator signs off on the task; rejection means no pay. Approved earnings collect in an in-app balance. A payout request names a PayPal address or an IBAN, and a Hashlist administrator checks and sends it manually; the Terms set a 10 business day target, allow identity, tax or payment-account checks beforehand, and permit a USD 50 minimum. Any PayPal or bank charges, and the cost of converting currency, are yours to bear.
What does Hashlist pay per hour?
Per accepted task, or per hour of accepted screen recording; each brief sets its rate. Hashlist publishes no rates outside its signed-in app (its public pages at dop.hashlist.com, read October 14, October 29 and November 2, 2026). Its app shows two kinds of brief (read November 2, 2026 from the app's public code): a US dollar amount per successful submission (or a custom rate) with Hashlist's estimate of the hourly equivalent, and computer-use briefs that pay an hourly rate for accepted active time recording yourself working in professional software, with an optional bonus per hour for narrating. Pay is earned only when a Hashlist administrator accepts the work (DOP Terms of Service, last updated September 25, 2026, sections 8.1 and 8.5). A job aggregator, aitrainer.work, listed 9 open briefs on November 2, 2026 (6 embedded, hardware and controls briefs at $300 per accepted task, 3 screen-recording briefs at $60 an hour of active time); those figures are a third party's copy, not shown on Hashlist's own public pages, so no number is stated here.
Is Hashlist worth your time next to a job in care?
Hashlist pays Per accepted task, or per hour of accepted screen recording; each brief sets its rate (employer-stated). It is remote contract work on AI beside a clinical job, not patient care, with no guaranteed hours. Worker sentiment: Its Trustpilot page has 0 reviews (unclaimed, read November 2, 2026); no written worker review of the data platform found.
How and when does Hashlist pay you?
Withdrawal on request to PayPal or a bank account (IBAN), reviewed and sent by hand within about 10 business days; a USD 50 minimum may apply, and fees and currency conversion are yours (DOP Terms section 9). Its app gives other times: its Balance page says 1 to 3 business days and its first-task guide says weekly through Stripe (read November 2, 2026).
Is Hashlist patient care?
No. Hashlist is remote contract work on AI, not patient care: you use your professional knowledge to review and improve what AI models say. Never share identifiable patient information in the work.
Does Hashlist have work for nurses, doctors or other health professionals?
Not in what its sources show. Its briefs are engineering and software tasks (embedded and automotive software, desktop applications) and paid screen recordings of professional software use, with no clinical brief among them.
Will Hashlist interview or test me before I start?
No. There is no separate screening. Instead, every task you submit is tried by a set of AI models and then ruled on by an administrator, who always gives the reason in writing.
Can a turned-down Hashlist task be resubmitted?
That depends on the verdict. In the app a failed task is either marked Fail, returned with notes so you can fix and resubmit it, or marked Rejected, which ends it. Neither verdict pays.
What does Hashlist pay?
The rate sits in each brief inside the signed-in app, in US dollars: a sum per successful submission (or a custom rate) with Hashlist's own hourly estimate beside it, or, on screen-recording briefs, an hourly rate for accepted active time. Only accepted work earns.
May I build a Hashlist task with ChatGPT or Claude?
No. Not for the task itself. Anything AI-made is turned away, so the job, its setup and the correct answers must be yours from real practice. Hashlist's own in-app helpers (Ask, and suggested checks) are allowed.
How does Hashlist pay out?
Approved pay sits in your balance until you request a transfer to PayPal or an IBAN. A person at Hashlist then sends it, within a 10 business day target per the Terms; a USD 50 floor and identity or tax checks may come first.
Hashlist next to its peers
Expert reasoning and evaluation rubrics for frontier labs, including credentialed medicine specialists.
$120–$200/hr (medical MD experts)Employer-statedHealthcare-domain AI roles, from nursing informatics to clinical data QA, $15 (source: Alignerr, Jobs)–$80/hr (source: Alignerr, Jobs).
Sources: Alignerr, Jobs; Alignerr, Health Informatics Analyst
$40–$80/hrTypical pay, live
Physicians, radiologists and clinical researchers design healthcare tasks that test AI agents, $30–$60/hr.
$30–$60/hr (healthcare & medical expert)Employer-stated
Paid voice work for AI (recorded conversations, voice acting, transcription) in many languages; no clinical roles.
$17.50–$150/hrEmployer-stated