Let's discuss your project

Home
/
Blog
/
General
/

Mechanical Turk and SageMaker Ground Truth Alternatives in 2026: What to Use Instead, by Task

Last updated:
25.10.2026
Read time:
X
min
Author:
Roy Andraos
MTurk closed in Sept 2026 and Ground Truth takes no new customers. Replacements by task: Toloka, Clickworker, Prolific, Labelbox, CVAT, DataVLab, iMerit.

Amazon closed Mechanical Turk on 30 September 2026, and SageMaker Ground Truth and Augmented AI no longer accept new customers or offer the MTurk workforce. This guide covers the replacements by task type, from crowd marketplaces to platforms and managed services, and what changes when you leave the crowd model.

Topics
Keypoints
  • MTurk closed to new requesters on 30 July 2026 and shut down on 30 September 2026; SageMaker Ground Truth and Augmented AI are in maintenance mode, with no new customers and no MTurk workforce.
  • For micro-tasks, Toloka, Clickworker and Prolific are the closest replacements; for computer vision and documents, platforms or managed services fit better.
  • Leaving the crowd model moves quality from redundancy to guidelines, gold sets and review, and makes compliance explicit.
  • Compare replacements on cost per accepted label including rework, not per-item price.

Amazon Mechanical Turk was, for nearly twenty years, the default answer to "we need a few thousand things labelled quickly". In 2026 it stopped being an answer at all. Amazon closed MTurk to new requesters on 30 July 2026, then announced its permanent closure, effective 30 September 2026. SageMaker Ground Truth and Amazon Augmented AI were not shut down, but they stopped accepting new customers on 30 July 2026 and lost the Mechanical Turk workforce option on 30 September 2026; Ground Truth Plus reached end of support on 30 June 2026. Teams whose labelling pipelines ran through an MTurk requester account or a Ground Truth job using the public workforce now need a replacement, and teams that never used them have lost the cheapest reference point for small jobs.

This guide covers what to use instead, by task type, and what changes when you move from a crowd to a managed service or a platform. It is written for ML engineers and data leads who need a working pipeline, not a vendor catalogue.

Vendor information in this article comes from public sources (company announcements, filings and documentation) and reflects what was published at the time of writing. Offers change; check with each vendor before deciding. Product and company names are trademarks of their respective owners, which have not reviewed or endorsed this article. DataVLab is one of the options described.

What changed, service by service

  • Mechanical Turk: the open crowd marketplace for micro-tasks, priced per HIT, with quality managed by requesters through qualifications, redundancy and gold questions. Closed on 30 September 2026; requesters could still approve or reject submitted work until 30 October 2026.
  • SageMaker Ground Truth: AWS-native labelling jobs with built-in templates, active learning and a choice of workforce (MTurk, vendors or private teams). Still running for existing customers in maintenance mode, with no new customers since 30 July 2026 and no MTurk workforce since 30 September 2026. The managed Ground Truth Plus offer reached end of support on 30 June 2026.
  • Augmented AI (A2I): human review workflows for model predictions, often used for document and content-moderation confidence thresholds. Same status as Ground Truth: existing customers only, without the MTurk workforce.

Even where the AWS services still run, maintenance mode with no new features is a signal to plan a migration. It has three parts: a new workforce, a new tool and a new quality process, because MTurk-style redundancy was the quality process for many teams.

Alternatives by task type

Simple micro-tasks: classification, transcription, short judgements

Toloka and Clickworker are the closest replacements for the open-crowd model, with their own quality controls and APIs. Prolific is the usual choice for research-grade human data with vetted participants and fair-pay policies. Expect to rebuild qualifications and gold questions; none of them import MTurk configurations.

Computer vision: boxes, polygons, masks, tracking

For vision tasks with guidelines and edge cases, two routes: a platform with your own annotators or a bought workforce (Labelbox, SuperAnnotate, Encord, V7, or open-source CVAT and Label Studio), or a managed service that delivers validated labels (DataVLab, iMerit, Cogito Tech). DataVLab's image annotation and video annotation services deliver COCO, YOLO, Pascal VOC or MOT files with per-class IoU and agreement reported, so the Ground Truth output format is easy to replace.

Documents and text: entities, classification, OCR fields

Kili Technology and Label Studio are strong platform options for text; managed services such as DataVLab's data labeling services or Cogito Tech handle multilingual programmes with reviewers. For regulated documents, prefer a vendor with ISO 27001 and a DPA you control.

Human review of model predictions (the A2I use case)

Most annotation platforms support review queues on model output. For a managed option, DataVLab can run human review on predictions below your confidence threshold, with the same guideline-and-validation process as its annotation work.

LLM evaluation and preference data

MTurk was often used for cheap pairwise comparisons; the market has moved to expert networks (Surge AI, Mercor, Scale AI) and to managed providers with domain experts. DataVLab covers LLM evaluation and GenAI annotation with calibrated raters and agreement reported per criterion.

Comparison table

ReplacementModelClosest toTypically used for
Toloka, ClickworkerCrowd marketplaceMTurkMicro-tasks, data collection
ProlificVetted participant poolMTurk (research)Surveys, human-feedback studies
Labelbox, SuperAnnotate, Encord, V7, KiliPlatform + optional workforceGround TruthTeams owning the pipeline
CVAT, Label StudioOpen source + hosted editionsGround Truth templatesEngineering-led teams
DataVLabManaged, expert-validated, EUGround Truth Plus / A2IRegulated and specialist data
iMerit, Cogito TechManaged, large workforceGround Truth PlusHigh-volume programmes

What changes when you leave the crowd model

  • Quality moves from redundancy to guidelines and review. Instead of three workers voting, you get trained annotators, a written guideline, gold sets and a reviewer. Write the guideline before you brief anyone; it is the asset you keep whatever vendor you use.
  • Pricing moves from per-HIT to per-item, per-hour or per-project. Compare on cost per accepted label, including rework. Research on ten widely used benchmark datasets found at least 3.3% of labels wrong, even in carefully built datasets; a crowd pipeline without review has no mechanism to stay below that.
  • Compliance becomes explicit. An open crowd cannot sign a DPA or keep data in the EU. If your data is personal, clinical or commercially sensitive, that alone decides the model.

Our guide to choosing a data annotation company and pricing guide cover the vendor questions and cost drivers in more depth.

How DataVLab fits in, and when it does not

DataVLab is a managed data annotation service for AI teams in regulated industries: healthcare, manufacturing, mobility, finance, agriculture and public sector. We combine custom annotation tooling with automated pre-annotation where it helps and expert human validation on every batch. ISO/IEC 27001 certified, GDPR- and HIPAA-compliant, with EU-only annotators when data cannot leave Europe, and every project starts with a written guideline and a paid pilot on your real data.

Where we are a good fit: projects where label quality is measured and audited (IoU and inter-annotator agreement per class, QA reports delivered with the files), sensitive data that needs EU-based handling, and specialist domains such as medical imaging, LiDAR and 3D or regulated documents. Where we are not: if you need a self-serve platform with no human services, a crowd of hundreds of thousands for a one-week burst, or a US-government accredited environment, choose a vendor that holds the relevant accreditation. Our pricing guide explains how we quote.

Frequently asked questions

Is Mechanical Turk really shut down?

Yes. Amazon stopped accepting new requesters on 30 July 2026 and closed Mechanical Turk on 30 September 2026, according to the notice published on the MTurk website. SageMaker Ground Truth and Augmented AI still run for existing customers, without the MTurk workforce.

What is the direct replacement for SageMaker Ground Truth?

Existing customers can keep using Ground Truth with private or vendor workforces, but it accepts no new customers and gets no new features. For a new pipeline, the closest equivalents are annotation platforms with model-assisted labelling (Labelbox, SuperAnnotate, Encord, V7) for the tooling, and managed services for the Ground Truth Plus style of delivered labels.

How do I migrate existing Ground Truth manifests?

Export the augmented manifests and convert them to COCO or your platform's import format; most platforms and managed vendors can ingest COCO, YOLO or Pascal VOC. DataVLab can also audit the existing labels and relabel what fails your guideline before you retrain.

What is the cheapest MTurk alternative?

Toloka and Clickworker for simple tasks. For anything with a guideline and edge cases, the cheapest option is the one with the lowest rework rate, which is rarely the lowest per-item price.

Next step

If your pipeline ran through Ground Truth or MTurk and the data is specialist or regulated, send us a sample. We will scope a paid pilot, match your output format and report quality per class.

Is Mechanical Turk really shut down?

Yes. Amazon stopped accepting new requesters on 30 July 2026 and closed Mechanical Turk on 30 September 2026. SageMaker Ground Truth and Augmented AI still run for existing customers, without the MTurk workforce.

What is the direct replacement for SageMaker Ground Truth?

Existing customers can keep using Ground Truth with private or vendor workforces, but it takes no new customers. For new pipelines, annotation platforms with model-assisted labelling replace the tooling, and managed services replace the Ground Truth Plus style of delivered labels.

What is the cheapest Mechanical Turk alternative?

Toloka and Clickworker for simple tasks. For anything with a guideline and edge cases, the cheapest option is the one with the lowest rework rate.

How do I migrate existing Ground Truth manifests?

Export the augmented manifests and convert them to COCO or your platform's import format; most platforms and managed vendors ingest COCO, YOLO or Pascal VOC. The existing labels can also be audited and relabelled before retraining.

Which MTurk alternatives can sign a data processing agreement?

Managed services and most commercial platforms can; an open crowd cannot. For personal, clinical or commercially sensitive data, choose a vendor with ISO 27001 certification and EU-based teams if residency matters.

What changes when I move from a crowd to a managed annotation service?

Quality moves from worker redundancy to written guidelines, gold sets and reviewers; pricing moves from per-HIT to per-item or per-project; and compliance becomes an explicit, contractual matter.

Roy Andraos

CEO DataVlab
Founder of DataVLab, a data annotation company supporting AI teams across healthcare, agriculture, retail, satellite imagery and other vision-intensive industries. Since 2019, we have helped organizations turn complex image, video and text data into reliable training datasets, combining operational expertise with a strong focus on annotation quality and scalability.
Let's discuss your project

We can provide realible and specialised annotation services and improve your AI's performances

Abstract blue gradient background with a subtle grid pattern.

Explore Our Different
Industry Applications

Our data labeling services cater to various industries, ensuring high-quality annotations tailored to your specific needs.

Data Annotation Services

Unlock the full potential of your AI applications with our expert data labeling tech. We ensure high-quality annotations that accelerate your project timelines.

Data Annotation Services

Data Annotation Services for AI Teams in Regulated Industries

ISO 27001-certified data annotation services for image, video, document and 3D data, with expert human validation and EU-based teams for sensitive projects.

Data Labeling Services

Data Labeling Services for AI Teams: Image, Video, Text, Audio and Sensor Data, Expert-Validated

Data labeling services for machine-learning teams in regulated industries: classification, detection, segmentation, transcription and entity labels across image, video, text, audio and sensor data, with human validation on every batch. ISO 27001, EU-only teams on request.

Image Annotation Services

Image Annotation Services for Computer Vision: Expert-Validated, ISO 27001, EU-Based

Image annotation services for detection, segmentation, keypoint, OCR and classification models. Bounding boxes, polygons, masks and landmarks with human validation on every batch, ISO 27001 certified, EU-only teams on request.

Video Annotation

Video Annotation Services for Computer Vision: Tracking, Events and Temporal QA

Video annotation services for detection, tracking, action-recognition and event models. Frame-by-frame boxes, masks, keypoints and identity-consistent tracks with sequence-level human validation on every batch. ISO 27001, EU-only teams on request.