Scale AI

Scale AI, Inc. is an American data annotation company based in San Francisco, California. It provides data labeling, model evaluation, and software to develop applications for artificial intelligence. The company’s research arm, the Safety, Evaluation and Alignment Lab, focuses on evaluating and aligning large language models (LLMs), including through initiatives such as Humanity's Last Exam, a benchmark designed to assess advanced AI systems on alignment, reasoning, and safety. Scale AI outsources data labeling through its subsidiaries, Remotasks, which focuses on computer vision and autonomous vehicles, and Outlier, which focuses on data annotation for LLMs. Scale AI's customers in the commercial sector have included Google, Microsoft, Meta, General Motors, OpenAI, and Time. The company also directly works with world governments, including the United States on multiple military-related projects, and with Qatar to improve the efficiency of its social programs.