Dataset
OpenAI WebGPT Comparisons
A dataset of ~20,000 human preference comparisons between WebGPT model answers to open-ended questions, rated for quality and factual accuracy. Used to train reward models for improving factual accuracy via human feedback.
Owner: OpenAI
Access: Freely available on Hugging Face with no access restrictions. Released by OpenAI to support research on RLHF and factual grounding.
Safety use case
Training reward models for factual accuracy; studying human preference signals for truthful, well-cited responses.
Benchmark relevance
Relevant to: WebGPT and TruthfulQA
Source
WebGPT Comparisons on Hugging FaceStatus: Verified. Last verified: 2026-06-13.
Want to list this dataset on the marketplace?
Data Canon takes no transaction fees. Contact us to update listing details or add new datasets.
Contact about this dataset