Subjectify.us is a web platform for conducting crowd-sourced subjective comparisons. The service is designed for the comparison of images, video, and sound processing methods. Apply your algorithm, its modifications, and competitive approaches to your test dataset—and upload the output to our server. We display results computed by different methods to paid participants pairwise. These participants are asked to choose the best method in each pair. We then convert pairwise comparison data to final scores and
You apply your algorithm and its competitors to your test dataset.
We recruit study participants and present your data pairwise to them.