What do you like best about Prolific?
- Speed of recruitment / data collection
- platform now has more integrated features for, e.g., maintaining data quality (e.g., capacity to automatically redirect individuals out of your study if and when they fail 2 attention checks)
- In my experience, when I've reached out to Prolific's support team they've been pretty helpful / prompt in their responses
- Nice that Prolific can now facilitate collection of some types of represenatative samples, though haven't used this option yet myself so don't know how useful / versatile it is nor how the cost compares to other options / services out there (e.g., from Toluna) Review collected by and hosted on G2.com.
What do you dislike about Prolific?
GENERAL SETTINGS / OPTIONS / PLATFORM
- Still glitchy at times (e.g., get strings of error messages while trying to create a new study and as a result unable to save the study in draft form)
- Still missing some settings / options that would be incredibly useful -- for example, it would be helpful if I could: (1) invite collaborators / grant access at the individual-study level and/or at the project level (not just at the "workspace" level); (2) move funds from one workspace to another, in part to help monitor and manage allocation of specific funding amounts to specific studies/projects w. different collaborators (e.g., for situations where you're drawing from some general / flexible pot of funding you've put onto Prolific to pay for these different studies and projects with different collaborators); (3) have more flexibility in organizing different studies / projects /workspaces, including retroactively (e.g., ability to move specific [completed] studies or projects to different workspaces)
PRESCREENERS
- some of the prescreeners are still rather clunky and/or lacking -- for example, there's no prescreener that disaggregates employment sectors within STEM
- More generally it would be helpful to know if any of Prolific's prescreeners were developed using / correspond to widely used classifications (e.g., employment classifications used by the EU, ILO, or UN) -- and if not, consider doing so, potentially with an eye toward using prescreeners with response options / classifications that map onto those used in large, generally accessible datasets (e.g., European Social Survey, World Values Survey, etc), which would better enable comparisons if not integration of findings / evidence across one's own Prolific studies and these large datasets. Similarly, using response options / classifications in prescreeners that correspond to those used in datasets that are population-level and/or representative would make it easier for researchers to apply some weighting techniques to their Prolific samples.
- Other prescreeners are outdated and sometimes cringeworthy -- for example, Sexual Orientation prescreener still "others" people (consider adjusting this response option to "Not Listed" or something akin), and via the "Sex" prescreener or any other prescreener it's not possible to identify / recruit individuals who are, e.g., Intersex Review collected by and hosted on G2.com.