Online Personals Watch
Menu
  • Home
  • About
  • Research
    • News by Company & Categories
    • News by Date
    • All Online Dating Statistics
    • Public Companies
    • Acquisitions
    • Funding Rounds
    • Top Online Dating Reporters
    • OPW in the Press
    • All Executive Interviews
  • Conferences
  • Courtland Brooks
  • Contact
  • Subscribe
Menu

Profile Approval Outsourcing To Amazon’s Mechanical Turk

Posted on January 4, 2010

Mechanicalturk logo OPW – Jan 4 – Courtland Brooks did a preliminary study of Amazon's Mechanical Turk
service recently. We wondered if it was appropriate to use this
service for profile approvals. Probably not. However, you can see the
study at the Courtland Brooks blog, here.

Share this:

  • Share on X (Opens in new window) X
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Share on Facebook (Opens in new window) Facebook
  • Email a link to a friend (Opens in new window) Email

Related


← Previous Post
Next Post →

8 thoughts on “Profile Approval Outsourcing To Amazon’s Mechanical Turk”

  1. Unknown's avatar twitter.com/rosswilliams says:
    January 6, 2010 at 6:40 am

    We look at this a year or two ago – and outsourcing profile approval generally.
    The challenge is responsibility for scammer elimination – if you outsource this, you’re outsourcing responsibility for letting scammers on your site. As you get rid of the stupid scammers, you’ll attract the smarter ones and the only way to eliminate these is to carry out checks such as :
    – Email verification
    – Email duplicate checking
    – IP checking
    – User behaviour
    – Messaging behaviour
    – Photo recognition technology
    There’s a few more tricks in there as well.
    The point is to block scammers properly you need to open up your systems considerably to a point where data protection issues come into play – as well as sensible commercial practise.
    The quality of a dating site’s database DIRECTLY affects conversion and retention – profile moderation is key to that and anyone who tries cutting corners using an outsourced solution will see their conversion and retention rates drop.
    Ross

    Reply
  2. Unknown's avatar twitter.com/rosswilliams says:
    January 6, 2010 at 6:40 am

    We look at this a year or two ago – and outsourcing profile approval generally.
    The challenge is responsibility for scammer elimination – if you outsource this, you’re outsourcing responsibility for letting scammers on your site. As you get rid of the stupid scammers, you’ll attract the smarter ones and the only way to eliminate these is to carry out checks such as :
    – Email verification
    – Email duplicate checking
    – IP checking
    – User behaviour
    – Messaging behaviour
    – Photo recognition technology
    There’s a few more tricks in there as well.
    The point is to block scammers properly you need to open up your systems considerably to a point where data protection issues come into play – as well as sensible commercial practise.
    The quality of a dating site’s database DIRECTLY affects conversion and retention – profile moderation is key to that and anyone who tries cutting corners using an outsourced solution will see their conversion and retention rates drop.
    Ross

    Reply
  3. David Evans's avatar David Evans says:
    January 6, 2010 at 3:26 pm

    That was brochureware, where is the “study?”
    Ross, disagree strongly, the beauty of services like Crowdflower is that they have built-in failsafes to deal with bad calls. If you talked with them like I have several times you would see that they deal with your concerns.
    Outsourcing can be powerful rejuvination of resources, leaving people free to do more important things, like testing landing pages and affiliate creative.
    Having people look at photos is stupid and will go away in a few years. You can’t imagine how many interesting stats and trends we’re seeing with photo verification and evaluation services, fascinating stuff.
    There are no issues with data protection, we’re talking about profile photos which are (should be) covered with the most basic TOS.

    Reply
  4. David Evans's avatar David Evans says:
    January 6, 2010 at 3:26 pm

    That was brochureware, where is the “study?”
    Ross, disagree strongly, the beauty of services like Crowdflower is that they have built-in failsafes to deal with bad calls. If you talked with them like I have several times you would see that they deal with your concerns.
    Outsourcing can be powerful rejuvination of resources, leaving people free to do more important things, like testing landing pages and affiliate creative.
    Having people look at photos is stupid and will go away in a few years. You can’t imagine how many interesting stats and trends we’re seeing with photo verification and evaluation services, fascinating stuff.
    There are no issues with data protection, we’re talking about profile photos which are (should be) covered with the most basic TOS.

    Reply
  5. russ dotson's avatar russ dotson says:
    January 6, 2010 at 4:33 pm

    That was brochureware, where is the “study?”
    Ross, disagree strongly, the beauty of services like Crowdflower is that they have built-in failsafes to deal with bad calls. If you talked with them like I have several times you would see that they deal with your concerns.
    Outsourcing can be powerful rejuvenation of resources, leaving people free to do more important things, like testing landing pages and affiliate creative.
    Having people look at photos is stupid and will go away in a few years. You can’t imagine how many interesting stats and trends we’re seeing with photo verification and evaluation services, fascinating stuff.
    There are no issues with data protection, we’re talking about profile photos which are (should be) covered with the most basic TOS.
    ————————————————
    Russ dotson
    http://themastercleanse.org/the-lemonade-diet > rel=”dofollow” rel=”nofollow”>lemonade Diet

    Reply
  6. russ dotson's avatar russ dotson says:
    January 6, 2010 at 4:33 pm

    That was brochureware, where is the “study?”
    Ross, disagree strongly, the beauty of services like Crowdflower is that they have built-in failsafes to deal with bad calls. If you talked with them like I have several times you would see that they deal with your concerns.
    Outsourcing can be powerful rejuvenation of resources, leaving people free to do more important things, like testing landing pages and affiliate creative.
    Having people look at photos is stupid and will go away in a few years. You can’t imagine how many interesting stats and trends we’re seeing with photo verification and evaluation services, fascinating stuff.
    There are no issues with data protection, we’re talking about profile photos which are (should be) covered with the most basic TOS.
    ————————————————
    Russ dotson
    http://themastercleanse.org/the-lemonade-diet > rel=”dofollow” rel=”nofollow”>lemonade Diet

    Reply
  7. Unknown's avatar twitter.com/rosswilliams says:
    January 7, 2010 at 3:20 pm

    Well – that spam post above shows that sometimes even with manual moderation mistakes slip through!! 🙂
    David, I think Crowdflower is an excellent idea – when we talk about moderation, we’re talking about photos, videos, profile information AND first messages. Photo approval isn’t simply yes/no – the kind of photo used can give you an indication whether someone is a scammer or not, as can the sort of first messages they send, etc.
    To spot this requires fairly in-depth training – not the kind of thing I’m yet comfortable outsourcing.
    If it were pure photo moderation like most sites operate (simple Yes/No) then I’m sure crowdsourcing is fine – I certainly like the idea of it for the right tasks. It depends how the company views this kind of thing – whether the quality of profiles and customer service is a core part of the business or not.

    Reply
  8. Unknown's avatar twitter.com/rosswilliams says:
    January 7, 2010 at 3:20 pm

    Well – that spam post above shows that sometimes even with manual moderation mistakes slip through!! 🙂
    David, I think Crowdflower is an excellent idea – when we talk about moderation, we’re talking about photos, videos, profile information AND first messages. Photo approval isn’t simply yes/no – the kind of photo used can give you an indication whether someone is a scammer or not, as can the sort of first messages they send, etc.
    To spot this requires fairly in-depth training – not the kind of thing I’m yet comfortable outsourcing.
    If it were pure photo moderation like most sites operate (simple Yes/No) then I’m sure crowdsourcing is fine – I certainly like the idea of it for the right tasks. It depends how the company views this kind of thing – whether the quality of profiles and customer service is a core part of the business or not.

    Reply

Leave a Reply Cancel reply

  • YouTube
  • X
  • LinkedIn
  • Facebook
Graphic featuring the logo of Courtland Brooks with the text 'We'll Help You Grow, Thrive & Exit' and bullet points for services including Strategy, Marketing, PR, Influencers, and Business Development.

OUR EVENTS

A blurred audience in a large venue with colorful lighting, featuring the bold text 'LTR US' in the foreground.

OUR SPONSORS

Logo of HubPeople featuring geometric shapes and the text 'HubPeople' in a modern font.
InnerVue logo with black geometric icon and wordmark on a green background
LeadThink logo with a stylized blue brain icon and gray and blue text

GOT NEWS?

Share your news at
tips@onlinepersonalswatch.com.

COURTLAND BROOKS

We help online dating & social businesses grow, thrive, and exit. See CourtlandBrooks.com.

CONTACT

Mark Brooks
CEO, Courtland Brooks
Publisher, Online Personals Watch
mark@courtlandbrooks.com

Irena Brooks
Editor, Online Personals Watch
irena@courtlandbrooks.com

©2026 Online Personals Watch