> In a snake-eating-its-own-tail irony, a 2023 analysis found that between 33% and 46% of workers on the platform were using large language models to complete their tasks,
I assume AI use by workers has risen to the point where it renders Mechanical Turk pointless.
This likely means those consuming the outputs of Mechanical Turk don't have a good way to measure the value (aka quality) of the outputs.
If they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.
I think the "state of the art" of measuring the quality of outputs was to send the same task to multiple "agents" and only accept answers if over a certain amount agree. With some human review and reputation scoring sprinkled on top. It was a while since I was in this field though
Yeah, I was doing this kind of Artificial Artificial Artificial Intelligence back in 2012 to make some extra $$$. Glad they finally "patched" that hole ^^.
Artificial Artificial Artificial intelligence is when the chat bot is out of capacity, so a person in India is writing the response that gets returned by the LLM which gets pasted into Mechanical Turk.
That's just Artificial Artificial Intelligence, the triple negative implies they built an automated system to impersonate humans who impersonate an automated system (which ultimately imitates a human).
I turked for a bit trying to make some extra cash leading up to my wedding, but it was a very time-inefficient way to make money. I think I managed to wring 10 or 20 bucks out of it tops after plugging at it for a month.
I can see a high value startup, that will provide Human Intelligence with real Humans, locked in the room, with no network, books, LLMs and monitored 24x7 with cameras.
Maybe the most unambiguous "ai will automate work" example I've seen yet.
Absolutely does not imply the workers are automated since they can now use the current models to do more complex tasks at the vast number of new AI training data startups.
Turk was simply not designed for greater complexity tasks and so much of their lunch has been eaten by startups specifically built to collect AI training data.
I assume AI use by workers has risen to the point where it renders Mechanical Turk pointless.
If they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.
Artificial Artificial Intelligence = using computers to do mechanical turk jobs
But the point gets across.
and
"Artificial Artificial intelligence"
are the same thing.
Come on. This site can do better.
Cheap, disposable, on-demand intelligence has existed for millennia.
If anything, AI is more of an equalizer.
It helped me buy a Battlefield 2 "Special Forces" expansion pack back in the day.
Well, I could've bought it either way but buying it didn't impact my normal income because I did Mechanical Turk in my free time enough to get it.
Absolutely does not imply the workers are automated since they can now use the current models to do more complex tasks at the vast number of new AI training data startups.
Turk was simply not designed for greater complexity tasks and so much of their lunch has been eaten by startups specifically built to collect AI training data.
Never underestimate just how cheap human life is!