Tootfinder

This https://arxiv.org/abs/2305.01317 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_mat…

The role of individual compensation and acceptance decisions in crowdsourced delivery
One of the recent innovations in urban distribution is crowdsourced delivery, where deliveries are made by occasional drivers who wish to utilize their surplus resources (unused transport capacity) by making deliveries in exchange for some compensation. The potential benefits of crowdsourced delivery include reduced delivery costs and increased flexibility (by scaling delivery capacity up and down as needed). The use of occasional drivers poses new challenges because (unlike traditional courier…

If in a Crowdsourced Data Annotation Pipeline, a GPT-4
Zeyu He, Chieh-Yang Huang, Chien-Kuang Cornelia Ding, Shaurya Rohatgi, Ting-Hao 'Kenneth' Huang
https://arxiv.org/abs/2402.16795

Seer: Proactive Revenue-Aware Scheduling for Live Streaming Services in Crowdsourced Cloud-Edge Platforms
Shaoyuan Huang, Zheng Wang, Zhongtian Zhang, Heng Zhang, Xiaofei Wang, Wenyu Wang
https://arxiv.org/abs/2402.14619

Seer: Proactive Revenue-Aware Scheduling for Live Streaming Services in Crowdsourced Cloud-Edge Platforms
As live streaming services skyrocket, Crowdsourced Cloud-edge service Platforms (CCPs) have surfaced as pivotal intermediaries catering to the mounting demand. Despite the role of stream scheduling to CCPs' Quality of Service (QoS) and throughput, conventional optimization strategies struggle to enhancing CCPs' revenue, primarily due to the intricate relationship between resource utilization and revenue. Additionally, the substantial scale of CCPs magnifies the difficulties of time-intensive sc…

The Zooniverse have a (relatively) new guide to crowdsourced transcription projects https://help.zooniverse.org/transcription-project-guide/
Over time their guide to building a great digital volunteering project has become a fantastic resource

Getting Started - Zooniverse Help
How to do things in the Zooniverse.

Crowdsourced Multilingual Speech Intelligibility Testing
Laura Lechler, Kamil Wojcicki
https://arxiv.org/abs/2403.14817 https://arxiv…

Crowdsourced Multilingual Speech Intelligibility Testing
With the advent of generative audio features, there is an increasing need for rapid evaluation of their impact on speech intelligibility. Beyond the existing laboratory measures, which are expensive and do not scale well, there has been comparatively little work on crowdsourced assessment of intelligibility. Standards and recommendations are yet to be defined, and publicly available multilingual test materials are lacking. In response to this challenge, we propose an approach for a crowdsourced…

Diversified Ensembling: An Experiment in Crowdsourced Machine Learning
Ira Globus-Harris, Declan Harrison, Michael Kearns, Pietro Perona, Aaron Roth
https://arxiv.org/abs/2402.10795

Diversified Ensembling: An Experiment in Crowdsourced Machine Learning
Crowdsourced machine learning on competition platforms such as Kaggle is a popular and often effective method for generating accurate models. Typically, teams vie for the most accurate model, as measured by overall error on a holdout set, and it is common towards the end of such competitions for teams at the top of the leaderboard to ensemble or average their models outside the platform mechanism to get the final, best global model. In arXiv:2201.10408, the authors developed an alternative crow…

Operational Collective Intelligence of Humans and Machines
Nikolos Gurney, Fred Morstatter, David V. Pynadath, Adam Russell, Gleb Satyukov
https://arxiv.org/abs/2402.13273

Operational Collective Intelligence of Humans and Machines
We explore the use of aggregative crowdsourced forecasting (ACF) as a mechanism to help operationalize ``collective intelligence'' of human-machine teams for coordinated actions. We adopt the definition for Collective Intelligence as: ``A property of groups that emerges from synergies among data-information-knowledge, software-hardware, and individuals (those with new insights as well as recognized authorities) that enables just-in-time knowledge for better decisions than these three elements a…

Bugcrowd, which offers crowdsourced bug bounty tools, raised a $102M Series E led by General Catalyst to expand internationally, and has ~1,000 global customers (Krystal Hu/Reuters)
https://www.reuters.com/technology/bugcrowd-rais…

Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs
Clemencia Siro, Mohammad Aliannejadi, Maarten de Rijke
https://arxiv.org/abs/2404.12994

Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs
In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback. In a conversational setting such signals are usually unavailable due to the nature of the interactions, and, instead, the evaluation often relies on crowdsourced evaluation labels. The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied. We focus on how the evaluation of task-oriented dialogue systems (TDSs), is affected by considering user fee…

Election interference takes different forms – voter intimidation, robocalls, polling places shut down… Unless quickly dealt with, interference can cause a lot of damage and delays.
https://thedemlabs.org/2024/03/05/fight-…

Fast Fixes forElection Interference And Robocalls
See Say Now uses crowdsourced reports of voter suppression to help election protection workers respond quickly to incidents.