A Machine Learning-Based Approach to Enhancing Label Aggregation in Crowdsourcing
Kaydedildi:
| Yayımlandı: | ADCAIJ : Advances in Distributed Computing and Artificial Intelligence Journal vol. 14 (2025), p. e32757-e32778 |
|---|---|
| Yazar: | |
| Diğer Yazarlar: | |
| Baskı/Yayın Bilgisi: |
Ediciones Universidad de Salamanca
|
| Konular: | |
| Online Erişim: | Citation/Abstract Full Text - PDF |
| Etiketler: |
Etiket eklenmemiş, İlk siz ekleyin!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3282913665 | ||
| 003 | UK-CbPIL | ||
| 022 | |a 2255-2863 | ||
| 024 | 7 | |a 10.14201/adcaij.32757 |2 doi | |
| 035 | |a 3282913665 | ||
| 045 | 2 | |b d20250101 |b d20251231 | |
| 100 | 1 | |a Suyal, Himanshu | |
| 245 | 1 | |a A Machine Learning-Based Approach to Enhancing Label Aggregation in Crowdsourcing | |
| 260 | |b Ediciones Universidad de Salamanca |c 2025 | ||
| 513 | |a Journal Article | ||
| 520 | 3 | |a Crowdsourcing is the most effective means of obtaining labelled data for supervised machine learning. However, the varying expertise of crowd workers often results in noisy annotations. While traditional label aggregation methods attempt to handle label noise, they typically overlook the relationships between different data instances. Moreover, crowdsourced datasets often experience class imbalance, wherein predominant classes eclipse minority classes, hence exacerbating label accuracy issues. This paper proposed a Reliability-Weighted Bayesian Label Aggregation (RWBLA) to overcome the above challenges. First, the K-nearest neighbours (KNN) method is used to improve the label set for each instance by augmenting labels from its closest neighbours, resulting in multiple noisy label sets. Next, it improves the aggregation by assigning weights to the neighbouring labels based on worker reliability, adaptive distance, and label similarity for each instance. In addition, worker reliability is determined dynamically based on the neighbourhood information, and to handle the imbalance issue, label similarity is modified. In the end, a weighted Bayesian inference method is used to infer the correct label for each instance. The performance of the proposed approach is evaluated on 20 synthetics and three real-world crowdsourcing datasets. It shows that RWBLA consistently surpasses eight baseline label aggregations, improving aggregation accuracy by 3 % to 13 %. Moreover, in analyses utilizing imbalanced real-world crowdsourcing data, RWBLA surpassed state-of-art aggregation algorithms by 2 % to 6 %, underscoring its efficacy in situations with minor class imbalances. | |
| 653 | |a Machine learning | ||
| 653 | |a Similarity | ||
| 653 | |a Datasets | ||
| 653 | |a Labels | ||
| 653 | |a Annotations | ||
| 653 | |a Bayesian analysis | ||
| 653 | |a Crowdsourcing | ||
| 653 | |a Statistical inference | ||
| 653 | |a Reliability | ||
| 653 | |a Supervised learning | ||
| 653 | |a Effectiveness | ||
| 700 | 1 | |a Singh, Avtar | |
| 773 | 0 | |t ADCAIJ : Advances in Distributed Computing and Artificial Intelligence Journal |g vol. 14 (2025), p. e32757-e32778 | |
| 786 | 0 | |d ProQuest |t Advanced Technologies & Aerospace Database | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3282913665/abstract/embedded/H09TXR3UUZB2ISDL?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/3282913665/fulltextPDF/embedded/H09TXR3UUZB2ISDL?source=fedsrch |