Crowdsourcing assessment model combined with quality control for collapsed buildings after the earthquake

doi:10.7523/j.issn.2095-6134.2019.03.009

Abstract

Abstract: In the field of remote sensing disaster assessment, crowdsourcing assembles the intelligence of the network users to complete the disaster assessment tasks. However, there is a problem that the quality of the workers' answers is not reliable in the real crowdsourcing platform. In this study, a new model combined with quality control for crowdsourcing assessment of collapsed buildings after the earthquake is proposed. A case study of Yushu earthquake was presented and the experimental platform was set up to collect crowdsourcing disaster assessment data. First, the gold data and consistency test method were used to filter out low-quality crowdsourcing data. Then, the reliable disaster interpretation results were derived by the crowdsourcing assessment model. The experimental results show that the assessment accuracies of the collapsed buildings in the test area were 70.59% without the quality control and 85.29% with the quality control, which indicates that the proposed model effectively increases the accuracy of the crowdsourcing disaster interpretation. Therefore, crowdsourcing provides reliable visual interpretation results based on the proposed method, which is of importance for remote sensing disaster assessment.

Key words: crowdsourcing, quality control, remote sensing disaster assessment, building collapse assessment

CLC Number:

P315.9

JIA Yingyu, LIU Shibin, DUAN Jianbo, XIE Shuai. Crowdsourcing assessment model combined with quality control for collapsed buildings after the earthquake[J]. , 2019, 36(3): 354-362.

References

[1] 雷添杰, 李长春, 何孝莹. 无人机航空遥感系统在灾害应急救援中的应用[J]. 自然灾害学报, 2011,20(1):178-183.
[2] 王晓青, 魏成阶, 苗崇刚,等. 震害遥感快速提取研究:以2003年2月24日巴楚-伽师6.8级地震为例[J]. 地学前缘, 2003, 10(S1):285-291.
[3] 王治华, 徐起德, 徐斌,等. 5.12汶川地震航空遥感应急调查[J]. 中国科学(E辑:技术科学), 2009, 39(7):1304-1311.
[4] 朱博勤, 魏成阶, 张渊智. 航空遥感地震灾害信息的快速提取[J]. 自然灾害学报, 1998,7(1):36-41.
[5] 中国地震局震灾应急救援司. 2006-2010年中国大陆地震灾害损失评估汇编[M]. 北京:地震出版社, 2015.
[6] 周光全, 卢永坤, 非明伦,等. 地震灾害损失初步评估方法研究[J]. 地震研究, 2010, 33(2):208-215.
[7] 杨毅柠, 宋微. 国土调查中的遥感目视解译与矢量化方法研究[J]. 环境保护与循环经济, 2009, 29(10):20-23.
[8] 赵江华, 王学志, 林青慧, 等. 众包模式在大规模遥感影像信息提取领域的探索[J]. 大数据, 2016, 2(6):53-64.
[9] 冯剑红, 李国良, 冯建华. 众包技术研究综述[J]. 计算机学报, 2015, 38(9):1713-1726.
[10] Sorokin A, Forsyth D. Utility data annotation with Amazon Mechanical Turk[C]//Computer Vision and Pattern Recognition Workshops, 2008. CVPRW'08. IEEE Computer Society Conference on, 2008:1-8.
[11] Yan T, Kumar V, Ganesan D. CrowdSearch:exploiting crowds for accurate real-time image search on mobile phones[C]//International Conference on Mobile Systems, 2010:77-90.
[12] Neis P, Zielstra D. Recent developments and future trends in volunteered geographic information research:the case of OpenStreetMap[J]. Future Internet, 2014, 6(1):76-106.
[13] 童咏昕, 袁野, 成雨蓉, 等. 时空众包数据管理技术研究综述[J]. 软件学报, 2017, 28(1):35-58.
[14] Tong Y, She J, Ding B, et al. Online mobile micro-task allocation in spatial crowdsourcing[C]//IEEE International Conference on Data Engineering, 2016:49-60.
[15] Tong Y, Wang L, Zhou Z, et al. Flexible online task assignment in real-time spatial data[J]. Proceedings of the Vldb Endowment, 2017, 10(11):1334-1345.
[16] Kazemi L, Shahabi C, Chen L. GeoTruCrowd:trustworthy query answering with spatial crowdsourcing[C]//ACM Sigspatial International Conference on Advances in Geographic Information Systems, 2013:314-323.
[17] Tong Y, She J, Ding B, et al. Online minimum matching in real-time spatial data:experiments and analysis[J]. Proceedings of the Vldb Endowment, 2016, 9(12):1053-1064.
[18] Soden R, Palen L. From crowdsourced mapping to community mapping:the post-earthquake work of OpenStreetMap Haiti[C]//Proceedings of the 11th International Conference on the Design of Cooperative Systems, 2014:311-326.
[19] Westrope C, Banick R, Levine M. Groundtruthing OpenStreetMap building damage assessment[J]. Procedia Engineering, 2014, 78(8):29-39.
[20] Fritz S, Mccallum I, Schill C, et al. Geo-Wiki:an online platform for improving global land cover[J]. Environmental Modelling & Software, 2012, 31(7):110-123.
[21] Perger C, Fritz S, See L, et al. A campaign to collect volunteered geographic information on land cover and human impact[M]. Berlin:ResearchGate,2012:83-91.
[22] Baruch A, May A, Yu D. The motivations, enablers and barriers for voluntary participation in an online crowdsourcing platform[J]. Computers in Human Behavior, 2016, 64:923-931.
[23] Zheng Y, Li G, Li Y, et al. Truth inference in crowdsourcing:is the problem solved?[J]. Proceedings of the Vldb Endowment, 2017, 10(5):541-552.
[24] Feng J. QASCA:a quality-aware task assignment system for crowdsourcing applications[C]//ACM SIGMOD International Conference on Management of Data, 2015:1031-1046.
[25] Fan J, Li G, Ooi B C, et al. iCrowd:an adaptive crowdsourcing framework[C]//ACM SIGMOD International Conference on Management of Data, 2015:1015-1030.
[26] Li G, Wang J, Zheng Y, et al. Crowdsourced data management:a survey[J]. IEEE Transactions on Knowledge & Data Engineering, 2016, 28(9):2296-2319.
[27] Feng J, Li G, Wang H, et al. Incremental quality inference in crowdsourcing[M].Jeju Island:Database Systems for Advanced Applications 2014:453-467.
[28] 唐思. 众包质量控制算法及评价框架研究[D]. 杭州:浙江大学, 2015.
[29] 张志强, 逄居升, 谢晓芹,等. 众包质量控制策略及评估算法研究[J]. 计算机学报, 2013, 36(8):1636-1649.
[30] 逄居升. 众包质量控制策略及评估算法研究[D]. 哈尔滨:哈尔滨工程大学, 2013.
[31] Xie S, Duan J, Liu S, et al. Crowdsourcing rapid assessment of collapsed buildings early after the earthquake based on aerial remote sensing image:a case study of Yushu Earthquake[J]. Remote Sensing, 2016, 8(9):759.
[32] Dou A, Wang X, Ding X, et al. Quantitative methods of rapid earthquake damage assessment using remote sensing and its application in Yushu Earthquake[J]. Journal of Catastrophology, 2012, 27(3):75-80.
[33] Cohen J. A coefficient of agreement for nominel scales[J].Educational & Psychological Measurement, 1960,20(1):37-46.
[34] 华琳, 阎岩, 张建. 关于对诊断一致性Kappa系统的探讨[J]. 数理医药学杂志, 2006, 19(5):518-520.