あとで読む論文リスト
Towards Effectively Test Report Classification to Assist Crowdsourced Testing
In general, testers in Baidu prepare packages for crowdsourced testing (software under test and testing tasks) anddistribute them online using their crowdsourced testing platform. Then, crowd workers could sign in to conduct the taskand are required to submit crowdsourced test reports2. Table 1 demonstrates the attributes of a typical crowdsourced report.
Baidu (baidu.com) is the largest Chinese search service provider.Its crowdsourcing test platform (test.baidu.com) is also thelargest one in China.
おおまかに時間を分けて人を集めて実験した→早い時間帯のほうが良さそうな人がいるっぽいことがわかった
beyond the turk を引用している
時間を変数として、いろいろなパラメタを変えて実験した
細かくやっているので参考になりそう
言語統計を見たもの
Peer, Eyal et al. Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. Journal of Experimental Social Psychology. 2017, 70, p.153-163. https://doi.org/10.1016/j.jesp.2017.01.006, (accessed 2019-12-24). Arechar, Antonio A et al. Turking Overtime: How Participant Characteristics and Behavior Vary Over Time and Day on Amazon Mechanical Turk. Journal of the Economic Science Association. 2017, 3(1), p.1-11. https://doi.org/10.1007/s40881-017-0035-0, (accessed 2019-12-24). Casey, Logan S. et al. Intertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collection. SAGE Open. 2017, 7(2). https://doi.org/10.1177/2158244017712774, (accessed 2019-12-24). Peer, Eyal,; Joachim Vosgerau; Alessandro Acquisti. Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior research methods. 2014, 46(4), p.1023-1031. https://doi.org/10.3758/s13428-013-0434-y, (accessed 2019-12-24). Pavlick, Ellie et al. The language demographics of amazon mechanical turk. Transactions of the Association for Computational Linguistics. 2014, 2, p.79-92. https://doi.org/10.1162/tacl_a_00167, (accessed 2019-12-24). Meng-Han Wu, Alexander James Quinn. "Confusing the Crowd: Task Instruction Quality on Amazon Mechanical Turk". AAAI Conference on Human Computation and Crowdsourcing. Québec, Canada, 2017-10-24/26, AAAI. AAAI Publications, 2017.
Cacioppo, John T.; Richard E. Petty; Chuan Feng Kao. The efficient assessment of need for cognition. Journal of personality assessment . 1984, 48(3), p.306-307. https://doi.org/10.1207/s15327752jpa4803_13, (accessed 2019-12-24). Rosenberg, Morris. Society and the adolescent self-image. Princeton university press, 2015.