Commit 212b4b1e5474b0f435662e283fce194334773f81

Authored by Olivier
1 parent 2c90d2d2a6
Exists in master

Submitted version

Showing 6 changed files with 13 additions and 12 deletions Side-by-side Diff

CHIPLAYpaper/MarketPaper.bbl View file @ 212b4b1
... ... @@ -43,7 +43,8 @@
43 43  
44 44  
45 45 \bibitem{Dankulov2015}
46   -{Marija~Mitrović Dankulov}, {Roderick Melnik}, {and} {Bosiljka Tadić}. 2015.
  46 +{Marija~Mitrovi\'{c} Dankulov}, {Roderick Melnik}, {and} {Bosiljka Tadi\'{c}}.
  47 + 2015.
47 48 \newblock \showarticletitle{The dynamics of meaningful social interactions and
48 49 the emergence of collective knowledge}.
49 50 \newblock {\em Scientific Reports\/} {5}, 12197, Article 12197 (2015).
CHIPLAYpaper/MarketPaper.log View file @ 212b4b1
1   -This is pdfTeX, Version 3.1415926-2.5-1.40.14 (MiKTeX 2.9) (preloaded format=pdflatex 2015.4.9) 18 APR 2016 15:36
  1 +This is pdfTeX, Version 3.1415926-2.5-1.40.14 (MiKTeX 2.9) (preloaded format=pdflatex 2015.4.9) 18 APR 2016 16:16
2 2 entering extended mode
3 3 **MarketPaper
4 4 (C:\Users\Olivier\gitlab\market-game\CHIPLAYpaper\MarketPaper.tex
... ... @@ -1756,7 +1756,7 @@
1756 1756 ) has been already used, duplicate ignored
1757 1757 <to be read again>
1758 1758 \relax
1759   -l.249 \bibitem{Phrasedetectives}
  1759 +l.250 \bibitem{Phrasedetectives}
1760 1760 [11])
1761 1761 Package atveryend Info: Empty hook `BeforeClearDocument' on input line 891.
1762 1762 pdfTeX warning (ext4): destination with the same identifier (name{page.}) has b
... ... @@ -1779,7 +1779,7 @@
1779 1779 Here is how much of TeX's memory you used:
1780 1780 31840 strings out of 493921
1781 1781 642881 string characters out of 3144871
1782   - 703608 words of memory out of 3000000
  1782 + 702608 words of memory out of 3000000
1783 1783 34274 multiletter control sequences out of 15000+200000
1784 1784 80796 words of font info for 277 fonts, out of 3000000 for 9000
1785 1785 841 hyphenation exceptions out of 8191
... ... @@ -1818,7 +1818,7 @@
1818 1818 b><C:/Program Files (x86)/MiKTeX 2.9/fonts/type1/urw/times/utmbi8a.pfb><C:/Prog
1819 1819 ram Files (x86)/MiKTeX 2.9/fonts/type1/urw/times/utmr8a.pfb><C:/Program Files (
1820 1820 x86)/MiKTeX 2.9/fonts/type1/urw/times/utmri8a.pfb>
1821   -Output written on MarketPaper.pdf (12 pages, 346294 bytes).
  1821 +Output written on MarketPaper.pdf (12 pages, 346374 bytes).
1822 1822 PDF statistics:
1823 1823 519 PDF objects out of 1000 (max. 8388607)
1824 1824 102 named destinations out of 1000 (max. 500000)
CHIPLAYpaper/MarketPaper.pdf View file @ 212b4b1

No preview for this file type

CHIPLAYpaper/MarketPaper.tex View file @ 212b4b1
... ... @@ -138,8 +138,8 @@
138 138 The second approach could be used to explore larger search spaces while harnessing collective intelligence, but popular crowdsourcing systems making use of the Amazon Mechanical Turk deliberately forbid communication between participants to avoid group-think phenomena.
139 139 %but interactions between players might lead to group-think phenomena. Therefore, popular crowdsourcing platforms such as Amazon Mechanical Turk deliberately forbid communication between participants.\\
140 140 In this paper, we design a novel multi-player game-with-a-purpose, and analyze the impact of multiple game mechanisms on the performance of the system. We present a highly collaborative human-computing game that uses a market, skills and a challenge system to help the players collectively solve a graph problem.
141   - The results obtained during 12 game sessions of 10 players show that the market helps players to build larger solutions. We also show that a skill system and, to a lesser extent, a challenge system can be used to influence and guide the players towards producing better solutions. %\\
142   -Our collaborative game-with-a-purpose is open-source, and aims to serve as an universal platform for further independent studies.
  141 + The results obtained during 12 game sessions of 10 players show that the market helps players to build larger solutions. We also show that a skill system and, to a lesser extent, a challenge system can be used to influence and guide the players towards producing better solutions.
  142 +Our collaborative game-with-a-purpose is open-source, and aims to serve as a universal platform for further independent studies.
143 143 \end{abstract}
144 144  
145 145 \keywords{Game-with-a-purpose; Human computing; Collaboration; Crowdsourcing; Graph problem; Market; Trading game; Skills; Challenges.}
CHIPLAYpaper/references.bib View file @ 212b4b1
... ... @@ -75,7 +75,7 @@
75 75 }
76 76  
77 77 @article{Dankulov2015,
78   - author = {Dankulov, Marija Mitrović and Melnik, Roderick and Tadić, Bosiljka},
  78 + author = {Dankulov, Marija Mitrovi\'{c} and Melnik, Roderick and Tadi\'{c}, Bosiljka},
79 79 title = {The dynamics of meaningful social interactions and the emergence of collective knowledge},
80 80 journal = {Scientific Reports},
81 81 volume = {5},
answers2referees.txt View file @ 212b4b1
... ... @@ -5,7 +5,7 @@
5 5  
6 6 - Reviewer 1:
7 7  
8   -1) We totally agree that the current introduction is not comprehensive enough and misses references to several important prior contributions. We ended up missing some time before the deadline to write the introduction we really wanted to write. Thanks a lot for the reference; it is indeed a good starting point.
  8 +1) We totally agree that the current introduction is not comprehensive enough and misses references to several important prior contributions. We ended up lacking time before the deadline to write the introduction we really wanted to write. Thanks a lot for the reference; it is indeed a good starting point.
9 9  
10 10 2) This is an important suggestion and we will definitely state clearly all the questions and hypotheses in the introduction. This will help a lot to clarify the goals of this paper, which is a remark that was made by the other reviewers as well.
11 11 Just to clarify, the questions we are trying to answer in this paper (and hypotheses) are:
... ... @@ -21,7 +21,7 @@
21 21  
22 22 *** OLIVER: It is good to indicate after each item which action you will take to address the referee’s remark ***
23 23  
24   -4) Thank you for this important suggestion. We found that basic statistics reported in the paper were sufficient at this stage to support the hypothesis of this work (see above). Nonetheless, we agree with the referee that deeper statistical analysis will help to strengthen the conclusion and impact of this paper. This material will be added to a revised version.
  24 +4) Thank you for this important suggestion. We found that basic statistics reported in the paper were sufficient at this stage to support the hypotheses of this work (see above). Nonetheless, we agree with the referee that deeper statistical analysis will help to strengthen the conclusion and impact of this paper. This material will be added to a revised version.
25 25  
26 26 *** OLIVIER: Since we add nothing, can we say that our current data are ok for now but that more will be added later? Revise my text if you don’t like it ***
27 27  
... ... @@ -40,7 +40,7 @@
40 40  
41 41 In fact, we intentionally use this situation. Our capacity to calculate a complete solution was a prerequisite for us since our goal is to fully characterize the computational efficiency of a market system (e.g. percentage of solution found by humans).
42 42  
43   -We should have mentioned in the paper is that the tasks we are trying to solve are (intentionally) well-defined and do not take advantage of all human capabilities. Nonetheless, to put this work in perspective, once the computing performance of the markets are evaluated, we can replace the color matching tasks with more complex task (e.g. handwritten digits instead of colors) in order to make a better use of humans skills.
  43 +We should have mentioned in the paper that the tasks we are trying to solve are (intentionally) well-defined and do not take advantage of all human capabilities. Nonetheless, to put this work in perspective, once the computing performance of the markets are evaluated, we can replace the color matching tasks with more complex task (e.g. handwritten digits instead of colors) in order to make a better use of human skills.
44 44  
45 45 As noted by other reviewers too, the confusion may stem from an insufficient description of the research questions in the introduction (See answer to Ref. #1). We will ensure to clarify all these aspect in a revised introduction.
46 46  
... ... @@ -53,7 +53,7 @@
53 53 2nd paragraph:
54 54 - As was also mentioned by the ref #2, it is true that we did not write enough about comparing the performance of the players with the performance of computers on this problem. The main reason for that is that we are here more interested in evaluating the absolute performance of markets to solve this problem rather than ‘beating the computer’. In fact, we intentionally used a NP-complete problem for which we can easily calculate the solution in order to estimate the absolute performance of the market (see also comments above).
55 55  
56   - - You mention a very important aspect of the game, which is competitiveness between the players. We agree that some biases could come from the competitive nature of the game. At the same time it is also a powerful motivation factor that we are trying to take advantage of. The different features of the game are implemented in such a way that the players' action are enhancing collaboration and that it is almost impossible to hurt another player.
  56 + - You mention a very important aspect of the game, which is competitiveness between the players. We agree that some biases could come from the competitive nature of the game. At the same time it is also a powerful motivation factor that we are trying to take advantage of. The different features of the game are implemented in such a way that the players' actions are enhancing collaboration and that it is almost impossible to hurt another player.
57 57  
58 58 *** OLIVIER: Again, you can say that you will clarify this in the text. ***
59 59