Thanks so much for filling out the surveys!

[NemisCassander]

dnoisette: Possibly. Again, I'm not imputing any nefarious intent on the devs. I understand that they're just trying to get data, and I applaud them for it.

Given the very poor structure of the survey, I'm just worried that they're going to analyze it as well as they designed it, which could be objectively bad for their product.

[dnoisette]

NemisCassander wrote:

dnoisette: Possibly. Again, I'm not imputing any nefarious intent on the devs.

I'm not either. I'm saying it's hard enough when you know what mistakes you should avoid making to not make them in the first place and so I understand why the surveys are biased: because Paizo staff is, in the end, humans. :D

[NemisCassander]

dnoisette: Sure, I understand that they're humans. And I appreciate their attempt at gathering data.

But someone needs to tell them that their survey data isn't telling them what they think it's telling them. It _can't_.

Or, at the very least, anyone who filled out the same survey I did likely did not provide unbiased data to the devs. And the devs don't realize this.

[Blueskier]

NemisCassander wrote:

I have filled out all of the surveys, even though my group has stopped the playtest due to lack of interest, and the chances of playing PF2E when it launches is basically nil.

I will say, though, from someone with a background in how to write (and analyze) survey questions, the devs need to seriously work on writing their survey questions. Without imputing nefarious intent, it is very clear (to me, at least) the expected response to most of these questions, and I would guess that the survey results are biased because of this.

Again, I am not imputing blame here, and I doubt the devs are even aware of the bias in their questions and selected answers.

Should the designers wish to discuss this, I am easily reachable here.

Can you provide a few examples of this, so someone who does not have any training on this can see what you mean?

Thanks!

[Joshua O'Connor-Rose]

Hey Part 7 GM link links to Part 6 Red Flags, thought this is the best place to put this

[Rob Godfrey]

Jason Bulmahn wrote:

N N 959 wrote:

Mark Seifter wrote:

Hey everyone,

I just wanted to put a thread up here to say that the amount of time you guys have been willing to spend on the surveys has been amazing, and your feedback has been great, and generally to thank you for the effort you've been putting in! ....

Can/will Paizo share the results of the surveys? It would help to know if my concerns are shared by others, or if I'm an anomaly with regards to preferences.

Also, what is Paizo's confidence that the survey captures an accurate representation of entire community versus those who spend times on the forums?

We will not be posting up too much in regards to specific survey feedback and such can have a very negative impact on data collection. I think we will be more open once the playtest period is over.

Our confidence is very high, with the caveat that these are self selected surveys. That comes with a certain bias, but our numbers are getting so big, in many cases, that we feel that we are probably about as close to having an accurate picture of the community as we can get.

I will say that I am continually surprised at the difference in response between the surveys, these boards, and various social media platforms. I am sure there is a research paper in there somewhere...

I have noticed that their are plenty of 'is this powerful' questions and very few to none 'is this enjoyable?' questions.