So, all those surveys...

[Ubahsur Kindellaer]

Have you been curious about the results of the 2011 Membership Survey (taken in February 2012) and the Bully Survey?

WONDER NO MORE!

You can find a PDF version of the Membership Survey results report in the Library.

You can find the text of and a PDF of the Bully Survey results.

HUGE thanks to Ennairam and Mirandha for their efforts in both these reports. Also to Toral for putting them in the Library for us.

 

[Anika Forsyn]

Thanks!!!!!

 

[Yarrow Al'Vare]

Fantastic!

 

[Alyssa Letherio]

Very intersting! Thank you for all the hard work!

 

[Nymala Ingasy]

Both surveys are fascinating! Thank you!

 

[Ibon Caseï]

Awsome! Thank you so much for all the great work being done with these surveys! :clap

 

[Zashara Sho'am]

Are there values for the number of people who responded to the bullying survey? The percentages mean nothing without that value.

ETA: Also, many of the percentages don't add up (ex. demographics add up to 97.94%).

 

[Keisha al'Benn]

Thank you to all who made this happen!

 

[Bao the Wyld]

So 45% of people witnessed bullying on the boards? Are we talking 45% of 10 people surveyed or 45% of 1000 people surveyed? I'm sure a lot of time went into the survey, but the numbers don't make any mathematical sense.

45.45% of people who witnessed bullying + 15.70% of those who did not witness bullying = an incomplete statistic.

 

[Yelenia Hylraren]

I'm also a bit concerned about the numbers. Also, will this be proofread before going up in the library?

Interesting results, would love to give them meaning with n= and no response numbers.

 

[Mirandha Laflor]

I'm too tired to do it now, but give me time and I'll update w/specifics. I meant to include them w/ a chart and then changed my mind.

ETA: before the edited report is done, here's what I can tell you.

242 responses were included in the statistics. Some of the demographics are off because the option to identify as "guest" was allowed. I'll have the survey software create charts if that will help people.

Regarding the stats w/witnessing bullying, the option to give no answer was allowed and also the survey counted incomplete answers as well. Again, I'll have the survey software provide a chart.

I honestly thought it would confuse people to include every single stat, but if it makes it clearer, I'll put charts in.

Yele, Ubah read everything over before putting it in the Library.

 

[Idris ab Eynon]

Can we have methodology survey?

 

[Deleios Cherchenuit]

7.85% of people chose not to identify.

It's not exactly that, as citizens had no over options that to choose that option, since there was no "Citizen" option

 

[Ubahsur Kindellaer]

Citizens were told to select Novice/Recruit or Guest and enter the comment Citizen. I believe only one Citizen did this.

The survey was done to a) collect objective data as to how membership viewed our community (was there bullying or not), and b) a platform to anonymously provide data to Execs regarding what they thought of as bullying - as very few instances were reported to Execs yet there was discussion and complaints to this effect. Execs cannot make decisions, policies, procedures, or make any impact without data and information.

 

[Deleios Cherchenuit]

Citizens were told to select Novice/Recruit or Guest and enter the comment Citizen. I believe only one Citizen did this.

The survey was done to a) collect objective data as to how membership viewed our community (was there bullying or not), and b) a platform to anonymously provide data to Execs regarding what they thought of as bullying - as very few instances were reported to Execs yet there was discussion and complaints to this effect. Execs cannot make decisions, policies, procedures, or make any impact without data and information.

My mistake then. It's what you get when you try to say something with a memory with more holes than Matrim Cauthon's. My apologies

 

[Mirandha Laflor]

I've updated the survey. Since I can't edit Ubah's original post (maybe a mod can please?) I'll drop this link here.

NEW AND IMPROVED (bully survey summary).

 

[Raam Sho'am]

The survey was done to a) collect objective data as to how membership viewed our community (was there bullying or not), and b) a platform to anonymously provide data to Execs regarding what they thought of as bullying - as very few instances were reported to Execs yet there was discussion and complaints to this effect. Execs cannot make decisions, policies, procedures, or make any impact without data and information.

I have a couple of problems with that. The first is that an anonymous survey regarding bullying, with no basic definition of the word to work with, does not even resemble "objective data". It is completely subjective. The second problem is that the survey was always going to suffer from at least some degree of confirmation bias - if you feel you or your friends have been bullied, you are far more likely to respond to a survey on the subject than someone who does not feel that way. Then, to top it all off, you have the flawed numbers. Why are the people who didn't complete the survey even represented in the results? That's 41 people messing up the numbers right there. And several more apparently skipped the most important questions (23 did not answer the question about bullying on the boards, and a ridiculous 56 did not answer the question about chat).

I realize a great deal of work went into this suvey, and kudos to those of you who were willing to take it on. However, the entire process was afflicted with methodological flaws which render this entire survey problematic at the very least, and quite possibly completely irrelevant.

 

[Mirandha Laflor]

How would you propose to initiate a survey on a topic that is completely subjective objectively? Part of the point of the survey was to help the Admins come up with a definition of bullying.

if you feel you or your friends have been bullied, you are far more likely to respond to a survey on the subject than someone who does not feel that way.

Having seen the survey results, I can tell you that you are wrong on this.

Why are the people who didn't complete the survey even represented in the results?

Because not all questions were mandatory.

(23 did not answer the question about bullying on the boards, and a ridiculous 56 did not answer the question about chat).

Because not everyone participates in chat. And vice versa. Some people are in chat more often than the boards.

However, the entire process was afflicted with methodological flaws which render this entire survey problematic at the very least, and quite possibly completely irrelevant.

Your suggestions will be listened to if you are the expert in surveys

 

[Ubahsur Kindellaer]

Mirandha is 100% correct.

We hope that all members of the community will participate in these official surveys to reduce bias. That is why we post about them in Site Announcements, and the Marketing department is kind enough to spread the word via social media. If one chooses to not participate, we cannot and will not force them to, but that choice then does limit the data we have available to us.

We do the best we can with the data provided to us, and so that we can make this community beneficial to as many members as possible. I would like to think that it is a good thing that Execs wish to make decisions based on data, rather than their own personal experiences or arbitrarily.

 

[Jalen te'Kreg]

Ubah, that's all appreciated, but data-based decisionmaking requires thoroughly correct data processing. There seem to be some valid concerns about those processes, especially given the fact that the results *will* be used for decision-making. These aren't personal or even unfair attacks so I think it's important not to be that dismissive.