This always happens to me as well, I start off giving some feedback and then I stop doing that and just start saying "no" mentally to entries that I don't find interesting. Good thing I am not a guest judge, my entries would soon go like:
No
No
Sucks, no.
Are you insane, no!
One important thing I noticed is: Take breaks.
After seeing about 2-3 monsters my mind needs time to refresh before focusing on the next one. It doesn't need to be a long break, just enough to clear your thoughts.
Listening to music also helps to keep you focused and even tackle ideas you initially dislike.
It also helps to once read all entries and then start judging them one at a time. This way you can if you are stuck with one, or don't really know what to think about it first proceed to one of which you already have made up you mind.
But giving a full review to all 32 Monsters still is a lot of work ( I've lost track of where I am right now). And doing that to 1000+ items will be plain impossible, even given a lot more time.
As I've already noted in Clark's thread the judges really have my deepest respect for doing this.
It can be any worse than grading term papers.
I don't know what you're talking about. I've never had any problem expressing my opinion on something or typing it out in voluminous detail. ;-D
That said, I haven't commented on the monsters this round and don't intend to. My role as a guest judge is done. And though I'll certainly follow along with the competition and vote and offer encouragement/advice in the non-submission threads...I'm going to stay out of the design critiques for a bit. I think I went a tad overboard (as usual) during the wondrous item round anyway. And I'm way too critical to keep airing that kind of commentary.
--Neil
I'm pouting at you, Neil. Pouting hard.
Can you feel it?!
Ummm...no?
It took me 2 days, probably about half an hour per entry. Not bad overall, and completely worth the time.
Clearly, I'm not pouting hard enough.
I may require lip balm.
|
This always happens to me as well, I start off giving some feedback and then I stop doing that and just start saying "no" mentally to entries that I don't find interesting. Good thing I am not a guest judge, my entries would soon go like:
No
No
Sucks, no.
Are you insane, no!
Right there with ya.
I suspect that the judges fall into a sort of shorthand on their initial pass and then go back at the stuff they found interesting and sharpen up their comments.
Good thing I am not a guest judge, my entries would soon go like:
No
No
Sucks, no.
Are you insane, no!
You forgot my favorite response: Are you insane, yes!
I've only provided comprehensive feedback on half of the Round 2 entries so far, and it's taken pretty much my entire day off to do it. How do the judges do it every round and every year? I'm sure I'd have just snapped and started auto-rejecting everything half way through Round 1.
The judges and guest judges all deserve medals or something.
Rounds 1 and 2 are the hardest.
Round 1 for the sheer number of items. But many of them can be disposed of summarily. Plus, we get a much longer time frame. The key to judging, as I shared with our new judge(s), is to stay on top of it as they come in. If you dont, and even if you do a good job but let it slip for a few days, then you wind up having to do hundreds of items in a few days which is a total nightmare. I let mine slide for a couple days, I was out of town, and came back to 200 or 300 to review. Luckily I still had plenty of time.
On the other hand, unlike Round 1, Round 2 entries can almost never be summarily disposed of. They all (or nearly all) merit detailed consideration (unlike the bulk of round 1 entries). And 32+4 alts is the largest pool that we judge in the shortest time frame. So that is the hardest round from a time standpoint.
I love this contest and every year I am excited about it. Until about the middle of round 1 when I start to think that I was insane to agree to do it again and what was I thinking :)
It easily monopolizes my nights for several weeks. I head downstairs at night to my bottom floor where my computer zone is all set up. My wife asks me "going to review items?" I say "Yep, dont wait up." ;)
Then round 1 ends and I forget all about that.
Depending on the word count of the assignment for round 3, it can be a doozy, too, since although you only have 16 to read you have a tight turn around and a long word count to get through. And, again, all the submissions really deserve the most detailed thought process and analysis (regardless of how long my review may be they all get really detailed thought by the judges).
RPG Superstar 2010 Top 32
|
All the hard work and great analysis is greatly appreciated, Clark. It's really cool that you guys devote so much time just because you love the game.
Really, the judges, guest judges, and Paizo all deserve a lot of recognition by the gaming world for this contest. I think it's raising the bar, not just for professional design, but also homebrew content. [/kiss-up]
For R1, we have several weeks, and as long as I spend about an hour each night, I'm generally able to keep up (both years I've fallen behind a bit but made it up in the last couple of days). It's easy to circular-file a lot of the R1 items that clearly don't make the cut; if they don't use the magic item format and are just running text, if they're just two lines of description/backstory followed by "When worn, this lets you use spell X 3/day," and so on.
For R2, I burned through all of them in about six hours the Sunday before voting opened, partly because I wanted them all fresh in my mind at the same time, and partly that's just how my schedule worked out. One trick I use is that I'm the one who sets up the submission format for the round, so I can build the format in such a way that it appeals to how my brain recognizes and sorts data. ;) I also didn't go quite as in-depth as Clark or Wes did--my goal was to be short and to the point, highlighting what I liked or didn't like about the monster concept and trying not to dwell too much on what the game stats may be and how that would affect my perception of the monster.
Also, remember that this is my job--reading and evaluating RPG material is much of my work day. I have a lot of practice at it. It also helps that I really like my job.
And it helps that we had so many good monster submissions this year. :)
Also, remember that this is my job--reading and evaluating RPG material is much of my work day. I have a lot of practice at it. It also helps that I really like my job.
And it helps that we had so many good monster submissions this year. :)
I want to echo that. The more you do it, the easier it is. For instance, the first year I did this it took me a TON of time just to decide what rubric I wanted to use to judge the entries. That is a lot easier now.
But having done it before helps. Which is why Sean is faster at it than me.
And as Sean said, the monster entries were really good. We didnt really have any lame flameouts. Its easier to judge quality submissions. Kind of like reffing basketball, sure the higher level games are faster and they are more athletic. But it is way easier to call the few college games I get to work (preseason) then my normal varsity high school games that I work, and in turn it is way easier to call HS varsity games than JV or freshman. The quality of play makes it easier to judge.
|
For R1, we have several weeks, and as long as I spend about an hour each night, I'm generally able to keep up (both years I've fallen behind a bit but made it up in the last couple of days). It's easy to circular-file a lot of the R1 items that clearly don't make the cut; if they don't use the magic item format and are just running text, if they're just two lines of description/backstory followed by "When worn, this lets you use spell X 3/day," and so on.
For R2, I burned through all of them in about six hours the Sunday before voting opened, partly because I wanted them all fresh in my mind at the same time, and partly that's just how my schedule worked out. One trick I use is that I'm the one who sets up the submission format for the round, so I can build the format in such a way that it appeals to how my brain recognizes and sorts data. ;) I also didn't go quite as in-depth as Clark or Wes did--my goal was to be short and to the point, highlighting what I liked or didn't like about the monster concept and trying not to dwell too much on what the game stats may be and how that would affect my perception of the monster.
Also, remember that this is my job--reading and evaluating RPG material is much of my work day. I have a lot of practice at it. It also helps that I really like my job.
And it helps that we had so many good monster submissions this year. :)
And it helps that you have an awesome gamer girlfriend who digs it :oD
Chief Technical Officer
|
For R1, we have several weeks, and as long as I spend about an hour each night, I'm generally able to keep up (both years I've fallen behind a bit but made it up in the last couple of days). It's easy to circular-file a lot of the R1 items that clearly don't make the cut; if they don't use the magic item format and are just running text, if they're just two lines of description/backstory followed by "When worn, this lets you use spell X 3/day," and so on.
Another thing that helps a bit is that the once two judges have rejected an entry, it usually gets kicked into the reject bin, so the third judge can skip it.
Yeah, but we prefer to have all 3 see it. Unless its just one that we know the third won't like. I often times spin through the reject bin just in case. I actually wound up pulling 3 out of the trash to keep around for later consideration.
The other way we do it is this...
We are superheros.
Wes has laser eyes.
Sean has stretching powers.
I can fly.
I've only provided comprehensive feedback on half of the Round 2 entries so far, and it's taken pretty much my entire day off to do it. How do the judges do it every round and every year? I'm sure I'd have just snapped and started auto-rejecting everything half way through Round 1.
The judges and guest judges all deserve medals or something.
Teachers do it every day and often for much more boring work.
The other way we do it is this...
We are superheros.
Wes has laser eyes.
Sean has stretching powers.
I can fly.
I prefer to call them "thin powers;" they allow me to fit into jeans with small waists, dash through closing doors, and even slip between bars. There's also my freakish resistance to poison and disease. Oh, and the whole <a href="http://seankreynolds.livejournal.com/131815.html">unbreakable</ a> thing.
Wes also has "spooky hands." When you see him in person, just ask him to say "spooky," he can't help but demonstrate.
Clark also commands legions of undead, which is pretty cool.
I'm flagging this entire thread. I can't believe that people would pester our judges with such an inappropriate, personal question.
Edit: Oh. Oh...
I tried this once, cant recommend it. The zombies wouldn't shut up about brains, couldn't sleep.
"I used to think I didn't need a family. I mean, I had the demons and the walking skeletons. But the difference between a walking skeleton and a kid is, a kid won't eat the soft parts of your face while you're sleeping." --Deadly Girl, The Specials
I tried this once, cant recommend it. The zombies wouldn't shut up about brains, couldn't sleep.
Clark also commands legions of undead, which is pretty cool.
I hear you. Zombies are for scrubs. Sure, they are cool to the newbie necromancer. But you really come to appreciate wraiths, wights, spectres and shadows. And hot banshee chicks are alright, with enchanted ear plugs.
And hot banshee chicks are alright, with enchanted ear plugs.
I'm having a Porky's flashback. I'm going to assume everyone who has seen the classic knows which scene I am referencing. :P
|
I hear you. Zombies are for scrubs. Sure, they are cool to the newbie necromancer. But you really come to appreciate wraiths, wights, spectres and shadows. And hot banshee chicks are alright, with enchanted ear plugs.
Well, thats what I get for using Necromancy for Dummies. But you have to crawl before you can walk!
I'm nearly finished writing my reviews and have already decided on my Top 3, but for the 4th place there is a near tie with 4-5 Monsters. 8 votes would have been way more easy to decide on.
But now for the last 2 reviews. Those are monsters I can't really make up my mind on.