The Forge Reference Project

 

Topic: Submitted for Your Consideration: Changes to ORIGINS Awards
Started by: ryand
Started on: 7/2/2003
Board: Publishing


On 7/2/2003 at 11:01pm, ryand wrote:
Submitted for Your Consideration: Changes to ORIGINS Awards

The following is a proposal I intend to submit to GAMA and the Academy
for review. Following the widespread dissatisfaction with this year's
ORIGINS Award process, I believe rapid, significant change is necessary
to rebuild the stature and interest in the Awards that is required to
make them meaningful and relevant.

Your comments are welcome!
-----------------------------------
PROPOSAL TO CHANGE THE ORIGINS AWARDS - DRAFT

Intent:
=======
The intent of this proposal is to focus the ORIGINS Awards toward the
games which are produced by the members of GAMA, specifically products
that represent the bulk of the products sold by the majority of the
members of GAMA, and to position the ORIGINS Award as the pre-eminent
award which could be earned by those products in any venue.

Problems with the Current System:
=================================
1. Awards Not Representative of Best in Class
------------------------------------------
Due to the challenges in working with European and Japanese publishers,
the ORIGINS Awards do not fully represent the extremely active and
diverse publisher communities in either region. As a result, awards in
the Board Game, Card Game and Trading Card Game categories (by any
terminology) often overlook worthy entrants. And, even if the
nominations process was improved, the vast preponderance of voters are
located in North America, meaning that the chance of a product from
either Europe or Japan winning in its category regardless of merit is
essentially nil.

2. Specificity of Game Types
-------------------------
The increasing overlap between the terms used to describe tabletop games
and video/computer/console games makes it hard to differentiate the
ORIGINS Awards from Awards targeting the computer game market.

3. Get Out the Vote drives unduly influence winners
------------------------------------------------
Each year, a handful of publishers make an extraordinary effort to
motivate their consumers to vote on their behalf for ORIGINS Award
consideration. As a result, a number of products have won ORIGINS
Awards despite overwhelming general consensus that they were not the
best products in the categories in question. This effect is especially
pronounced when the publisher in question operates a widely distributed
house-organ such as a magazine or a highly trafficked website.

4. A number of categories are outdated
-----------------------------------
Several ORIGINS Awards are given to product categories which no longer
have any material effect on the financial health of the industry. These
categories slow down the awards presentation, clutter the ballot, and
reduce the overall impact of ORIGINS Award nomination and winning.

5. A number of categories are subordinate to other awards
------------------------------------------------------
A number of the current ORIGINS Award categories are subordinate to more
prestigious awards handled through other venues. Continuing to make
awards in these categories, without realistic hope that the ORIGINS
Award will rise to become the pre-eminent award in that category,
reduces the overall value of the ORIGINS Awards substantially.

Proposed Award Category Revision
================================
The following is a list of the current Award categories, and a proposed
list of new award categories, removing a number of existing categories
and adding three new general recognition award categories.

Current Categories (as of 2003):
--------------------------------
* Best Abstract Board Game
* Best Board Game Expansion or Supplement
* Best Card Game Expansion or Supplement
* Best Game Aide or Accessory
* Best Game Periodical
* Best Game-Related Fiction Long Form
* Best Game-Related Fiction Short Form
* Best Graphic Design of a Board Game
* Best Graphic Design of a Book Format Product
* Best Graphic Design of a Card Game Or Expansion
* Best Graphic Fiction
* Best Historical Board Game
* Best Historical Figure Miniature Series
* Best Historical Miniature
* Best Historical Miniature Rules
* Best Play-By-Mail Game
* Best Roleplaying Adventure
* Best Roleplaying Game
* Best Roleplaying Supplement
* Best Science Fiction or Fantasy Board Game
* Best Science Fiction or Fantasy Miniature
* Best Illustration
* Best Science Fiction or Fantasy Figure Miniature Series
* Best Science Fiction or Fantasy Miniatures Rules
* Best Trading Card Game
* Best Traditional Card Game
* Game of the Year

Proposed Revised List of Categories:
------------------------------------
* Best Game Periodical
* Best New Game Aide or Accessory
* Best New Traditional Board Game
* Best New Traditional Card Game
* Best New Tabletop Wargame
* Best New Tabletop Roleplaying Game
* Best New Tabletop Roleplaying Supplement
* Best New Tabletop Roleplaying Adventure
* Best New Game Requiring Sculpted Miniature Figures
* Best New Sculpted Miniature Figures Line
* Best New Individual Sculpted Miniature Figure
* Best New Trading Card Game
* Best New Trading Card Game Expansion
* Artist of the Year
* Designer of the Year
* Publisher of the Year
* Game of the Year

Revisions to Policies & Procedures:
===================================
The following points represent changes to the ORIGINS Award policies and
procedures which are designed to better achieve the objectives of the
Awards in general.

Scope of Awards:
----------------
The ORIGNS Awards will specifically be described as:

"The premiere Award recognizing excellence in the field of tabletop game
publication featuring products distributed in the North American
market."

It is important to note that these are not >game design< awards. They
are product awards, which encompass game design, graphic design,
illustration, editing, marketing, and brand management. As such,
separate recognition for the components of the game products (as per the
current "Art" awards) is not desirable.

Changes to Award Categories:
----------------------------
Many of the current categories represent works eligible for more
prestigious awards in other venues. Several are legacy awards that no
longer represent mainstream unit volume or revenue for most GAMA
members. Others target things sold in game stores which are not games.
And some are subdivisions of categories that already represent small
portions of the general GAMA membership's marketplace.

The list of categories eligible for Award consideration is changed
substantially by this proposal. First, it focuses on the 3 significant
categories of revenue which support the whole industry: RPGs, CCGs and
Miniatures games. Second, it removes legacy categories and categories
with more prestigious awards. Third, it recognizes individual
excellence in the fields of Artist, Designer, and Publisher.

The net effect of these changes should be a much more focused Awards
Ballot and Ceremony, and an increase in the overall prestige value of
the Awards. The Awards will also be more fully representative of the
actual market represented by the GAMA Memebership.

New and Unusual Formats:
------------------------
In the event that a game appears which is both popular, and defines a
new category not covered by the existing ORIGINS Awards categories (i.e.
Diskwars or Magic: the Gathering), the Academy would have the ability
within 2 years of the game's first distribution in the North American
market to award a special "ORIGINS Award for Innovation" to that game to
ensure proper recognition of the achievement.

Selection of Products for the Final Ballot:
-------------------------------------------
Based on market research provided either by GAMA, or gathered by the
Academy in a process acceptable to GAMA, the top 3 best-selling (by unit
volume) products that qualify for each category will be automatically
placed on the Final Ballot.

A Nominations Form will be circulated to the members of the Academy.
The Nominations Form will list all products qualifying for each category
to the best of the Academy's ability to assemble such a list. The list
will not include the marketshare leading products that are automatically
placed on the Final Ballot. The members of the Academy will be allowed
to vote for 3 products in each category. The 3 products with the most
votes in each category will be added to the Final Ballot.

The Academy committee may, at its sole discretion, add one or more
products it deems worthy, but overlooked, to the Final Ballot for each
category.

The Academy Nominations Form will be used to select the Artist, Designer
and Publisher of the Year nominations.

The Academy committee will determine which products are nominated for
Game of the Year. Game of the Year consideration is not limited to
products eligible for the other ORIGINS Award categories.

Publisher Control of Nominations:
---------------------------------
The publisher of a given work may elect to omit that work from the Final
Ballot for any reason and without prejudice. Publishers with products
nominated (or placed) on the Final Ballot will be contacted in a timely
manner prior to the public release of the Final Ballot and asked if they
wish to exercise this privilege. In the event that a publisher
exercises this option, the next product in the natural sequence of
selection for that category would be placed on the Ballot.

Voting Process:
---------------
The winner of the ORIGINS Award will be determined as follows:

Each GAMA Full Voting Member will be permitted to vote, and those votes
will constitute 33% of the total value of the votes.

Each Academy member in good standing will be permitted to vote, and
those votes will constitute 33% of the total value of the votes.

Members of the general public (those who are neither GAMA members nor
Academy members) will be permitted to vote, and those votes will
constitute 33% of the total value of the votes.

In the event of a tie, the Award will be given to both products.

This procedure will tend to minimize the impact of "bloc voting"
engendered by publisher campaigning, and will shift a preponderance of
the vote value to professionals in the industry. Essentially, the
public vote becomes a tiebreaker between the publishers and the gaming
professionals who comprise the Academy itself.

Message 7050#73658

Previous & subsequent topics...
...started by ryand
...in which ryand participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/2/2003




On 7/3/2003 at 12:09am, Christopher Kubasik wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Hi Ryan,

I'm sure others will have many questions and suggestions for you about this proposal. As far as I can tell, the intent is right on the mark. But I'll kick off with my first question:

The automatic awards for sales. Leaving aside the issue of how one even gets these numbers, what is the logic behind this. I'm not saying it's a bad idea. I'm not sure yet what exactly the idea is.

Thanks,

Christopher

Message 7050#73663

Previous & subsequent topics...
...started by Christopher Kubasik
...in which Christopher Kubasik participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 4:39am, Ron Edwards wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Hello Ryan,

Welcome to the Forge, and thanks for posting this proposal here (and elsewhere, I presume).

There's a lot to discuss, as I'm sure you know. In general, revising the Origins Awards is long overdue and badly needed. It's one piece of reviewing Origins per se, as a convention, and GAMA as an organization - also badly needed.

But to 'scope down to the details, here's one suggestion: to reduce the awards down into non-redundant categories. I consider "adventure" to be so loosely defined as to be useless, and just considering adventures to be one form of supplement seems fine to me. I also can't quite see how best single miniature and best line of miniatures can be reasonably separated.

Here's another, in agreement with Christopher: it strikes me that the sales-based approach to eligibility is badly flawed. Can you explain just why this approach is desirable, without relying on the tautology of sales = good = sales = good = etc?

Best,
Ron

Message 7050#73672

Previous & subsequent topics...
...started by Ron Edwards
...in which Ron Edwards participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 11:40am, Valamir wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

A game is comprised of many parts. 1 part is the game design, how it plays. 1 is how it looks, both art and layout which are two quite different things. 1 is how its supported. Not just supplements, but discussion forums, downloads, free expansions, a community of fans.

I see no possible way that you can successfully boil down these disparate elements into a single "best" award. Different people put different weightings on the importance of each aspect. Given an RPG of great design and poor art and layout vs a game of medicore design but high production qualities, what standard do you suggest using to determine which is "better".

Any such standard will either be viewed as putting style over substance if one gives superior weight to appearance; or in wrongfully neglecting the hard and important work of a significant number of industry people who contribute to that appearance if one gives inferior weight to appearance.

If you don't have any standard at all and just leave it up to the judges sense of what is "best" you won't have an award that has earned any greater acceptance than it has now because the choice of "best" will be so obviously wrong to people with different priorities. No. I think any award that jumbles together so many different aspects of a game into one award is doomed to failure.

There is a reason that the academy awards give out Oscars for best score and best costume design and not just best picture. Because it is important to recognize people who's contributions are significant even if their name isn't in the marquee. And there's no way that these people would get the recognition they deserve in a single award.

Also, in an effort to reduce categories you're combining some pretty disparate things. Best Historical Miniatures is not the same thing as Best Fantasy Miniatures. I find your dismissal of them as no longer contributing to the strength of the hobby as completely insulting and irrelevant.

Personally I think you should decide on catagories of games: Tabletop RPGs, Tabletop Wargames, Historical Miniatures, Fantasy Miniatures, CCGs, etc.

There should be an award for Game Design, Art, Layout, and Support for each of these categories (with Art Direction and Layout being modified as appropriate for non print based games).

If each category then has a Best in Class (like a Best Picture) award that goes to the game that has the best synergy of all of these elements than so much the better.

Your current list of categories IMO are actually inferior to the existing list.

Message 7050#73685

Previous & subsequent topics...
...started by Valamir
...in which Valamir participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 12:25pm, Jared A. Sorensen wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Um, cares?

- J

Message 7050#73688

Previous & subsequent topics...
...started by Jared A. Sorensen
...in which Jared A. Sorensen participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 2:48pm, Mike Holmes wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

I would assume that most here would prefer Mr. Dancey's suggestion that the awards be changed from the current popularity contest/ballot stuffing debacle? I think his voting split sounds quite equitable and would help greatly.


Mr. Dancey will note, however, our reluctance to accept the automatic inclusions of high-sale items. I think that this opinion, too, will be universal here. Essentially most designers here never intend to mass-market their games. Not because they aren't good games, but because that's the level of involvement that we're willing to accept.

Basically, it's odd that the rewards would claim to be accolades for design, production, etc, when in fact a primary selection criteria is based on the value that the games provide for the GAMA members. Essentially this is schitzophrenic. The awards ought to either be based soley on the merits of the games themselves as determined by the voters (who can and will consider the profits that the game makes if they like, anyhow), or they ought to be based on the profits which they provide. Mixing the two would seem to be a conflict of interest.

And one that would alienate designers like ourselves. While only a few independent designers are GAMA members, we'd like to think that our small contributions to the hobby do provide some benefit to the industry as a whole, helping to fill out niches and advancing the "technology" of games. Denying that would only alienate us further, and make us even less interested in what would start to seem to us like an "good old boy" network. Further damaging, rather than increasing the pre-eminence of the awards.

And lastly, if the GAMA members make the nominations anyhow, can't they decide that profit is a determinant, and decide to nominate games based on that criteria if they so desire? I'm willing to bet that the best sellers will get nominated anyhow, eliminating the need for the measure. If there happens to be a so-so game that sells well, and the GAMA members realize it, they can thus prevent it from appearing on the ballot if they feel that such is warranted.

Are these awards for the best games, or the most profitable games? Where do you draw the line? If you want to go by profits, then it's easy enough to just compare balance sheets and just go by bottom line. But it seems to me that the profits made by games are their own rewards to those who make the games. Why not compare all games on an even playing field, and actually reward excellence? That would seem to me to be the most legitimizing criteria to me.

Mike

Message 7050#73698

Previous & subsequent topics...
...started by Mike Holmes
...in which Mike Holmes participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 4:21pm, ryand wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Christopher Kubasik wrote: Hi Ryan,
The automatic awards for sales. Leaving aside the issue of how one even gets these numbers, what is the logic behind this. I'm not saying it's a bad idea. I'm not sure yet what exactly the idea is.


First, I believe that when the marketshare leading products don't appear on the Final Ballot (the ballot the public sees), the public loses confidence in the Award. There's a critical link between consumer confidence in the Awards and making the Awards have a real impact.

Second, by ensuring the the marketshare leaders are on the ballot, the system provides a de facto nomination process for consumers. As it would not be possible to do an effective "balloting" of consumers in the nominations round, putting the top sellers on the Final Ballot ensures that consumers who voted with their dollars are having an impact on the Awards process.

Third, GAMA, as an organization, needs to do more to reach out to the largest publishers in the industry. Currently, only WizKids is actively involved in GAMA. Without major publisher participation, GAMA does not, and can not effectively represent the industry. Gettting big publisher attention focused on the awards by getting their products on the Final Ballot consistently will help get them engaged with GAMA in general.

(Great question phrased well, btw.)

Ryan

Message 7050#73706

Previous & subsequent topics...
...started by ryand
...in which ryand participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 4:52pm, ADGBoss wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

ryand wrote:
Third, GAMA, as an organization, needs to do more to reach out to the largest publishers in the industry. Currently, only WizKids is actively involved in GAMA. Without major publisher participation, GAMA does not, and can not effectively represent the industry. Gettting big publisher attention focused on the awards by getting their products on the Final Ballot consistently will help get them engaged with GAMA in general.

(Great question phrased well, btw.)

Ryan


Curious about this last part. In the original post you said

. Get Out the Vote drives unduly influence winners
------------------------------------------------
Each year, a handful of publishers make an extraordinary effort to
motivate their consumers to vote on their behalf for ORIGINS Award
consideration. As a result, a number of products have won ORIGINS
Awards despite overwhelming general consensus that they were not the
best products in the categories in question. This effect is especially
pronounced when the publisher in question operates a widely distributed
house-organ such as a magazine or a highly trafficked website.


Now it would seem to me that the former quote and the latter seem to be working a bit at cross purposes. Since the big major publishers are usually the ones running the "Vote for X" campaigns, then would not limiting their ability to saturate the vote counter your efforts in point #3 above?

Name recognition accounts for a lage amount of sales but name recognition is not a garuntee of quality. Especially when it comes to supplemental material. Some supplements are considered necassary (as necassary as a game book ever is) for the enjoyment of a game and some are truly optional. The "necassary" supplements may seel well because their corresponding main game sells well (for whatever reason) but its no garuntee of the quality of the supplement. Per Example: D&D and WOD splat books are widely considered a waste (in general not in all specific cases) but none the less do sell fairly well for their games.

Would it not be better to let the big companies know that they are wanted and welcome and offer them some other carrot that does not reward their ability to sell products based on name recognition or possibly dubious game design and construction.

Just my 2 lunars and thank you for posting this btw, it seems a rampant bee in many people's bonnets :)

Sean

Message 7050#73714

Previous & subsequent topics...
...started by ADGBoss
...in which ADGBoss participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 5:17pm, ryand wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

ADGBoss wrote:
Since the big major publishers are usually the ones running the "Vote for X" campaigns


Not recently. It is far more effective for a small publisher to run a "Get out the Vote" campaign if the major publishers are disinterested in the Awards. Right now, that's the case, and right now, small publisher "Get out the Vote" campaigns are having an impact.

Ryan

Message 7050#73718

Previous & subsequent topics...
...started by ryand
...in which ryand participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 5:22pm, ADGBoss wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Ok well that makes a bit o sense then. Thank you


Sean

Message 7050#73719

Previous & subsequent topics...
...started by ADGBoss
...in which ADGBoss participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 5:31pm, Christopher Kubasik wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Hi Ryan,

Thanks for the reply.

After considering this thread last night, I'd like to take a step back.

What, actually, is the purpose of the awards?

Is it to recognize the "best" -- just actually, the best, as can be guaged by a public polling of manufacturers and consumers?

Is it a promotional tool to highlight products made by GAMA members?

Is it a tool to promote GAMA?

I understand it might do all these things, but let's say we lived in an imperfect world and had to prioritize. What's the agenda.

In short, what is the mission statement for the awards, and does it mention what, exactly, is being reconized for nominated and winning games?

Thanks,
Christopher

Message 7050#73721

Previous & subsequent topics...
...started by Christopher Kubasik
...in which Christopher Kubasik participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 5:41pm, ryand wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Christopher Kubasik wrote: Hi Ryan,

What, actually, is the purpose of the awards?


Here's my opinion:

The Awards exist to serve the interests of GAMA.

I would enumerate those interests as:

1) Selling more products to more people

2) Improving the quality of the products in the market

3) Recognizing and rewarding the hard work of the people and companies in the gaming industry

In my opinion, after many years of steady, incremental progress, the Awards should become the de facto standard by which a product can be measured in comparison to its peers, and a source of individual recognition that enables the individuals recognized to command higher salaries and added responsibilities from their employers.

Rome was not built in a day. To get to that point, we need to start with a strong foundation even if the highest aspirations of the ORIGINS Awards require years of patient work and nurturing. So we need to keep a clear vision of what we want the Awards to be, even as we recognize as a practical matter that they cannot achieve those goals immediately.

Ryan

Message 7050#73726

Previous & subsequent topics...
...started by ryand
...in which ryand participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 6:32pm, Jared A. Sorensen wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

I saw that this was cross-posted on RPG.net so I ask again, why do we (The Forge) care? GAMA serves the game industry. More to the point, the retail-distro chain. Why/how does this affect anyone here?

They have their Oscars. We have our Sundance.

Message 7050#73735

Previous & subsequent topics...
...started by Jared A. Sorensen
...in which Jared A. Sorensen participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 7:30pm, ADGBoss wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Anything that affects the integrity of the RPG industry, like an award, I think has a very big affect on the Industry as a whole. From the big guns down to Indie Games, both free and for pay.

The chance to be able to affect something that may very well reflect well on the industry as a whole should not be ignored. So I think it is very relevant to us here.

Just my 2 Lunars of course


Sean

Message 7050#73745

Previous & subsequent topics...
...started by ADGBoss
...in which ADGBoss participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 7:35pm, Andy Kitkowski wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Now if only someone would get around to making some sort of award... perhaps a peer-only award... for independently published RPGs that don't usually interact with GAMA or the tradtional distrol channels...

:)

-Andy

Message 7050#73746

Previous & subsequent topics...
...started by Andy Kitkowski
...in which Andy Kitkowski participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 7:36pm, Jared A. Sorensen wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

ADGBoss wrote: Anything that affects the integrity of the RPG industry, like an award, I think has a very big affect on the Industry as a whole. From the big guns down to Indie Games, both free and for pay.

The chance to be able to affect something that may very well reflect well on the industry as a whole should not be ignored. So I think it is very relevant to us here.



I keep hearing this word industry. What industry? Do we care? I mean, I guess you do...and I guess I don't.

- J, the Industry!

Message 7050#73747

Previous & subsequent topics...
...started by Jared A. Sorensen
...in which Jared A. Sorensen participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 7:53pm, ADGBoss wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Jared A. Sorensen wrote:

I keep hearing this word industry. What industry? Do we care? I mean, I guess you do...and I guess I don't.

- J, the Industry!


Well thats a perfectly viable opinion to have and more power to you, but I find it incongruous to belong to a Forum dedicated to the improvement of Indie games and RPGs in general, but not care about "The Industry". I would say you me and us are part of the "Industry" whether we like or not.

Again though thats just my opinion so I guess we do disagree :)

Sean

Message 7050#73751

Previous & subsequent topics...
...started by ADGBoss
...in which ADGBoss participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/3/2003 at 11:39pm, GMSkarka wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Jared A. Sorensen wrote: I saw that this was cross-posted on RPG.net


It was cross-posted on several public websites, and posted to one industry email list as well.

It was NOT, however, posted to the Academy mailing list, the forum for such discussions.

Participating in these threads on the various places it has been posted does nothing more than further one individual's power-politics BS to "drive change from without".

Take that as you will.

GMS

Message 7050#73774

Previous & subsequent topics...
...started by GMSkarka
...in which GMSkarka participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/3/2003




On 7/4/2003 at 4:07pm, Ron Edwards wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Hello,

Couple things to go over.

THING ONE
Sean (ADGboss), Jared is making a point that you're not seeing, and I think it'd be valuable for you to consider it - that "the industry" is not necessarily important or relevant to RPG publishers and players. Jared's work has demonstrated this beyond any shadow of a doubt, and my own success at the industry level is based on my earlier success without it.

In other words, participating in "the industry" (retailers, distributors) is an option for, not the definition of, role-playing publishing. This is one of the founding principles of the Forge.

Therefore doing stuff to benefit "the industry" is not the obvious no-brainer that it might seem. To many of us, doing so would be a disastrous waste of effort and money. To others, including me, doing such stuff is necessary but limited - best handled from a strong "what's in it for me" perspective.

However - and this is important - some independent RPGs do rely largely on the "industry" functioning. Therefore this topic is relevant to the Forge (which is my answer to Jared), even though it's not overwhelmingly crucial to everyone here.

THING TWO
It strikes me as perfectly viable for someone, GAMA most likely best suited, to offer awards based strictly on monetary gain or volume of sales of some sort. In other words, Ryan, if you're looking for an indicator of RPGs' physical and commercial presence in our society, as a means of advertisement, why not jettison the whole "awards based on content" in the first place? Supposing that the numbers regarding profits and sales-volume could be gathered, just list the getters of the Mostest in order, as the winners of the awards. All done.

If these companies are themselves the recipients of other, content-based awards as well, regardless of commercial presence, then it's a bonus - both "big" and "good" would be rewarded independently.

Letting the one be the gateway for eligibility to assess the other, though, seems quite odd to me.

Best,
Ron

Message 7050#73806

Previous & subsequent topics...
...started by Ron Edwards
...in which Ron Edwards participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/4/2003




On 7/4/2003 at 5:27pm, ethan_greer wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Ron Edwards wrote: In general, revising the Origins Awards is long overdue and badly needed. It's one piece of reviewing Origins per se, as a convention, and GAMA as an organization - also badly needed.

Ron, can you elaborate on the reasons underlying this opinion? It's not that I disagree - just seeking better understanding of where you (and Ryan, and others) are coming from.

Message 7050#73818

Previous & subsequent topics...
...started by ethan_greer
...in which ethan_greer participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/4/2003




On 7/4/2003 at 5:28pm, ADGBoss wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Ron Edwards wrote: Hello,

Couple things to go over.

THING ONE
Sean (ADGboss), Jared is making a point that you're not seeing, and I think it'd be valuable for you to consider it - that "the industry" is not necessarily important or relevant to RPG publishers and players. Jared's work has demonstrated this beyond any shadow of a doubt, and my own success at the industry level is based on my earlier success without it.

In other words, participating in "the industry" (retailers, distributors) is an option for, not the definition of, role-playing publishing. This is one of the founding principles of the Forge.


Therefore doing stuff to benefit "the industry" is not the obvious no-brainer that it might seem. To many of us, doing so would be a disastrous waste of effort and money. To others, including me, doing such stuff is necessary but limited - best handled from a strong "what's in it for me" perspective.

However - and this is important - some independent RPGs do rely largely on the "industry" functioning. Therefore this topic is relevant to the Forge (which is my answer to Jared), even though it's not overwhelmingly crucial to everyone here.

Best,
Ron


I do see what JAred is saying and I respect his opinion, otherwise I never would have taken the time to comment on it. However, I think he is wrong but perhaps thats because I consider "industry" to be beyond the retail and distribution. I consider industry to include all Players and Designers and Artists and Publishers as well as Retailers and Distributors. So that anything that could affect "the industry's" image or integrity either as a positive or negative, I think is extremely relevant to players and especially designers. Thats where I was coming from.

Sean

Message 7050#73819

Previous & subsequent topics...
...started by ADGBoss
...in which ADGBoss participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/4/2003




On 7/4/2003 at 8:33pm, Pramas wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

ethan_greer wrote:
Ron, can you elaborate on the reasons underlying this opinion? It's not that I disagree - just seeking better understanding of where you (and Ryan, and others) are coming from.


One of the biggest problems with the OAs is that they a hybrid peer award/fan award and they serve neither group particularly well. The Academy determines the final slate of nominees and the votes of its members are weighted in the final public vote. Right now, the final vote is 50% Academy and 50% public. This system has all sorts of problems.

First, the Academy is a small group, currently less than 200 strong. It costs $30 to join for a year, and even though you usually get back far more than that in comps (many companies send out samples of their prodcuts during the process) many professionals never bother to join. This allows a large and motivated company like Wizkids to buy a lot of Academy memberships for their staffers--and they have a lot of staffers. Any company that can bring to bear 20-30 votes is likely to get whatever it wants on the final ballot and to get a nice chunk of the Academy weighted votes in the final ballot as well.

The public vote end of things has its own problems. Most gamers aren't particularly well informed about the nominees, so they tend to vote for companies, games, and brands they've heard of. Witness the Lord of the Rings RPG winning this year. I doubt most of the folks who voted for the game ever read it, never mind played it, but they like Lord of the Rings so they voted for it. People also tend to vote for "funny" products, which has led to comic books dominating the Best Periodical category for the last 5+ years. Witness Hackmaster as Game of the Year last year as well.

The upshot of all this is that while the OAs are supposed to recognize excellence in design, you can look through the winners in any given year and find many products that make you say, "WTF." Which creates a credibility problem, which makes people less interested in the awards, which sort of defeats the whole purpose of having them in the first place.

Nicole Lindroos, the new chairperson, has many plans to try address the issues, but as she's been chair for all of a week, she hasn't gotten the ball rolling yet. Hopefully, by the time she's done, people will be give the awards another chance.

Message 7050#73830

Previous & subsequent topics...
...started by Pramas
...in which Pramas participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/4/2003




On 7/4/2003 at 11:44pm, HinterWelt wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Being an academy member let me point out that the main problem which has been sited will remain a problem and there is little this restructuring will do to solve it.

The main problem people seem to be sighting is one of a "Popularity Contest". The initial list of games we received out lined so many I had never heard of and thus had no opinion on. Guess what, I also had much more important things to do than research the many games mentioned. In the end I voted for the games I had a knowledge of (I happen to own the LOTR game and was greatly disappointed with it). Whether you have the vote split into three (of which I qualify for all three) or have it based on an elite "Academy" it will still come down to what you know. I received a bunch of Hackmaster and Kenzer co stuff as a preview of their material. Up until then I had not owned a single Kenser co item. I was seriously offended that Hackmaster won last year(I was not a member of the academy then) after reviewing their products. To be honest, I will probably not renew my membership as I see no benefit in it.

Allow me to also say I do not see much benefit being a part of GAMA as an organization. I find the GPA to be a massively more beneficial organization and cheaper. I am a voting member there for $60 while it costs $300 to be a voting member in GAMA. This all comes back to the Origins Awards and what does it say about the org. Does it garner more sales for winners? I honestly do not know. Does it garner respect and is it something sought by the best of the best? All the companies I have ever talked to at the 3 GTS that I have attended fall into two groups. The small group of winners which claim it is a great honor and the larger group of individuals who really did not care.

In the end, I am not sure what Mr. Dancey’s motives are but the overall change would seem to be to the benefit of the big companies that are most popular. Sum zero. No effectual change.

My suggestion would be to either make it a popular vote award where every vote is weighted equally or make it an elite rotating staff made up of respected individuals from all parts of the gaming community but very finite. This could be along the lines of 2 retailers, 2 distributors, two manufacturers (including indie), 2 gamers. Make it no bigger than 12-15 and allow submissions by all nominees to these individuals for their review. Establish a criteria by which each category would be judged. If you want sales to be a driver make a category for it. Take the top 5 selling games and have them judged against each other. Other than that category ignore sales and judge games on its own merits. Some of these ideas were already expressed in this thread but I wanted to express my agreement.

All the above is of course my opinion and may be ignored at will.

Bill

Message 7050#73842

Previous & subsequent topics...
...started by HinterWelt
...in which HinterWelt participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/4/2003




On 7/7/2003 at 7:53pm, ryand wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Ron Edwards wrote: Hello,


In other words, Ryan, if you're looking for an indicator of RPGs' physical and commercial presence in our society, as a means of advertisement, why not jettison the whole "awards based on content" in the first place? Supposing that the numbers regarding profits and sales-volume could be gathered, just list the getters of the Mostest in order, as the winners of the awards. All done.


I'm convinced that an award process that is designed to select the "best" products by category is possible. And I think that doing so, because we lack the ability to make quantitative judgements about what is "best" due to the subjective nature of the question and the products involved, requires the use of a system based on multiple inputs.

The sales volume metric does a couple of interesting things. First, it essentially gives "the consumers" a vote at the table - their purchases matter in the selection process. Individually, I don't think that consumers always make the best purchasing choices. But in aggregate, I think that new hobby gaming products become bestsellers because they are of high quality first, and most other considerations second.

That market-based analysis is insufficient as a single factor though. Limits on distribution and awareness are obviously barriers to widespread success for some kinds of products. That's where the "peer review" component comes into play - especially in my "Special Master" revision. The "peer review" component would be insufficient by itself as well, because oftentimes peers become very focused on the selective parts of a product that relate to their own jobs, and it can be hard for peers to see the forest for the trees.

I believe that a combination of the two inputs offers a reasonably high chance that the nominations list will contain a mix of products that both peers and consumers will accept as "valid" by any reasonable test. A list constucted using just one of the two methods would fail that test.

If the list is considered "reasonable" by a large number of stakeholders, the resulting award will gain relevance as well. Making the winner more relevant is a key to making the whole Award system more useful and meaningful.

Message 7050#74051

Previous & subsequent topics...
...started by ryand
...in which ryand participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/7/2003




On 7/7/2003 at 8:51pm, Ron Edwards wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Hi Ryan,

Well, real-world data can go two ways.

1. Just as you describe, including multiple variables can result in identifying a "vector" among their distributions that is not expressed by any single one, but which means something on its own and can be named.

This is how biologists measure "size," for instance. No single variable is itself "size," but the aggregate portion of variance among different variables that all varies together can be called size.

2. Conversely, the vector can be mathematically derivable, but conceptually not worth the paper it's printed on. IQ is quite likely such a pseudo-variable ("reification"); the data used to get it make more sense as a set of separate variables or categories than their shared vector does as a single number (i.e., there's no "it").

So which is it for RPGs? Damn good question. I favor the latter. I'd be happier with two separate awards, one with its winners and runners-up based on commerce, and the other with its winners and runners-up based on content alone (and play thereof). Again, if a particular game scores really well, well then hey, it wins both awards.

You apparently favor the former, which is OK too - because frankly, distinguishing between the two phenomena in the real world is often very difficult, and relies very heavily on the nature of the original measured variables.

Best,
Ron

Message 7050#74068

Previous & subsequent topics...
...started by Ron Edwards
...in which Ron Edwards participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/7/2003




On 7/8/2003 at 8:22am, Bruce Baugh wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

I wanted to point out a waiting trap in thinking about awards based on sales, with an example.

WotC sold Everway in mixed palettes with Magic: The Gathering cards for a while. That is, distributors who wanted their M:TG also had to buy Everway. So a lot of copies of Everway left WotC. But those copies sitting in distributors' warehouses didn't all move on to retailers, and certainly retailers did not sell Everway in earthshaking quantities. What WotC sold and what gamers bought differed quite significantly.

That kind of thing happens all the time, too, though usually less extremely. Sometimes a company sends out a lot of copies...and then gets a lot of them back, in chain bookstore returns, stock abandoned by distributor collapse, and like that. Sometimes things fly to retailers, and then don't move, because end customers prove less interested for whatever reason.

What we'd need to have awards based on sales is genuinely reliable sales data - the equivalent of Soundscan and Bookscan, with verifiable data and methodology. That doesn't exist in gaming at all. There are some stores (physical and online) that have reliable point-of-sale data, and every single one I know of can discuss ways in which they're not representative. None of us actually knows what's sitting around not moving in J. Random Gamer's semi-hobby store. Or flying off the shelves there, for that matter.

Okay, I suppose we could have awards for companies most successful in selling to distributors, but it wouldn't mean anything even to most of us in the business, let alone to the public at large. The data that matter, I think, are the ones about customers at the far end of the chain are doing, and they are terra incognita to a very large degree.

Now if WotC and its regular associates were to back a big push for point-of-sale data collection and processing in the gaming business, that would be an enormous boon, and I'd sign on with much enthusiasm as long as the results remained open to inspection and verification.

Message 7050#74141

Previous & subsequent topics...
...started by Bruce Baugh
...in which Bruce Baugh participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/8/2003




On 7/8/2003 at 8:28am, Bruce Baugh wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

Ron Edwards wrote: So which is it for RPGs? Damn good question. I favor the latter. I'd be happier with two separate awards, one with its winners and runners-up based on commerce, and the other with its winners and runners-up based on content alone (and play thereof). Again, if a particular game scores really well, well then hey, it wins both awards.


This seems like a good way to go, to me.

Though I find myself pondering (and wrote about this on rpg.net, so I'm recycling a comment) whether there are meaningful comparisons across the whole of gaming.

Andy Kitkowski's awards deal with a population that I think does have a certain identity - the definition of indie rpg sets some boundaries, and the pool of games worth considering is of a manageable size. ENWorld's ENnie awards also encompass something that has an identity - the fact of being d20 (or OGL) draws some boundaries, and while the pool of possible contenders is very large, it's relatively easy to extract the subset that actually deserves serious consideration.

But then you get beyond communities like that and...I dunno. We're doing such different things in such different ways with such different assets and priorities. In theory, taxonomy like the Forge's could provide a conceptual frame of reference for looking at the whole field's ideas, but that would still leave the fact of varying format, both for individual works and their position in ongoing publishers' efforts.

I'm not crying doom here, mind. I honestly don't know.

Message 7050#74143

Previous & subsequent topics...
...started by Bruce Baugh
...in which Bruce Baugh participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/8/2003




On 7/8/2003 at 11:54am, kwill wrote:
just books

> What we'd need to have awards based on sales
> is genuinely reliable sales data - the
> equivalent of Soundscan and Bookscan, with
> verifiable data and methodology.

but hey, aren't most gaming products just books? (or am I just biased? :)

Nielsen Bookdata (I think the new name for Bookscan) seem to cover almost everything with an ISBN, I think what they'll miss are:

- books without ISBNs

- books not distributed through gigantic distributors (Ingram, Gardners et al)

...in other words, indie games

GAMA could use this data if their members distribute through the right channels

all in all, though, I'm in favour of seperate bestseller tracking and awards

also, perhaps take another look at the Oscar model? that said I can't remember exactly how it goes, something like...

1) nominations by relevant academy members (directors nominate for Best Director, actors nominate for Best Actor) and award voted by The Committee

or 2) nominations by all academy members, award voted by relevant academy members

(where academy is replaced by GAMA)

again, box office success is tracked seperately in this industry

here's hoping for the day I see a special issue of The Bookseller on roleplaying

Message 7050#74152

Previous & subsequent topics...
...started by kwill
...in which kwill participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/8/2003




On 7/8/2003 at 4:35pm, Bruce Baugh wrote:
RE: Submitted for Your Consideration: Changes to ORIGINS Awards

A lot of specialty shops aren't covered by Bookscan; this isn't unique to gaming, by any means.

Message 7050#74190

Previous & subsequent topics...
...started by Bruce Baugh
...in which Bruce Baugh participated
...in Publishing
...including keyword:

 (leave blank for none)
...from around 7/8/2003