Balance as a Wicked Problem
What is a Wicked Problem? It is a concept originally derived for social/political planning problems by Rittel & Webber in 1973 as having 10 characteristics (borrowing from Wikipedia for this):
1) There is no definite formulation of a wicked problem.
2) Wicked problems have no stopping rule?
3) Solutions to wicked problems are not true-false, but better or worse.
4) There is no immediate and ultimate test of a solution to a wicked problem.
5) Every solution to a wicked problem is a "one-shot operation"; because there is no opportunity to learn by trial and error, every attempts counts significantly.
6) Wicked problems do not have an enumerable (or an exhaustively describable) set of potential solutions; nor is there a well-described set of permissible operations that may be incorporated into the plan.
7) Every wicked problem is essentially unique.
😎 Every wicked problem can be considered a symptom of another problem.
9) The existence of a discrepancy representing a wicked problem can be explained in numerous ways. The choice of the explanation determines the nature of the problem's resolution.
10) The social planner has no right to be wrong (i.e. planners are liable for the consequences of the actions they generate).
I keep on returning to this concept as I read all the different discussions of balance on this forum. While the framework above needs to be adjusted from a social planning framework to Age of Sigmar I think it can be incredibly helpful in sorting out why these discussions (a) get so heated and (b) rarely seem to lead to consensus conclusions.
The first condition requires little if any adjustment as if 10 people are having a discussion of balance it is easy to pick out at east 12 different definitions of balance or more bouncing back and forth. I want to be clear, this is a comment on quantity, the quality of these definitions is often excellent yet the very lack of any consensus highly that none of these definitions are, well, definitive. Given this I feel comfortable saying the issue of Balance in Age of Sigmar meets the first condition.
Is there a stopping rule in Age of Sigmar? While there are definitive ends to individual games (i.e. individual games do have a stopping rule) as a system Age of Sigmar is not deigned with a definitive end. Of course there will be new editions (3.0 seems inevitable this Summer) but in general these are conceived as updates or evolutions. I guess we could argue that transition from Warhammer Fantasy Battles to Age of Sigmar represented a true "stop" but even then originally a majority of the armies and models transferred over to the new format. All in I feel pretty comfortable in arguing that there is no stopping rule for Age of Sigmar as a system and thus the issue of Balance in Age of Sigmar meets the second condition.
The third condition is one which I believe would be very fruitful to return to as a whole entire blog post could probably just be written about this one issue. Certainly there are those who argue that there are absolute answers or solutions to the problem of balance in these forums. Yet the response to their proposals suggest that they are far from convincing others. So if there is a greater truth to be found regarding Balance in Age of Sigmar I think it is fair to say we haven't found it yet. On the other hand reading these threads you can often see a consensus forming around what is good, better and even sometimes best and visa versa. Again, I think this is an issue worth discussing in deeper detail but for now I will suggest that the issue of Balance in Age of Sigmar meets the third condition.
I've already written a blog post expressing my belief that you have to play the games. One of the stronger areas of consensus on these threads is that new Battletomes could use more playtesting - though even here there is a contrarian perspective that some of the problems should have been obvious.... If we look at each Battletome and each points update as a "solution" to the issue of Balance in Age of Sigmar though is there any other way to test these solutions except to see how everything plays out on the table top? And given how massively multivariate Age of Sigmar is arguably we need lots and lots and lots of games for certain aspects (particularly large point updates). This suggests the lack of an immediate test but what about an ultimate test? Absent a complete pause in new tomes, models, etc. (again, the lack of a stopping rule) there can be no ultimate test as Age of Sigmar is always evolving. I'm not as confidant in the fourth condition but I think it is okay for now to say that the issue of Balance in Age of Sigmar meets this condition.
The 5th & 6th conditions are the toughest to translate into Age of Sigmar's context. Again, in principle each time GW releases a new battletome or resets the points they are testing. Until recently (looking at you LRL) though we could consider each of those tomes as a "one-shot operation". The real question in regards to Age of Sigmar comes in that balance between trial & error and every shot counting significantly. I believe a lot of the frustration with GW comes from the fact that they do seem to get an above average number of trials with the increased frequency of releases but players struggle to see where the learning is coming from. That issue is clearly compounded though by the reality that every trial does seem to count significantly based on the responses new tomes receive from both their players and their opponents. If I emphasize the latter point then we can say that Balance in Age of Sigmar at least partially satisfies the fifth condition.
At first glance though there does seem to be an enumerable/exhaustive set of potential solutions in points, changes to the war scrolls which seem well described. So it is not unreasonable to say that Balance in Age of Sigmar may not meet the 6th condition. But again the context of the game matters and thus I think it is worthwhile to jump ahead to the 8th condition where whether the problem of balance can be considered a symptom of other problems in Age of Sigmar and how this may interact with the solution set. Here I think the issue of feedback loops are vital to the discussion as what quickly becomes clear in reading these threads is how often the solution to one problems creates another. To use a popular recent example a lot of the solutions (not all to be clear) to LRL Sentinels would seem to devastate other factions. LRL Sentinels are certainly not unique in this way.
AoS is chockful of feedback loops and a lot (though again not all) of the issues of balance arise out of these feedback loops. Put another way it may not be a war scroll in and of itself that is a problem but how that war scroll interacts with another war scroll's buff, a sub-faction ability, a spell and/or a battalion bonus. This would be an example of a runaway positive feedback loop where something that may just be okay to good becomes great to OP once all the factors are applied. There are examples of negative feedback loops (where an ability sounds great but the conditions required to make it work, whether from a points basis in support units or the limited range of an aura ultimately make it impractical) but these are less an issue when it comes to balance. In theory solving a positive feedback loop is simple as removing one piece of the puzzle often causes the whole buff stack to collapse.
But here's where the problems begin. All too often removing a piece of a buff stack causes ripples across the rest of a faction. While that aura may be too good for unit X, without it units Y & Z are kneecapped for example. Given so many of these buffs, are for example, KEYWORD based, and that GW has tried to a certain extent limit KEYWORD proliferation it may become a binary issue. Either remove the buff entirely to prevent X being OP and accept the weakening of Y & Z or visa versa.
Again, I can continue to go on with the 8th condition just like I could the 3rd but for now I think it suffices to say I believe that the issue of Balance in Age of Sigmar meets the 8th condition. With that knowledge I think it worthwhile to briefly return to the 6th condition and acknowledge that while the "solutions" may be more easily enumerable/exhaustive than the wicked problems of the original social/political planning issues the framework was designed for, the commonality of the difficulty in parsing apart the feedbacks loops in order to derive truly discrete solutions means we can argue for at least a weak case for Balance in Age of Sigmar meeting the 6th condition.
After that difficulty fortunately condition 7 is a reasonably straight forward case. Balance in Age of Sigmar cannot be solved by importing a solution from a different gaming system. Certainly you can try and incorporate best practices from another system (see the push & pull between AoS & 40K in recent editions) but there is always an adjustment necessary to factor in the unique rule sets and numerous war scroll interactions. Thus while it can be useful to look at gaming systems perceived as having more balance it is never as simple as just doing the same thing in AoS.
The 9th condition, like the 3rd and 8th, is one that we could spend multiple blog posts on. Having read about balance in as many threads as I have I feel fair to say that so much of the discussion/debate is over how to define the problem. The question I often ask myself when reading though is the order of operation. Are people arguing for a given definition because they believe it is accurate and thus they are willing to accept the resolution that logically arrives from that definition? Or, consciously or sub-consciously, are they starting rom their preferred solution and working backwards? Regardless, I think Balance in Age of Sigmar strongly meets the 9th condition.
How about the last one? I think it is fair to say that the position of many on these threads is that GW has no right to be wrong...
So if we can argue that Balance in Age of Sigmar is a Wicked Problem does that gain us anything or leave us in an even worse spot? Rittel & Webber fortunately offered another shorter set of characteristics that I think are helpful (again, thank you wikipedia):
1) The solution depends on how the problem is framed and visa versa (i.e. the problem definition depends on the solution)
Honest AND HUMBLE discussion & definition is more likely to lead to progress than debating solutions whilst different parties hold different definitions. The key is the honesty and the humility. If it is a wicked problem than suggestions that the definitions are obvious and/or indisputable is NOT helpful. Part of that humility is recognizing that you're never likely to convince everyone and that those you don't convince are not bad/stupid/ignorant etc. they just are coming at a wicked problem from a different perspective. Than carryover that honesty and humility when you try and get your solutions implemented (unless you work for GW chances are this will be more in the context of TO rulings or tournament conditions), especially when it comes to how that solution may impact other players.
2) Stakeholders have radically different world views and different frames for understanding the problem.
There are so many different stakeholders when it comes to Age of Sigmar. Recognize that no one voice can speak for all of them. Recognize that no one framework can represent all of them. The solutions that work for one set of stakeholders may not for another. There is unlikely to be any solution that makes every stakeholder happy. If you are currently among the happier stakeholders, have empathy for the less happy. If you are among the less happy, please don't subscribe to a "misery loves company" approach either in stoking the negative sentiment of others or trying to diminish the enjoyment of the game for others who are not (as?) impacted by the issue(s) you are facing but rather work to positively contribute to the debate surrounding the definitions of the problem and look for ways things can get better.
3) The constraints that the problem is subject to and the resources need to solve it change over time.
AoS has a variety of different constraints ranging from the cost to build an army (whether defined in money or time), the points limits of a given match, the rules for list construction (e.g. battle line or available allies) to simply finding other players to play against. Different stakeholders have different access to these resources. At different times in their gaming lifecycle different constraints will arise (ahh, the joys of trying to find time to game with a new child... or finding ways to play during a pandemic).
It is worth remembering though that it is not just players that face constraints. GW only has so much production capacity. New launches require vast timelines. Stores have limited space to carry inventory, etc.
All of these constraints and resource limitations may only indirectly effect Balance in Age of Sigmar but they're ones we can all probably find a few we can relate to or understand. It is helpful to keep constraints and limitations, yours and those of others, in mind when discussing & debating a wicked problem.
4) The problem is never solved definitively.
Unless a stopping rule for AoS arises (and again, I think that would be a bad thing) any balance is more likely to be a brief point of transition in a longer journey rather than a permanent resting place. If we ever get there enjoy it while it lasts as some new balance issue will inevitably arise. The good news about this? We'll never run out of things to talk about on these threads!
- 3
10 Comments
Recommended Comments