View source for Spading

Spading is all about figuring out how the game works.  From discovering new mechanics such as [[Semi-Rare Adventures]] and the effects of [[Harold's bell]], to figuring out the combat frequency in the castle, to finding the success rate of {{plural|tattered scrap of paper}}, spading involves the use of many different methods in order to discover the basic mechanics of the game.

All spading begins with a hunch.  Through regular adventuring, you realize that something interesting is happening, and want to find out if it's RNG or something deeper.  People realized that something wrong was going on while adventuring with +ML and combat modifiers, and it was this hunch that led to a concentrated spading effort to solve the [[Monster Level#Monster Level and Combat Rate Modifiers|new mechanic]].  Someone realized that the random numbers on {{plural|fortune cookie}} weren't [[Semi-Rare Adventures|so random]] after all.  It is moments of inspiration such as these that leads to most of the good spading done in the game.


==The Basics==

When it comes to spading, the three most important things are: Sample size, sample size, and sample size.  The obvious implication of this is that 500 turns of data will be more precise than 15 turns of data, but that's not all.  If over the course of 500 turns an event happens 3 times, the margin of error is still quite large.  While a sample size of 500 is good for most things, a sample size of 3 is subject to huge RNG.

== Margin of error ==

A quick way to calculate how trustworthy your numbers are, is to calculate the margin of error.  This is most often done by calculating the range of 95% confidence, which in turn is done by the following equation:

Error = 2* [r*(1-r)/N]^0.5, where r is the rate that an event occurred, and N is the sample size.

For example, if an item was found to drop 9 times in 61 adventures, then the rate is said to be 14.8% +/- 9.1%.  This further emphasizes the issue of sample size.  Due to the very small sample of actual drops in this case, the margin of error is almost as big as the calculated average!  In cases like these, much larger samples are required.

==Variables==

Besides sample size, the biggest difference between regular adventuring and spading involves your control over external variables.  While adventuring, your [[Familiar abilities|Meat/item familiars]] will constantly be gaining weight, and you'll be swapping [[buff]]s and equipment.  While spading, it is important to know everything that is effecting your account at a given time and to keep these constant.  For example, it is impossible to spade Meat drops with a constantly leveling [[Leprechaun]], unless the weight gains are explicitly stated!  When your results are displayed, usually it is taken for granted that all these secondary variables are constant, and that the only variables that are changing are those that are explicitly stated throughout the spading project.  Plenty of spading data has had to be discarded because of people forgetting about passive skills, or what [[Strung-Up Quartet|ballroom song]] is set.  Make sure your data is of high quality and control all your secondary variables!

Some important variables to keep track of while spading are:
*[[Strung-Up Quartet|Ballroom song]]
*[[Buff]]s
*[[:Category:Passive Skills|Passive skills]]
*[[:Category:Equipment|Equipment]]
*Familiar [[Familiars by type|type]] and [[Familiar Weight|weight]]
*+[[Monster Level|ML]]

=== Effects and wiki-reliability ===

Try to only use equipment and skills with explicitly stated enchantments.  When using things that don't explicitly state their effects, such as most [[:Category:Usable Items|usable items]] and most [[:Category:Effects|status effects]], you are trusting someone else's spading - which may not be a reliable source.  While items that modify [[familiar weight]] are easy to check, items that modify [[Damage Reduction|DR]], [[Items from Monsters|item drops]], or [[Combat Initiative|initiative]] are hard to spade reliably.  For example, when attempting to get a certain amount of +items for a spading project, stay away from [[Candy Hearts|candy hearts]] and [[Oyster Egg Day#Item Effects|oyster eggs]].

==How can I help?== 

* Check the [[:Category:Needs Spading|Needs Spading]] category for a list of everything on the wiki for which spading has been requested.  Also see the [[TheKolWiki:Current Projects|Current Projects]] and [[:Category:Needs Content|Needs Content]].
* ALL new content needs to be spaded to some extent.
* Post your results on one of the spading forums, such as HCO [http://jick-nerfed.us/forums/viewforum.php?f=20] or AFH [http://afh.s4.bizhat.com/viewforum.php?f=10&mforum=afh].  Take the feedback from more experienced spades and use it to refine your method.
* These forums are also great places to find projects you can help join, learning about the process of spading before you go about designing your own data collection and analysis.

== Methods for spading various mechanics ==

A major part of spading involves discovering new and efficient ways of spading various gameplay mechanics.  Current methods may be too time consuming or imprecise for the mechanic you are trying to spade, but here is a partial list of some spading methods.

===[[Meat from Monsters|Meat Drops]]===
Spading Meat drops involves taking advantage of the way Meat bonuses are coded in the game.  Meat drops are first calculated from a continuous range of possible Meat drops, then +Meat bonuses are added, and finally the results are rounded down.  As a result, Meat drops caused by +Meat bonuses will not fall into a continuous range.  In fact, the precise set of Meat drops is unique to each amount of +Meat bonuses applied.

A helpful zone would be the [[Beanbat Chamber]], which has a [[Beanbat|single monster]] that drops 28-40 Meat.  Once 9-10 unique Meat drops have been recorded, the unique set of meat drops can be compared to those possible with a wide range of meat bonuses to find the bonus in play.  15 turns of spading can often achieve results accurate to within 0.25% of the true bonus.

===[[Combat Frequency]] Modifiers===
The [[The Penultimate Fantasy Airship|Penultimate Fantasy Airship]] noncombat [[Random Lack of an Encounter]] is useful for spading combat frequency modifiers, since the results for the choice "Head down to the galley" depend on your current modified noncombat rate.
*Assumption: The number of times "and on" is displayed varies according to 2 + Ceiling[ Floor(noncombat rate) / 3 ]

Using this test:
*Run a net +noncombat on your character
*Choose the "Head down to the galley" choice and count the number of times "and on" is displayed
*Adjust your noncombat rate in intervals of 1% by the addition or subtraction of +5ML (to a minimum of +0ML), and repeat the test
*After roughly 3 data points have been obtained, the total noncombat frequency modifier on your character can be calculated

===[[Items from Monsters|Item drops]]===
*Assumption: [[Beanbat]]s have a 50.0% [[enchanted bean]] drop rate.  Therefore...
*With +100% items, a bean will drop every round
*If a bean fails to drop, less than 100% items have been applied.

Using this in a test:
*Apply +X% item drop and the unknown effect
*If a bean fails to drop, the unknown effect provides less than (100-X)% item drop bonus
**Retest with more than +X% item drops
*If after 300 turns you have acquired 300 beans, the unknown effect provides at least a (100-X)% item drop bonus.
**Retest with less than X% item drops and repeat.

===[[Monster Level]]===
Assumption: Stat gain is ML/4.  Fractional stat gains give a percent chance of extra stats.

Using this test:
*Calculate the stat gains from a monster
*If gain is not constant, adjust MCD-likes to between 1 and 3, until stat gain is constant
*ML is now (stats*4-MCD)

===Deleveling===
Assumption: Unarmed combat will have a fixed level of [[Weapon Damage#Weapon Damage Formula|damage]]:
<center>min(muscle/4-monster moxie,0) + 1 + C + damage bonuses</center>

where C is 1 for critical hits, 0 for non-critical hits.

Using this test:
* Select a zone where the highest [[Monster Level|monster level]] is 5-10 points below your muscle/4.
* Adventure, using the following sequence:
** Hit the monster until successful. Record damage as D0, subtracting 1 if its a critical hit.
** Use the delevelling item.
** Hit the monster again until successful. Record damage as D1, again subtracting 1 if critical.
** Use the delevelling item.
** Repeat.

The amount delevelled will be Dn - D(n-1). Keep track of these values to get a range of values and distribution.