Spading: Difference between revisions

From A KoL Wiki
imported>Zafoquat
imported>Clovis Sangrail
m Remove KoLSpading link; malware lies there these days.
 
(54 intermediate revisions by 21 users not shown)
Line 1: Line 1:
{{rewrite|comment=Page needs content and formatting.}}
Spading is all about figuring out how the game works.  From discovering new mechanics such as [[Semi-Rare Adventures]] and the effects of [[Harold's bell]], to figuring out the combat frequency in the castle, to finding the success rate of {{plural|tattered scrap of paper}}, spading involves the use of many different methods in order to discover the basic mechanics of the game.


All spading begins with a hunch.  Through regular adventuring, you realize that something interesting is happening, and want to find out if it's RNG or something deeper.  People realized that something wrong was going on while adventuring with +ML and combat modifiers, and it was this hunch that led to a concentrated spading effort to solve the [[Monster Level#Monster Level and Combat Rate Modifiers|new mechanic]].  Someone realized that the random numbers on {{plural|fortune cookie}} weren't [[Semi-Rare Adventures|so random]] after all.  It is moments of inspiration such as these that leads to most of the good spading done in the game.


Spading is a colloquialism for the process of pooling, organizing, and deciphering the raw data from a large string of adventures while under the effect of the same set of variables (skills items level area etc.)
WARNING: The historic KoLSpading third-party forum site is defunct, and subsequent operation of the domain has featured apparently malicious content.


==The Basics==


==The Basics==
When it comes to spading, the three most important things are: Sample size, sample size, and sample size.  The obvious implication of this is that 500 turns of data will be more precise than 15 turns of data, but that's not all.  If over the course of 500 turns an event happens 3 times, the margin of error is still quite large.  While a sample size of 500 is good for most things, a sample size of 3 is subject to huge RNG.
 
== Margin of error ==


A quick way to calculate how trustworthy your numbers are is to calculate the margin of error.  This is most often done by calculating the range of 95% confidence, which in turn is done by the following equation:


☼ The more adventures supporting your data the more your data supports the truth.
Error = 2 &times; [r &times; (1-r)/N]<sup>0.5</sup>, where r is the rate that an event occurred, and N is the sample size.


☼ The more specific the data record the more information and speculation can be drawn from the data
For example, if an item was found to drop 9 times in 61 adventures, then the rate is said to be 14.8% +/- 9.1%.  This further emphasizes the issue of sample size.  Due to the very small sample of actual drops in this case, the margin of error is almost as big as the calculated average!  In cases like these, much larger samples are required.


==Variables==
==Variables==
Variables are all the things that effect your character and it's abilities that are not constants. Depending on the scope of your project a small change in stats could dramaticly skew the final results, or the change could be in a variable that has no impact on the part of the results you're spading to get.


As a general rule of thumb you want to keep any variables you start spading with throughout your entire spading lot. ALL of your variables should be listed when you format your data at the end. If a variable DOES change while your spading and you think itll be of little impact please LIST that it changes and how it changed over the course of your lot. Alot of faulty infomation has been drawn from the final results of spading where people forget or incorrectly list their variables, for example the passive skill Expert Panhandling will throw off alot of spading lots if its not accounted for.
Besides sample size, the biggest difference between regular adventuring and spading involves your control over external variables. While adventuring, your [[Familiar abilities|Meat/item familiars]] will constantly be gaining weight, and you'll be swapping [[buff]]s and equipment.  While spading, it is important to know everything that is affecting your account at a given time and to keep these constant. For example, it is impossible to spade Meat drops with a constantly leveling [[Leprechaun]], unless the weight gains are explicitly stated!  When your results are displayed, usually it is taken for granted that all these secondary variables are constant, and that the only variables that are changing are those that are explicitly stated throughout the spading project. Plenty of spading data has had to be discarded because of people forgetting about passive skills, or what [[Strung-Up Quartet|ballroom song]] is set.  Make sure your data is of high quality and control all your secondary variables!


Some important variables to keep track of while spading are:
*[[Strung-Up Quartet|Ballroom song]]
*[[Moon sign]]s
*[[Buff]]s
*[[:Category:Passive Skills|Passive skills]]
*[[:Category:Equipment|Equipment]]
*Familiar [[Familiars by type|type]] and [[Familiar Weight|weight]]
*+[[Monster Level|ML]]


☼ Complete List of Variables ☼
=== Effects and wiki-reliability ===


Stats<br>
Try to only use equipment and skills with explicitly stated enchantments. When using things that don't explicitly state their effects, you are trusting someone else's spading - which may not be a reliable source. In particular, avoid effects with only qualitative descriptions.
Buffs<br>
Passives<br>
Equipment<br>
Environmental Effects (stat days etc)<br>
....<br>
....<br>
....<br>


==Formating==
==How can I help?==  
There are quite a few variations to how people choose to display their finished data. A table is a very typical solution illustrated below


Character: The RNG, level 253 Inscrutable Force
* Check the [[:Category:Needs Spading|Needs Spading]] category for a list of everything on the wiki for which spading has been requested.  Also see the [[TheKolWiki:Current Projects|Current Projects]] and [[:Category:Needs Content|Needs Content]].
* ALL new content needs to be spaded to some extent.
* Post your results on one of the spading forums, such as HCO [http://hardcoreoxygenation.com/forums/viewforum.php?f=20] or AFH [https://alliancefromhell.com/viewforum.php?f=10].  Take the feedback from more experienced spades and use it to refine your method.
* These forums are also great places to find projects you can help join, learning about the process of spading before you go about designing your own data collection and analysis.


Date: July 13th<br>
== Methods for spading various mechanics ==
Skills Used: None<br>
Buffs: None<br>
Familiar: 72-lb Fuzzy Dice<br>
Quest: ****<br>
Equipment: <br>
big bad voodoo mask<br>
antique spear<br>
incredibly creepy marionette<br>
pygmy nose-bone<br>
badass belt<br>
hemp string<br>
(A)nimal, (R)ectangle, (P)hlat Tire<br>
Enemies: paarrprprpapapaaprpppaarppaarpraarparrrprpa<br>
Adventures: 43<br>


A major part of spading involves discovering new and efficient ways of spading various gameplay mechanics.  Current methods may be too time consuming or imprecise for the mechanic you are trying to spade, but here is a partial list of some spading methods.


==Deciphering Basic Results==
Various items allow vastly simplified spading.
*The [[talking spade]] reveals item, meat, initiative and monster level, though this is only useful for items that don't display their bonuses, and making sure your drops are what you expect.
*The [[bakelite backpack]] lets you use [[Accordion Bash]] (with an accordion) to receive half of the monster's base meat drops.
*The [[perfectly fair coin]] (or the [[Live. Ascend. Repeat.]] path) eliminates RNG in determining monster item drops. The coin lasts for a single turn, so use [[free kills]] or [[Effect Duration|buff extenders]] to increase the effect. Note that using [[Macrometeorite]] to roll a new monster bring back the RNG, so don't do that!


So you just spent 1000 carefully executed and recorded adventures spading something of your interest. Then you went to all the trouble compiling and formatting your data to be legible. What do you do with it? How does this list of information tell you any facts about what you spaded?
===[[Combat Frequency]] Modifiers===
The [[The Penultimate Fantasy Airship|Penultimate Fantasy Airship]] noncombat [[Random Lack of an Encounter]] is useful for spading combat frequency modifiers, since the results for the choice "Head down to the galley" depend on your current modified noncombat rate.
*Assumption: The number of times "and on" is displayed varies according to 2 + Ceiling[ Floor(noncombat rate) / 3 ]


Using the RNG and its very simple spading lot you could come up with this statistic
Using this test:
*Run a net +noncombat on your character
*Choose the "Head down to the galley" choice and count the number of times "and on" is displayed
*Adjust your noncombat rate in intervals of 1% by adjusting the weight of a hound dog, and repeat the test
*After roughly 3 data points have been obtained, the total noncombat frequency modifier on your character can be calculated


Out of 43 adventures the RNG encountered 17 Phlat Tires 13 Animals and 13 Rectangles. From that you can figure out a guestimate the odds of fighting one mob over another.
===[[Combat Initiative]]===
While most initiative modifiers are explicitly given in the game, there can still be other methods that affect initiative (such as increased ML or underwater pressure penalties).


The smaller the spading lot the less accurate your results
Assumption: An increase or decrease in initiative will directly affect your chances of [[Run Away|running away]].


==How can I help?==  
To spade an increase or decrease in initiative, unequip all and turn off all ML effects.
* In the Current Project listings on the left-hand menu of the Wiki you can find a  
 
long list of articles tagged as needing spading.
# Pick a zone with one monster: [[the Dire Warren]], [[the Hedge Maze]], or using the [[drum machine]] or create a zone with one monster (using [[Banishing]] effects).
# Find your Point of No Escape (P). This is the level of modifiers (usually negative) where
## You cannot run away from a particular monster over 5 adventures.
## You can run away if you have 5% more initiative.
#* To determine this point, only use equipment that have a stated plus or minus initiative.
#* Avoid antique equipment, as this equipment tends to break during testing.
#* The [[1-ball]] is very useful, as it is the only common +5% initiative equipment.
# Once you have established your Point of No Escape, apply the effect or outfit you wish to test.
# Find your new Point of No Escape (Pn).
#* If you adventure and can run away, apply another -5% of initiative.
#* If you can adventure 5 times and cannot run away, apply another 5% of initiative.
# P - Pn is the initiative modifier.
 
===[[Meat from Monsters|Meat Drop Modifiers]]===
Spading Meat drops involves taking advantage of the way Meat bonuses are coded in the game.  Meat drops are first calculated from a continuous range of possible Meat drops, then +Meat bonuses are added, and finally the results are rounded down.  As a result, Meat drops caused by +Meat bonuses will not fall into a continuous range.  In fact, the precise set of Meat drops is unique to each amount of +Meat bonuses applied.
 
A helpful zone would be the [[Beanbat Chamber]], which has two monsters, [[Beanbat|one of which]] drops 28-40 Meat.  Once 9-10 unique Meat drops have been recorded, the unique set of meat drops can be compared to those possible with a wide range of meat bonuses to find the bonus in play.  15 turns of spading can often achieve results accurate to within 0.25% of the true bonus.
 
===[[Items from Monsters|Item drops]]===
*Assumption: [[Beanbat]]s have a 50.0% [[enchanted bean]] drop rate.  Therefore...
*With +100% items, a bean will drop every round
*If a bean fails to drop, less than 100% items have been applied.
 
Using this in a test:
*Apply +X% item drop and the unknown effect
*If a bean fails to drop, the unknown effect provides less than (100-X)% item drop bonus
**Retest with more than +X% item drops
*If after 300 turns you have acquired 300 beans, the unknown effect provides at least a (100-X)% item drop bonus.
**Retest with less than X% item drops and repeat.
* Starwed has made a helpful webpage for spading [http://ludonomicon.com/kol/bayes.html simple] and [http://ludonomicon.com/kol/CoffeeBayes.html complicated] item droprates.
 
===Deleveling===
Most skills and combat items that delevel do so explicitly, displaying the message below:{{delevel|att=X|def=Y}}
 
However, if you suspect that a skill or item delevels, you can use a [[Monster Manuel]] or [[tongue depressor]] to observe the monster's current Attack and Defense and any fluctation therein.
 
Prior to the explicit deleveling message, unarmed damage was used to determine deleveling effects. However, this method is not optimal given current resources.
 
===[[Conditional Drops]]===
''' This information is mostly obsolete -- there may now be conditional items which can drop from yellow rays, pickpocket attempts, or rave steal '''
 
There are several types of conditional drops, all outlined on the [[Conditional Drops]] page.  There is an easy way to check for conditional drops.  Using a [[Point at your opponent|major yellow ray]] from the [[He-Boulder]] (or a [[pumpkin bomb]] or anything else that causes the [[Everything Looks Yellow]] effect) forces all non-conditional items to drop from the monster.


* ALL new content needs to be spaded to some extent.
It is still possible for conditional items to drop when doing this, and they aren't distinguishable if they do drop.  The way to prevent them from dropping is to reduce your item drop modifiers to at least -100%.  Good items for this task are [[makeshift SCUBA gear]] and [[aerated diving helmet]], which combine to give -150% item drops.  By doing this, any item that drops is not a conditional drop, and any item that does not drop is a conditional drop.


* You are almost guaranteed to NOT do your first spading perfectly. Take the criticism you get as constructive and learn from it.
[[Category:Miscellaneous]]
[[Category:Statistics]]

Latest revision as of 20:31, 10 January 2021

Spading is all about figuring out how the game works. From discovering new mechanics such as Semi-Rare Adventures and the effects of Harold's bell, to figuring out the combat frequency in the castle, to finding the success rate of tattered scraps of paper, spading involves the use of many different methods in order to discover the basic mechanics of the game.

All spading begins with a hunch. Through regular adventuring, you realize that something interesting is happening, and want to find out if it's RNG or something deeper. People realized that something wrong was going on while adventuring with +ML and combat modifiers, and it was this hunch that led to a concentrated spading effort to solve the new mechanic. Someone realized that the random numbers on fortune cookies weren't so random after all. It is moments of inspiration such as these that leads to most of the good spading done in the game.

WARNING: The historic KoLSpading third-party forum site is defunct, and subsequent operation of the domain has featured apparently malicious content.

The Basics

When it comes to spading, the three most important things are: Sample size, sample size, and sample size. The obvious implication of this is that 500 turns of data will be more precise than 15 turns of data, but that's not all. If over the course of 500 turns an event happens 3 times, the margin of error is still quite large. While a sample size of 500 is good for most things, a sample size of 3 is subject to huge RNG.

Margin of error

A quick way to calculate how trustworthy your numbers are is to calculate the margin of error. This is most often done by calculating the range of 95% confidence, which in turn is done by the following equation:

Error = 2 × [r × (1-r)/N]0.5, where r is the rate that an event occurred, and N is the sample size.

For example, if an item was found to drop 9 times in 61 adventures, then the rate is said to be 14.8% +/- 9.1%. This further emphasizes the issue of sample size. Due to the very small sample of actual drops in this case, the margin of error is almost as big as the calculated average! In cases like these, much larger samples are required.

Variables

Besides sample size, the biggest difference between regular adventuring and spading involves your control over external variables. While adventuring, your Meat/item familiars will constantly be gaining weight, and you'll be swapping buffs and equipment. While spading, it is important to know everything that is affecting your account at a given time and to keep these constant. For example, it is impossible to spade Meat drops with a constantly leveling Leprechaun, unless the weight gains are explicitly stated! When your results are displayed, usually it is taken for granted that all these secondary variables are constant, and that the only variables that are changing are those that are explicitly stated throughout the spading project. Plenty of spading data has had to be discarded because of people forgetting about passive skills, or what ballroom song is set. Make sure your data is of high quality and control all your secondary variables!

Some important variables to keep track of while spading are:

Effects and wiki-reliability

Try to only use equipment and skills with explicitly stated enchantments. When using things that don't explicitly state their effects, you are trusting someone else's spading - which may not be a reliable source. In particular, avoid effects with only qualitative descriptions.

How can I help?

  • Check the Needs Spading category for a list of everything on the wiki for which spading has been requested. Also see the Current Projects and Needs Content.
  • ALL new content needs to be spaded to some extent.
  • Post your results on one of the spading forums, such as HCO [1] or AFH [2]. Take the feedback from more experienced spades and use it to refine your method.
  • These forums are also great places to find projects you can help join, learning about the process of spading before you go about designing your own data collection and analysis.

Methods for spading various mechanics

A major part of spading involves discovering new and efficient ways of spading various gameplay mechanics. Current methods may be too time consuming or imprecise for the mechanic you are trying to spade, but here is a partial list of some spading methods.

Various items allow vastly simplified spading.

The Penultimate Fantasy Airship noncombat Random Lack of an Encounter is useful for spading combat frequency modifiers, since the results for the choice "Head down to the galley" depend on your current modified noncombat rate.

  • Assumption: The number of times "and on" is displayed varies according to 2 + Ceiling[ Floor(noncombat rate) / 3 ]

Using this test:

  • Run a net +noncombat on your character
  • Choose the "Head down to the galley" choice and count the number of times "and on" is displayed
  • Adjust your noncombat rate in intervals of 1% by adjusting the weight of a hound dog, and repeat the test
  • After roughly 3 data points have been obtained, the total noncombat frequency modifier on your character can be calculated

While most initiative modifiers are explicitly given in the game, there can still be other methods that affect initiative (such as increased ML or underwater pressure penalties).

Assumption: An increase or decrease in initiative will directly affect your chances of running away.

To spade an increase or decrease in initiative, unequip all and turn off all ML effects.

  1. Pick a zone with one monster: the Dire Warren, the Hedge Maze, or using the drum machine or create a zone with one monster (using Banishing effects).
  2. Find your Point of No Escape (P). This is the level of modifiers (usually negative) where
    1. You cannot run away from a particular monster over 5 adventures.
    2. You can run away if you have 5% more initiative.
    • To determine this point, only use equipment that have a stated plus or minus initiative.
    • Avoid antique equipment, as this equipment tends to break during testing.
    • The 1-ball is very useful, as it is the only common +5% initiative equipment.
  3. Once you have established your Point of No Escape, apply the effect or outfit you wish to test.
  4. Find your new Point of No Escape (Pn).
    • If you adventure and can run away, apply another -5% of initiative.
    • If you can adventure 5 times and cannot run away, apply another 5% of initiative.
  5. P - Pn is the initiative modifier.

Spading Meat drops involves taking advantage of the way Meat bonuses are coded in the game. Meat drops are first calculated from a continuous range of possible Meat drops, then +Meat bonuses are added, and finally the results are rounded down. As a result, Meat drops caused by +Meat bonuses will not fall into a continuous range. In fact, the precise set of Meat drops is unique to each amount of +Meat bonuses applied.

A helpful zone would be the Beanbat Chamber, which has two monsters, one of which drops 28-40 Meat. Once 9-10 unique Meat drops have been recorded, the unique set of meat drops can be compared to those possible with a wide range of meat bonuses to find the bonus in play. 15 turns of spading can often achieve results accurate to within 0.25% of the true bonus.

  • Assumption: Beanbats have a 50.0% enchanted bean drop rate. Therefore...
  • With +100% items, a bean will drop every round
  • If a bean fails to drop, less than 100% items have been applied.

Using this in a test:

  • Apply +X% item drop and the unknown effect
  • If a bean fails to drop, the unknown effect provides less than (100-X)% item drop bonus
    • Retest with more than +X% item drops
  • If after 300 turns you have acquired 300 beans, the unknown effect provides at least a (100-X)% item drop bonus.
    • Retest with less than X% item drops and repeat.
  • Starwed has made a helpful webpage for spading simple and complicated item droprates.

Deleveling

Most skills and combat items that delevel do so explicitly, displaying the message below:

Monster AttackMonster attack power reduced by X
Monster DefenseMonster defense reduced by Y

However, if you suspect that a skill or item delevels, you can use a Monster Manuel or tongue depressor to observe the monster's current Attack and Defense and any fluctation therein.

Prior to the explicit deleveling message, unarmed damage was used to determine deleveling effects. However, this method is not optimal given current resources.

This information is mostly obsolete -- there may now be conditional items which can drop from yellow rays, pickpocket attempts, or rave steal

There are several types of conditional drops, all outlined on the Conditional Drops page. There is an easy way to check for conditional drops. Using a major yellow ray from the He-Boulder (or a pumpkin bomb or anything else that causes the Everything Looks Yellow effect) forces all non-conditional items to drop from the monster.

It is still possible for conditional items to drop when doing this, and they aren't distinguishable if they do drop. The way to prevent them from dropping is to reduce your item drop modifiers to at least -100%. Good items for this task are makeshift SCUBA gear and aerated diving helmet, which combine to give -150% item drops. By doing this, any item that drops is not a conditional drop, and any item that does not drop is a conditional drop.