In the real, physical class we learned to count yesterday. Elementary combinatorics, I mean. Figured out what “n!” and “n choose k” and the like meant and how that married with probability and produced a binomial distribution. Pure mechanics. (We begin Chapter 4 today.)
I trust, dear reader, if you don’t already know these things you can read over the class notes to learn, or can find one of hundreds of internet sites which have this sort of information. It is of some interest and we will later use the binomial for this and that. If my Latex renderer is working, you should be able to see this formula for the binomial (if not, even Wikipedia gets this one right):
Now the thing of interest for us is that we must have some evidence, or list of premises, or propositions taken “for the sake of argument”, that we assume are true and which state, E = “There is some X which can and must take one of two states, a success or a failure, and the chance X is a success is always p; plus, X can be a success anywhere from k = 0, 1, 2, …, n times.” Then, given this E, the formula above gives the probability that in n attempts we see k successes.
An example of an X can be X = “A side shows 6.” Now given the evidence (we have seen many times before) Ed = “There is a six-sided object to be tossed, just one side is labeled ’6′, and just one side can show” we know that
Pr(X | Ed) = 1/6 = p.
Notice that if n = k = 1, then the binomial formula just reproduces p.
Here is where it gets tricky, and where mistakes are made. Notice that Ed is evidence we assume is true. Whether it really is true (with respect to any other external evidence) is immaterial, irrelevant. Also notice—and here is the juice; pay attention—Ed says nothing about a real, physical die. We are still in the realm of pure logic. And logic is just a study of the relation between propositions: it is silent on the nature of the propositions themselves.
So for instance, let Em = “Just one-sixth of all Martians wear a hat” and let Y = “The next Martian to pass by wears a hat.” Thus
Pr(Y | Em) = 1/6 = p.
For the next n Martians that pass by, we could calculate the probability that k = 0, or k = 1, or … k = n of them wear a hat. Even though, of course, given our observational evidence that there are no Martians, no Martian will ever pass by.
(If you are sweating over this, remove “Just one-sixth of” from Em; Pr(Y|Em) = 1 and then we can still us the binomial to calculate the probability that the next k of n Martians wears a hat.)
Probability, like all logical statements, are measures of information, and information between propositions. The propositions do not have to represent real, physical objects. Pick up any book of introductory logic to convince yourself of this.
Where people go wrong in statistics in not starting with the reminder that probability is logical, a branch of logic. Thus they confuse Ed with saying something about real dice. They ask questions like, “How do we know the die isn’t weighted? How do we know how it’s tossed? How much spin is imparted? What kind of surface is the die tossed onto? What about the gravitational field into which the die is tossed? Is there a strong breeze?”
All of those (and many, many more) are excellent questions to ask about real dice, but all of them are absolutely irrelevant to Ed and to our absolute, deduced knowledge that Pr(X | Ed) = 1/6.
It is only later, after we learn the formal rules of probability, some basic mechanics, but more importantly after we have fully assimilated the interpretation of probability, do we invert things and ask questions like, “Given that we have seen so many real-life tosses of this real-life die, in this certain real-life situation, what is the probability we will see a 6 on the very next roll?”
Make sure you see the difference between that last question and the one above using the binomial using Ed or Em.
Read over Chapter 2 and be sure you understand the four most basic rules of probability (the mechanics stuff).
Correct any typos in this post.