Tuesday, September 28, 2010

[Book] False Positives and Positive Fallacies



Conditional Probability

We learned earlier that more details can lead to more restriction and reduce the corresponding probability. More specifically, the probability of event A is always greater than the probability of events A and B.

But details do not always reduce the probability. It can increase the probability by shrinking the sample space. We can be more sure that a specific outcome will occur if we can cross off some of the sample space. This is known as “Bayes’ Theorem”.


Bayes’ Theorem

If you recall, Bernoulli considered the question

“Given a specified number of white and black balls in an urn, what is the probability of drawing a black ball?”

There is a minister and mathematician, who was interested in the following problem

“Given that one or more balls has been drawn, what can be said about the number of white and black balls in the urn?”

His name is Thomas Bay. He coined two terms.

  • Prior probability: The basic probability or initial estimation of an event
  • Posterior probability: The probability of the same event, when given more information (e.g., some of the balls are removed).
False Positive

Consider an HIV testing scenario. With 10,000 test subjects, suppose the result is shown below:


Suppose your blood test is HIV positive. What is the chance that you are not infected? It’s not uncommon to think that the chance is pretty slim (i.e., 10 in 10,000 or 1%). And, you might think that you will not live long enough to see your grandchild.

This is another fallacy. Look at what you are considering. You are comparing false positive test to all test subjects regardless of their test results. What you should really looking for is as follows
“Among those whose blood test is positive, how many people are not infected?”
Then, you will see that the error is 10 (false positive) in 10+1 (blood test is positive). The error is around 91%! On the other hand, there is no chance (0), that you will be infected if you blood test is negative. So you might consider taking the test again, if you blood test might turn out positive. But you do not need to take another test if your blood test is negative. The test result per se is necessary but not sufficient. We need to factor in the relevant sample space.

Fallacy: Prosecutor’s Fallacy

Prosecutor’s fallacy is statistical misconceptions when making legal arguments. Common prosecutor’s fallacy includes, for example, drug test, and DNA test.


Source: The Drunkard's Walk: How Randomness Rules Our Lives by Leonard Mlodinow, Chapter 6 [Read the Book Review] [Read the Previous Part] [Read the Next Part].

---------------------------------------------------------------------------------------------------------
Book or Audiobooks?


Personally, I prefer audiobooks. It's fun, and I can listen when I'm doing something else. It also makes other activities (e.g., jogging) a lot more fun. For more detail about audiobooks, please read [this post].

There is one more reason that may encourage you to go for the audiobook version. You can get it now for FREE. Audible offers you a free trial for 14 days. Even if you get the book and cancel the subscription right away (so that you don't have to pay), you can keep the book. And, don't worry if you lost the audiobook file. Just log into audible.com. You can keep downloading the over and over again.


About the summary: It takes time to finish up a book. And, when you do, sometimes, you want to review what you learn from the book. If you do not make notes as you read, you might have to go through the book once again. This can be time-consuming when you are dealing with a book. But you can still flip through the book and locate what you are looking for

However, when the material is an audiobook, it is extremely hard to locate a specific part of content. Most likely you will have to listen to the entire audiobook once again.

This book summary will help solve the pain of having to go through the book all over again.

I am leaving out the details of the books. Most books have interesting examples and case studies, not included here. Reading the original book would be much more entertaining and enlightening. If you like the summary, you may want to get the original from the source below.

No comments: