The rules of probability

In probability, we have some rules that become very useful when visualization gets too cumbersome. These rules help us calculate compound probabilities with ease.

The addition rule

The addition rule is used to calculate the probability of either or events. To calculateThe addition rule, we use the following formula:

The addition rule

The first part of the formula (P(A) + P(B)) makes complete sense. To get the union of the two events, we have to add together the area of the circles in the universe. But why the subtraction of P(A and B)? This is because when we add the two circles, we are adding the area of intersection twice, as shown in the following diagram:

The addition rule

See how both the red circles include the intersection of A and B? So, when we add them, we need to subtract just one of them to account for this, leaving us with our formula.

You will recall that we wanted the number of people who either had cancer or had a positive test result. If A is the event that someone has cancer, and B is that the test result was positive, we have the following:

P(A or B) = P(A) + P(B) - P(A and B) = .25 + .30 - .2 = .35

This is represented visually in the following diagram:

The addition rule

Mutual exclusivity

We say that two events are mutually exclusive if they cannot occur at the same time. This means that A∩B= , or just that the intersection of the events is the empty set. When this happens, P(A ∩ B) = P(A and B) = 0.

If two events are mutually exclusive, then the following applies:

P(A B) = P(A or B)= P(A) + P(B) − P(A ∩ B) = P(A) + P(B)

This makes the addition rule much easier. Some examples of mutually exclusive events include the following:

  • A customer seeing your site for the first time on both Twitter and Facebook
  • Today is Saturday and today is Wednesday
  • I failed Econ 101 and I passed Econ 101

None of these events can occur simultaneously.

The multiplication rule

The multiplication rule is used to calculate the probability of and events. To calculate P(A ∩ B) = P(A and B), we use the following formula:

P(A ∩ B) = P(A and B) = P(A) P(B|A)

Why do we use B|A instead of B? This is because it is possible that B depends on A. If this is the case, then just multiplying P(A) and P(B) does not give us the whole picture.

In our cancer trial example, let's find P(A and B). To do this, let's redefine A to be the event that the trial is positive, and B to be the person having cancer (because it doesn't matter what we call the events). The equation will be as follows:

P(A ∩ B) = P(A and B) = P(A) P(B|A) = .3 * .6666 = .2 = 20%

It's difficult to see the true necessity of using conditional probability, so let's try another, more difficult problem.

For example, of a randomly selected set of 10 people, 6 have iPhones and 4 have Androids. What is the probability that if I randomly select 2 people, they both will have iPhones? This example can be retold using event spaces, as follows:

I have the following two events:

  • A: This event shows the probability that I choose a person with an iPhone first
  • B: This event shows the probability that I choose a person with an iPhone second

So, basically, I want the following:

  • P(A and B): P(I choose a person with an iPhone and a person with an iPhone)

So, I can use my P(A and B) = P(A) P(B|A) formula.

P(A) is simple, right? People with iPhones are 6 out of 10, so, I have a 6/10 = 3/5 = 0.6 chance of A. This means P(A) = 0.6.

So, if I have a 0.6 chance of choosing someone with an iPhone, the probability of choosing two should just be 0.6 * 0.6, right?

But wait! We only have 9 people left to choose our second person from, because one was taken away. So, in our new transformed sample space, we have 9 people in total, 5 with iPhones and 4 with Androids, making P(B) = 5/9 = .555.

So, the probability of choosing two people with iPhones is 0.6 * 0.555 = 0.333 = 33%.

I have a 1/3 chance of choosing two people with iPhones out of 10. The conditional probability is very important in the multiplication rule as it can drastically alter your answer.

Independence

Two events are independent if one event does not affect the outcome of the other, that is P(B|A) = P(B) and P(A|B) = P(A).

If two events are independent, then the following applies:

P(A ∩ B) = P(A) P(B|A) = P(A) P(B)

Some examples of independent events are as follows:

  • It was raining in San Francisco, and a puppy was born in India
  • I flip a coin and get heads, and I flip another coin and get tails

None of these pairs of events affect each other.

Complementary events

The complement of A is the opposite or negation of A. If A is an event, Ā represents the complement of A. For example, if A is the event where someone has cancer, Ā is the event where someone is cancer free.

To calculate the probability of, Ā, use the following formula:

P(Ā) = 1 − P(A)

For example, when you throw two dice, what is the probability that you rolled higher than a 3?

Let A represent rolling higher than a 3.

Ā represents rolling a 3 or less.

P(A) = 1 − P(Ā)

P(A) = l - (P(2)+P(3))

= 1 - (2/36 + 2/36)

= 1 - (4/36)

= 32/36 = 8 / 9

= .89

For example, a start-up team has three investor meetings coming up. We will have the following probabilities:

  • A 60% chance of getting money from the first meeting
  • A 15% chance of getting money from the second
  • A 45% chance of getting money from the third

What is the probability of them getting money from at least one meeting?

Let A be the team getting money from at least one investor, and, Ā, be the team not getting any money. P(A) can be calculated as follows:

P(A) = 1 − P(Ā)

To calculate P(Ā), we need to calculate the following:

P(Ā) = P(no money from investor 1 AND no money from investor 2 AND no money from investor 3)

Let's assume that these events are independent (they don't talk to each other):

P(Ā) = P(no money from investor 1) * P(no money from investor 2) * P(no money from investor 3) =

0.4 * 0.85 * 0.55 = 0.187

P(A) = 1 - 0.187 = 0.813 = 81%

So, the start-up has an 81% chance of getting money from at least one meeting!

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset