# Information Theory

Teaching students
Suitable
Teaching educators
Suitable

## Preview slides with notes

We recommend previewing these slides on a larger screen to view the slides and speaker notes easily.

# Information Theory

## Key question

• How can information be measured?
• What is entropy?

## Claude Shannon

### 1916 - 2001

Juggler, mathematician, inventor...

I think I will ask if it is a T.
They will first ask me if it is a T. It is, so I will just say "Yes".
Yes!

Message:

a a a a a a a a a

What comes next?

Message:

Z q a v

What comes next?

Message:

a b c a b c a b c

What comes next?

?
?
?
?
?
?
?
?
?
?
?
?
?
?
?