What is the difference between probability and statistics?

The problems considered by probability and statistics are inverse to each other:

  • In probability theory we consider some underlying process which has some randomness or uncertainty modeled by random variables, and we figure out what happens.
  • In statistics we observe something that has happened, and try to figure out what underlying process would explain those observations.

stats.stackexchange.com/a/675