A major source of difficulty in many real-world artificial intelligence applications is that many of the factors of variation influence every single piece of data we are able to observe:
- The individual pixels in an image of a red car might be very close to black at night.
- The shape of the car’s silhouette depends on the viewing angle.
Most applications require us to disentangle the factors of variation and discard the ones that we do not care about.