Thursday, June 21, 2018

Why Do Movies Move?

If you spend time watching movies or TV, you have probably know that you see a moving image on the screen, but that the sense of motion is created by your brain from a series of static images.  Typical movies, for example, flash 24 frames per second.  Somehow, the brain takes the changes from one frame to the next and gives you the illusion of fluid movement. 
How does that happen?  Take a moment to try to explain it to yourself.
This question is just one of many that is explored in a great book that came out in 2015 called Flicker by cognitive neuroscientist Jeff Zacks.  The book itself explores a variety of topics ranging from low-level aspects of the way the visual system understands the images on the screen all the way to high-level topics like the reason why movies are so good at creating emotion.
So, why do movies move?
You might think that what is happening is that each image persists a little on the retina (the cells at the back of your eye that respond to light) and that changes in the image are detected there.  Or perhaps, when the image is first processed in the brain, it recognizes small discrepancies from one frame to the next.
Neither of those possibilities is quite right.
The images from the screen enter the eye and hit the retina.  From there, they are passed into the brain and ultimately make their way to the occipital lobe in the back of the brain where most visual processing is done.  Initially, the brain looks for simple visual features in the image like the presence of edges, because edges usually signal the boundaries of objects.
The interesting thing is, the brain divides up the task of understanding the image in multiple ways, with different brain areas searching for different features in the image.  The unified sense of vision we have arises because the brain ultimately puts all of those independent properties back together. 
Early in the processing of images a particular area of the brain called area MT (shown in the figure) looks for blobs that have changed position.  When MT sees a blob in a location that has changed it position a bit, it gives a signal suggesting that there was motion.  Sustained activity of MT indicating motion in a particular direction gives people the experience that an object moved.  This brain area doesn’t really care much about the blobs themselves.  The blobs could actually change shape or color from one frame to the next, it is just looking for motion.
So, the motion in movies comes from activity in the brain area MT.  As Zacks points out, though, this can sometimes cause problems.  In particular, when a movie is put together, it is usually constructed from a set of scenes that are spliced (or cut) together.  If the editor is not careful, when one scene is cut to the next, some of the objects may appear to jump from one location on the screen to another.  This jarring sense of movement is called a jump cut.  Filmmakers try not to create these jump cuts, and texts on film making give suggestions for how to avoid them. 
These jump cuts are caused by the same process that causes the sense of motion in scenes.  When one scene is cut to another, if area MT detects the motion of a blob, it will send a signal that an object in one location actually moved to another.  That can feel weird, because brain areas that calculate the size, color, and shape of the object may not see strong similarities in the objects from one scene to the next, so you can get a feeling of motion without have a clear sense of what moved.
One of the reasons why Flicker is an interesting read is that Zacks explores the ways that movies exploit the structure of the brain to give us an immersive experience.  If you can pull yourself away from the screen for a few hours, it is well-worth the time to check it out.


  1. You know I stopped watching too much movies and TV now I like to go out and do outdoor works and entertainment.
    cable TV services

  2. I understand why - "The images from the screen enter the eye and hit the retina. From there, they are passed into the brain and ultimately make their way to the occipital lobe in the back of the brain where most visual processing is done. Initially, the brain looks for simple visual features in the image like the presence of edges, because edges usually signal the boundaries of objects." hyundaisaigon

  3. If you don't have time to watch more than two or three movies a month there is a plan for you
    The defector

  4. By and large, the legends, folklore and traditions of Africans and other indigenous cultures, have been demonized through religion and western culture, and so it seems we shun the magical and fantastical images of ourselves as sorcerers, demigods and heroes.
    solar movies

  5.  A portable fish finder is a good choice if you don't fish from the same ship all the time. Halloween streaming vf

  6. The opinions of movie fans will vary from person to person as to who is the greatest movie director of all time. There is a lot to be said for James Ford by Western Movie fans. Further, to suspense movie fans Alfred Hitchcock is the greatest, but to science fiction solar movies fans, perhaps George Lucas is the greatest.

  7. Lincoln seems to be a hot topic in theaters this 123 movies. I'm not sure why this is so, but first he's hunting vampires and now he's freeing slaves. Go Abraham! I must start by saying that this movie was incredible. Truly. It was brilliantly (and I mean freaking BRILLIANTLY!) cast, and the acting, script, scope and emotional impact was extraordinary.

  8. Matthew Vaughn could well be correct and he isn't the only one in feeling that the present ubiquity in Super Hero motion pictures could be arriving at and end. Everything comes down to studios endeavoring to benefit from a famous pattern however in doing as such going over the best and as a result destroying it's life span by tossing an excessive number of these motion pictures at groups of onlookers in a brief timeframe, hurrying through second rate films just to profit while the surge is on.
    Movie Decals for Model Cars

  9. Parties are pretty much everywhere because people always want to celebrate special occasions and get to know more people. With parties, we are able to expand our connection to the world. To make parties complete, all you need is a party catering service that can make everyone enjoy the party. stag parties

  10. The perfect kids birthday party location can vary widely depending on where you live and the type of party you are throwing. Here are some tips and ideas to help when picking that perfect location for your little one! stag parties

  11. Movies are a favorite past time for the young and old alike. The smell of buttery popcorn, the thrill of watching a movie on a big screen, engulfed in sound and sharing the experience with a crowd is all an exciting part of going to the theatre. Watching a movie in the home cuddled up with a loved one is a great relaxing quality past time. koktale

  12. Spokane movie theaters are one of the wonderful places you can choose to go, enjoy at and see the latest movie. A movie theater provides a venue for viewing motion pictures and is typically a "building type." koktale

  13. I simply couldn’t go away your website before suggesting that I actually enjoyed the standard information an individual provide on your visitors? Is gonna be back frequently in order to inspect new posts. miss ptc punjabi 2018

  14. I do trust all of the concepts you’ve presented for your post. They are really convincing and can certainly work. Nonetheless, the posts are too brief for newbies. May just you please lengthen them a little from next time? Thanks for the post. indian idol full episode