Why is it so hard to shoot down a missile?

The U.S. has a system in place guarding it from intercontinental ballistic missiles. But it's by no means foolproof. Here's why.