What's The Deal With The Bones In Canned Anchovies?

After opening your first can of anchovies you may be surprised to discover the fish still have bones, which will make you wonder what to do.