Why Are Bananas Berries, But Strawberries Aren't?

Despite its name, the strawberry isn't a true berry. Neither is the raspberry or the blackberry. But the banana, it turns out, is a berry, scientifically speaking, as are eggplants, grapes and oranges. So what's the deal? Why are berries so very hard to define?