The Silent Generation and Baby Boomers are sitting on a whopping $13.5 trillion worth of home inventory, but aging Boomers are expected to trigger a large exodus from the housing market in upcoming years. Millennial homeownership may not be able to meet housing market, according to Fannie Mae.