Persistent affordability concerns contributed to homebuilder confidence retreating four points to 56 in December, marking a three-year low, according to the National Association of Home Builders/Wells Fargo Housing Market Index.