Victor Smith narrates the real reason behind his text message dismissal by the Rawlingses