'Orange Is the New Black' actor recalls being separated from family