Nyantakyi parting ways with Fred Pappoe led to his downfall