Add method to remove cached plugin after removing plugin