Thomas Markle Sr states that it was Prince Harry who prevented Meghan from visiting his father