"Do you have to go to work so early? I thought being the boss meant you could do what you want?" Ashley Tervort asking her husband