You don't have to answer yes or no to a question that requires explanation
But on TV the attorney is always cutting off the witness and shouting "Just answer yes or no!"
That's what cross or redirect examination is for, explaining and expanding your answers to opposing counsel's hostile questions with the friendly and intelligent guidance of your own attorney.
Jeff