The acting White House chief of staff said it would be "silly" to fire someone for trying to protect Trump's feelings.