WH: Americans Won't 'Begrudge their President for Taking Some Downtime with his Family'