There is no reason to take them down unless they make you feel uncomfortable. This is your office space and you should be able to do whatever you want in that particular space. Personally, I would leave them up.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.
