Even the ones you lock away in their own room are still there. You just don't let them out, don't let yourself think about them. So it's not really like amnesia. If you had to remember them, you can picture yourself unlocking their doors.