If you don't want them to access the files you will need to do it via security. You are kidding yourself if you think just removing the entries is going to do it for you.