You could use the INF route and have the system auto uninstall them with a GPO

I would not do a DEL from the root as it could delete legitimate files of a similar name (if the user has rights).

Or run an uninstaller that supports monitoring and watch what gets modified on a removal and then write your removal script based on that.