Is the server part of the domain? YES
Domain or local groups? Domain Groups (Global-Security)

I have tried both and it behaves the same way, it does not work.
"domainname\groupname"
"servername\groupname"

?