Restrict users to logon on the particular computer

Configure the local Group Policy in

CompConf\Windows Settings\Security Settings\Local Policies\User Rights Assignment\ - Log on locally.

Put users that are allowed to log on at that machine in there. Remove others. Be sure to not lock yourself out... try to not use the "Deny log on locally" permission..