Video games are a form of entertainment largely dependent on fine motor skills which are required to use most video game controllers. For individuals with limited mobility, a potential solution is the use of an eye tracker as a video game controller. However, prior gaming experience with traditional game controllers, which individuals with limited mobility might not have, is related to better performance on measures of perception and attention. The present study investigates whether gamers are better at playing an eye tracker video game and rate the usability and enjoyability of an eye tracker as a controller more favourably than non-gamers. Participants (n = 54) played a Super Mario-style video game using an eye tracker as the controller and then completed a Usability and an Enjoyability questionnaire. No differences in performance, usability, or enjoyment were found between gamers and non-gamers. A number of additional finer-grained analyses were performed on aspects of video game experience and performance, usability ratings, and enjoyability ratings. Results of these analyses found that participant motivations for playing video games led to a difference in usability and enjoyability scores, and that playing video games weekly was correlated with lower performance and higher enjoyment. In conclusion, gamers do not have an advantage over non-gamers when using an eye tracker to play video games. These results support eye trackers as an accessible alternative for video game controllers as they are not reliant on gaming experience. However, these results also indicate that eye tracker controllers need further development before they can fully replace a standard video game controller.