No. What you do need is willingness to put in hard work.
Game design requires a lot of attention to detail. There are multiple areas of game design, including the artistic portions (making the games actually look good by creating images, sounds, and for some games, 3D models), game mechanics (deciding how hard a level should be, what you need to do to overcome an obstacle, if that obstacle should be seen once or on every level, those sorts of things), and programming (actually telling the computer how to make all of these pieces work together). Every one of them requires a lot of attention to detail, and often a lot of study in college or otherwise, to learn how to do it.
If you want to work on video games, you will have to decide which parts you want to learn about. As a programmer myself, I would recommend focusing on the programming side, because you can use the exact same skills you need to program games for a lot of other jobs, which gives you job security. The parts you focus on will tell you the skills that you need.
Also, while games will continue to advance, the skills involved remain largely the same. As a programmer, a lot of the same techniques go in to writing Pac-Man and games on modern video game consoles, it just takes a lot more programming to make a modern game. If you start small now, you will be able to grow to adapt to whatever super-advanced games are being made when you're out getting a job.
Do you have a sense of what part of video game design you want to work on? Do you want to be a generalist and be able to do a little bit of all of it?