Other universities have less restrictions on switching majors. In that case you'd still work with your advisor to change majors. The rest remains true, there will likely be a cost to switching.
If you can afford the financial implications of extending your studies and you are confident in changing course in your academic pursuits go for it! A semester or two may seem like a long time to delay graduation, but in the long run it won't matter. If you can align your studies to your personal interests and find something that is more fulfilling that your current program then make the switch, you will not regret it!
Michele recommends the following next steps: