What are the downsides of careers in the music field?

I'm a freshman in high school and have been debating doing a career in music in the future. I haven't looked into this career a lot and was wondering what the downsides were.