If modeling is something you are truly passionate about, you should definitely go for it! Don't ever let somebody tell you that you can't fo something.
If you try it and realize it isn't right for you, there are other positions related to the fashion industry that you could totally do. You can work as a pattern maker and deal with the technical side of clothing production, be a product designer, work in marketing and the business side of things, and so much more!
When I was in middle school and high-school, I worked at the headquarters of a fashion company nearby as a "fit-model". Basically, my job was to try on new products and test them out for comfort and fit, and then communicate with everyone working behind the scenes to help develop the best possible product! It was so much fun, and it didn't have the same pressure that might come along with runway walking or photoshoots.
Whatever path you decide on - you got this!