You need to follow your heart. Write what you are inspired to write. That said, children's books usually require art, the picture books anyway. That increases the publisher's cost. Many are turning to self publishing. If you are capable of doing your own art, or can partner with an artist, self publishing may be a solution.
Writing is important to many career fields, so I encourage you to develop your talents in this area. But do be practical as you consider how to use your skill. You may want to train for a career in an area of your interest (writing or otherwise) and write your children's books on the side. It is a competitive field.