Having a full time job (on average 40 hours a week, plus commute time) takes up a lot of you "awake time." It's a tough reality to face when you step out into the real world. I knew it would be difficult making that transition after college and graduate school, which is why I did my best to find a company I knew I wanted to work for and a place where I enjoy going every day. Since you do spend a lot of your time at your job, it's important to like what you do, and hopefully enjoy the people you are around.
Work life balance is also important. If 40 hours/week plus commute time seems overwhelming, maybe a career in a school is something you would like to look into. If you can find passion in working in the education system, then there is always that option. Shorter hours, summers and school breaks off. Leaves more time for family. My mother is a teacher and she has the best of both worlds --a job she loves and extra time with her family.