Many people start in public accounting and then work in industry. Starting in any of the Big 4 (PwC, EY, Deloitte, KPMG) or at one of the larger mid-tier (RSM, Grant Thorton, etc.) is great for you resume would be worthwhile and is pretty normal.
If you start in one of the Big 4 or at one of the respected and well-known mid-tier firms then you'd receive top-notch training and you'd get a lot of experience that would be useful. Also, you'd benefit from the firm's reputation, and their brand would become part of yours. It's because of these reasons that companies seek out people with public accounting experience.
Public accounting can be a lot of work, but for many it's well worth it! I know I've enjoyed it!