It doesn't sound like this physics course is required for your degree, so if you are just interested in the subject, you could always take it "for fun" at a community college or through "massive on-line courses" offered by some universities for free. Physics might be challenging to learn on your own, but anything is possible with the right level of interest and determination.
Wasting money and hurting your GPA for a non-required course for your degree is probably not a good risk to take. However, I will tell you as a hiring manager a candidates' GPA is rarely a deal breaker for me as long as it is reasonable and explainable, many other portions of a resume hold more weight than a GPA for most positions. Good luck, and yes - physics is fun!