The up side is remembering those good times and jobs you performed with pride. Pointing them out to your family and friends.
The body takes a beating but in the end you can say with pride that you had something to do with the success of the job.
I having been working in the construction industry for 50 years now and it has had its ups and downs like every industry. I can honestly say that it has given me a wonderful life experience. So much to learn and still to learn, always something changing in the industry and if you are with the right company then you become part of something bigger.
Of course you must be prepared to put in long shifts on occasions and maybe miss out on some days out with family and friends, also working in challenging conditions but the bright times have always outshone the dull stuff.
My advice would be to give it a try and you will soon find out if its for you.