Federal requirements are that they be welded in, if they're installed on a car. That's to keep someone from taking it off immediately after emissions inspections. I believe vehicles over 25 years old are exempt of emissions standards in Georgia and under Federal guidelines. An 'off-road' pipe can be put in place of it and clamped on in the event that you may went or need to install a cat in the future. The stock GT exhaust without a cat isn't that noisy at cruising speeds.
I would go the easiest path first and replace the fuel filter. Can only help the car, irregardless.