Check both connections at the battery.
Check your connection where the big red positive wire is bolted to the starter.
Check the connection where the big battery ground wire connects to the block or head.
While you're checking the positive wire, check the fusible links. On an 84, they're connected to the big starter lug, along with the battery wire.
There also should be a small ground wire that goes from the battery, down to the frame/shock tower.
It's also possible that one or the other of your battery cables/connectors is bad. Maybe corroded where the connectors attach.
Those are all the first things to check.
If you have to get under the car, make sure it's in park or neutral and the wheels are chocked. There was a guy, up north, a few months back, who got crushed under his Fiero.