Step 2: Use rust penetrant. Get a rust penetrant like ... it’s usually best to let rusty screws soak in vinegar for 24 hours.