The fuse on the back of the headlight switch is for the interior lights. There is no inline fuses for other lights in the wire harness.
If both lights do not work, there is probably a single bad bullet connector where one wire feeds both lights, could be the one that is located in the harness just above the transmission hump (behind the radio). Sometimes the connector gets a little loose, dirty or corroded.
Body ground is important. I ran a separate ground wire with green insulation from the firewall ground screw under the dash all along the rear bumper harness to the back of the car and used it to make ground connections to the taillight housings, backup light housings, license plate light socket and the fuel sending unit.