Like dave said, there should be four bolts that hold the two block off plates in place(two each location). The rubber plug, is if you want to leave the pump in place, and just poke the plug inside of the housing, where the large ID
hose connects to the pump on the front of the motor. The plug is an extra part when doing a complete removal.
All the rest of the pump stuff gets removed. You may have to separate several of the pump pieces from each other to wiggle it out of the area over the starter.