To remove the front bearing cap, you need to break it free from the FIPG. But you need to do this without prying on the cap/head mating surface. IIRC, I did it by gently prying between the cap and the cam gears. Try to pry straight up, a little at a time until it breaks the FIPG seal.
Do you have the service manual for reference? If not, see the attachments - just pick out the pertinent steps.
You need to clean off the FIPG completely (see image) and only apply it where specified (see FSM). I used razor blades (don't gouge the aluminum) and green Scotchbright to remove the FIPG. Don't use power tools - you don't want to remove aluminum, just the FIPG.
The washers under the four cap bolts (shown above) are seal washers. These need to be replaced and can only be sourced from the dealer. Because these four bolts have smaller shank diameters than standard bolt, seal washers sourced from an industrial supply house will not seal properly. The ID of the Toyota seal washers have a smaller diameter that works with these bolts.
There are also round plugs bonded in place with FIPG at the ends of the camshaft bores. Might be a good idea to remove, clean and reseal these.
EM-33 Cylinder Head - Removal.pdf
EM-57 Cylinder Head - Installation.pdf