Thanks for the quick response. My mistake was to use a plastic laptop spudger. Apparently, the spudger was not stiff enough to pull the clips down fully so it would bounce back up. That ting sound that the clips make when it bounces back up is so frustrating to hear.. Switching to a small flathead screwdriver I was able to get the 2 outer most clips to click down. After removing the center vent, I broke off the 2 center clips =)
BTW, prying from the top will do nothing. The clips that you're instructed to pull down are not what's actually holding the vents in place but are more like "extra security". I left the two outside clips pulled down and when I pushed the vent back into place, the vent pretty much clipped itself into place similar to when you're putting a battery cover back on your phone.