If your CEL is on for bad o2 sensors then you will not get good gas mileage, but I would not replace them if your car doesn't have CEL.
It could be many things that your car doesn't get good gas mileage such as dirty air filter, bad spark plugs, etc...