I'm going to answer myself and hope that other Atlanta women out there will have some answers for themselves should they be looking.

Here are the hospital prices: (v) = Vaginal, no drugs (c) ceserean
Dekalb Medical (v) $4500 (c) $5500
Piedmont Hospital (v) $3250 (c) $5275
Northside Hospital (v) $4840 (c) Not Available (usually approx $1000 more)
Atlanta Medical (v) $4000 (c) Not Available
Emory Downtown (v) $2700-3000 (c) $3100-3600

Doctor Fees:
These all varied. They started at $2200 and went up to $3700. This is includes most prenatal ultrasounds and bloodwork, but some bloodwork and any test outside the scope of 'normal' are all extra. Usually up to $700 - $1000. These fees cover the start of your dr visits all the way through delivery. These fees do not include circumcision for a boy, which range from $180 to $320, depending on the dr. And there were other small things here and there wouldn't be covered, but I'm sure would add up. So you would need to budget for extra $$.

Atlanta's Intown Midwifery told me they have a rate of $2500, at the time of writing this, and they deliver at Atlanta Medical.

You will, obviously, apply for insurance for your child before it is born and this is what is suppose to cover the other expenses for the child.

There is also the option of having the baby at home as women have been doing throughout all of time. You can walk around, eat, drink water, be in your own home, etc. This is for very low risk pregnancies and should be monitored by an experienced professional with the proper equipment to monitor you and your baby. It is also recommended that you only do this if you are close to a hospital and would have a small drive, including traffic time. But it definitely saves on the hospital fees!