it used to be simple but since DDR2 it all got a little complicated....
the voltage can vary from 1.8V (standard ram) to 2.3V (some of the higher end stuff)
Now im assuming your bios will be preset to 1.8V and the ram installed will be of the same flavour , yuo really need to get the exact same ram type to avoid any hassles (memory can be a right pain in the rear end)
Obviously running ram over voltage can damage it running it undervoltage can cause all sorts of weird and wonderfull issues. when buying ram the specs will tell you its operating voltage.
The next problem , sometimes when adding extra ram yuo need to up the voltage a tiny bit to get it stable (because your memory controller needs to work harder or because of volt drop due to extra ram)
unfortunately as you have a Dell im assuming the advanced features in the bios (including memory voltage control ) will be locked out by Dell (dont you just love em)
If you get new ram of a lower speed the fsb will default to that speed (assuming its set to "auto" in your bios) so your old ram will run slower , if you get faster it will default to the lower speed of your old ram (the voltage is NOT automatic it can only be set manually)
if however you get ram that operates at 2.1v and your mobo is set to the default 1.8v yuo will most likely have issues
so to summerise , find out what ram is installed now and match it as exactly as you can , even manufacturer if possible
hope this helps , and hasnt confused you even more , if it has feel free to slap me with a fish........i prefer halibut or a nice cod