after you uninstall firefox, try deleting the directories it leaves behind.

One is in:

C:\Program Files\Mozilla Firefox

Another is at:

C:\Documents and Settings\<username>\Application Data\Mozilla

a lot of times these directories will leave info about the settings. Just remember to copy the bookmark.html file because it has bookmarks in it.