Hi,
When you are doing an in-place upgrade of DE from 11.3 to R12, the target DB cannot be changed. The whole idea of in-place upgrade is to allow current setup to be upgraded, without changing current DE host and DB.
If you want to use a separate DB then you may want to look in to the migration feature of DE.
Thank you,
Nitin Pande
CA Technologies