How can I prevent the foreign key column from being deleted when I delete a foreign key relationship?

You can't. Deleting a foreign key automatically deletes the corresponding foreign key columns.

Is this article helpful for you?