Reconsider https://github.com/openhwgroup/cv32e40x/pull/612

Created by: Silabs-ArjanB

I would like to understand https://github.com/openhwgroup/cv32e40x/pull/612 better as I would prefer to undo all of its changes.

Some todos related to that pull request might already have been added:

• https://github.com/openhwgroup/cv32e40s/pull/253
• https://github.com/openhwgroup/cv32e40x/pull/620