Ok so accidentally I seem to have found the issue.

It seems to be with the standard RTL-SDR .dll that comes from the included install.bat, When its selected in the source selection section of SDR# the problems occur.

However when selecting the RTL-SDR .dll which produces the below config UI all the mentioned problems go away.