Affect pivot point in edit mode

[Regnas]

I almost forgot that we have the sculpt mode too, as pointed out by John1, and it has transform tools now, in 2.81.
So yeah, this is the only possible solution, and it will solve all those issues at once.

@Regnas

AGAIN, even in zbrush I can directly move the gizmo/pivot. They have a beautiful lock icon next to the gizmo to lock/unlock it.