[Feature Request] Remove default groups from pyproject.toml

[cretz]

Describe the solution you'd like

Default groups were inadvertently added when we switched from Poetry to uv. Remove them.

[cretz]

To clarify, trying to solve the case where non-shared/unrelated dependency groups are installed by default now, whereas they weren't before