The four classes within the juce_opengl/geometry folder can be quite useful even if one is not using OpenGL. For example for pseudo 3D, which can be done using normal 2D graphics, and Vector3D is great to have for all sorts of things.
Since the graphics module is a necessary dependency for juce_opengl, this should not be a breaking change.