I think I would agree, in the abstract, that Callais alone does not justify SCOTUS expansion since Congress could easily override it by other means.
The problem is that Callais is only one of many rulings that collectively warp the Constitution to make liberal democratic governance impossible.
To the extent Callais is a problem, it can be better addressed by steps such as banning gerrymandering.www.lawfaremedia.org