I'm no expert on lens construction and as far as I know, nobody in this forum is.
But as a general impression - lens construction is an extremely complicated matter. Theres a lot of possible lens errors, and its extremely hard to compensate for them all, and impossible to compensate for any of them perfectly. And you can do the same thing in many different ways, with different results. And of course there are always new materials and new refinement techniques developed which change the game.
For example Panasonic mentioned they've been unable to create a camera like the LX100 before, because it only became possible with new materials to make a lens this compact.
So in general, if the lens designer wants a larger maximum aperture, obviously they need to make the lens more complex, which makes it larger, have more elements, etc. A 50mm f2.8 lens will be a LOT more compact than a 50mm f1.0 lens.
On the other hand, if the lens designer wants to make the lens more compact, for example they can put all lens elements BEHIND the aperture, which logically will result in a very compact lens, but also makes lens construction harder.