That’s not at all how it works. In particular, it didn’t start from an original, dense point. It started everywhere, with nearly uniform density apparently infinitely in all directions. If the Universe is boundless, there is no reason to suspect the material it contains is not equally boundless.