Is math a proxy for all language?

If yes, does this type of incompleteness imply that every statement about the universe requires an assumption or context that itself cannot be proven.

In other words, is this proof that there is no philosophical or scientific grounding that can ever be justified in and of itself?