That phrase is a pet peeve of mine, for being meaningless and in that way misleading.
In mathematics, there is no concept called “number”.
There many concepts called with compound nouns of the form “___ numbers”.
Some contain elements in them called “infinity”, some don’t.