Handling numbers in text

Hello, I’m doing the Quora question pair problem on Kaggle.

I’m using Glove for word embeddings, my question is how should I deal with numbers in the text. Should I convert them to words or should I remove numbers? If I remove them, the text might lose some context.

For example, if there is a large number like 18207, how should I represent it?