How do we know that space is expanding/stretching?

I think you can't look at only one object. Have you ever heard of violet shift? It isn't ever measured, so...