There doesn't have to be any context. In terms of the PL we have not been average, if you understand what average actually means.
Over the course of a season you pretty much end up where you deserve. The season we finished 2nd was because of Spurs' amusing capitulation. So fine, let's say we really should have finished 3rd. That still isn't average.