Think about the opposite use case, you're watching in low quality and decide to switch it to higher, the buffered video is all not what the user wants.
Think about the opposite use case, you're watching in low quality and decide to switch it to higher, the buffered video is all not what the user wants.