State of the art for querying large containers

I started a response to this but as it is a bit of a tangent made it a separate topic: