[WIP] Performance bottleneck on 1 TB data

Just to confirm, you guys are running in ludicrous mode, right?