]> git.sesse.net Git - plocate/commit
Deduplicate docids as we go.
authorSteinar H. Gunderson <steinar+git@gunderson.no>
Mon, 28 Sep 2020 07:34:31 +0000 (09:34 +0200)
committerSteinar H. Gunderson <steinar+git@gunderson.no>
Mon, 28 Sep 2020 07:34:31 +0000 (09:34 +0200)
commit1bb5df65bf76c5a2dff0c6e69f38cdcb9d884d69
treefd9dfa95d0af8958fa6679301a36932aa985d0a7
parent184cfc93ecb5a17b3d5360d5953d7bf4126b5f5c
Deduplicate docids as we go.

This saves ~50% RAM in the build step, now that we have blocking
(there's a lot of deduplication going on), and seemingly also
~15% execution time, possibly because of less memory allocation
(I haven't checked thoroughly).
plocate-build.cpp