Karsten Schmidt#ReleaseSunday π Quite a few https://thi.ng/column-store updates over the past month, including further performance optimizations, more tests and documentation updates...
Just also added a small section and diagram illustrating the extensive use of bit-fields and bitmap-based indexes to optimize query processing and the stepwise narrowing of result sets in multi-term queries. Depending on column configuration and query term/operator type, individual rows often do not need to be visited/checked at all (only their bitfields are combined). But even if a traversal is necessary, the use of bitfields allows the engine to only having to check rows which have already been pre-selected by previous terms in the query. Apart from some exceptions, no interim result arrays are created. Queries are also short circuiting, i.e. terminate the moment a sub-term does not produce any results...
Happy coding! :)
#ThingUmbrella #Database #Query #Optimization #Bitfield #OpenSource #TypeScript #JavaScript
gloriouscow