A good day to trie-hard: saving compute 1% at a time

What this post added

Introduced a new open-source Rust crate, 'trie-hard', which implements a highly optimized trie data structure. This crate was integrated into the pingora-origin service to replace a less efficient header removal mechanism, resulting in a significant reduction in CPU utilization (from 1.71% to 0.34% in production sampling) and a corresponding increase in request processing capacity. The trie-hard crate achieves its performance gains by storing node relationships in bits of unsigned integers and keeping the tree in contiguous memory.