BlogsMilvusCompilation Optimization

Compilation Optimization

Compilation Optimization

1
posts
2021

Milvus has implemented significant compilation optimization strategies, including dependency decoupling, testing containerization, and leveraging compilation cache tools like CCache. These efforts have resulted in a 60% reduction in average compile times, improving code integration efficiency. Future work includes further parallelization of compilation.

2021

Accelerating Compilation 2.5X with Dependency Decoupling & Testing Containerization

5/28/2021

This post details strategies for accelerating compilation times by decoupling project dependencies and implementing testing containerization. It introduces techniques such as creating dependency relationship graphs, flattening dependencies using DFS, and using Merkle Trees for component tagging. It also covers optimizing compilation within components using cache tools like CCache and optimizing Docker image builds. The post also discusses leveraging containerized testing for consistent environments and reducing errors, and outlines strategies for regular cache cleanup and selective caching.