Building Foundry Part 3: From archive to creative search | Weaviate

This post details the implementation of Foundry's scanning process, which includes capturing source path, project, file type, size, modified date, and content hash. It also describes the preparation stage where descriptions, tags, extracted text, relationship roles, and a source URI are added to records. The synchronization step with Weaviate is explained, highlighting the creation or update of the 'Foundry' collection and the use of deterministic identifiers for updating objects. The post also contrasts keyword, semantic, and hybrid retrieval modes and mentions the possibility of adding filters for project, file type, and relationship role.