Using our identity schema to deliver personalized, permissions-aware results
Aug 10, 2026

Summary
This post details optimizations to the identity crawl process for connector applications, specifically addressing inefficiencies in complex permission models like Salesforce. The author implemented concurrent execution of non-API related tasks and filtering based on user domains to improve crawl speed and accuracy. This resulted in up to a 98% identity crawl time improvement for one customer and at least a 22% improvement for others.
More from the Enterprise Data Crawler trail
- Why building a workplace ChatGPT requires a great crawler
- Unlock rich insights across your entire business and BigQuery environments with Glean’s new structured query agents
- What is an intranet search engine, and what should modern enterprise search actually do?
- Make every business decision a better-informed one with Glean's Deep Research
- How Glean uses Apache Beam Streaming to efficiently read a large corpus from MySQL