Apache Spark

11 posts · 7 sources

NotionBlog10 Aug

Rebuilding Notion’s lexical search reindexer

David OndrejYouTube8 Aug

My double DGX Spark setup

StripeBlog8 Jun

Scaling up your microservice testing with Apache Spark—Part 2

StripeBlog1 Jun

Scaling up your microservice testing with Apache Spark

HexBlog24 Oct

Scaling Hierarchical Clustering

GrabBlog16 Jan

A Lean and Scalable Data Pipeline to Capture Large Scale Events and Support Experimentation Platform

Two SigmaBlog25 Oct

Introducing Flint: A Time-Series Library for Apache Spark

Two SigmaBlog21 Nov

Introducing Pandas UDFs for PySpark

Two SigmaBlog6 Jun

Improving Python and Spark Performance and Interoperability with Apache Arrow

MetaBlog7 Feb

Using Apache Spark for large-scale language model training

MetaBlog31 Aug

Apache Spark @Scale: A 60 TB+ production use case