Containerization and Orchestration

8/3/2026

This post introduces the challenges of scaling real-time AI agents, which rely on stateful, long-lived bidirectional streams rather than ephemeral requests. It highlights the inadequacy of traditional QPS and CPU utilization metrics for load balancing these systems. The post proposes tracking active sessions within the runtime as a critical signal for load balancing. It details a hybrid load balancing model that combines session counts with utilization metrics, using a formula to estimate effective capacity and prevent backends from becoming overloaded. The post also emphasizes the importance of realistic benchmarking for session-aware balancing and validating the overhead of session tracking mechanisms.

8/18/2021

This post details the process of containerizing Google App Engine applications for deployment on Cloud Run. It outlines the steps involved in migrating existing App Engine standard environment applications to container images, leveraging Cloud Build for the containerization process, and deploying these containers to Cloud Run. The post emphasizes the benefits of this approach, such as improved portability, scalability, and access to Cloud Run's features, while maintaining compatibility with existing App Engine configurations.

7/8/2021

This post details the technical process of migrating a Python web application from Google App Engine's webapp2 framework to Flask. It covers the challenges encountered, such as differences in request handling, routing, and template rendering, and provides specific code examples and strategies for addressing these issues. The migration involved refactoring the application's structure, updating dependencies, and adapting to Flask's conventions for routing, request objects, and template engines. The goal was to leverage Flask's flexibility and extensive ecosystem for improved maintainability and scalability.

11/21/2017

Introduced container-diff, a tool for comparing container images by analyzing their layers and configurations. This tool helps in identifying differences, debugging issues, and enhancing security by understanding image contents.

12/11/2014

This post details the technical implementation of a scalable geofencing API built on Google App Engine. It discusses the architecture, data structures (e.g., spatial indexing with quadtrees), and strategies for handling a large number of geofences and location updates efficiently. It highlights the use of App Engine's capabilities for scaling and managing such a system.

6/26/2014

This post introduces Google Cloud Dataflow, a cloud-native, unified stream and batch data processing service. It highlights Dataflow's ability to handle both batch and streaming data processing with a single programming model, its integration with other Google Cloud services like BigQuery and Cloud Storage, and its underlying architecture that leverages Apache Beam for portability and scalability. The post emphasizes Dataflow's role in simplifying complex data pipelines and enabling real-time analytics.

12/2/2013

This post announces the General Availability of Google Compute Engine (GCE), highlighting expanded OS support, transparent maintenance, and lower prices. It signifies a maturation of the platform for building and deploying applications at scale.

5/15/2013

This post announces the general availability of Google Compute Engine (GCE) to all developers, marking a significant step in Google's offering of infrastructure-as-a-service. It highlights GCE's ability to provide scalable, on-demand computing resources, allowing developers to build and deploy applications without managing physical hardware. This expansion signifies a maturing of Google's cloud infrastructure offerings.

12/13/2012

App Engine 1.7.4 release introduces new features and improvements for developers, including support for the latest SDKs, enhanced capabilities for building and deploying applications, and bug fixes.

11/28/2012

This post details the technical steps and considerations for launching WordPress into the Google Cloud. It covers the use of Google App Engine for hosting, including the setup of a WordPress instance, database configuration (MySQL), and the management of static files. It also touches upon the benefits of using Google Cloud for WordPress, such as scalability and reliability, and provides guidance on how to get started.

6/28/2012

This post introduces Google Compute Engine (GCE) as a new service offering scalable virtual machine instances for developers. It highlights GCE's ability to provide computing resources on demand, allowing users to build and deploy applications without the limitations of traditional hardware. The post emphasizes the flexibility and power of GCE for various computing needs, including running large-scale applications and potentially supporting containerized workloads.

5/19/2010

This post introduces the integration of Google App Engine with VMware, enabling cloud portability for business applications. It highlights how businesses can leverage App Engine's platform for developing and deploying applications that can run on-premises or in the cloud, facilitating a hybrid cloud strategy.