TechPrufer
Get started
Google
Google logoGoogle · Feature trail

Google Cloud Datastore

34 posts · Apr 2008 – Aug 2026

What this trail covers

Google Wallet continues to evolve, expanding its capabilities for digital IDs, family access, granular notifications, proximity-based alerts, value-added opportunities, and travel enhancements. New features include support for government-issued digital IDs in more US states and UK passports, the Digital Credentials API for verifiable proof of age/identity, and Family Link integration for kids' access. Granular field update notifications and Nearby Passes notifications offer more engaging user experiences. Value Added Opportunities allow personalized modules within passes. The Pass Upgrade experience prompts users to sign into merchant accounts for linked passes. Auto Linked Passes are expanded for airlines to push boarding passes. Google Transit Insights will support season pass sales linked to tokenized open-loop payment cards. Real-time transit pass updates are now available. Secure Private Images allow passes with user profile photos. The Google Wallet API remains unchanged for the kids' access enhancement.

All Google trails
  1. Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU- Google Developers BlogThis post details the engineering efforts to integrate vLLM with Cloud TPUs for high-precision, long-context multimodal embedding inference. Key contributions include: 1. Hardware-safe tensor alignment for TPU MXUs by implementing a unified vocabulary padding strategy. 2. Materialization hardening, TPU lazy-loading, and compilation pre-warming to eliminate initialization failures and runtime JIT latencies. 3. A hybrid StepPool architecture with metadata migration to CachedRequestState for handling ultra-long contexts and preventing state loss. It also provides a Python code example for initializing Qwen3-Embedding-8B on TPU and presents numerical parity evaluations (cosine similarity) against XPU baselines for text and multimodal inputs, demonstrating high throughput and accuracy.
  2. Speeding Up AI: Bringing Google Colossus to PyTorch via GCSFS and Rapid Bucket- Google Developers BlogIntroduced Rapid Bucket, a high-performance object storage solution leveraging Google's Colossus architecture and gRPC bidirectional streams for AI/ML workloads. Integrated Rapid Storage with PyTorch via `fsspec` and `gcsfs`, enabling significant performance gains (23% reduction in training time, 4.8x read throughput, 2.8x write throughput) by bypassing legacy REST APIs and utilizing zonal co-location for reduced latency. This integration requires no code rewrites for existing `fsspec` clients.
  3. Explore the latest updates on Google Wallet- Google Developers BlogThis post announces several new features and enhancements for Google Wallet, focusing on digital IDs, family access, user engagement, and travel. Key technical contributions include the introduction of the Digital Credentials API for verifiable proof of age/identity, granular field update notifications for passes, Nearby Passes notifications triggered by proximity to points of interest, Value Added Opportunities for personalized modules within passes, and a Pass Upgrade experience to link passes to merchant accounts. Auto Linked Passes are expanded for airlines to push boarding passes, and Google Transit Insights will support season pass sales linked to tokenized open-loop payment cards. Real-time transit pass updates are now available via the Google Wallet API's live status support and integration with Google Maps. Secure Private Images allow passes with user profile photos, accessible only to the pass holder. Notably, no changes to the Google Wallet API are required for the kids' access enhancement.
  4. Simplified Dataflow Connectors with Managed I/O- Google Developers BlogIntroduces Managed I/O for Google Cloud Dataflow, which automates the management and upgrading of Apache Beam I/O connectors. This feature addresses complexities such as manual Beam upgrades, varying connector APIs, and sub-optimal connector performance on the Dataflow runner. Managed I/O provides automatic SDK upgrades, a simplified and standardized API for sources and sinks (e.g., `Managed.read(SOURCE).withConfig(sourceConfig)`), and automatic optimization for the Dataflow runner. Benchmarks demonstrate linear scaling for batch pipelines with Managed Iceberg I/O and high throughput (250k msgs/sec) for streaming pipelines with Managed Kafka I/O, while efficiently utilizing VM resources.
  5. Inference with Gemma using Dataflow and vLLM- Google Developers BlogThis post introduces the integration of vLLM, an open-source library for high-throughput LLM inference, with Google Cloud Dataflow's model manager. It details how vLLM's continuous batching technique significantly improves LLM inference performance compared to traditional batching, achieving over a 23x improvement in vCPU hours for processing prompts. The post explains how Dataflow's model manager simplifies the deployment of vLLM within streaming pipelines by allowing users to control the exact number of model copies, thereby optimizing resource utilization and reducing out-of-memory issues for large models.
  7. Gemma for Streaming ML with Dataflow- Google Developers BlogThis post details the integration of Gemma 2, a lightweight LLM, into a Google Cloud Dataflow streaming pipeline for real-time sentiment analysis and summarization of customer chat data. It outlines the pipeline architecture, including reading from Pub/Sub, processing with Gemma via a custom KerasNLP model handler, and branching based on sentiment to either store in BigQuery or generate a response for human review. The post provides code snippets for pipeline construction, prompt templating, and discusses setup considerations for using GPUs with Dataflow ML and custom containerization.
  8. Migrating from App Engine Blobstore to Cloud Storage (Module 16)- Google Developers BlogThis post details the technical process and considerations for migrating from App Engine Blobstore to Cloud Storage. It covers the rationale for migration, the challenges encountered, and the steps taken to ensure a smooth transition, including data migration strategies and application code updates. The post emphasizes the benefits of Cloud Storage for scalability, performance, and cost-effectiveness compared to the legacy Blobstore.
  9. Migrating from App Engine Memcache to Cloud Memorystore (Module 13)- Google Developers BlogThis post details the migration of App Engine Memcache to Cloud Memorystore, a managed Redis service. It covers the technical considerations, challenges, and steps involved in this migration, including strategies for minimizing downtime and ensuring data integrity. The migration process involves understanding the differences between the two services, planning the transition, and executing the switchover. Cloud Memorystore offers enhanced performance, scalability, and features compared to App Engine Memcache, making it a suitable successor for caching needs.
  10. Cloud NDB to Cloud Datastore migration- Google Developers BlogThis post details the technical process and considerations for migrating from Cloud NDB to Cloud Datastore, including schema mapping, data transformation, and strategies for minimizing downtime during the migration. It highlights the benefits of Cloud Datastore for improved performance and scalability.
  11. Migrating from App Engine ndb to Cloud NDB- Google Developers BlogThis post details the migration of App Engine's ndb client library to Cloud NDB. It covers the process of migrating from the legacy App Engine Datastore client to the new Cloud NDB client, including considerations for data consistency, performance, and the use of features like eventual consistency and strong consistency. The migration involves updating dependencies, adapting code to the new client's API, and testing the application's behavior under different consistency models.
  12. NoSQL for the serverless age: Announcing Cloud Firestore general availability and updates- Google Developers BlogAnnounces the general availability of Cloud Firestore, a NoSQL document database designed for serverless applications. Highlights its real-time synchronization, offline support, and scalability, positioning it as a successor to the Datastore mode.
  13. Introducing Cloud Firestore: Our New Document Database for Apps- Google Developers BlogIntroduced Cloud Firestore, a new NoSQL document database for applications. It offers a flexible schema, real-time data synchronization, offline support, and powerful querying capabilities, designed for scalable, real-time applications across mobile, web, and IoT platforms. It also includes robust security features and automatic scaling.
  14. Sneak peek: Google Cloud Dataflow, a Cloud-native data processing service- Google Developers BlogThis post introduces Google Cloud Dataflow, a fully managed, cloud-native service for executing Apache Beam pipelines. It highlights Dataflow's ability to automatically scale, manage resources, and provide a unified programming model for both batch and streaming data processing. Key features discussed include autoscaling, dynamic work rebalancing, and integration with other Google Cloud services. The post emphasizes Dataflow's role in simplifying complex data processing tasks for developers.
  15. Create a blog on App Engine with Django and Google Cloud SQL- Google Developers BlogThis post introduces how to create a blog on App Engine using Django and Google Cloud SQL, demonstrating the integration of these services for building web applications. It details the setup process, including configuring the Django project, setting up the Cloud SQL instance, and deploying the application to App Engine.
  16. Google Cloud SQL now Generally Available with an SLA, larger databases up to 500GB, and encryption- Google Developers BlogThis post announces the General Availability of Google Cloud SQL, highlighting its new Service Level Agreement (SLA), increased database capacity to 500GB, and the introduction of encryption at rest. These updates signify a maturation of Cloud SQL into a production-grade managed database service.
  17. Google Cloud SQL is now accessible from just about any application, anywhere- Google Developers BlogThis post announces the general availability of Google Cloud SQL and highlights its accessibility from any application via JDBC and ODBC drivers. This expands the integration capabilities of Cloud SQL beyond previous limitations.
  18. Google Cloud Platform enhances Compute Engine, App Engine and Cloud Datastore- Google Developers BlogThis post announces enhancements to Google Cloud Platform services, specifically Compute Engine, App Engine, and Cloud Datastore. Compute Engine now supports custom machine types, allowing users to configure CPU and memory to their specific needs, and offers per-second billing for increased cost efficiency. App Engine has introduced a new pricing model based on instance hours, with a free tier for small applications, and has improved its deployment capabilities. Cloud Datastore has seen performance optimizations and increased storage limits.
  19. Get started with Google Cloud Datastore - a fast, powerful, NoSQL database- Google Developers BlogThis post introduces Google Cloud Datastore as a fast, powerful, NoSQL database. It highlights its scalability, automatic scaling, and ease of use for developers building applications. Key features discussed include its ability to handle large amounts of data and its role as a managed service, reducing operational overhead for developers.
  20. Google Compute Engine: Expanded availability, new features, and lower prices- Google Developers BlogThis post announces the expanded availability of Google Compute Engine, including new features and lower prices. It highlights the ability to run custom machine types, the introduction of preemptible instances for cost savings, and improved networking capabilities. The post also mentions the integration of Compute Engine with other Google Cloud services, emphasizing its role as a foundational infrastructure component.
  21. Using Tailbone to talk to App Engine with JavaScript- Google Developers BlogThis post introduces Tailbone, a JavaScript library that enables direct communication between client-side JavaScript and Google App Engine, specifically targeting the Datastore. It details how to set up and use Tailbone for CRUD operations on the Datastore, including handling authentication and data serialization, thereby extending App Engine's accessibility to front-end developers.
  22. Google Cloud Storage - more value for performance- Google Developers BlogThis post announces enhancements to Google Cloud Storage, focusing on improved performance and value for developers. It highlights features like multi-region buckets for higher availability and durability, and introduces new pricing tiers that offer more value for performance-sensitive workloads. The post also mentions the deprecation of the older Google Cloud Storage XML API in favor of the newer JSON API, encouraging migration for better performance and feature access.
  23. Get started at no cost with a faster, larger Cloud SQL database- Google Developers BlogThis post announces that Google Cloud SQL is now accessible from just about any application, and that users can get started at no cost with a faster, larger database.
  24. Streak brings CRM to the inbox with Google Cloud Platform- Google Developers BlogThis post details how Streak integrated CRM functionality into the inbox by leveraging Google Cloud Platform. It highlights the use of Google Cloud's infrastructure for data storage and management, enabling a seamless connection between email and CRM capabilities. This demonstrates the platform's ability to support complex application integrations.
  25. Introducing new Fusion Tables API- Google Developers BlogThis post introduces the new Fusion Tables API, allowing developers to programmatically access and manage Fusion Tables data. This API provides capabilities for creating, reading, updating, and deleting tables, as well as executing SQL queries. It aims to enable developers to build applications that leverage Fusion Tables for data storage, analysis, and visualization.
  26. Google Cloud Storage: high performance that just works- Google Developers BlogThis post introduces Google Cloud Storage, highlighting its high performance and ease of use for developers. It emphasizes the system's ability to handle large amounts of data efficiently and reliably, positioning it as a robust solution for various application needs.
  27. Google Cloud Storage: concurrency controls and deeper App Engine integration- Google Developers BlogThis post introduces concurrency controls for Google Cloud Storage, specifically focusing on conditional requests using If-Generation-Match and If-Generation-Not-Match headers. It also details deeper integration with App Engine, allowing developers to use Cloud Storage directly from their App Engine applications without needing to manage credentials manually, simplifying the development of data-intensive applications.
  28. Simplifying Access Control in Google Cloud Storage- Google Developers BlogThis post introduces a new approach to access control in Google Cloud Storage, simplifying the management of permissions for buckets and objects. It details the introduction of signed URLs, which allow for temporary, time-limited access to objects without requiring users to have Google accounts or explicit permissions. This simplifies sharing and distribution of content stored in Cloud Storage.
  29. Google Cloud SQL: your database in the cloud- Google Developers BlogThis post announces the general availability of Google Cloud SQL, highlighting its production-readiness with an SLA. It also details increased database size limits up to 500GB and the implementation of encryption at rest, emphasizing its robustness, scalability, and security for developers and enterprises.
  30. Google Storage for Developers open to all, with new features- Google Developers BlogThis post announces the general availability of Google Cloud SQL, highlighting its production-readiness with an SLA, increased database size limits (up to 500GB), and encryption at rest. It emphasizes the service's robustness, scalability, and security for developers and enterprises.
  31. Google Storage for Developers: A Preview- Google Developers BlogThis post announces Google Cloud Storage for Developers, a preview of a new storage service. It highlights its scalability, reliability, and cost-effectiveness, positioning it as a robust solution for developers needing to store and manage large amounts of data. The service is designed to be accessible and easy to use, with features for managing data and controlling access.
  32. Google Fusion Tables API- Google Developers BlogThis post announces the Google Fusion Tables API, a new API that allows developers to programmatically access and manipulate data stored in Google Fusion Tables. The API supports operations such as creating, reading, updating, and deleting tables, as well as querying data and exporting it in various formats. This enables developers to build applications that leverage Fusion Tables for data storage, analysis, and visualization.
  33. Standards-based Persistence For Java™ Apps On Google App Engine- Google Developers BlogThis post introduces standards-based persistence for Java applications on Google App Engine, enabling developers to use Java Data Objects (JDO) and Java Persistence API (JPA) for data management. It highlights the benefits of these standards for building robust applications and outlines the initial steps for developers to adopt them.
  34. Code Review: Start your App Engine and run the cloud offline with your docs- Google Developers BlogThis post introduces the ability to run App Engine applications locally, enabling developers to develop and test their applications offline. It highlights the benefits of local development for faster iteration and debugging, and provides instructions on how to set up and use the local development environment.