GCP Dataflow is an excellent choice for batch or stream data that requires processing and enrichment before processing by downstream systems such as analysis, machine learning, or data warehousing. GCP Dataflow connects Google Cloud's Vertex AI and TensorFlow Extended (TFX) to enable predictive analytics, fraud detection, real-time personalization, and other advanced use cases. When Dataflow is used, all data is encrypted at rest and in transit. Dataflow inline monitoring provides direct access to job metrics to aid in pipeline troubleshooting at step and worker levels. Dataflow jobs can be created using the cloud console UI, the cloud CLI, or the API.
