Can't Upload Large Files To Python + Flask In Gcp App Engine

UPDATE: (5/18/2020) Solution at the end of this post! I'm attempting to upload big CSV files (30MB - 2GB) from a browser to GCP App Engine running Python 3.7 + Flask, and then push

Solution 1:

The answer is that you cannot upload or download files larger than 32 MB in a single HTTP request. Source

You either need to redesign your service to transfer data in multiple HTTP requests, transfer data directly to Cloud Storage using Presigned URLs, or select a different service that does NOT use the Global Front End (GFE) such as Compute Engine. This excludes services such as Cloud Functions, Cloud Run, App Engine Flexible.

If you use multiple HTTP requests, you will need to manage memory as all temporary files are stored in memory. This means you will have issues as you approach the maximum instance size of 2 GB.