AWS now supports response streaming in API Gateway, allowing REST APIs to send responses progressively. This reduces wait times, improves user experience in applications like AI chatbots, and handles larger payloads more efficiently.

AWS Lambda response streaming has increased its maximum response payload size to 200 MB, ten times the previous limit, enhancing performance for latency-sensitive applications. This improvement allows for direct processing of large datasets and media files without the need for intermediate services, thereby reducing time to first byte (TTFB) for end-users. The new limit is applicable across all supported AWS Regions and compatible with both Node.js managed and custom runtimes.