Click any tag below to further narrow down your results
Links
Pulumi is an open source tool for provisioning cloud infrastructure by writing ordinary code in languages like TypeScript, Python, Go, or C# instead of YAML. This README covers the CLI, install steps, a sample serverless deploy, and the list of supported languages and providers.
- You define AWS, Azure, Google Cloud, or Kubernetes resources with normal language features like loops, functions, and classes, so creating three web servers is a short for-loop.
- It supports six languages (JavaScript, TypeScript, Python, Go, .NET, Java) plus YAML, and over 300 providers.
- Running pulumi up computes a minimal diff against what's already deployed, so later changes only touch what actually changed.
@kittl/sdk-backend handles authentication on your server by verifying short-lived JWTs from Kittl users, keeping sensitive auth logic out of the browser sandbox. It gives you a `KittlSDK` class to validate tokens and optional external key storage for serverless/edge environments.
- Frontend calls `kittl.auth.getUserToken()` to get a JWT, sends it to your backend, where `KittlSDK.verifyUserToken()` validates it before processing the request
- Token verification returns `payload.sub`, a pseudonymous per-app user ID that stays consistent for each user across sessions
- External signing key caching is required for serverless, edge, and autoscaling runtimes where in-memory caches don't persist between requests
AWS Lambda now supports S3 Files, letting functions mount S3 buckets as file systems for direct read/write without object downloads. This simplifies stateful and AI/ML workflows by enabling shared workspaces and automatic checkpointing via durable functions.
- Lambda functions can now mount S3 buckets directly as file systems (S3 Files, built on EFS) instead of downloading/uploading objects in code
- Multiple Lambda functions can access the same S3 Files mount simultaneously for shared, real-time workspaces without custom locking
- Combined with durable functions for checkpointing, this avoids the 512 MB /tmp storage limit for stateful, multi-step workflows like AI/ML pipelines
- Setup works through the Lambda console, CLI, SDKs, CloudFormation, or SAM, with no extra fee beyond normal Lambda and S3 pricing
Amazon MWAA runs Airflow pipelines on AWS as a managed service with serverless or provisioned deployment options. It handles infrastructure provisioning, scaling, security, and integrates with SageMaker for end-to-end ML and data workflows.
- MWAA now offers two deployment modes: serverless (pay-per-execution, auto-scaling) and provisioned (full config control with AWS-managed infrastructure)
- It integrates directly with the next-gen SageMaker Unified Studio, letting Airflow run alongside Jupyter notebooks for unified data prep, training, and inference pipelines
- Both modes run inside your VPC with end-to-end encryption and IAM controls, with serverless adding workflow-level permissions and provisioned offering environment-wide team separation
Andy Warfield recounts how genomic researchers struggled with moving large datasets between local filesystems and S3, spurring the creation of S3 Files to present S3 buckets as POSIX-compatible file stores. The post then covers how Amazon added S3 Tables for managed Iceberg tables and built-in vector indexing to cut storage friction and speed up analytics and search.
- S3 Files was inspired by genomics researchers at UBC who wasted hours copying sequencing data between NFS and S3 because their GATK4/Spark pipeline still required POSIX filesystem semantics despite massive serverless parallelism.
- Agent-driven development is lowering the barrier for domain experts to build apps, making it more critical to decouple persistent data from any single application or workflow.
- S3 handles over 25 million Parquet requests daily, often via Hive tables, but open formats like Iceberg still force customers to manage object-level APIs, compaction jobs, and metadata services themselves.
- S3 Files aims to provide a filesystem-style interface on top of S3's scale and durability, eliminating manual copy scripts and unifying table-format intelligence under one system.