GuideAdvanced

Genai On Aws Production

Adds Andes Cargo's first generative AI workload: an extractor that kicks in when the inherited deterministic manifest parser can't read free-text input, invoking an Amazon Bedrock model as an escalation path, never as the default. This is the only guide in the ecosystem where no real model invocation runs inside the lab — Bedrock requires a paid account and is only available on LocalStack's Ultimate plan — so it declares the entire infrastructure as real code (`terraform validate`/`plan` genuinely verified, with no LocalStack or AWS account needed), builds Bedrock Guardrails' six policies as HCL, and complements them with its own defense-in-depth layer (a PII scrubber and an output schema validator, both deterministic and tested with `pytest`). It extends the security gate and cost gate the sibling guides already built (least-privilege IAM for `bedrock:InvokeModel`, a new cost policy) and computes per-token cost with its own calculator, since Infracost can't price a volume assumption nobody declared. It applies SLI/SLO vocabulary to AI metrics (escalation rate, guardrail block rate, latency) and closes with a capstone that runs the cheap path end to end and documents, with exact honesty, where the executable stops and the representative begins. It doesn't teach prompt engineering, RAG, agents, or semantic evaluation — that's AI Engineering territory; this guide teaches how to operate, not build, the AI system.

64
lessons
8
modules
English · Spanish
available in
Yes
certificate
Free
access
NIEVA

Outcomes

What you'll be able to do

  • Tell a notebook prototype apart from a generative AI workload in production, and understand the core architecture decision: the cheap, deterministic path stays the default, the LLM is only the escalation path
  • Understand how Bedrock is actually billed (on-demand, Provisioned Throughput, Batch, Flex, Priority) and what invocation-per-minute quotas are
  • Declare an AI workload's infrastructure as real Terraform code — `aws_bedrock_guardrail`, a least-privilege IAM role for `bedrock:InvokeModel` — with `validate`/`plan` genuinely verified, with no dependency on LocalStack or an AWS account
  • Declare Bedrock Guardrails' six policies (content filters, PII, denied topics, contextual grounding, word filters) as code, and build your own deterministic defense-in-depth layer (PII scrubber, output schema validator) that never depends on the model existing in the lab
  • Extend the already-built security gate (`conftest`/Trivy/`cosign`) to this guide's new Terraform and artifact, with a least-privilege policy specific to the model
  • Extend the already-built cost gate with a per-token cost model: your own deterministic calculator, a budget policy, and cost-allocation tagging for the AI workload
  • Apply SLI/SLO vocabulary to AI-specific metrics: escalation rate from the deterministic path to the LLM (computable without invoking the model), your own guardrail's block rate, and inference latency (representative, with its technical reason stated)
  • Run a capstone that genuinely executes the deterministic path end to end and documents, with an explicit honesty ledger, exactly where the system stops being executable and becomes representative

Before you start

What you need to bring

It's for you if...

  • Cloud, backend, or DevOps engineers who completed the seven prior AWS Cloud ecosystem guides and want to add their first generative AI workload to that same infrastructure
  • AI Engineering graduates who already know how to build with an LLM (prompting, function calling, structured outputs) but never learned to operate one in production: IAM, guardrails as code, per-token cost, observability
  • Teams evaluating adding Bedrock to a real system who want to understand the infrastructure, security, and cost discipline before invoking a single token
  • Not for anyone looking to learn prompt engineering, RAG, agents, or building an AI application from scratch — that boundary with AI Engineering is respected without exception in this guide

Requirements and materials

  • The seven prior AWS Cloud ecosystem guides completed (or equivalent): `andes-cargo-infra/` with the pipeline, security gate, and cost gate already working
  • AI Engineering ecosystem completed (or equivalent): knowing how to build with an LLM — prompting, function calling, structured outputs — since this guide doesn't re-teach it
  • Terraform and an AWS account with Bedrock enabled, if you want to run a real invocation on your own (the guide teaches everything around it, not the invocation itself)
  • Basic Python and `pytest`, for the custom guardrail checks

Content

The syllabus, module by module

Open any of them to see its lessons.

Common questions

What people usually ask

Start whenever you like

Reviews

What students say

These reviews are from enrolled students who completed at least 50% of the course. We moderate reviews only on content grounds (spam, offensive language, personal data), never for being critical or negative.

No approved reviews yet.

Be the first to share your experience!