Skip to content

Lesson 374·M29 Enterprise AI Solutions Architecture

Disaster Recovery & Business Continuity

Open

Learning Objectives

By the end of this lesson you should be able to:

  • Explain the targets: the RTO, the RPO (L374)
  • Explain the plan: the backups, the replicas, the failover (L374)
  • Explain the story: the multi-region AI (L374)
  • Explain the test: the rehearsed (L374)
  • Explain the AI shape: the recovery's plan (L374)

One-Line Definition

The disaster recovery & business continuity is the RTO, the RPO, and the multi-region AI story (L374) — the targets (the RTO: the time to recover; the RPO: the data lost, L374), the plan (the backups L304, the replicas L286, the failover L273, L374), and the story (the multi-region AI: the primary L261 and the standby L286, L374) — with the test (the rehearsed L374) — the enterprise's (L380) continuity (L374).

The one-sentence interview answer: "The DR is the enterprise's continuity (L374). The targets (L374): the RTO (L374) — the time to recover: how fast the system (L374) returns (L374); and the RPO (L374) — the data lost: how much the backups (L374) lag (L374). The plan (L374): the backups (L304) — the snapshots (L268) and the point-in-time (L268); the replicas (L286) — the cross-region (L268); and the failover (L273) — the Route 53 (L273) and the standby (L286). The story (L374): the multi-region AI (L374) — the primary (L261) and the standby (L286): the compute (L264), the data (L268), the models (L278) — the L286 architecture (L286), enterprise-shaped (L374). The test (L374): the rehearsed (L374) — the runbooks (L286) and the drills (L374) — the RTO (L374) measured (L374). The AI shape (L173): the enterprise (L380) — the DR (L374): the RTO (L374) and the RPO (L374), the plan (L374), and the multi-region story (L286) — the continuity (L374), planned (L374)."

Mental Model

Think of the DR as the hospital's emergency plan. The plan (the DR, L374): the targets (L374) — the ambulance's (the recovery's, L374) response time (the RTO, L374) and the patient's (the data's, L374) blood loss (the RPO, L374); the backups (L304) — the blood bank (the snapshots, L268); the replicas (L286) — the second hospital (the standby, L286); and the drills (the test, L374) — the rehearsed (L374) emergencies (L374). The hospital works because the targets are known, the blood is banked, the second hospital is ready, and the drills are run (L374).

   the emergency plan (the DR, L374)
   ┌────────────────────────────────────────────────────────┐
   │ the targets (L374) — the RTO (L374), the RPO (L374)    │
   │ the blood bank (the backups, L304) · the second        │
   │ hospital (the standby, L286)                           │
   │ the drills (the test, L374) — the rehearsed (L374)     │
   └────────────────────────────────────────────────────────┘

The mental model is the emergency plan: the targets, the banks, and the drills (L374).

Visual Flow — One Recovery

   the disaster (L374)
        │
        ▼
   ┌────────────────────── THE TARGETS (L374) ──────────────────────────┐
   │  the RTO: 15 min (L374) · the RPO: 5 min (L374)                  │
   └──────────────────────────┬───────────────────────────────────────┘
                              ▼
   ┌────────────────────── THE FAILOVER (L273) ─────────────────────────┐
   │  the Route 53 (L273): the health check (L273) → the standby       │
   │  (L286)                                                           │
   └──────────────────────────┬───────────────────────────────────────┘
                              ▼
   ┌────────────────────── THE RECOVERY (L374) ─────────────────────────┐
   │  the replicas (L268) · the backups (L304) · the runbooks (L286)   │
   │  the RTO (L374) measured (L374)                                   │
   └──────────────────────────────────────────────────────────────────┘

The flow is the recovery: disaster → failover → recovery (L374).

How It Works — The Plan, Part by Part

  • The targets (L374). The RTO (L374) and the RPO (L374) — the contract (L374).
  • The plan (L374). The backups (L304), the replicas (L286), the failover (L273).
  • The story (L374). The multi-region AI (L374): the primary (L261) and the standby (L286).
  • The test (L374). The rehearsed (L374): the runbooks (L286) and the drills (L374).

Note

The RTO/RPO is the contract; the test is the proof (L374). The senior answer pairs them (L374): the RTO (L374) — the time to recover — and the RPO (L374) — the data lost — are the contract (L374) with the business (L360); the test (L374) — the drills (L374) and the runbooks (L286) — is the proof (L374): the untested DR (L374) is the imaginary DR (L374). The RTO (L374) measured (L374) on the drill (L374) — the contract (L374) verified (L374).

Real Project Usage

  • An enterprise engagement (L379). The DR (L374) — the RTO/RPO (L374) with the business (L360).
  • A multi-region SaaS (L357). The primary (L261) and the standby (L286) — the L286 story (L286).
  • A regulated AI (L371). The RPO (L374) — the compliance's (L371) requirement (L374).
  • A model service (L278). The model (L278) in the standby (L286) — the Bedrock (L278) multi-region (L374).
  • Anything enterprise (L380). The continuity (L374) — the targets, the plan, the test (L374).

The through-line: the plan is the continuity's — the targets, the story, and the test (L374).

Interview Explanation

Say it in four moves:

  1. The targets. "The RTO (L374) and the RPO (L374)."
  2. The plan. "The backups (L304), the replicas (L286), the failover (L273)."
  3. The story. "The primary (L261) and the standby (L286)."
  4. The test. "The runbooks (L286) and the drills (L374)."

Senior-Level Insights

  • The RPO is the backups' (L374). The snapshots (L268) and the replicas (L286) — the lag (L374) — the data lost (L374).
  • The RTO is the failover's (L374). The Route 53 (L273) and the runbooks (L286) — the recovery's (L374) speed (L374).
  • The multi-region is the AI's (L286). The compute (L264), the data (L268), the models (L278) — the L286 architecture (L286), enterprise-shaped (L374).
  • The model is the DR's (L278). The Bedrock (L278) in the standby (L286) — the model's (L148) availability (L374).
  • The drill is the proof (L374). The rehearsed (L374) — the RTO (L374) measured (L374) — the contract (L374) verified (L374).

Common Mistakes

  • The backup-only (L374). The snapshots (L304) without the failover (L273) — the RTO (L374) hours (L374).
  • The undefined targets (L374). The RTO/RPO (L374) unset (L374) — the recovery (L374) unmeasurable (L374).
  • The single-region (L286). The one region (L261) — the region's (L261) failure (L374) — the standby (L286) missing (L374).
  • The untested DR (L374). The runbooks (L286) un-drilled (L374) — the imaginary (L374) DR (L374).
  • The model forgotten (L278). The data (L268) recovered (L374), the model (L278) unavailable (L374) — the Bedrock (L278) in the standby (L286).

Best Practices

  • Set the targets (L374) — the RTO (L374) and the RPO (L374) with the business (L360).
  • Backup and replicate (L304, L286) — the snapshots (L268) and the cross-region (L268).
  • Failover automatically (L273) — the Route 53 (L273) and the runbooks (L286).
  • Plan the model (L278) — the Bedrock (L278) in the standby (L286).
  • Drill the recovery (L374) — the RTO (L374) measured (L374).

Interview Questions

Q: Walk me through the disaster recovery.

A: The enterprise's continuity (L374). The targets — the RTO (L374) and the RPO (L374). The plan — the backups (L304), the replicas (L286), the failover (L273). The story — the primary (L261) and the standby (L286). And the test — the runbooks (L286) and the drills (L374).

Q: What's the RTO/RPO?

A: The contract (L374): the RTO (L374) — the time to recover: how fast the system (L374) returns (L374); the RPO (L374) — the data lost: how much the backups (L374) lag (L374). The RTO (L374) is the failover's (L273) speed (L374); the RPO (L374) is the replication's (L268) lag (L374).

Q: What's the AI's DR?

A: The multi-region story (L286): the primary (L261) — the compute (L264), the data (L268), the models (L278); and the standby (L286) — the replicas (L268), the Bedrock (L278) in the second region (L286). The L286 architecture (L286), enterprise-shaped (L374).

Q: How do you test it?

A: The drills (L374): the runbooks (L286) rehearsed (L374) — the failover (L273) forced, the RTO (L374) measured, the rollback (L304) practiced (L374). The untested DR (L374) is the imaginary DR (L374) — the drill (L374) is the proof (L374).

Follow-Up Questions

  • What's the RTO/RPO (L374)?
  • What's the plan (L374)?
  • What's the AI's DR (L374)?
  • How do you test it (L374)?
  • What's the story (L286)?

Comparison Table — The RTO vs the RPO

The RTO (L374)The RPO (L374)
The question (L374)how fast (L374)how much lost (L374)
The lever (L374)the failover (L273), the runbooks (L286)the replication (L268), the backups (L304)
The cost (L374)the standby (L286)the replication (L268)
The AI (L374)the model (L278) in the standby (L286)the vectors (L183) replicated (L268)

The senior read: the RTO by the failover, the RPO by the replication (L374).

Code Example — The Plan, Applied

// The DR plan (L374) — the targets, the plan, the test (L374).
// 1 · THE TARGETS (L374) — the contract (L374).
const contract = {
  rto: '15 min',                     // the time to recover (L374)
  rpo: '5 min',                      // the data lost (L374)
};

// 2 · THE REPLICATION (L286) — the RPO's lever (L374).
const replication = {
  rds: { crossRegionReplica: 'us-west-2' },   // L268
  s3:  { replication: 'us-west-2' },          // L265
  pgvector: { replicated: true },             // L183
};

// 3 · THE FAILOVER (L273) — the RTO's lever (L374).
const failover = {
  route53: { healthCheck: '/health', failover: 'us-west-2' },  // L273
  bedrock: { standbyRegion: 'us-west-2' },     // the model (L278, L286)
  runbooks: 'runbooks/dr.md',                  // the rehearsed (L286)
};

// 4 · THE TEST (L374) — the drill (L374).
async function drill() {
  const started = Date.now();
  await forceFailover(failover);               // the forced (L273)
  const rtoMeasured = Date.now() - started;    // the measured (L374)
  assert(rtoMeasured <= parseRto(contract.rto));   // the proof (L374)
}
What the reader must SEE — the plan, applied:

  rto 15m + rpo 5m          → the contract (L374)
  cross-region replicas     → the RPO's lever (L268)
  route53 + bedrock standby → the RTO's lever (L273, L278)
  the drill + the assert    → the proof (L374)

  The targets, the plan, the test (L374).

Tip

The pair that defines the plan: the cross-region replica (the RPO, L268) and the measured drill (the RTO's proof, L374). Set the targets, replicate the data, fail over automatically, drill the recovery — the continuity, planned (L374).

Performance Notes

  • The replica is the RPO (L374). The replication (L268) — the lag (L374) — the data lost (L374).
  • The failover is the RTO (L374). The Route 53 (L273) — the recovery's (L374) speed (L374).
  • The standby is the cost (L285). The second region (L286) — the L285 line (L285) — the DR's (L374) price (L374).
  • The drill is the ops' (L374). The rehearsed (L374) — the scheduled (L221) drill (L374).

Debugging Scenarios

SymptomFirst check (L374)The lever
The RTO is missedThe failover (L273)The runbooks (L286)
The data is lostThe RPO (L374)The replication (L268)
The region failsThe standby (L286)The multi-region (L286)
The model is downThe Bedrock (L278)The standby region (L286)
The DR fails the drillThe test (L374)The rehearsed (L374)

Quick Revision Notes

  • The disaster recovery = the continuity's plan (L374): the targets, the plan, the story, the test.
  • The targets: the RTO (L374) and the RPO (L374).
  • The plan: the backups (L304), the replicas (L286), the failover (L273).
  • The story: the primary (L261) and the standby (L286).
  • The test: the runbooks (L286) and the drills (L374).

Cheat Sheet

DISASTER RECOVERY & BUSINESS CONTINUITY = the RTO, the RPO, the story

THE TARGETS (L374)
  the RTO (L374) — the time to recover (L374)
  the RPO (L374) — the data lost (L374)
  the contract (L374) with the business (L360)

THE PLAN (L374)
  the backups (L304) — the snapshots (L268), the point-in-time (L268)
  the replicas (L286) — the cross-region (L268)
  the failover (L273) — the Route 53 (L273), the standby (L286)

THE STORY (L374)
  the multi-region AI (L374): the primary (L261) — the compute
  (L264), the data (L268), the models (L278)
  the standby (L286) — the replicas (L268), the Bedrock (L278)

THE TEST (L374)
  the runbooks (L286) · the drills (L374)
  the RTO (L374) measured (L374) — the proof (L374)

INTERVIEW, 4 MOVES
  1 targets "the RTO and the RPO (L374)"
  2 plan    "the backups, the replicas, the failover (L374)"
  3 story   "the primary and the standby (L286)"
  4 test    "the runbooks and the drills (L374)"

Key Takeaways

Recap

  • The disaster recovery & business continuity is the RTO, the RPO, and the multi-region AI story (L374): the targets (L374), the plan (L374), the story (L374), and the test (L374)
  • The targets (L374): the RTO (L374) — the time to recover; and the RPO (L374) — the data lost — the contract (L374) with the business (L360)
  • The plan (L374): the backups (L304), the replicas (L286), and the failover (L273)
  • The story (L374): the multi-region AI (L374) — the primary (L261) and the standby (L286) — the compute (L264), the data (L268), the models (L278) — the L286 architecture (L286), enterprise-shaped (L374)
  • The test (L374): the runbooks (L286) and the drills (L374) — the RTO (L374) measured (L374)
  • The principle (L374): the RTO/RPO (L374) is the contract (L374), and the test (L374) is the proof (L374) — the untested DR (L374) is the imaginary DR (L374)

Check your understanding

Answer each one out loud. Then rate yourself honestly.

0/8
1

What's the RTO/RPO (L374)?

2

What's the plan (L374)?

3

What's the AI's DR (L374)?

4

How do you test it (L374)?

5

What's the story (L286)?

6

What's the drill (L374)?

7

What's the contract (L374)?

8

What is the continuity's plan (L374)?

A Closing Note — The Emergency Plan, Drilled

You now hold the plan: the targets, the plan, the story, and the test — with the blood banked and the drills run. The hospital's emergency plan is rehearsed — and the second hospital is ready (L374).

Next: connecting the AI to the systems the business already runs — Enterprise Integration (L375).