Back to Portfolio

TestPilot AI

AI-Powered Test Automation Platform

Visit Live AppTimeline: 4 weeks from concept to production

The Problem

Manual testing is slow, expensive, and error-prone. QA teams spend hours writing test scripts for every feature change. Small teams often skip testing entirely, leading to production bugs and customer churn.

The Solution

TestPilot AI uses Claude AI to automatically generate comprehensive test plans from plain-English requirements. It runs browser-based tests in serverless Lambda functions with Playwright, providing AI-analyzed results with actionable insights — no test scripts to write.

My Approach

1

Designed a multi-tenant architecture supporting organizations with role-based access

2

Built AI test plan generation using Claude with structured output parsing

3

Implemented serverless browser testing using Playwright inside Lambda (custom layer with Chromium)

4

Created SQS FIFO queue for reliable test job processing with exactly-once delivery

5

Built real-time progress tracking with DynamoDB streams and polling

6

Deployed via CloudFront + S3 for global edge caching

Architecture

Next.js 14 (Static Export) → CloudFront CDN

API Gateway → Lambda (Express.js) for REST API

SQS FIFO Queue for test job queuing

Worker Lambda with Playwright + Chromium layer

DynamoDB (5 tables: Users, Orgs, Members, Projects, Runs)

Claude AI API for test plan generation and result analysis

Tech Stack

Next.jsTypeScriptAWS LambdaDynamoDBSQS FIFOAPI GatewayCloudFrontS3PlaywrightClaude AITailwind CSS

Key Results

~12s

Test Generation Time

From requirements to full test plan with AI

$3/mo

Infrastructure Cost

Fully serverless, pay only for actual test runs

< 60s

Test Execution

Full browser-based test suite per run

100%

Zero Servers

Completely serverless — no EC2 instances to manage

Challenges & Solutions

Lessons Learned

  • Lambda cold starts matter for UX — pre-warming strategies and provisioned concurrency help for critical paths
  • DynamoDB single-table design pays off massively at scale but requires upfront query pattern planning
  • SQS FIFO with Lambda is the most reliable async pattern — built-in retries, DLQ, and exactly-once processing
  • Static export + CloudFront is unbeatable for cost and performance — $0.01/mo hosting for unlimited traffic

Want something similar?

I build production-grade serverless applications. Let's discuss your next project.

Let's TalkBack to Portfolio