# How to Vibe Code Your Own ELSA Speak (and Stop Paying for It)

> The world’s best way to improve your English speaking

- Site: https://elsaspeak.com
- Category: Education & AI Speech Coaching
- Platforms: iOS app, Android app, Web app
- Verdict: **Serious undertaking** (35/100 vibecodeable)
- Estimated effort: 3-6 months of serious development

## Verdict

You should pay for ELSA Speak unless you are building a custom phonetics research engine, because replicating their specialized acoustic models requires massive non-native speech datasets.

While an AI coding agent can scaffold a React Native app with an OpenAI chat wrapper and basic Whisper transcription in a few days, it will completely fail to reproduce ELSA's core value: precise, phoneme-level pronunciation grading for non-native accents. Standard speech-to-text APIs autocorrect minor accent aberrations, rendering them useless as strict accent coaches. Building a functional clone means training custom acoustic models or assembling complex forced-alignment pipelines, making this a serious engineering undertaking.

### What you can't replicate

- Proprietary non-native accented speech datasets collected over a decade
- Sub-word phoneme alignment engines calibrated against professional linguistic dictionaries
- Brand trust, curriculum partnerships, and enterprise compliance integration

## What it does

An AI-powered language learning platform focused on improving English pronunciation, fluency, intonation, and conversational confidence through fine-grained phonetic feedback and role-play bots.

### Core features

- Pronunciation assessment with phonetic breakdown
- Generative AI role-play conversations
- Personalized learning path generation
- Speech analyzer for professional test prep
- Bilingual AI tutor support
- Progress tracking and CEFR-level estimation

## The business

### Pricing

- Free: $0 — Limited access to basic pronunciation checks, dictionary, and trial study plans.
- ELSA Premium (3-Month): $20.00/mo — Billed quarterly at $59.99.
- ELSA Premium (1-Year): $13.33/mo — Billed annually at $159.99.
- ELSA Business & Schools: Custom — Custom enterprise pricing based on seat volume with administrative reporting dashboards.

### Funding

$40M+ raised.
- Series A (2017): $7M
- Pre-Series A (2018): $3.2M
- Series A Extension (2019): $7M
- Series B (2021): $15M
- Expansion Round (2023): $20M
Investors: Gradient Ventures, Monk's Hill Ventures

Founded 2015.
Team size: 200-500.

## The hard parts

- Trained non-native acoustic models for fine-grained phoneme alignment and error detection
- Low-latency real-time bidirectional audio streaming and voice processing loops
- Extensive localized content library across 10+ native source languages
- Dynamic curriculum generation matching adaptive user levels

## How to vibe code ELSA Speak

### Prerequisites

- Node.js (free): Runtime environment for building and executing the web backend and tooling.
- Expo Account (free): Required for building and testing cross-platform mobile app bundles.
- GitHub (free): Repository hosting and version control integration for AI coding tools.

### Recommended AI tools

- Claude Code: Best-in-class terminal coding agent for multi-file scaffolding, API integration, and debugging loops.
- Cursor: AI-native code editor ideal for reviewing diffs and making rapid iterative UI updates.

### Stack

- Frontend: React Native with Expo
- Backend: Next.js API routes
- Database: Supabase (PostgreSQL with pgvector)
- Auth: better-auth
- Payments: RevenueCat
- Other: OpenAI API, ElevenLabs, PostHog

### Hosting

- Vercel (Hosting the web backend API routes and analytics dashboard): $0-20/mo
- Supabase (Managing user profiles, lesson contents, and vector embeddings): $0-25/mo

### Build guide

1. **Project Scaffolding & Database Schema** — Initialize the React Native mobile app using Expo and configure the backend database with Supabase.

```
Initialize a new Expo React Native TypeScript app with file-based routing. Set up Supabase client connections and create database schemas for users, lessons, phonemes, and user speech practice attempts. Ensure environment variables are structured correctly for local development and production.
```

2. **Authentication & User Profiles** — Implement user authentication using better-auth integrated with Supabase PostgreSQL.

```
Set up email/password and social login authentication flows using better-auth pointing to our Supabase PostgreSQL instance. Build login and registration screens in the Expo app with proper session token storage and persistence.
```

3. **Lesson Management & UI Navigation** — Build the core bite-sized lesson navigation screen and dynamic card interface.

```
Create a structured lesson feed screen within the Expo app supporting categories like pronunciation, vocabulary, and grammar. Fetch lesson content dynamically from Supabase tables and render interactive cards with progress bars and score indicators.
```

4. **Audio Recording & Whisper Transcription Pipeline** — Implement audio capture in the mobile app and connect to OpenAI Whisper API for speech evaluation.

```
Build an audio recording component using Expo AV that records user speech snippets upon button press. Send the audio blob to a Next.js backend endpoint that calls the OpenAI Whisper API to transcribe the audio and return text transcripts for comparison against target sentences.
```

5. **AI Role-Play Chat Interface** — Create a real-time conversational AI role-play screen backed by OpenAI LLM endpoints.

```
Implement a conversational chat interface for AI role-play scenarios (e.g., job interviews, workplace meetings). Connect the chat interface to an OpenAI API endpoint that streams contextual assistant responses and utilizes ElevenLabs for optional voice text-to-speech playback.
```

6. **Progress Tracking & Analytics Dashboard** — Add visual performance graphs and CEFR-level scoring dashboards.

```
Create a progress tracking screen in the app that aggregates user practice attempts, pronunciation accuracy scores, and estimated CEFR levels from Supabase. Use a charting library to visualize skill improvements over time.
```

7. **In-App Subscriptions & Deployment** — Configure RevenueCat for cross-platform subscriptions and prepare app builds for store deployment.

```
Integrate RevenueCat SDK into the Expo app to manage subscription paywalls and entitlement checking for Premium features. Configure EAS build profiles for iOS and Android application store distribution.
```

### Cost vs paying

**Starting costs (one-time):**

- Apple Developer Account: $99/yr
- Google Play Developer Account: $25 one-time
- AI Coding Assistant Subscriptions: $40
- Total: ~$164 one-time

**Ongoing costs (monthly):**

- Supabase Pro Tier: $25/mo
- OpenAI & ElevenLabs API Usage: $30/mo
- Total: ~$55/mo

- Paying for the SaaS instead: $13.33/mo
- Build time: 120-160 hours
- AI tool credits: $40.00
- Break-even: Never (commercial subscriptions are vastly cheaper)

## Sources

- [ELSA Speak Official Website & Marketing Pages](https://elsaspeak.com)
- [New Market Pitch - Top EdTech Startups 2026](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFcmniTzb3SbRL0t2FOtPVcRxnnAHY9sbX4sC44riE0sopXerOnkC4RyTLHdOLnLw0mkB756B0sV9gY2Xw_lyMPwZgL9EE97DPqEYCTI5aJ8R_3CfEib6wopI52urhPps_46jvdgTKBWw_UCrvyHd14MPY5Jvf2sEhtyec-)
- [KrASIA - Startup Stories: ELSA Speak AI Technology Deep Dive](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHYL2yunQWd6RQcrbT6E_rzg3iaUnEheZDaM0jSGK2EuxC4K8EU_vCQnBgKhYx4n-DOh38pbNLm1fqOtxXeUfGN8zt08mJjUyXI9P1eHDcVFh0V43DFfhoMZrYWeOe1xE2c1bIO-ckO6kDL3NzbU963J-ONi347CQuX8TcYndPFrQDhzhj2kH_y72oHcoUxJm5OmdVc)