Hureka AI
BYOK Multi-Tenant AI SaaS Platform
Overview
A Bring-Your-Own-Key (BYOK) multi-tenant AI customer support platform where organizations connect their own LLM API keys, upload knowledge documents, and deploy autonomous AI support with human-in-the-loop approval workflows.
The Challenge
Enterprise clients needed an AI support platform without surrendering their LLM API keys to a third party. The system had to support multiple LLM providers (Anthropic, OpenAI, Google, Ollama), enforce strict tenant isolation, encrypt API keys at rest with AES-256-GCM, and handle durable multi-step email workflows with human approval gates.
The Solution
Architected a pnpm monorepo with Next.js 15 frontend and Temporal-powered workflow orchestration. Built a unified LLM adapter pattern supporting Anthropic, OpenAI, Google, and self-hosted Ollama. Implemented AES-256-GCM encryption with per-organization key storage, Prisma middleware for automatic tenant scoping, and LangFuse integration for LLM observability and cost tracking.
Results
- ✓Zero raw API key exposure — all keys encrypted at rest with AES-256-GCM
- ✓Multi-LLM support via unified adapter pattern (Anthropic, OpenAI, Google, Ollama)
- ✓Durable email workflows with human approval via Temporal
- ✓Full audit trail for every LLM call and key decryption event
- ✓Per-tenant rate limiting and cost tracking via LangFuse