Dilip Singh logo

Hureka AI

BYOK Multi-Tenant AI SaaS Platform

Client
Hureka Technologies Inc
Industry
Enterprise SaaS / AI
Duration
18 months
Role
Lead Software Architect
4+
LLM Providers
AES-256
Encryption
Multi
Tenants
Temporal
Workflow Engine

Overview

A Bring-Your-Own-Key (BYOK) multi-tenant AI customer support platform where organizations connect their own LLM API keys, upload knowledge documents, and deploy autonomous AI support with human-in-the-loop approval workflows.

The Challenge

Enterprise clients needed an AI support platform without surrendering their LLM API keys to a third party. The system had to support multiple LLM providers (Anthropic, OpenAI, Google, Ollama), enforce strict tenant isolation, encrypt API keys at rest with AES-256-GCM, and handle durable multi-step email workflows with human approval gates.

The Solution

Architected a pnpm monorepo with Next.js 15 frontend and Temporal-powered workflow orchestration. Built a unified LLM adapter pattern supporting Anthropic, OpenAI, Google, and self-hosted Ollama. Implemented AES-256-GCM encryption with per-organization key storage, Prisma middleware for automatic tenant scoping, and LangFuse integration for LLM observability and cost tracking.

Results

  • Zero raw API key exposure — all keys encrypted at rest with AES-256-GCM
  • Multi-LLM support via unified adapter pattern (Anthropic, OpenAI, Google, Ollama)
  • Durable email workflows with human approval via Temporal
  • Full audit trail for every LLM call and key decryption event
  • Per-tenant rate limiting and cost tracking via LangFuse

Tech Stack

Next.js 15TemporalPrismaLangFuseAES-256-GCMRedispnpm MonorepoPostgreSQL