Architecture

Prompt Store employs a number of containers running on a Kubernetes cluster. The application is not limited to Kubernetes, however Kubernetes is the default deployment environment.

The application consists of a React SPA front-end, and an API back-end, which integrates with various API services including OpenAI.

A PostgreSQL database is used to store content and metadata such as campaign information.

Keycloak is used as the default Identity Management and Authentication Server. Keycloak supports Single Sign-on (SSO), and federated authentication to the organisation’s own Identity Management System such as Azure AD or Okta.

Keycloak also generates the bearer tokens for API authentication between the front-end and the back-end components.

Prompt Store Web

React SPA application.

Prompt Store API

Backend API server.

Temporal Engine

Scheduled and triggered background job processing.

Onesource

Extracts annotated text and metadata from documents types such as PDF and Word.

Vecsearch

Semantic indexing and search engine.

Private models

Private model serving using Knative for on-demand inference supporting scale up and scale down to zero.

Keycloak

Identity management and SSO.

Grafana Loki

Logging.

Istio

Service mesh.