How TalkToData Works

Powered by an Agentic AI built with the OpenAI Agents SDK and GPT-4o

System Architecture

Frontend

Next.js + React

Supabase

Auth + DB + Storage

AI Agent Service

FastAPI Backend + OpenAI Agents SDK

Agentic Loop (ReAct Pattern)

Query
Think
Act
Observe
Repeat until complete

File Tools

3 tools

Analysis Tools

5 tools

Visualization

5 tools

OpenAI API

GPT-4o

Key AI Concepts

LLM Backbone

GPT-4o provides reasoning, natural language understanding, and autonomous decision-making capabilities.

Tool Use / Function Calling

Agent invokes Python functions decorated with @function_tool to interact with data and generate visualizations.

ReAct Pattern

Agent iteratively Reasons about the task, Acts by calling tools, and Observes results in a loop.

Prompt Engineering

System instructions guide agent behavior, define capabilities, and structure response format for consistent outputs.

11 Agent Tools

File Tools
  • • Load datasets (CSV, Excel)
  • • Inspect column schemas
  • • List available files
Analysis Tools
  • • Statistical summaries
  • • Data filtering
  • • Group by aggregations
  • • Value counts
  • • Correlation analysis
Visualization Tools
  • • Bar charts
  • • Line charts
  • • Histograms
  • • Scatter plots
  • • Pie charts