Omniscient / README.md
Chrisyichuan's picture
upd link
6af1bca

A newer version of the Streamlit SDK is available: 1.47.0

Upgrade
metadata
title: Omniscient
emoji: ๐Ÿ‘๏ธโ€๐Ÿ—จ๏ธ
colorFrom: indigo
colorTo: purple
sdk: streamlit
python_version: 3.11
sdk_version: 1.35.0
app_file: app.py
pinned: false

๐Ÿง  Omniscient

"The all-knowing AI that sees everything, knows everything"

Python License Streamlit HuggingFace

A versatile AI bot for image analysis and dataset curation with support for multiple AI models

๐ŸŽฎ Try it Live on HuggingFace! (Actively WIP)


โœจ Features

๐Ÿ—ƒ๏ธ Dataset Curation

Generate and curate high-quality image datasets with intelligent filtering and categorization.

๐Ÿ” Single Image Analysis

Benchmark different AI models on individual images with detailed performance metrics.

๐Ÿค– Agentic Analysis

Multi-step AI reasoning and analysis with advanced decision-making capabilities.

๐ŸŒ Multiple AI Providers

Seamless integration with OpenAI, Anthropic, and Google AI platforms.


๐Ÿš€ Quick Start

๐Ÿ“‹ Step 1: Setup Environment

cd simple_G_ai_bot

Create a .env file in the project root:

# ๐Ÿ” .env
OPENAI_API_KEY=your_openai_api_key_here
ANTHROPIC_API_KEY=your_anthropic_api_key_here
GOOGLE_API_KEY=your_google_api_key_here

๐Ÿ“ฆ Step 2: Install Dependencies

uv sync

๐ŸŽฏ Step 3: Usage Examples

๐Ÿ—๏ธ Dataset Curation

Generate 50 urban outdoor samples:

python main.py --mode data --samples 50 --urban --no-indoor
โšก Single Image Analysis

Benchmark GPT-4o on 5 samples:

python main.py --mode benchmark --models gpt-4o --samples 5
๐Ÿง  Agentic Analysis

Run multi-step analysis with Gemini:

python main.py --mode agent --model gemini-2.5-pro --steps 10 --samples 5

โš™๏ธ Configuration

๐Ÿ”‘ Environment Variables

Variable Description Status
OPENAI_API_KEY OpenAI API key for GPT models ๐Ÿ”ถ Optional
ANTHROPIC_API_KEY Anthropic API key for Claude models ๐Ÿ”ถ Optional
GOOGLE_API_KEY Google AI API key for Gemini models ๐Ÿ”ถ Optional

๐Ÿ› ๏ธ Command Line Options

๐ŸŒŸ Common Options

  • --mode โ†’ Operation mode (data, benchmark, agent)
  • --samples โ†’ Number of samples to process (default: 10)

๐Ÿ™๏ธ Data Mode Options

  • --urban โ†’ Focus on urban environments
  • --no-indoor โ†’ Exclude indoor scenes

๐Ÿ“Š Benchmark Mode Options

  • --models โ†’ AI model to use (e.g., gpt-4o, claude-3, gemini-pro)

๐Ÿค– Agent Mode Options

  • --model โ†’ AI model for agentic analysis
  • --steps โ†’ Number of reasoning steps (default: 5)

๐ŸŽฏ Supported Models

Provider Models Status
๐Ÿ”ต OpenAI GPT-4o, GPT-4, GPT-3.5-turbo โœ… Active
๐ŸŸฃ Anthropic Claude-3-opus, Claude-3-sonnet, Claude-3-haiku โœ… Active
๐Ÿ”ด Google Gemini-2.5-pro, Gemini-pro, Gemini-pro-vision โœ… Active

๐Ÿ“‹ Requirements

Prerequisites:

  • ๐Ÿ Python 3.8+
  • ๐Ÿ“ฆ UV package manager
  • ๐Ÿ”‘ Valid API keys for desired AI providers

๐Ÿ”ง Installation

1๏ธโƒฃ Clone the repository

git clone <repository-url>

2๏ธโƒฃ Navigate to project directory

cd simple_G_ai_bot

3๏ธโƒฃ Create .env file with your API keys

touch .env
# Add your API keys

4๏ธโƒฃ Install dependencies

uv sync

5๏ธโƒฃ Run the bot with desired mode and options! ๐ŸŽ‰


๐Ÿ’ก Examples

๐Ÿ—๏ธ Basic Dataset Generation

python main.py --mode data --samples 20

๐ŸŒ† Urban Scene Analysis

python main.py --mode data --samples 30 --urban --no-indoor

โš”๏ธ Model Comparison

# GPT-4o Analysis
python main.py --mode benchmark --models gpt-4o --samples 10

# Claude-3 Analysis  
python main.py --mode benchmark --models claude-3-opus --samples 10

๐Ÿง  Advanced Agentic Workflow

python main.py --mode agent --model gemini-2.5-pro --steps 15 --samples 3

๐Ÿ” Security Note

โš ๏ธ Important: Never commit your .env file to version control. Add .env to your .gitignore file to keep your API keys secure.


๐Ÿ“œ License

MIT License - see LICENSE file for details.


Made with love AI Powered Open Source

โญ Star this repo if you find it useful!