Spaces:
Building
Building
A newer version of the Streamlit SDK is available:
1.47.0
metadata
title: Omniscient
emoji: ๐๏ธโ๐จ๏ธ
colorFrom: indigo
colorTo: purple
sdk: streamlit
python_version: 3.11
sdk_version: 1.35.0
app_file: app.py
pinned: false
๐ง Omniscient
"The all-knowing AI that sees everything, knows everything"
A versatile AI bot for image analysis and dataset curation with support for multiple AI models
๐ฎ Try it Live on HuggingFace! (Actively WIP)
โจ Features
๐ Quick Start
๐ Step 1: Setup Environment
cd simple_G_ai_bot
Create a .env
file in the project root:
# ๐ .env
OPENAI_API_KEY=your_openai_api_key_here
ANTHROPIC_API_KEY=your_anthropic_api_key_here
GOOGLE_API_KEY=your_google_api_key_here
๐ฆ Step 2: Install Dependencies
uv sync
๐ฏ Step 3: Usage Examples
๐๏ธ Dataset Curation
Generate 50 urban outdoor samples:
python main.py --mode data --samples 50 --urban --no-indoor
โก Single Image Analysis
Benchmark GPT-4o on 5 samples:
python main.py --mode benchmark --models gpt-4o --samples 5
๐ง Agentic Analysis
Run multi-step analysis with Gemini:
python main.py --mode agent --model gemini-2.5-pro --steps 10 --samples 5
โ๏ธ Configuration
๐ Environment Variables
Variable | Description | Status |
---|---|---|
OPENAI_API_KEY |
OpenAI API key for GPT models | ๐ถ Optional |
ANTHROPIC_API_KEY |
Anthropic API key for Claude models | ๐ถ Optional |
GOOGLE_API_KEY |
Google AI API key for Gemini models | ๐ถ Optional |
๐ ๏ธ Command Line Options
๐ Common Options
--mode
โ Operation mode (data
,benchmark
,agent
)--samples
โ Number of samples to process (default: 10)
๐๏ธ Data Mode Options
--urban
โ Focus on urban environments--no-indoor
โ Exclude indoor scenes
๐ Benchmark Mode Options
--models
โ AI model to use (e.g.,gpt-4o
,claude-3
,gemini-pro
)
๐ค Agent Mode Options
--model
โ AI model for agentic analysis--steps
โ Number of reasoning steps (default: 5)
๐ฏ Supported Models
Provider | Models | Status |
---|---|---|
๐ต OpenAI | GPT-4o, GPT-4, GPT-3.5-turbo | โ Active |
๐ฃ Anthropic | Claude-3-opus, Claude-3-sonnet, Claude-3-haiku | โ Active |
๐ด Google | Gemini-2.5-pro, Gemini-pro, Gemini-pro-vision | โ Active |
๐ Requirements
Prerequisites:
- ๐ Python 3.8+
- ๐ฆ UV package manager
- ๐ Valid API keys for desired AI providers
๐ง Installation
1๏ธโฃ Clone the repository
2๏ธโฃ Navigate to project directory
|
3๏ธโฃ Create
4๏ธโฃ Install dependencies
|
5๏ธโฃ Run the bot with desired mode and options! ๐
๐ก Examples
๐๏ธ Basic Dataset Generation
python main.py --mode data --samples 20
๐ Urban Scene Analysis
python main.py --mode data --samples 30 --urban --no-indoor
โ๏ธ Model Comparison
# GPT-4o Analysis
python main.py --mode benchmark --models gpt-4o --samples 10
# Claude-3 Analysis
python main.py --mode benchmark --models claude-3-opus --samples 10
๐ง Advanced Agentic Workflow
python main.py --mode agent --model gemini-2.5-pro --steps 15 --samples 3
๐ Security Note
โ ๏ธ Important: Never commit your
.env
file to version control. Add.env
to your.gitignore
file to keep your API keys secure.