Getting Started
Prerequisites
- macOS with Xcode installed
- iOS device (Simulator has limited support due to
ios_systemconstraints) - An API key from a supported provider (OpenAI, Azure, Gemini, etc.)
Clone the Repository
git clone https://github.com/OpenRocky/OpenRocky.git
cd OpenRocky
Open in Xcode
open Rocky/Rocky.xcodeproj
The project uses Swift Package dependencies located in the Packages/ directory. Xcode will resolve them automatically.
Build
Select your target device and build:
xcodebuild build -scheme Rocky -project Rocky/Rocky.xcodeproj -destination 'generic/platform=iOS'
The ios_system framework does not support iOS Simulator. For full functionality, build and run on a physical device.
Configure Providers
Rocky uses two separate provider systems — one for Chat (text) and one for Voice (realtime audio). You can configure them independently with different models and API keys.
After launching the app, go to Settings > Providers where you'll see two tabs:
Chat Provider
Used for text-based conversations, task planning, and tool execution.
| Provider | Example Models |
|---|---|
| OpenAI | GPT-5, GPT-4o |
| Azure OpenAI | GPT-4o (deployment) |
| Anthropic | Claude 3.7 Sonnet |
| Google Gemini | Gemini 2.5 Pro / Flash |
| Groq | Llama 3.3 70B |
| xAI | Grok 3 Beta |
| OpenRouter | Multi-model proxy |
| DeepSeek | DeepSeek Chat |
| Doubao (Volcengine) | Doubao Seed |
| AIProxy | Proxy-based access |
Voice Provider
Used for real-time voice conversations — the primary interaction mode.
| Provider | Example Models | Notes |
|---|---|---|
| OpenAI Realtime | GPT Realtime Mini / GPT Realtime | Full-featured |
| Doubao Realtime | Doubao E2E Voice | Optimized for Chinese |
| Gemini Live | Gemini 2.5 Flash Native Audio | Native audio |
Only one Chat provider and one Voice provider can be active at a time, but you can configure multiple instances of each and switch between them freely.
Setup Steps
- Open Rocky app
- Go to Settings > Providers
- Switch between the Chat and Voice tabs
- Tap Add Provider, select the provider type
- Enter your API key and configure the endpoint if needed
- Tap to activate the provider you want to use
Start Talking
Tap the voice button on the home screen and start talking to Rocky. Voice is the primary input — just speak naturally about what you want to accomplish.