Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update docs to remove dup python reqs install and add sample .env #2

Open
medright opened this issue Oct 26, 2024 · 0 comments
Open

Comments

@medright
Copy link

Hello, I've got a branch that updates the docs and includes a sample .env for folks to edit. would it be ok to allow folks to push feature branches for review? here is the docs update for instance:

Anthropic Computer Use (for Mac)

Anthropic Computer Use is a beta Anthropic feature which runs a Docker image with Ubuntu and controls it. This fork allows you to run it natively on macOS, providing direct system control through native macOS commands and utilities.

Caution

This comes with obvious risks. The Anthropic agent can control everything on your Mac. Please be careful.
Anthropic's new Claude 3.5 Sonnet model refuses to do unsafe things like purchase items or download illegal content.

Features

  • Native macOS GUI interaction (no Docker required)
  • Screen capture using native macOS commands
  • Keyboard and mouse control through cliclick
  • Multiple LLM provider support (Anthropic, Bedrock, Vertex)
  • Streamlit-based interface
  • Automatic screen resolution scaling
  • File system interaction and editing capabilities

Prerequisites

  • macOS Sonoma 15.7 or later
  • Python 3.12+
  • Homebrew (for installing additional dependencies)
  • cliclick (brew install cliclick) - Required for mouse and keyboard control

Setup Instructions

  1. Clone the repository and navigate to it:
git clone https://github.com/deedy/mac_computer_use.git
cd mac_computer_use
  1. Run the setup script:
chmod +x setup.sh
./setup.sh

This will:

  • Install system dependencies if needed (Homebrew, Python 3.12, cliclick)
  • Create and activate a Python virtual environment
  • Install all required Python packages
  • Create an activation script

Running the Demo

Set up your environment and Anthropic API key

  1. Copy the sample environment file and configure your settings:
cp .sample.env .env
  1. Edit the .env file with your settings. At minimum, you'll need:
  • Your Anthropic API key from Anthropic Console
  • Desired screen dimensions (recommended: stay within XGA/WXGA resolution)

Example minimal configuration:

API_PROVIDER=anthropic
ANTHROPIC_API_KEY=your_key_here
WIDTH=1280
HEIGHT=800
DISPLAY_NUM=1

For other API providers (Bedrock, Vertex), refer to the additional settings in .sample.env.

  1. Activate the environment:
source activate.sh
  1. Start the Streamlit app:
streamlit run streamlit.py

The interface will be available at http://localhost:8501

Screen Size Considerations

We recommend using one of these resolutions for optimal performance:

  • XGA: 1024x768 (4:3)
  • WXGA: 1280x800 (16:10)
  • FWXGA: 1366x768 (~16:9)

Higher resolutions will be automatically scaled down to these targets to optimize model performance. You can set the resolution using environment variables:

export WIDTH=1024
export HEIGHT=768
streamlit run streamlit.py

Important

The Beta API used in this reference implementation is subject to change. Please refer to the API release notes for the most up-to-date information.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant