diff --git a/README.md b/README.md index bfb2f29..1947b50 100644 --- a/README.md +++ b/README.md @@ -26,20 +26,36 @@ ITEM_PIPELINES = { } ``` +### Save Scraped Items + +```python +from crawlab import save_item + +scraped_items = [ + { + 'name': 'item1', + 'value': 'value1' + }, + { + 'name': 'item2', + 'value': 'value2' + } +] + +for item in scraped_items: + save_item(item) +``` + ## Development -### Install dependencies +### Pre-requisites ```bash -pip install -r requirements.txt +pip install poetry ``` -### Compile gRPC +### Install dependencies ```bash -# Set the environment variable CRAWLAB_PROTO_PATH to the path of the gRPC proto files -export CRAWLAB_PROTO_PATH=/path/to/grpc/proto/files - -# Compile gRPC to Python code -./compile_grpc.sh +poetry install ```