|
1 | | -# DeepClawBenchmark |
| 1 | + |
2 | 2 |
|
3 | | -paper | poster | video |
| 3 | +# The DeepClaw Benchmark |
4 | 4 |
|
5 | | -The DeepClaw benchmark is a framework for establishing a reproducible and shareable benchmarking for dexterous manipulation. DeepClaw benchmark provides a standardized dexterous manipulation pipeline consisting of four subtasks: localization, recognition, grasp planning, and motion planning. It also provide necessary components to benchmark manipulations including hardware drivers, data I/O utilities, baseline algorithm modules and evaluation metrics. |
| 5 | +The DeepClaw is a benchmarking model zoo that functions as a Reconfigurable Robotic Manipulation System for Robot Learning. The main homepage can be found at [here](https://bionicdl-sustech.github.io/DeepClawBenchmark/). This is the GitHub repository of DeepClaw source code, including instructions for installing and using DeepClaw. |
6 | 6 |
|
7 | | -The DeepClaw has been used extensively to benchmark a series of manipulation tasks including claw machine, jigsaw game and TicTacToe. The source codes of these experiments are placed under /examples. |
8 | | - |
| 7 | +## Resources |
9 | 8 |
|
10 | | -## Quick Start |
| 9 | +- Documentation: https://bionicdl-sustech.github.io/DeepClawBenchmark/ |
| 10 | +- Paper explaining DeepClaw: [arXiv:2005.02588 [cs.RO]](https://arxiv.org/abs/2005.02588) |
| 11 | +- Papers using DeepClaw: |
| 12 | + - [arXiv:2003.01584 [cs.RO]](https://arxiv.org/abs/2003.01584) |
| 13 | + - [arXiv:2003.01583 [cs.RO]](https://arxiv.org/abs/2003.01583) |
| 14 | + - [arXiv:2003.01582 [cs.RO]](https://arxiv.org/abs/2003.01582) |
11 | 15 |
|
12 | | -### Prerequisites |
| 16 | +## Code Organization |
13 | 17 |
|
14 | | -DeepClaw framework has only been tested with *Python 2.7* and *Ubuntu 16.04 LTS*. We recommend using a virtual environment (such as virtualenv) to manage DeepClaw. |
| 18 | +The DeepClaw code is organized as follows: |
15 | 19 |
|
16 | | -Install virtualenv. |
| 20 | + configs/ configuration for robotic station for manipulation tasks. |
| 21 | + deepclaw/drivers/ drivers for various robotic hardware, i.e. ur, franka, aubo. |
| 22 | + deepclaw/models/ model zoo for segmentation, classification, pick planning, and motion planning. |
| 23 | + deepclaw/utils/ server setup with dockers and client setup for laptops (x86) and jetson (arm). |
| 24 | + projects/proj_TrashSorting a sample project to run deepclaw for sorting trash. |
| 25 | + datasets/trash description of trash sorting dataset |
| 26 | + docs/ description of this document as a manual. |
| 27 | + data/trash data on trash sorting |
17 | 28 |
|
18 | | -```shell |
19 | | -$ pip install -U virtualenv |
20 | | -``` |
21 | | - |
22 | | -Create a new virtual environment. |
23 | | - |
24 | | -```shell |
25 | | -$ virtualenv -p /usr/bin/python2.7 ./DCvenv |
26 | | -``` |
27 | | - |
28 | | -Activate or retreat from virtual environment. |
29 | | - |
30 | | -```shell |
31 | | -$ source ./DCvenv/bin/activate # activate virtual environment |
32 | | -$ deactivate # retreat from virtual environment |
33 | | -``` |
34 | | - |
35 | | -### Installation |
36 | | - |
37 | | -Clone or download DeepClaw from Github. |
38 | | - |
39 | | -```shell |
40 | | -$ git clone https://github.com/bionicdl-sustech/DeepClawBenchmark.git |
41 | | -$ cd ./DeepClawBenchmark |
42 | | -``` |
43 | | - |
44 | | -Install Prerequisites: |
45 | | - |
46 | | -```shell |
47 | | -$ pip install -r requirements.txt |
48 | | -``` |
49 | | -Build libfranka server |
50 | | -```shell |
51 | | -$ cd ./DeepClawBenchmark/driver/arms/Franka/libfraka_server |
52 | | -$ mkdir build |
53 | | -$ cd build |
54 | | -$ cmake .. |
55 | | -$ make |
56 | | -``` |
57 | | -### Verify Installation |
58 | | -Run calibration task with your drivers, for example, UR10e, HandE, Kinect and so on. |
| 29 | +## Bibliography |
59 | 30 |
|
60 | | -```shell |
61 | | -$ python main.py ur10e hande kinect-azure calibration true |
62 | 31 | ``` |
63 | | - |
64 | | -There also are some test cases for testing your installation and calibration. |
65 | | - |
66 | | -[Test cases](https://github.com/bionicdl-sustech/DeepClawBenchmark/blob/master/Documents/TestCases.md) |
67 | | - |
68 | | -## <a name="tasks">Tasks</a> |
69 | | -We have implemented some tasks using DeepClaw with classical algorithm modules: |
70 | | -- Task Family 1: [Jigsaw](https://github.com/bionicdl-sustech/DeepClawBenchmark/blob/master/Documents/Jigsaw_task/task_description.md) |
71 | | -- Task Family 2: Tic-tac-toe Game |
72 | | -- Task Family 3: Toy Claw Machine |
73 | | - |
74 | | -Find the task description template [here](https://github.com/bionicdl-sustech/DeepClawBenchmark/blob/master/Documents/Task-Description-Template.md). |
75 | | -And we encourage developers to create new tasks ([how to create](https://github.com/bionicdl-sustech/DeepClawBenchmark/blob/python2.7/documents/How-to-Create-Task.md)). |
76 | | -## Algorithm Modules |
77 | | -We also provide modules pool for developers to assembly their own manipulation tasks. |
78 | | - |
79 | | -Find all modules description [here](https://github.com/bionicdl-sustech/DeepClawBenchmark/tree/python2.7/modules). |
80 | | -And how to create a new module. |
81 | | -## References |
82 | | -[1] O. Kroemer, S. Niekum, and G. Konidaris, “A review of robot learning for manipulation: Challenges, representations, and algorithms,”arXiv preprintarXiv:1907.03146, 2019. |
| 32 | +@misc{wan2020deepclaw, |
| 33 | + title={DeepClaw: A Robotic Hardware Benchmarking Platform for Learning Object Manipulation}, |
| 34 | + author={Fang Wan and Haokun Wang and Xiaobo Liu and Linhan Yang and Chaoyang Song}, |
| 35 | + year={2020}, |
| 36 | + eprint={2005.02588}, |
| 37 | + archivePrefix={arXiv}, |
| 38 | + primaryClass={cs.RO} |
| 39 | +} |
| 40 | +``` |
0 commit comments