Skip to content

Commit

Permalink
Merge pull request #297 from visual-layer/dnth/nb-split
Browse files Browse the repository at this point in the history 
Split Enrichment notebook into smaller notebooks
  • Loading branch information
@amiralush
amiralush authored Nov 1, 2023
2 parents 3ca37ef + 4b76fb9 commit eb44148
Show file tree
Hide file tree
Showing 8 changed files with 3,255 additions and 15 deletions.
115 changes: 101 additions & 14 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -363,8 +363,8 @@ Learn the basics of fastdup through interactive examples. View the notebooks on
</table>


## Data Sources
This notebooks in this section shows how you can load data from various sources and analyze them with fastdup.
## Load Data From Sources
The notebooks in this section show how to load data from various sources and analyze them with fastdup.

<table>
<tr>
Expand Down Expand Up @@ -591,49 +591,130 @@ This notebooks in this section shows how you can load data from various sources
<!-- ------------------------------------------------------------------- -->
</table>


## Exciting New Features

> **Note**: We're happy to announce new features are out from beta testing and now available to the public, completely free of charge! We invite you to try them out and provide us with your valuable [feedback](https://visualdatabase.slack.com/join/shared_invite/zt-19jaydbjn-lNDEDkgvSI1QwbTXSY6dlA#/shared-invite/email)!
## Enrich Data Using Foundation Models
The notebooks in this section show how to enrich your visual dataset using various foundation models supported in fastdup.

<table>
<tr>
<td rowspan="4" width="160">
<a href="https://visual-layer.readme.io/docs/enrichment-zero-shot">
<img src="./gallery/enrichment_thumbnail.jpg" width="200">
<a href="https://visual-layer.readme.io/docs/enrichment-zero-shot-classification">
<img src="./gallery/enrichment_classification_thumbnail.jpg" width="200">
</a>
</td>
<td rowspan="4">
<b> 🎞 Zero-Shot Classification:</b> Enrich your visual data with zero-shot image classification and tagging models such as <a href="https://github.com/xinyu1205/recognize-anything">Recognize Anything Model</a>, <a href="https://github.com/xinyu1205/recognize-anything">Tag2Text</a>, and more.<br><br>
<div align="right"><a href="https://visual-layer.readme.io/docs/enrichment-zero-shot-classification">🔗 Learn More.</a></div>
</td>
<td align="center" width="80">
<a href="https://nbviewer.org/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-classification.ipynb">
<img src="./gallery/nbviewer_logo.png" height="30">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-classification.ipynb">
<img src="./gallery/github_logo.png" height="25">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://colab.research.google.com/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-classification.ipynb">
<img src="./gallery/colab_logo.png" height="20">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://kaggle.com/kernels/welcome?src=https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-classification.ipynb">
<img src="./gallery/kaggle_logo.png" height="25">
</a>
</td>
</tr>
<!-- ------------------------------------------------------------------- -->
<tr>
<td rowspan="4" width="160">
<a href="https://visual-layer.readme.io/docs/enrichment-zero-shot-detection">
<img src="./gallery/enrichment_detection_thumbnail.jpg" width="200">
</a>
</td>
<td rowspan="4">
<b> 🎯 Zero-shot Data Enrichment:</b> Enrich your visual data with labels, captions, bounding boxes, and masks by running then over zero-shot models such as <a href="https://github.com/xinyu1205/recognize-anything">Recognize Anything Model</a>, <a href="https://github.com/IDEA-Research/GroundingDINO">Grounding DINO</a>, <a href="https://github.com/facebookresearch/segment-anything">Segment Anything Model</a> and more.
<b> 🧭 Zero-Shot Detection:</b> Enrich your visual data with zero-shot image detection model such as <a href="https://github.com/IDEA-Research/GroundingDINO">Grounding DINO</a> and more.<br><br>
<div align="right"><a href="https://visual-layer.readme.io/docs/enrichment-zero-shot-detection">🔗 Learn More.</a></div>
</td>
<td align="center" width="80">
<a href="https://nbviewer.org/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot.ipynb">
<a href="https://nbviewer.org/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-detection.ipynb">
<img src="./gallery/nbviewer_logo.png" height="30">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot.ipynb">
<a href="https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-detection.ipynb">
<img src="./gallery/github_logo.png" height="25">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://colab.research.google.com/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot.ipynb">
<a href="https://colab.research.google.com/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-detection.ipynb">
<img src="./gallery/colab_logo.png" height="20">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://kaggle.com/kernels/welcome?src=https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot.ipynb">
<a href="https://kaggle.com/kernels/welcome?src=https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-detection.ipynb">
<img src="./gallery/kaggle_logo.png" height="25">
</a>
</td>
</tr>
<!-- ------------------------------------------------------------------- -->
<tr>
<td rowspan="4" width="160">
<a href="https://visual-layer.readme.io/docs/enrichment-zero-shot-segmentation">
<img src="./gallery/enrichment_segmentation_thumbnail.jpg" width="200">
</a>
</td>
<td rowspan="4">
<b> 🎯 Zero-Shot Segmentation:</b> Enrich your visual data with zero-shot image segmentation model such as <a href="https://github.com/facebookresearch/segment-anything">Segment Anything Model</a> and more.<br><br>
<div align="right"><a href="https://visual-layer.readme.io/docs/enrichment-zero-shot-segmentation">🔗 Learn More.</a></div>
</td>
<td align="center" width="80">
<a href="https://nbviewer.org/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-segmentation.ipynb">
<img src="./gallery/nbviewer_logo.png" height="30">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-segmentation.ipynb">
<img src="./gallery/github_logo.png" height="25">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://colab.research.google.com/github/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-segmentation.ipynb">
<img src="./gallery/colab_logo.png" height="20">
</a>
</td>
</tr>
<tr>
<td align="center">
<a href="https://kaggle.com/kernels/welcome?src=https://github.com/visual-layer/fastdup/blob/main/examples/enrichment-zero-shot-segmentation.ipynb">
<img src="./gallery/kaggle_logo.png" height="25">
</a>
</td>
</tr>
<!-- ------------------------------------------------------------------- -->
</table>

## Extract Features From Dataset
The notebooks in this section show how to run fastdup on your own embeddings in combination with frameworks like ONNX and PyTorch.
<table>
<tr>
<td rowspan="4" width="160">
<a href="https://visual-layer.readme.io/docs/embeddings-timm">
<img src="./gallery/timm_embeddings_thumbnail.jpg" width="200">
Expand Down Expand Up @@ -743,7 +824,13 @@ This notebooks in this section shows how you can load data from various sources
</a>
</td>
</tr>
<!-- ------------------------------------------------------------------- -->
</table>

## Exciting New Features

> **Note**: We're happy to announce new features are out from beta testing and now available to the public, completely free of charge! We invite you to try them out and provide us with your valuable [feedback](https://visualdatabase.slack.com/join/shared_invite/zt-19jaydbjn-lNDEDkgvSI1QwbTXSY6dlA#/shared-invite/email)!
<table>
<tr>
<td rowspan="4" width="160">
<a href="https://visual-layer.readme.io/docs/video-face-detection">
Expand Down
Loading

0 comments on commit eb44148

Please sign in to comment.