Watsonxai environment url - https://techzone.ibm.com/my/workshops/student/65381d845739e500178a849e
#FOR MAC OS (Arm architecture)
export HNSWLIB_NO_NATIVE=1
brew install cmake libomp
declare -x TESSDATA_PREFIX=/usr/share/tesseract-ocr/4.00/tessdata
arch -x86_64 /bin/zsh or arch -x86_64 /bin/bash
# For arm64 Pythons:
~/.pyenv/versions/3.10.2/bin/python -m venv venv
# For x86 Pythons:
~/.pyenv/versions/3.10.2_x86/bin/python -m venv venv
pyenv install 3.11
pyenv global 3.11
pip install --upgrade pip
virtualenv venv -p python3.11
source venv/bin/activate
pip install pip-tools
pip install --no-cache-dir -r requirements.txt --extra-index-url https://download.pytorch.org/whl/cpu
## Uncomment below installs only if you are running this notebook fresh
pip install python-dotenv
pip install pypdf
pip install InstructorEmbedding
pip install 'transformers[torch]'
pip install sentence-transformers
pip install cachetools
pip install unstructured
pip install from-root
pip install chromadb
pip install chroma-migrate
pip install --upgrade ibm-watson
pip install matplotlib
pip install ibm-watson-machine-learning
pip install PyPDF2
pip install langchain | tail -n 1
pip install langchain --upgrade
pip install -U langchain-community
- Finally, run the following command to generate a requirements.txt file:
pip-compile requirements.in
or
python -m piptools compile
TrainingMaterial - Presentation Decks
labs - Hands on labs
IBM Granite LLM
IBM watsonx Developer Hub
IBM watsonx.ai samples
IBM watsonx.ai samples
IBM Docling library
Multi-Task Prompt Tuning
Fine Tuning a Slate LLM
Good article on the True cost of Generative AI: