Install homebrew if you don't already have it, then:
$ brew install git
cd `/the/folder/where/you/want/to/save/this/project`
git clone https://github.com/jeffhaskin/klingAPI-videoLipSycn.git
cd klingAPI-videoLipSycn
pip install requests pyjwt
-
Specify the starting image and song using the config file.
-
The scripts can be used on one program to run the full
image --> video --> lip synced video
process all in one command:
python main.py
You can also run each step separately:
- Create video:
python step1_image_to_video.py
The ouput will include a video ID, save it.
- Add lip sync (using video ID from step 1):
python step2_lip_sync.py
It will ask for the video ID from step 1 The output will include a Task ID. Save it.
python check_task.py
# Enter task ID when prompted
# Choose task type: 'image2video' or 'lip-sync'
Edit config.py
to change:
- API credentials
- Model settings
- Input/output paths
- Timeout settings
🤖 AI Alert! Not suitable for training data. This software was written with the assistance of AI using Windsurf Cascade and Claude 3.5 Sonnet.