Integrate Haiper AI for AI-Generated Videos

[jeffpaul]

Is your enhancement related to a problem? Please describe.

This feature request proposes integrating Haiper AI to enable video generation within WordPress. Similar to how DALL·E is used for image generation, Haiper AI could allow users to generate videos from prompts and refine them through iterative re-prompting, streamlining content creation workflows.

Why Haiper AI?

• Hosted Open-Sora Instance – No need to self-host an Open-Sora model.
• API-Driven Automation – Allows seamless integration with ClassifAI for automated workflows.
• Minimal Free Tier Available – Haiper AI offers a free (beta) tier, but with significant limitations (see "Describe alternatives you've considered" section below).
• Feature Expansion Roadmap – Integration will start with Haiper AI's Text-to-Video generation, with plans to expand to Image-to-Video and Repainting in future iterations.

Initial Integration Focus: Text-to-Video

The first phase of integration will utilize Haiper AI’s Text-to-Video API, allowing users to generate videos from text descriptions directly within WordPress. This feature will provide:

• AI-powered video creation based on written prompts
• Dynamic content generation for blogs, marketing, and storytelling
• A seamless workflow for embedding AI-generated videos into WordPress

Future Expansion Targets

Once the initial Text-to-Video integration is stable, additional Haiper AI features could be explored:

• Image-to-Video – Allowing users to animate images and turn them into video sequences.
• Repainting – Enabling AI-powered refinements and modifications to existing video content.

Haiper AI Free Tier Limitations

• 10 creations per day, 300 credits, 3 concurrent creations
• Watermark-free images, but videos may include watermarks
• No commercial use or private creations on the free tier
• Upgrading to the Pro plan ($24/month) removes these limitations
• See more via Haiper AI's Pricing & Access

Potential Use Cases

• Automated Video Creation for Blog Content – Generate dynamic video summaries, intros, or explainer videos from blog posts
• Product Showcase Videos – Create promotional videos for WooCommerce products dynamically
• Storyboarding & Visual Narratives – Assist content creators with AI-generated video sequences
• Social Media & Marketing Videos – Generate engaging short-form videos for marketing campaigns

Integration Points & API Considerations

Haiper AI provides an API for video generation, allowing WordPress users to interact with the service efficiently. Integration would involve the following workflows:

1. Request Video Generation

   • Users provide a prompt describing the video (e.g., “A scenic drone shot over a tropical beach at sunset”).
   • API request sent to Haiper AI to generate video content.

2. Retrieve & Display Video

   • Once generation is complete, the video URL is returned and can be embedded into WordPress.
   • Videos can be stored in the Media Library for easy reuse.

3. Refinement & Edits

   • Users can re-prompt Haiper AI with modifications (e.g., adjust scene, extend length, refine motion).
   • API calls to Haiper AI to request iterative updates to the generated video.

4. UI/UX Considerations

   • Add a “Generate Video” option alongside existing AI-powered features.
   • Display generation status and allow users to manage iterations.
   • Enable previewing and selecting from multiple AI-generated variations.

Haiper AI API Documentation & References

• Haiper AI API Reference
• Haiper AI Pricing & Access

Next Steps & Considerations

• Confirm API access requirements and determine feasibility for free-tier integration
• Ensure proper media handling (e.g., storing videos locally or linking to cloud storage)
• Implement UI for user-friendly prompt-based video creation
• Assess performance considerations, including async processing and webhook-based callbacks for completed videos

Designs

No response

Describe alternatives you've considered

1. Note that this enhancement would significantly expand ClassifAI’s AI capabilities but requires a paid third-party service for full functionality, which isn't different than our various OpenAI integrations but is suboptimal in that it doesn't have a free tier option for ClassifAI users to test out the feature for free before fully putting it to use on their site.

2. Note that I explored utilizing Sora for this, but there's currently no API available so I've got this feature slotted for a slightly farther future release in hopes OpenAI opens up Sora a bit more for us to consider that instead of / alongside Haiper AI.

Code of Conduct

• I agree to follow this project's Code of Conduct