Call-04 Agenda - 2024-10-24

[hthillman]

Intro

• 15min Inc Product Update - Hunter

Status Checks From Last Call

• AuxData

Open Discussion

AI Job Tester repo

• Should Livepeer take ownership of AI Job Tester repo
• Depends on custom Gateway fork (Orch selection, Timeouts)

Inference workflow - comfy vs. block-builder vs. other

Wrapup & Goal-Setting

[papabear99]

Livepeer.Cloud SPE

Priorities

Outline your top 3 development priorities (1-3 sentences max)

1. Livepeer.Cloud SPE Proposal (AI Metrics & Visibility)

   • Coding / Implementation - This phase complete
   • Testing and Validation - This phase is complete
   • Deployment & DevOps - This phase is complete

2. Livepeer.Cloud SPE - AI & Transcoding Gateway Support / Maintenance

   • Updated the Gateways to 0.7.9.ai3 and AI Runner 0.7.0 (Done)
   • Continue to support AI SPE releases and troubleshooting

3. Planning For Upcoming Deployment

   • Early October Release: Staging (Missed target, waiting for PR merges)
   • Late October Release: Production (At risk, waiting for PR merges)

Blockers

Are there any external factors preventing you from achieving your top 3 priorities? If so, please outline them (1-3 sentences max)

1. PR/Code Reviews put the October release at risk

Discussion topics

Got a topic you’d like to cover in open discussion?

1. AI Job Tester repo

   • Should Livepeer take ownership of AI Job Tester repo
   • Depends on custom Gateway fork (Orch selection, Timeouts)

2. New Livepeer Inc team member

   • Introduce new team members to community
   • What are their roles in the community?
   • Where and how will they interact with the community?

[thomshutt]

Inc AI Network

Priorities

1. PoC of whether we can run ComfyUI pipelines as part of the Realtime AI pipeline
2. Architecture and task breakdown for shipping a developer preview of realtime "pipeline" development by EOY
3. Defining what metrics we want to collect across the full G <> O <> W stack

Blockers

• Co-ordination internally as we move the entire team onto realtime AI
• No current proven way of syncing input audio and output frames in realtime pipeline
• Team members also supporting Livepeer video customers

Discussion topics

• N/A

[rickstaa]

Livepeer AI SPE

Key Priorities

1. Merge Pull Requests: Finalize the integration of our pull requests (e.g., Lipsync, text-to-audio, capability endpoint, etc.) along with bounty submissions.
2. Review External PRs: Provide reviews for pull requests submitted by external teams and facilitate knowledge transfer.
3. Complete SAM Video Pipeline: Focus on finalizing the SAM video processing pipeline.
4. Develop Private LoRA Support: Initiate the development of private LoRA (Low-Rank Adaptation) support.
5. Realtime SAM2 Pipeline: Begin development on the realtime version of the SAM2 pipeline.

Current Blockers

• ComfyUI Integration: We need more clarity on the specifics of ComfyUI integration to determine whether our batch inference block builder remains necessary.

Discussion Topics

• None at the moment.

[iameli]

Aquareum

Priorities

1. Player and playback testing
2. Integrating Livepeer transcoding

Blockers

• Nothing major

Discussion topics

1. We're doing a lot with GStreamer lately via the go-gst bindings and it's going really well; happy to help other teams get set up with that if helpful