[Initiative]: Cloud Native AI Sustainability Papers

[zanetworker]

Name

Cloud Native AI & Sustainability

Short description

Two white papers for the AI sustainability

Responsible group

TOC

Does the initiative belong to a subproject?

Yes

Subproject name

Cloud Native AI Working Group

Primary contact

@zanetworker

Additional contacts

@raravena80

Initiative description

Paper 1: The paper aims to provide a framework and recommendations for building and managing AI systems with sustainability in mind, emphasizing resource optimization and reducing the environmental footprint.

Paper 2: The paper discusses the challenges and opportunities for making Generative AI more sustainable in cloud-native systems. It highlights the high energy consumption of AI training and inference, issues like inefficient GPU usage and data management, and proposes strategies for optimization. Key areas of focus include energy tracking, power capping, efficient resource scheduling, and the use of tools like Kepler, Kueue, and KEDA to manage AI workloads more sustainably.

Original issue: cncf/tag-runtime#168

Source: https://docs.google.com/document/d/1tNfR5yxnqfu9fduEb3108oBGXQ6spyRzA6cBTs9zbnQ/edit?tab=t.fwj647zi37u1#heading=h.a2csx0fpflu3

Deliverable(s) or exit criteria

Final draft versions for both papers to be handed off to the CNCF publishing staff.

[zanetworker]

Background. We broke up the paper into two, originally it was just one.

[angellk]

@zanetworker all papers require TOC review and approval prior to handling off to CNCF staff.

Please break this initiative up into the two separate Papers and outline how many pages are expected then vote can be opened. Shorter initiatives are prioritized first 🙏

[payamohajeri]

We are starting with meetings to review and push these whitepapers to the finish line. Our goal is to start finalizing the first whitepaper here on this Github issue, and then the second on #1918 . Here are the meeting links and calendar for next scheduled calls. Meetings will be recorded and meeting notes will be published.

https://calendar.google.com/calendar/embed?src=c_90d4740d5a131b095d5d07ed639439c32e6b92303d54ddeba1d1f5497880e8eb%40group.calendar.google.com&ctz=Europe%2FBerlin

[marisolpalmero]

PR has been created for the 1st paper: #2041

[raravena80]

@angellk does this paper need to be vetted by TAG Infrastructure? The team has finished the paper (~10 pages) and is looking to get it published. Thanks!

cc: @marisolpalmero @payamohajeri