Platogram: Transform Audio into Knowledge

Platogram is an open-source project that converts audio content into structured, readable essays with embedded references. It's designed to help researchers, content creators, and knowledge workers extract valuable insights from audio sources like lectures, podcasts, and interviews.

Key Features

• Convert audio from YouTube, local files, etc into well-structured text.
• Create passages, summaries, and titles from audio content.
• Maintain references to the original transcript and timestamps.
• Create a searchable knowledge base from processed audio.
• Use the generated content for further AI-powered analysis and content creation.

Getting Started

Prerequisites

• Access to Anthropic's Claude API (required)
• Assembly AI API access (optional, for transcription)
• Python 3.10+
• FFmpeg (optional, for transcription)

Installation

pip install git+https://github.com/code-anyway/platogram.git

Basic Usage

Command Line Interface (CLI)

Obtain your API keys for Anthropic and Aseembly AI. Provide a URL to audio source or local file name.

plato \
--anthropic-api-key "YOUR_ANTHROPIC_API_KEY" \
--assemblyai-api-key "YOUR_ASSEMBLYAI_API_KEY" \
https://www.youtube.com/shorts/XsLK3tPy9SI

Python SDK

import platogram as plato


# Initialize models
llm = plato.llm.get_model("anthropic/claude-3-5-sonnet", "YOUR_ANTHROPIC_API_KEY")
asr = plato.asr.get_model("assembly-ai/best", "YOUR_ASSEMBLYAI_API_KEY")  # Optional

# Process audio
url = "https://www.youtube.com/shorts/XsLK3tPy9SI"
transcript = plato.extract_transcript(url, asr)
content = plato.index(transcript, llm)
  
# Access generated content
print(content.title)
print(content.summary)

for passage in content.passages:
    print(passage)

Use Cases

• Create searchable archives of lectures or conference talks
• Generate blog posts or articles from podcast episodes
• Extract key insights from interviews or meetings
• Build a personal knowledge base from audio content
• Enhance learning by converting lectures into structured notes

Acknowledgments

• Uses transcript and text of Chapter 1: Atoms in Motions from Feynman Lectures on Physics, Copyright © 1963-1965, 2006, 2013 by the California Institute of Technology, Michael A. Gottlieb and Rudolf Pfeiffer

Feedback and Support

We're actively seeking feedback to improve Platogram. For questions, suggestions, or issues, please contact us at [email protected] or open an issue on GitHub.

Start transforming your audio content into valuable, structured knowledge today with Platogram!

Copyright and License

Copyright (c) 2023-2024 Code Anyway, Inc. https://codeanyway.com

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.