Skip to content

Commit

Permalink
chore: ..
Browse files Browse the repository at this point in the history
  • Loading branch information
zeeshanlakhani committed May 1, 2024
1 parent 8693849 commit f154faa
Showing 1 changed file with 11 additions and 1 deletion.
12 changes: 11 additions & 1 deletion example-llm-workflows/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -442,7 +442,17 @@ How does a model with 8 billion parameters running on a laptop compare to a simi

I took our sequential chain output from above ([`chain1.json`](./chain1.json)) and evaluated it in in [Grammarly's readability score indicator][grammarly-score], which calcualtes the accuracy level of the document based on total word count, and the number and type of writing issues detected.

Our demo AI-chain workflow using Homestar and LLaMA rates out at a 94, which ChatGPT 3.5 rates out at a 91. This is by no means a fully qualified study, but showcases that local, smaller LLMs can work well enough for targeted use cases.
ChatGPT 3.5 produced this after a series of sequential prompts:

``` console
Pittsburgh's history is a captivating tale of transformation. From its humble beginnings as a strategic fort in the 18th century to its industrial heyday in the 19th and 20th centuries, the city became known as the "Steel City" for its booming steel industry. Over time, Pittsburgh has evolved into a vibrant hub of technology, healthcare, and education, while still retaining echoes of its industrial past in its iconic bridges and rugged skyline.

Furthermore, Pittsburgh's story is deeply intertwined with the growth of America itself. During the Industrial Revolution, the city played a pivotal role in driving the nation's economic engine, supplying steel for everything from skyscrapers to railways. Immigrants from around the world flocked to Pittsburgh in search of work, leading to a rich tapestry of cultures that still influences the city's identity today. Additionally, Pittsburgh's resilience was tested during the decline of the steel industry in the latter half of the 20th century. However, the city adapted and diversified its economy, leveraging its strengths in technology and healthcare to emerge as a leader in these fields. Today, Pittsburgh stands as a testament to the power of innovation and reinvention, a city that has overcome adversity to forge a new path forward.

Moreover, Pittsburgh boasts a rich cultural heritage, evident in its world-class museums, theaters, and music venues. From the Carnegie Museums to the Andy Warhol Museum, the city offers a diverse array of artistic experiences. Its neighborhoods, each with its own unique character and history, provide a glimpse into Pittsburgh's past and present. Whether exploring the vibrant Strip District or strolling through the quaint streets of Shadyside, visitors are sure to find something that captures their imagination. And let's not forget about sports—Pittsburgh's fervent passion for football, baseball, and hockey is legendary, with the Steelers, Pirates, and Penguins serving as symbols of civic pride. In every aspect, Pittsburgh's story is one of resilience, innovation, and cultural richness.
```

Our demo AI-chain workflow using Homestar and the non-quantized 8B-parameter LLaMA model rates out at a 94, which ChatGPT 3.5 rates out at a 91. This is by no means a fully qualified study, but showcases that local, smaller LLMs can work well enough for targeted use cases.

## What is Homestar in a Nutshell?

Expand Down

0 comments on commit f154faa

Please sign in to comment.