---
title: Olmo Chat Demo
emoji: 📚
colorFrom: yellow
colorTo: pink
sdk: docker
pinned: false
license: bsd-3-clause
---

## Olmo Chat Demonstration

This is a demonstration of the Olmo Chat application.
It is a simple chat application that allows users to interact with the [OLMo-7B-Instruct-GGUF](https://huggingface.co/ssec-uw/OLMo-7B-Instruct-GGUF) model.

This application is built using the following technologies:

- [Panel](https://panel.holoviz.org/)
- [LangChain v0.1](https://python.langchain.com/v0.1/)
- [llama-cpp-python](https://github.com/abetlen/llama-cpp-python)

## Contact

For errors in this application, contact Don, landungs at uw dot edu.

## Acknowledgement

We would like to thank the hardworking folks at [Allen AI](https://huggingface.co/allenai) for providing the original model.

Additionally, the work to convert and quantize the model was done by the
[University of Washington Scientific Software Engineering Center (SSEC)](https://escience.washington.edu/software-engineering/ssec/),
as part of the [Schmidt Futures Virtual Institute for Scientific Software (VISS)](https://www.schmidtsciences.org/viss/).