|
--- |
|
language: |
|
- en |
|
license: apache-2.0 |
|
tags: |
|
- text-generation-inference |
|
- transformers |
|
- unsloth |
|
- llama |
|
- trl |
|
base_model: unsloth/tinyllama |
|
datasets: |
|
- ShieldX/manovyadh-3.5k |
|
library_name: transformers |
|
metrics: |
|
- accuracy |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
# Uploaded model |
|
|
|
- **Developed by:** ShieldX |
|
- **License:** apache-2.0 |
|
- **Finetuned from model :** unsloth/tinyllama |
|
|
|
<style> |
|
img{ |
|
width: 40vw; |
|
height: auto; |
|
margin: 0 auto; |
|
display: flex; |
|
align-items: center; |
|
justify-content: center; |
|
} |
|
</style> |
|
|
|
# ShieldX/manovyadh-1.1B-v1 |
|
|
|
Introducing ManoVyadh, A finetuned version of TinyLlama 1.1B Chat on Mental Health Counselling Dataset. |
|
|
|
|
|
<img class="custom-image" src="manovyadh.png" alt="BongLlama"> |
|
|
|
|
|
# Model Details |
|
|
|
## Model Description |
|
|
|
ManoVyadh is a LLM for mental health counselling. |
|
|
|
# Uses |
|
|
|
## Direct Use |
|
|
|
- base model for further finetuning |
|
- for fun |
|
|
|
|
|
## Downstream Use |
|
|
|
- can be deployed with api |
|
- used to create webapp or app to show demo |
|
|
|
|
|
## Out-of-Scope Use |
|
|
|
- cannot be used for production purpose |
|
- not to be applied in real life health purpose |
|
- cannot be used to generate text for research or academic purposes |
|
|
|
|
|
# Bias, Risks, and Limitations |
|
|
|
Significant research has explored bias and fairness issues with language models (see, e.g., [Sheng et al. (2021)](https://aclanthology.org/2021.acl-long.330.pdf) and [Bender et al. (2021)](https://dl.acm.org/doi/pdf/10.1145/3442188.3445922)). Predictions generated by the model may include disturbing and harmful stereotypes across protected classes; identity characteristics; and sensitive, social, and occupational groups. |
|
|
|
# Training Details |
|
|
|
# Model Examination |
|
|
|
We will be further finetuning this model on large dataset to see how it performs |
|
|
|
# Environmental Impact |
|
|
|
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). |
|
|
|
- **Hardware Type:** 1 X Tesla T4 |
|
- **Hours used:** 0.30 |
|
- **Cloud Provider:** Google Colab |
|
- **Compute Region:** India |
|
|
|
# Technical Specifications |
|
|
|
## Model Architecture and Objective |
|
|
|
Finetuned on Tiny-Llama 1.1B Chat model |
|
|
|
|
|
### Hardware |
|
|
|
1 X Tesla T4 |
|
|
|
|
|
# Citation |
|
|
|
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. --> |
|
|
|
**BibTeX:** |
|
|
|
``` |
|
@misc{ShieldX/manovyadh-1.1B-v1, |
|
url={[https://huggingface.co/ShieldX/manovyadh-1.1B-v1](https://huggingface.co/ShieldX/manovyadh-1.1B-v1)}, |
|
title={ManoVyadh}, |
|
author={Rohan Shaw}, |
|
year={2024}, month={Jan} |
|
} |
|
``` |
|
|
|
# Model Card Authors |
|
|
|
ShieldX a.k.a Rohan Shaw |
|
|
|
# Model Card Contact |
|
|
|
email : [email protected] |
|
|
|
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. |
|
|
|
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |
