File size: 3,013 Bytes
c1bb4ad 2404ef6 c1bb4ad 2404ef6 c1bb4ad 2404ef6 c1bb4ad d681c5c 7d157a6 c1bb4ad 2404ef6 c1bb4ad 2404ef6 c1bb4ad c9ea919 f52687c c9ea919 2e2d8cf c9ea919 2404ef6 c1bb4ad d681c5c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 |
---
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
base_model: unsloth/tinyllama
datasets:
- ShieldX/manovyadh-3.5k
library_name: transformers
metrics:
- accuracy
pipeline_tag: text-generation
---
# Uploaded model
- **Developed by:** ShieldX
- **License:** apache-2.0
- **Finetuned from model :** unsloth/tinyllama
<style>
img{
width: 40vw;
height: auto;
margin: 0 auto;
display: flex;
align-items: center;
justify-content: center;
}
</style>
# ShieldX/manovyadh-1.1B-v1
Introducing ManoVyadh, A finetuned version of TinyLlama 1.1B Chat on Mental Health Counselling Dataset.
<img class="custom-image" src="manovyadh.png" alt="BongLlama">
# Model Details
## Model Description
ManoVyadh is a LLM for mental health counselling.
# Uses
## Direct Use
- base model for further finetuning
- for fun
## Downstream Use
- can be deployed with api
- used to create webapp or app to show demo
## Out-of-Scope Use
- cannot be used for production purpose
- not to be applied in real life health purpose
- cannot be used to generate text for research or academic purposes
# Bias, Risks, and Limitations
Significant research has explored bias and fairness issues with language models (see, e.g., [Sheng et al. (2021)](https://aclanthology.org/2021.acl-long.330.pdf) and [Bender et al. (2021)](https://dl.acm.org/doi/pdf/10.1145/3442188.3445922)). Predictions generated by the model may include disturbing and harmful stereotypes across protected classes; identity characteristics; and sensitive, social, and occupational groups.
# Training Details
# Model Examination
We will be further finetuning this model on large dataset to see how it performs
# Environmental Impact
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
- **Hardware Type:** 1 X Tesla T4
- **Hours used:** 0.30
- **Cloud Provider:** Google Colab
- **Compute Region:** India
# Technical Specifications
## Model Architecture and Objective
Finetuned on Tiny-Llama 1.1B Chat model
### Hardware
1 X Tesla T4
# Citation
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
```
@misc{ShieldX/manovyadh-1.1B-v1,
url={[https://huggingface.co/ShieldX/manovyadh-1.1B-v1](https://huggingface.co/ShieldX/manovyadh-1.1B-v1)},
title={ManoVyadh},
author={Rohan Shaw},
year={2024}, month={Jan}
}
```
# Model Card Authors
ShieldX a.k.a Rohan Shaw
# Model Card Contact
email : [email protected]
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |