---
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
base_model: unsloth/tinyllama
datasets:
- ShieldX/manovyadh-3.5k
library_name: transformers
metrics:
- accuracy
pipeline_tag: text-generation
---

# Uploaded  model

- **Developed by:** ShieldX
- **License:** apache-2.0
- **Finetuned from model :** unsloth/tinyllama

<style>
  img{
    width: 40vw;
    height: auto;
    margin: 0 auto;
    display: flex;
    align-items: center;
    justify-content: center;
  }
</style>

# ShieldX/manovyadh-1.1B-v1

Introducing ManoVyadh, A finetuned version of TinyLlama 1.1B Chat on Mental Health Counselling Dataset.


<img class="custom-image" src="manovyadh.png" alt="BongLlama">


# Model Details

## Model Description

ManoVyadh is a LLM for mental health counselling.

# Uses

## Direct Use

- base model for further finetuning
- for fun


## Downstream Use
 
- can be deployed with api
- used to create webapp or app to show demo


## Out-of-Scope Use

- cannot be used for production purpose
- not to be applied in real life health purpose
- cannot be used to generate text for research or academic purposes


# Bias, Risks, and Limitations

Significant research has explored bias and fairness issues with language models (see, e.g., [Sheng et al. (2021)](https://aclanthology.org/2021.acl-long.330.pdf) and [Bender et al. (2021)](https://dl.acm.org/doi/pdf/10.1145/3442188.3445922)). Predictions generated by the model may include disturbing and harmful stereotypes across protected classes; identity characteristics; and sensitive, social, and occupational groups.

# Training Details

# Model Examination

We will be further finetuning this model on large dataset to see how it performs

# Environmental Impact

Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).

- **Hardware Type:** 1 X Tesla T4
- **Hours used:** 0.30
- **Cloud Provider:** Google Colab
- **Compute Region:** India

# Technical Specifications

## Model Architecture and Objective

Finetuned on Tiny-Llama 1.1B Chat model


### Hardware

1 X Tesla T4


# Citation

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

```
@misc{ShieldX/manovyadh-1.1B-v1,
      url={[https://huggingface.co/ShieldX/manovyadh-1.1B-v1](https://huggingface.co/ShieldX/manovyadh-1.1B-v1)},
      title={ManoVyadh},
      author={Rohan Shaw},
      year={2024}, month={Jan}
}
```

# Model Card Authors

ShieldX a.k.a Rohan Shaw

# Model Card Contact

email : rohanshaw.dev@gmail.com

This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)