Update README.md

README.md

@@ -28,6 +28,15 @@ The Aquila2-34B has achieved a 6.9% improvement in comprehensive evaluations, wi
 
 The additional details of the Aquila model will be presented in the official technical report. Please stay tuned for updates on official channels.
 
+### Note
+<p>
+We have discovered a data leakage problem with the GSM8K test data in the pre-training task dataset. Therefore, the evaluation results of GSM8K have been removed from the evaluation results.
+
+Upon thorough investigation and analysis, it was found that the data leakage occurred in the mathematical dataset A (over 2 million samples), recommended by a team we have collaborated with multiple times. This dataset includes the untreated GSM8K test set (1319 samples). The team only performed routine de-duplication and quality checks but did not conduct an extra filtering check for the presence of the GSM8K test data, resulting in this oversight.
+
+Our team has always strictly adhered to the principle that training data should not include test data. Taking this lesson from the error caused by not thoroughly checking the source of external data, we are currently investigating all 2 trillion tokens of data for various test datasets. So far, no test data such as MMLU and CMMLU have been found in the pre-training data.
+</p>
+
 ## Chat Model Performance
 
 <br>