Suggestion to add Megatron to PYTHONPATH

README.md

@@ -71,6 +71,22 @@ You can move those files to different directories if needed.
 python3 $MYDIR/transformers/src/transformers/models/megatron_bert/convert_megatron_bert_checkpoint.py $MYDIR/nvidia/megatron-bert-uncased-345m/checkpoint.zip
 ```
 
+As explained in [PR #14956](https://github.com/huggingface/transformers/pull/14956), if when running this conversion 
+script and you're getting an exception:
+```
+ModuleNotFoundError: No module named 'megatron.model.enums'
+```
+you need to tell python where to find the clone of Megatron-LM, e.g.:
+```
+cd /tmp
+git clone https://github.com/NVIDIA/Megatron-LM
+PYTHONPATH=/tmp/Megatron-LM python src/transformers/models/megatron_bert/convert_megatron_bert_checkpoint.py ...
+```
+Or, if you already have it cloned elsewhere, simply adjust the path to the existing path.
+
+If the training was done using a Megatron-LM fork, e.g. [Megatron-DeepSpeed](https://github.com/microsoft/Megatron-DeepSpeed/) then 
+you may need to have that one in your path, i.e., /path/to/Megatron-DeepSpeed.
+
 ## Masked LM
 
 The following code shows how to use the Megatron BERT checkpoint and the Transformers API to perform a `Masked LM` task.