bigscience

/

bloom-optimizer-states

like 8

Follow

BigScience Workshop 1.2k

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?