preview版本的config 
hidden_size          = 7168
n_routed_experts     = 384
num_hidden_layers    = 61
num_attention_heads  = 128

但是正式版config，疑似是把flash的配置拷贝过来了 
hidden_size          = 4096
n_routed_experts     = 256
num_hidden_layers    = 43
num_attention_heads  = 64