what exactly should be the weights for the pixels?

I have a problem with the implementation of the mean shift tracking algorithm.The weighted mean is moving in a different direction when I implemented the algo given in most papers...