There is often a dilemma when your manager wants you to move, but the prospect of doing so does not move you at all. It is normal to be concerned that if you refuse the transfer, you will be labeled as something other than a team player. However, the outcome of such a refusal varies from company to company.
Before making any decision, you should try to gather more information. You need to know more about the other department, your possible role and responsibilities in it, the reason why you were asked to transfer, and the company's expectations of employees who are asked to make this kind of move.
It will be very helpful for you to meet with your manager to discuss the transfer in more detail, as he can provide you with much of the information that you need. After all, this type of transfer can indicate that the company is pleased with you, or it can just as easily point to some problems.
When it comes to answering your question, the additional information that you gather is going to tell you if the answer is to transfer.
| 
