Since Dr. Conrad Murray went back to his regular practice last month, late Michael Jackson’s family have been upset that he still maintains his medical license.

Sister, Janet Jackson and mom, Katherine Jackson are building a wrongful death law suit and “an appeal to U.S. authorities” to take away his license and the right to practice.

Jermaine Jackson told Larry King that Dr. Conrad Murray should have refrained from practicing at least until the end of the investigation, which is now going to continue into 2010.

“I’ll just say this. I’m very upset to hear that this doctor is able to go back and practice medicine. No charges… and to take our brother’s life and one of the biggest names in the world. Who is he going to practice on? I mean, he’s been marked. But I’m just saying that I’m very disappointed and they (the Jackson family) are, too, because he should not be where he is. He should be charged.”

Dr. Conrad Murray was pressured to return to work in order to start paying back the growing child support alimony he was ignoring.

Janet Jackson has put her bid in for custody of the late singer, Michael’s, three children.

Michael allegedly discussed his wishes for his children with Janet before his passing. The singer was even planning to draft a new will with different custody details in relation to Paris, 12, Prince MIchael I, 11, and Price Michael II, seven, in the event he passed, according to ContactMusic.com.

An unidentified source said: “There was a lot of rifts in the family, but Janet was the one person he spoke to regularly and he made sure the children kept in touch with her too.

“Ultimately, he wanted Janet to look after the children, with help from his mother Katherine, and was planning to draft a new will to reflect those wishes. He trusted Janet implicitly.

“When he had health concerns, he had a talk with Janet about how much she meant to him and the children, and how if anything happened to him, he wanted her to make sure the children would be loved and cared for in the same way he was raising them. She told him of course she would.”

Michael’s most recent will was written in 2002 and named the family matriarch, Katherine, as the guardian. However, Janet, who took the children to the family home to gather their belongings after the singer’s death last month, has the support of her siblings to take custody of the children.

The source added to Britain’s Grazia magazine: “The family think this could be a great idea – they are supportive of Katherine, but although she is in good health, she is nearly 80 and they are worried she is not up to the task.

“Janet is blossoming into a woman with tremendous untapped maternal instincts. The children automatically turn to her for comfort and direction.”