Accused Elizabeth Smart kidnapper Brian David Mitchell was once again removed from a federal courtroom Friday. But after a very short delay, the hearing continued as scheduled.

Mitchell, who along with his estranged wife Wanda Barzee, were indicted by a federal grand jury on charges of interstate kidnapping and unlawful transportation of a minor across state lines, was gagged at his initial federal court hearing before U.S. Magistrate Samuel Alba on Monday, but still created enough of a disturbance that the hearing was continued.

On Friday, Alba again allowed Mitchell in the courtroom to give him the opportunity to listen to the proceedings without creating a disruption.

Wearing a red jumpsuit from the Salt Lake County Jail, Mitchell entered the courtroom under tight security with his eyes closed, his hands and feet shackled and carrying what appeared to be a blank note pad.

After being placed in his seat to wait for the judge to come out, Mitchell began singing the hymn, "Be Still My Soul."

"Is he going to stop or is he going to continue?" Alba asked the defense.

When the judge was informed Mitchell would likely continue his singing, he was removed from the courtroom to be placed in a "lock-up" area where a video camera and microphone broadcast the hearing to Mitchell. Mitchell, however, could not be seen or heard.

"(He) can hear and see everything in lockup going on," Alba said.

Mitchell sat in the room with one of his newly appointed attorneys from the Federal Public Defender's Office.

Once court resumed, Alba entered a "not guilty" plea on behalf of Mitchell, gave prosecutors a week to gather the evidence from the state competency hearing so it could be shared with the judge and defense, and set another hearing for Nov. 12. At that time, Alba is expected to rule on the government's motion for a competency evaluation for Mitchell at a federal facility.

The defense responded to the motion, saying the doctors at the Utah State Hospital who have already evaluated Mitchell were more qualified to make a determination of Mitchell's competency and that any evaluation should be done in Utah and not out of state.

"I absolutely disagree with it," U.S. Attorney for Utah Brett Tolman said, calling Mitchell's three years at the Utah State Hospital "somewhat of a tortured history."

"There has been little if any treatment," he noted.