Israel removed metal detectors from a highly sensitive Jerusalem holy site on Tuesday after their installation triggered deadly violence, but Muslim officials said worshipers should continue a boycott for now.