Muttahida Qaumi Movement-Pakistan (MQM-P) has threatened to quit the federal government over the rise in street crimes in Karachi.