The huge red crane crashed into a part of the Grand Mosque - the largest in the world - that was filled with worshippers at the time.
The head of Saudi Arabia's civil defence said strong winds and heavy rains had caused the collapse.
Mecca is currently preparing for the annual Muslim Hajj pilgrimage.
Hundreds of thousands of people are expected to arrive in the Saudi city from all over the world later this month.
