The essence of all that is happening and would happen is to push humanity through the doors of the inner being into a higher and greater consciousness.
The way to deal with this shadow is to persistently offer it to the Divine Mother until it is transformed. No human effort can deal with this. Precisely because of the difficulty of this task we are told to rely more and more on the Grace.
Since the Divine dwells within man, the Guru also dwells within man. All Gurus in fact derive from this aspect from the Divine and are His conscious or half-conscious representatives. However, since it is difficult for man to discover the Divine Master within, He comes to us in a human form.