"Cain, the Traitor of Gods" will only put magic stones into your magic stone area once at the beginning of your main phase. Going into and out of combat phase will not re-trigger him.
The turn "Cain, the Traitor of Gods" is put into the field, it will not trigger its magic stone ability because the "beginning of main phase" trigger condition will have already passed.