Maybe you are too down in the seat?
Adjust the boom so you have some bend in the leg when fully extended. That will keep you more upright and reduce bottom bracket swing. Go down slower slopes and just keep pedaling. If you stop pedaling you will probably freeze. Get to the desired speed and...