Mold grows because of moisture. It sounds like the seal of your washer may be very tight, not allowing airflow to evaporate the moisture left behind after you finish using it.
The only idea I have would be to clean the mold off, then try leaving the door ajar when not in use.