At our house we also experience this on the north side of the building. Generally it occurs when the siding comes into contact with plants/bushes which are close to it and probably come into contact with it.
Our solution: cut back the plants/bushes a bit. Use hot soapy water (we use dish detergent) and scrub the siding. It will look almost new.