If you try cleaning it again, you might want to try using a bit of dish soap or liquid hand soap. A lot of road grime is non-polar, probably soot, and water doesn't do a good job getting it out/off.

When I clean my car windows, I'm always disturbed by the amount of black crud I get off. The mat is probably in worse shape, since it was driven over.