Polarising filters work with colour and to a limited extent (OK Motcon! a reasonable extent... OK. OK - the same extent) on b&w. If you put B/W contrast filters (yellow, green, orange, red et al) on for colour work you just get a yellow, green, etc. image on your colour film.
Other colour filters like UV or colour correction have little or no effect on b/w film - they just reduce your exposure.