Spray the comb with adhesive remover and use a toothbrush to brush it out.

This also works great for getting adhesive out of hair along the edge of the base. Simply saturate the hair, lay it on a flat surface (or put your finger underneath) and use the toothbrush to gently comb and separate the strands of hair.