Incremental Model Enhancement via Memory-based Contrastive Learning