I’ll sample something as a means to an end, and that end may just be seeding a new thing.
I think the important thing with sampling is the context - if you’re paying homage, do it right and with intention, and if you’re using samples like paint, like Actress said, do it like paint and make people dig for the source.
But I guess to answer your question, it’s mostly about the sound for me.