Make face swap blend no matter skin tone

Make the face of the person on the face swap blend with the rest colour on the rest of the body. eg black face swap on a lighter body match with what ever the skin tone of the face swap so they end up looking like its from a person not a mask