What should i do or should i do nothing?

Just tell him you didn't ask for the lady's phone number because he's married and you felt uncomfortable doing what he wanted you to do and you didn't want to cause problems with his marriage.