He's always following, me touching me...joking with me, & so on. We're friends, but does he want to be more?

I would say this guy might be falling in love with you and is just waiting for you to give him the okay, he seems to be a caring person and a big plus is he loves your kids. If you have feelings for him as well let him know in little ways, sneak a kiss and give a hug , some of the best relationships are the ones where the two people were really good friends for sometime before taking the big step . Good Luck