Is this normal packaging at an African/ Caribbean grocery store?

yes, it is normal. You have to realize that it doesn't come from the states, and doesn't have the same laws about packaging and hygiene etc. Just wash off the bottle if it bothers you. Since you are not eating it, don't fret. I shop in the african groceries and middle eastern ones too. They sell lots of stuff in packaging that looks homemade. I have never poisoned my family or myself, and I have been shopping in them for more than 10 years.