Fanny pack, yo. Not even joking. It makes the most sense because it can't fall out while you're bouncing around. You can also carry other things as well. (phone, knife, etc)
Personally, I hate jogging so I wouldn't do it. But if I did, fanny pack all dayyyy.