If they are honey bees then they are there probably for a long time,,many years,,
Honey bees store wax and honey,,even if you kill the bees, others this year ,next year will smell the honey,unless you can seal it air tight,,i have killed some honey bees high up in some barge boards and every year there are still bees there,,oh and it also attrracts wasps to the smell of honey.