Remove the birthday aspect and think about what sounds enjoyable. Maybe you start with a night out with your SO. Ok, does adding more people sound better, about the same, worse?
I think you are mixing a party for other people and a party for yourself. Both are fine, but they may not be compatible with each other.
Good opportunity to communicate. “I understand that you just want to support me, but the continued asking is stressing me out.”