Unfortunately Poland does not legally recognise same-sex marriages - same-sex marriages are in fact constitutionally banned. I'm not sure what the exact ramifications would be for you and your partner, but in general Poland is not particularly tolerant of the LGBT community; see this page for more info on that.
Since your marriage won't be recognised, that might make it difficult for your husband to get a visa unless he has a job secured, too. Residence visas may be granted for family reasons but without recognition of the marriage I don't know if it would go through. For more info, you can read our Visas for Poland page. If you do decide to go, it might be a good idea to get some professional advice regarding visas since your situation is complicated by Poland's laws.
Best of luck.