Here the profit is not only concern. Obeying the law and leaving a peaceful life is bigger question.
As a responsible citizen your first duty is to buy goods with a proper bill.
The person who is offering your goods without bill is a defaulter, if you want to be a defaulter and carry on with guilt, go ahead.
Even you know the answer.