A heat bath is a large system that is in thermal contact with some other system of interest.

By "large" we mean that the system is unperturbed when in thermal contact with the system of interest. Thus the heat bath is effectively an infinite reservoir of energy and accessible quantum states at a given temperature.