Traditionally in the Jewish faith, goats were often offered as sacrifices. And also, according to the audio commentary, for Chagall the goat also represented the way in which the Jews were badly treated in Russia and across Europe, especially during the Holocaust.