This is a traditional thing: the cow on the church roof. Before it was a real cow, now it's a mock one.
I think it was a celebration of the harvest or maybe to get rid of the weeds???
You really need a car to get there and visit around. I believe there is a bus to Nevers but it is infrequent.
If you do not go far then bikes are ideal, otherwise go by car.
The roads in this part of Morvan can be very straight. They are red because the alsphast is made with the local red earth (full of iron).