The following list is a very strict interpretation of the paleo diet.
Of course, there are many exceptions to this. "Primal" dieters seem to have less problems with fattier meats. Robb Wolf seems to be okay with some of the fermented soy products such as Tamarin Soy Sauce. Many, many paleo sites have recipes that call for high-quality grass fed butter or ghee.
Still, a great resource for people who want an informational list.
Update: A friend of mine has read through my backlog and pointed out that honey is on this list.
I've made my own honey-mustard several times and see no problem with it's occasional use. Then main takeaway should be "grains/legumes/dairy" avoidance for the first month and then see how you feel.