This is possibly going to get linked to death, but Diego Doval has written an excellent introduction to weblogs. A good thing to point people who ask "A weblog? What's a weblog?" to.
Update: Here is Part 2, which explains syndication.