What is mod_log_spread?
mod_log_spread is a patch to Apache's mod_log_config, which provides an interface for spread to multicast access logs. It utilizes the group communication toolkit Spread, developed at Johns Hopkins University's Center for Networking and Distributed Systems. mod_log_spread was developed to solve the problem of collecting consolidated access logs for large web farms. In particular, the solution needed to be scalable to hundreds of machines, utilize a reliable network transport, allow machines to added or dropped on the fly, and impose minimal performance impact on the webservers. Current version is 1.0.4.
What are other Spread logging projects?
In addition to the apache module, we also have a patch for the lightweight web server thttpd to allow similair logging capabilities. If you're running spread on a highly utilized Linux system, you may benefit from setting our spread daemon to real-time scheduling. Here's a perl module to make that easy to accomplish.
Availability
mod_log_spread is available under an apache style license. Basically, redistribution is permitted as long as the copyright is preserved and included intact. In addition, the authors of Spread have provided an unlimited use license for using Spread to log web requests. Thanks CNDS!
ChangeLog
  • 2000-05-27 Fixed brown-paper-bag parse error.
  • 2000-06-04 Added perl scheduler interface for Linux to help running spread in realtime.
  • 2000-06-07 Added spread tuning docs. Fixed potential issue of inedfinetly blocking on SP_multicast if Spread's queue is full.
  • 2000-07-14 Added Theo Schlossnagle's wonderful spreadlogd to the dist as a replacement to log_writer.
  • 2000-09-24 mod_log_spread becomes part of the Backhand Project!
  • 2000-10-14 Added vhost support. Fixed potential hang.
  • 2001-03-20 Fixed bug with handling piped logs.
  • 2001-03-24 Fixed compatability with Spread-3.15.
  • 2001-03-31 Added multiple spread daemon and failover support.
Download for Apache
Download thttpd patch
Download Perl Linux Scheduler module
Report Bugs


Like mod_log_spread? Please mail me and let me know what you think or how you've used it.