Scribe (log Server)
Scribe is a server for aggregating log data streamed in real-time from a large number of servers. It is designed to be scalable, extensible without client-side modification, and robust to failure of the network or any specific machine.
Scribe was developed at Facebook using Apache Thrift and released in 2008 as open source. As of December 2012, Github sources are not updated for more than a year.
Scribe servers are arranged in a directed graph, with each server knowing only about the next server in the graph. This network topology allows for adding extra layers of fan-in as a system grows, and batching messages before sending them between datacenters, without having any code that explicitly needs to understand datacenter topology, only a simple configuration.
Scribe was designed to consider reliability but to not require heavyweight protocols and expansive disk usage. Scribe spools data to disk on any node to handle intermittent connectivity node failure, but doesn't sync a log file for every message. This creates a possibility of a small amount of data loss in the event of a crash or catastrophic hardware failure. However, this degree of reliability is often suitable for most Facebook use cases.
Read more about Scribe (log Server): See Also
Famous quotes containing the word scribe:
““Our earth is degenerate in these latter days. Bribery and corruption are common. Children no longer obey their parents. . . . The end of the world is evidently approaching.” Sound familiar? It is, in fact, the lament of a scribe in one of the earliest inscriptions to be unearthed in Mesopotamia, where Western civilization was born.”
—C. John Sommerville (20th century)