Combine is a robot for harvesting web resources, and is designed to be distributable, parallel and flexible. |
It is distributable in the sense that different parts of Combine can run on separate computers. Parallel, meaning that some parts of a Combine system can exist in several instances to increase performance. Flexibility is achieved by the system being built by putting together small and relatively simple building blocks in a way that is modifiable by the user.