Run a Python "pipe" incrementally with PipeController

Posted 2 Oct 2012 at 23:34 UTC by vasudevram Share This

I recently wrote a tool called PipeController to experiment with pipe-like programs in Python. It does not work the same as UNIX pipes, which do IPC between programs/processes. Rather, it enables a sort of pipelined communication between multiple functions in a single Python program/process. A blog post about it (with an example of how it can be used to run a "pipe" incrementally), and a link to download PipeController v0.2, is here:

Running a pipe incrementally has two potential uses: 1) to debug a pipe, by generating the intermediate outputs created by adding a component at a time to the pipe, in a loop, and 2) saving the intermediate outputs, which may be of use in their own right, apart from the final output of the entire pipeline.

The blog post has a description of a test program that uses PipeController to run a pipe incrementally, along with sample input and outputs from the run.

- Vasudev Ram
Dancing Bison EnterprisesMy blog on software innovation:

New Advogato Features

New HTML Parser: The long-awaited libxml2 based HTML parser code is live. It needs further work but already handles most markup better than the original parser.

Keep up with the latest Advogato features by reading the Advogato status blog.

If you're a C programmer with some spare time, take a look at the mod_virgule project page and help us with one of the tasks on the ToDo list!

Share this page