Gentoo Archives: gentoo-user

From: Florian Philipp <lists@××××××××××××××××××.net>
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] Re: Pipe Lines - A really basic question
Date: Fri, 10 Sep 2010 16:35:34
Message-Id: 4C8A5E0D.8040202@f_philipp.fastmail.net
In Reply to: [gentoo-user] Re: Pipe Lines - A really basic question by Grant Edwards
1 Am 09.09.2010 22:28, schrieb Grant Edwards:
2 > On 2010-09-09, Florian Philipp <lists@f_philipp.fastmail.net> wrote:
3 >
4 >> When you look closer at `sort`, it is actually a quite impressive
5 >> tool. It sorts in-memory for small amounts of data and switches to
6 >> temporary files for larger. It can even compress those files to save
7 >> disk space.
8 >>
9 >> And it is still faster than most "business-grade" software for
10 >> importing data into data warehouses.
11 >>
12 >> Throw `cut`, `paste`, `join` and `grep` into the mix and you can
13 >> build your own relational database system based on shell scripts ;)
14 >
15 > Sort of linke /rdb: http://www.rdb.com/
16 >
17
18 Interesting. I've just read the paper they have posted.
19
20 You know what I'd really like to do? Build a graphical dataflow-centric
21 programming language for generating shell scripts. Since dataflows are
22 the real strength of shells, I figure it would be a neat tool for
23 improving more complex tasks. Usually I resort to temporary files when
24 stuff gets more complicated than a simple sequential pipe. That really
25 hurts performance. A more abstract representation could really help in
26 those situations.
27
28 Well, I figure someone has already done this with Eclipse GMF or
29 something like that and I just don't know it. Well, whatever. Nice to
30 know such stuff exists, though.
31
32 Thanks for the pointer ;)

Attachments

File name MIME type
signature.asc application/pgp-signature

Replies

Subject Author
[gentoo-user] Re: Pipe Lines - A really basic question Grant Edwards <grant.b.edwards@×××××.com>