Re: [gentoo-dev] maybe it is time to put portage queries into a database.

[jesse]

I would say options, tools and the ability to do this sorta stuff should
be optional. I don't wan't to have to run mysql on my laptop however
having portage db in a dbfile would be handy. On the other hand i run 8
machines in my house on Gentoo, and having each machines info and db's
in my mysql server here would be a great boon ( already using local
syncing and nfs mounted dist dirs)

using DBI this could make it pretty easy to support
mysql/postrgesql/dbfiles. Isn't there already a project out there doin
somthing with mysql ?


0.02$

On Tue, 2003-06-24 at 15:00, Tony Clark wrote:
> I wanted to quickly find a package with emerge -s whatever.  I noticed that it
> seemed to be taking a long time now for basic searches.  A couple of random
> example are presented below.  Now in my case on the machine in question, it
> is probably a bit slower than need be as /usr/portage is nfs mounted but
> neither the nfs server, this client are what would be called slow machines
> and I run 100baset ethernet.
>
> 12 months ago I thought the search times where acceptable, nowdays they are
> pushing it and with the number of packages going into portage sooner rather
> than later it is going to be unacceptal.  I would also suggest a centralised
> server approach using something like mysql as apposed to localised databases
> based on berekley or something else.  reason being that a number a ppl are
> running home lans and they are increasing in popularity and there is no need
> to store N machines worth of data. mysql comes to mind as it is a popular
> database as there is a good chance that for some other application it is
> already running on the network.  I know in my case thats so.
>
> I know this has been discussed in the past but always put down for reasons I
> largely agreed with, but the number of packages and times have changed.  I
> don't mind helping out with this with some perl etc.  What I was thinking on
> for the initial implementation would be just to store the information
> required for searching.  I don't see a need to store all dependcies etc so
> the installation process actually becomes database driven.  In this case the
> queriey times are so short to the actually installation time, no noticable
> speed up will take place.
>
> The floor is open, let the flames begin :)
>
> tony
>
> tony@power tony $ time emerge -s zope
> Searching...
> [ Results for search key : zope ]
> [ Applications found : 2 ]
>
> *  app-admin/zope-config
>       Latest version available: 0.1-r1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files: 0 kB
>       Homepage:
>       Description: A Gentoo Zope multi-Instance configure tool.
>
> *  net-zope/zope
>       Latest version available: 2.6.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files: 2,317 kB
>       Homepage:    http://www.zope.org
>       Description: Zope is a web application platform used for building
> high-performance, dynamic web sites.
>
>
>
> real    0m6.968s
> user    0m1.310s
> sys     0m0.660s
>
>
> tony@power tony $ time emerge -S zope
> Searching...
> [ Results for search key : zope ]
> [ Applications found : 27 ]
>
> *  app-admin/zope-config
>       Latest version available: 0.1-r1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files: 0 kB
>       Homepage:
>       Description: A Gentoo Zope multi-Instance configure tool.
>
> *  net-zope/zope
>       Latest version available: 2.6.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files: 2,317 kB
>       Homepage:    http://www.zope.org
>       Description: Zope is a web application platform used for building
> high-performance, dynamic web sites.
>
> *  app-admin/zprod-manager-0.1
>       Latest version available: 0.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.gentoo.org/
>       Description: Gentoo Zope Product selection tool
>
> *  app-admin/zprod-update-0.1 [ Masked ]
>       Latest version available: 0.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:
>       Description: Gentoo Zope Product selection tool.
>
> *  net-zope/abracadabraobject-1.5.1
>       Latest version available: 1.5.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zope.org/Members/mjablonski/AbracadabraObject
>       Description: This can add pre-configured ZOPE-objects to folders through
> ZMI.
>
> *  net-zope/btreefolder2-0.5.0
>       Latest version available: 0.5.0
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://hathaway.freezope.org/Software/BTreeFolder2/
>       Description: Acts like a Zope folder but can store many more items.
>
> *  net-zope/cmfcollectorng-0.20
>       Latest version available: 0.20
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:
> http://www.zope.org/Members/ajung/CMFCollectorNG/Wiki/FrontPage
>       Description: Zope/CMF-based bugtracking system.
>
> *  net-zope/cmfforum-1.0
>       Latest version available: 1.0
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.sf.net/projects/collective/
>       Description: This is a zope product
>
> *  net-zope/cmfphoto-0.2
>       Latest version available: 0.2
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://sourceforge.net/projects/collective/
>       Description: Zope product to have photos.
>
> *  net-zope/cmfphotoalbum-0.2
>       Latest version available: 0.2
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://sourceforge.net/projects/collective/
>       Description: Zope/CMF product to organize e-pics into hierarchical photo
> album.
>
> *  net-zope/extfile-1.2.0_beta2
>       Latest version available: 1.2.0_beta2
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zope.org/Members/shh/ExtFile
>       Description: Zope proxy objects for files on the filesystem
>
> *  net-zope/filesystemsite-1.2
>       Latest version available: 1.2
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:
> http://www.zope.org/Members/k_vertigo/Products/FileSystemSite
>       Description: Zope proxy objects for files on the filesystem.
>
> *  net-zope/groups-0.3.1
>       Latest version available: 0.3.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zope.org/Members/faassen/Groups
>       Description: Group support (including local roles) for Zope
>
> *  net-zope/ldapuserfolder-2.1_beta3
>       Latest version available: 2.1_beta3
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.dataflake.org/software/ldapuserfolder/
>       Description: LDAP User Authentication for Zope.
>
> *  net-zope/localfs-1.0.0
>       Latest version available: 1.0.0
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://sourceforge.net/projects/localfs/
>       Description: Zope product for accessing the local filesystem
>
> *  net-zope/localizer-1.0.0-r1
>       Latest version available: 1.0.0-r1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.localizer.org
>       Description: Helps to build multilingual zope websites and zope
> products.
>
> *  net-zope/neoportallibrary-0.9b
>       Latest version available: 0.9b
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zoper.net/
>       Description: Collection of modules to build Zope/CMF/Plone products.
>
> *  net-zope/parsedxml-1.3.1
>       Latest version available: 1.3.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zope.org/Members/faassen/ParsedXML
>       Description: XML objects for Zope.
>
> *  net-zope/photo-1.2.3
>       Latest version available: 1.2.3
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zope.org/Members/rbickers/Photo
>       Description: Zope product for managing photos and photo albums
>
> *  net-zope/plone-1.0.1-r1
>       Latest version available: 1.0.1-r1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://plone.org
>       Description: A Zope Content Management System, based on Zope CMF.
>
> *  net-zope/squishdot-1.5.0
>       Latest version available: 1.5.0
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://squishdot.org/
>       Description: A web-based news publishing and discussion product for
> Zope.
>
> *  net-zope/translationservice-0.3
>       Latest version available: 0.3
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zope.org/Members/efge/TranslationService/
>       Description: Translation servive for zope. i18n tags in ZPT.
>
> *  net-zope/xmlwidgets-0.8.5
>       Latest version available: 0.8.5
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zope.org/Members/faassen/XMLWidgets
>       Description: UI widgets for Zope XML objects.
>
> *  net-zope/zmysqlda-2.0.8
>       Latest version available: 2.0.8
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://sourceforge.net/projects/mysql-python
>       Description: A MySQL Database Adapter(DA) for zope.
>
> *  net-zope/zphotoslides-1.1-r1 [ Masked ]
>       Latest version available: 1.1-r1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.zphotoslides.org/
>       Description: Present your photos quickly in zope.
>
> *  net-zope/zpsycopgda-1.1.2
>       Latest version available: 1.1.2
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://www.initd.org/software/psycopg.py
>       Description: PostgreSQL database adapter for Zope.
>
> *  net-zope/zwiki-0.17.0
>       Latest version available: 0.17.0
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files:  [no/bad digest]
>       Homepage:    http://zwiki.org/
>       Description: A zope wiki-clone for easy-to-edit collaborative websites.
>
>
>
> real    1m23.409s
> user    0m26.580s
> sys     0m11.130s