Gentoo Archives: gentoo-soc

From: Vikraman <vikraman.choudhury@×××××.com>
To: other <gentoo-soc@l.g.o>
Subject: [gentoo-soc] Package statistics, progress report #1
Date: Thu, 19 May 2011 10:52:51
Message-Id: 20110519105224.GA18565@felicia
1 Hello everyone,
3 I'm working on the 'Package Statistics' project [1] for GSoC this summer.
4 This is my first progress report.
6 Title: "Client-server model for reporting and querying package statistics"
7 ==========================================================================
9 This project aims to implement a client program to gather package
10 information from gentoo hosts and submit them to a server, which will
11 calculate useful statistics based on the data, rendered using a webapp.
13 Over the past 2-3 weeks, I have been communicating with my mentor Alec,
14 and have already written a proof-of-concept client and server, that is
15 ready to be deployed and collect data, thanks to excellent code reviews
16 and ideas from Alec.
18 A short summary of my progress:
19 -------------------------------
21 * Created project repository [2] on
22 * Read up on RESTful Web Services (from the O'reilly book)
23 * Tried to improve my python coding style using the google guide
24 (suggested by Alec)
25 * Wrote a simple client in python to collect a few environment variables
26 from portage, list of installed packages with useflags, encode the
27 data in JSON, with proper authentication, and issue a POST to the
28 server
29 * Wrote a simple webapp using to handle requests from the above
30 client and save the data to MySQL tables
31 * Wrote some documentation to deploy the webapp and client
33 Issues encountered:
34 -------------------
36 * Choice of portage api vs gentoolkit api: The gentoolkit api is very
37 easy to use, but quite slow [3] compared to the portage api. Alec asked me
38 to use both of them as necessary, but provide an easy way to swap out
39 one in favor of the other at a later time.
40 * Choice of web framework, Turbogears vs others: I ended up using
41 for the server, instead of Turbogears (as promised in my proposal),
42 since I found it easier to implement RESTful services using
43 Also, is lightweight, provides more control, and has enough
44 features for implementing this webapp. However, should I hit a snag
45 using, it probably wouldn't take more than a day or two of
46 coding to replace it with Turbogears.
48 The project repository currently provides a working client and server,
49 and it'll be deployed soon on
51 Plans for the upcoming weeks:
52 -----------------------------
54 * Get updates from the community on what data should be collected from
55 hosts
56 * Try to add more fields to the client/server and modify the SQL tables
57 accordingly
58 * Learn more about the portage api and discuss them on #gentoo-portage
60 My semester exams are currently in progress, and they'll last till the
61 end of May. So, I'll not be able to work during these 2 weeks. I'm
62 looking forward to get back on 1st June, and continue with my project.
64 [1]
67 [2]
70 [3]
73 --
74 Vikraman


File name MIME type
signature.asc application/pgp-signature


Subject Author
Re: [gentoo-soc] Package statistics, progress report #1 Brian Dolbec <brian.dolbec@×××××.com>