Gentoo Logo
Gentoo Spaceship




Note: Due to technical difficulties, the Archives are currently not up to date. GMANE provides an alternative service for most mailing lists.
c.f. bug 424647
List Archive: gentoo-scm
Navigation:
Lists: gentoo-scm: < Prev By Thread Next > < Prev By Date Next >
Headers:
To: gentoo-scm@g.o
From: Maciej Mrozowski <reavertm@...>
Subject: Splitting gentoo-x86 repository for easier consumption
Date: Sat, 11 Apr 2009 14:40:27 +0200
Hi

As git is generally not best suited for large repositories, there are some 
ideas how to make it perform better with gentoo-x86.
- horizontal partitioning - a'ka cutting history
- vertical partitioning - splitting based on some categorization (not sure 
whether this was considered here, hence my mail).

As cutting history have already been proposed here and received with mixed 
opinions, I'd like to suggest category based partitioning (divide and conquer 
approach FTW).
Well, not really category-based...

Let's look at tree - one thing can be said about each package - it belongs to 
some herd or (doesn't, and it's with status maintainer wanted or maintained by 
individual developers).
So creating separate repository for each herd is the most obvious (and naive) 
idea.

Pros are the following:
- project members  taking care of some herd (or belonging to herd?) receive 
(and have access) (only) to repository they are interested in, resulting in 
smaller pulls/pushes
- some level of isolation - gives possibility to restrict access (for example: 
"only toolchain and arch teams allowed here")
- some testing overlays could now just track their tree counterparts - merging 
stuff from testing to tree could be semi-automatic and trivial
- alternative projects - like hardened - can just have separate branches when 
appropriate - for easy merges with "main tree"
- profile can be (should be actually) separated in another repository and 
developed easier

Some cons:
- projects are now more dependant on other projects and its responsiveness, 
unless access is granted to all repositories for every developer
- needs some basic tools to 'glue' final repository and ready it for rsync
- possibly needs better multiple repositories support in Portage (not sure 
though)
- profile no longer there
- to fully benefit from git - robbat2 would need to propose his slim manifest 
format as GLEP (or in case of lack of time - quite possible - get someone else 
to do it) and get it implemented by someone.
- probably not easy way to migrate from monolithic gentoo-x86 to split sub-
repositories retaining complete history
- not settled yet what to do with orphaned/proxy maintained packages and herd-
switching

Zac, I'm CC-ing you here, I hope you don't mind. Sorry, but your input is too 
valuable here :)

I guess I could, and find someone as well to, do some tedious and repetitive 
work in that manner.

-- 
regards
MM

Attachment:
signature.asc (This is a digitally signed message part.)
Replies:
Re: Splitting gentoo-x86 repository for easier consumption
-- Ryan Hill
Re: Splitting gentoo-x86 repository for easier consumption
-- Caleb Cushing
Re: Splitting gentoo-x86 repository for easier consumption
-- Robin H. Johnson
Re: Splitting gentoo-x86 repository for easier consumption
-- Robert Buchholz
Re: Splitting gentoo-x86 repository for easier consumption
-- Maciej Mrozowski
Navigation:
Lists: gentoo-scm: < Prev By Thread Next > < Prev By Date Next >
Previous by thread:
Status report, 2009/04/10
Next by thread:
Re: Splitting gentoo-x86 repository for easier consumption
Previous by date:
Re: Status report, 2009/04/10
Next by date:
Re: Splitting gentoo-x86 repository for easier consumption


Updated Jun 17, 2009

Summary: Archive of the gentoo-scm mailing list.

Donate to support our development efforts.

Copyright 2001-2013 Gentoo Foundation, Inc. Questions, Comments? Contact us.