Re: [gentoo-dev] Re: [GLEP] RFC - Keywording scheme

[Chris Gianelloni]

On Tue, 2007-04-17 at 11:19 +1200, Christopher Sawtell wrote:
> On Tuesday 17 April 2007 01:10:20 Chris Gianelloni wrote:
> [ ... ]
>
> > Yeah, ulimit won't do it.  We hit this issue with mimedefang, actually.
> > Our problem is that the kernel is doing the limiting.  We ended up
> > having to split things up a good bit into multiple processes to get
> > everything working.  We also added another machine to the cluster to try
> > to reduce the load on any one server at a time.  Nothing we did with
> > ulimit made a bit of difference.
>
> http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-files/

The problem isn't open files.  It is file descriptors.

wolf31o2@vertigo /usr/src/linux/include $ head -n 25 linux/posix_types.h
#ifndef _LINUX_POSIX_TYPES_H
#define _LINUX_POSIX_TYPES_H

#include <linux/stddef.h>

/*
 * This allows for 1024 file descriptors: if NR_OPEN is ever grown
 * beyond that you'll have to change this too. But 1024 fd's seem to be
 * enough even for such "real" unices like OSF/1, so hopefully this is
 * one limit that doesn't have to be changed [again].
 *
 * Note that POSIX wants the FD_CLEAR(fd,fdsetp) defines to be in
 * <sys/time.h> (and thus <linux/time.h>) - but this is a more logical
 * place for them. Solved by having dummy defines in <sys/time.h>.
 */

/*
 * Those macros may have been defined in <gnu/types.h>. But we always
 * use the ones here. 
 */
#undef __NFDBITS
#define __NFDBITS       (8 * sizeof(unsigned long))

#undef __FD_SETSIZE
#define __FD_SETSIZE    1024

-- 
Chris Gianelloni
Release Engineering Strategic Lead
Alpha/AMD64/x86 Architecture Teams
Games Developer/Council Member/Foundation Trustee
Gentoo Foundation