Re: [gentoo-user] Retrieving bounced list messages

[Hogren]

Hello,


With a little search, I saw it (on MARC, software used by gentoo [1]) :

" Robot policy

In theory, we don't mind people snarfing down some MARC pages for
off-line reading. (I travel a lot, and sometimes want to pull down long
threads before hitting the road to read locally, etc.)

On the other hand... first, if we think you are a spam-bot
address-harvester, no death is slow or painful enough. Also, even if
well-intentioned, a robot crawling MARC can sometimes create a DoS; if
the robot sustains many parallel requests (or we happen to be hit by
multiple different robots at the same time) and doesn't back off if the
site starts to slow down, it can bog down the server. In a perfect world
MARC would scale better, and would automatically recognize abusive
robots 100% accurately, 100% of the time. But since it's not a perfect
world... we may throttle traffic from you if your IP, user-agent, or
IP/user-agent combination have misbehaved in the past.

If you want to crawl MARC, please be sure you have a delay between
requests, say one or two seconds. If you think we've mis-identified you
as a robot, please feel free to contact us. Please include information
we'll need to find your activity in our logs, such as the time you get
this message, the IP address(es) you are browsing from, and the
user-agent (web browser) you are using."


With this warning, you can use the MARC interface to try to dump what
you want. Try to start with at the mailing list page [2]. The on MARC
contains date, and others mail headers. Use libcurl and sed should be
sufficient for your needs.



[1] : https://marc.info/?q=about

[2] : https://marc.info/?l=gentoo-announce&r=1&w=2



Good luck :)


Hogren


On 04/01/2017 08:58, Floyd Anderson wrote:
> On Tue, 03 Jan 20:12:05 -0500
> Philip Webb <purslow@××××××××.net> wrote:
>> 170104 Floyd Anderson wrote:
>>> Is it possible — and when how — to retrieve bounced mailing list
>>> messages,
>>> e.g. from <gentoo-announce@l.g.o> or this list) ?
>>
>> You can recover everything from the Gentoo lists' archive :
>>  http://archives.gentoo.org/ .
>
> Thanks for your response. I’ve already found [1] but it’s hard (even
> impossible) to figure out the bounced message(s) from there. Notice,
> the bouncing messages information from mailing list manager (mlmmj)
> looks like:
>
>> Some messages to you could not be delivered. If you're seeing this
>> message it means things are back to normal, and it′ merely for your
>> information.
>>
>> Here is the list of the bounced messages:
>> - 174956
>> - 174958
>
> I see no change to find any message on [1] by its message number.
> Although it were possible, my goal is to have the messages local
> stored and searchable while being offline. Also [2] doesn’t help here
> even though it offers a message download link — it’s not the raw email
> (with header fields).
>
> Anyway, you push me in the right direction. After digging somewhat
> deeper I found the ability to send a message request to e.g.
> <gentoo-user+get-N@l.g.o> (where N is the message number).
>
> Now there is still one thing. How to get messages (better whole
> threads) for offline usage from a period before the list subscription
> when their message numbers is unknown?
>
>
> [1] <https://archives.gentoo.org/gentoo-user/>
> [2] <https://marc.info/?l=gentoo-user&m=148349234522442&w=2>
>