Someone recently mentioned missing posts. I just did a comparsion of
comp.lang.ruby and ruby-talk-google and indeed the usenet is missing
posts.
James you want to have a look at the gateway?
T.
Trans wrote:
Someone recently mentioned missing posts. I just did a comparsion of
comp.lang.ruby and ruby-talk-google and indeed the usenet is missing
posts.James you want to have a look at the gateway?
T.
I think someone mentioned earlier that the missing posts were mostly those with HTML in them. Why the HTML posts are filtered out I do not know.
as far as i can tell it always is - or at least has been for weeks.
can we write a script to compare on a regular basis? a monitor?
are you in charge of this james?
cheers.
-a
···
On Fri, 1 Dec 2006, Trans wrote:
Someone recently mentioned missing posts. I just did a comparsion of
comp.lang.ruby and ruby-talk-google and indeed the usenet is missing posts.James you want to have a look at the gateway?
--
if you want others to be happy, practice compassion.
if you want to be happy, practice compassion. -- the dalai lama
Someone recently mentioned missing posts. I just did a comparsion of
comp.lang.ruby and ruby-talk-google and indeed the usenet is missing
posts.
Here's the information I have on this currently:
* I rewrote the entire Gateway this last week, so anything before that is history. The news-to-email side is already deployed. My email-to-news code is complete, but not deployed. (Our SysAdmin will get to it soon now.) If you raise issues, please make sure they are recent.
* I now have very detailed logs on everything the Gateway does, so please be specific. For example, tell me which messages are missing, not just that they are.
* Our Usenet host does not allow us to post HTML emails. This is not changing. (I'm not bothered by this because I do not believe anyone should be sending HTML email to Ruby Talk.)
* Our Gateway is an NNTP <-> email Gateway. There has been at least one instance of a Usenet post using ancient header formatting predating NNTP. These messages are not supported.
James you want to have a look at the gateway?
I will address individual issues, as long as they are aware of all four points above.
James Edward Gray II
···
On Nov 30, 2006, at 9:22 PM, Trans wrote:
Michael W. Ryder wrote:
Trans wrote:
Someone recently mentioned missing posts. I just did a comparsion of
comp.lang.ruby and ruby-talk-google and indeed the usenet is missing
posts.
James you want to have a look at the gateway?T.
I think someone mentioned earlier that the missing posts were mostly those with HTML in them. Why the HTML posts are filtered out I do not know.
Not true. I had some missing posts (a couple misdated and a couple not) and I only send text.
Cheers,
V.-
I rewrote and now run the Ruby Gateway, yes.
James Edward Gray II
···
On Dec 1, 2006, at 8:29 AM, ara.t.howard@noaa.gov wrote:
are you in charge of this james?
* I rewrote the entire Gateway this last week, so anything before that is history. The news-to-email side is already deployed. My email-to-news code is complete, but not deployed. (Our SysAdmin will get to it soon now.) If you raise issues, please make sure they are recent.
mine aren't - so ignore for now.
* I now have very detailed logs on everything the Gateway does, so please be specific. For example, tell me which messages are missing, not just that they are.
can't we automate this? monitor/scraper?
* Our Usenet host does not allow us to post HTML emails. This is not changing. (I'm not bothered by this because I do not believe anyone should be sending HTML email to Ruby Talk.)
harp:~ > echo '<html><body><b>__html_2_text?__</b></body></html>' | links -dump -stdin
__html_2_text?__
??
* Our Gateway is an NNTP <-> email Gateway. There has been at least one instance of a Usenet post using ancient header formatting predating NNTP. These messages are not supported.
check.
I will address individual issues, as long as they are aware of all four points above.
so... i have this rash... 
-a
···
On Sat, 2 Dec 2006, James Edward Gray II wrote:
--
if you want others to be happy, practice compassion.
if you want to be happy, practice compassion. -- the dalai lama
James Edward Gray II wrote:
···
On Nov 30, 2006, at 9:22 PM, Trans wrote:
> Someone recently mentioned missing posts. I just did a comparsion of
> comp.lang.ruby and ruby-talk-google and indeed the usenet is missing
> posts.Here's the information I have on this currently:
* I rewrote the entire Gateway this last week, so anything before
that is history. The news-to-email side is already deployed. My
email-to-news code is complete, but not deployed. (Our SysAdmin will
get to it soon now.) If you raise issues, please make sure they are
recent.
* I now have very detailed logs on everything the Gateway does, so
please be specific. For example, tell me which messages are missing,
not just that they are.
* Our Usenet host does not allow us to post HTML emails. This is not
changing. (I'm not bothered by this because I do not believe anyone
should be sending HTML email to Ruby Talk.)
* Our Gateway is an NNTP <-> email Gateway. There has been at least
one instance of a Usenet post using ancient header formatting
predating NNTP. These messages are not supported.
Have a look at recent topic: Wisdom of including Rakefile in releases.
The 2nd post from Jason Roelofs appears to be missing.
T.
Your posts appeared on one side of the Gateway (the Ruby Talk mailing list or the Usenet group comp.lang.ruby), but did not reach the other side? If so, please lead me to the posts on the side where they did appear.
James Edward Gray II
···
On Dec 1, 2006, at 4:06 AM, Damphyr wrote:
Not true. I had some missing posts (a couple misdated and a couple not) and I only send text.
* I now have very detailed logs on everything the Gateway does, so please be specific. For example, tell me which messages are missing, not just that they are.
can't we automate this? monitor/scraper?
Probably not too meaningfully. Every Usenet host uses a different system for numbering posts, so the numbers wouldn't be much help to the outside world.
Besides, now that I understand the Gateway code intimately, I'm hoping to get it robust enough to make problems rare.
* Our Usenet host does not allow us to post HTML emails. This is not changing. (I'm not bothered by this because I do not believe anyone should be sending HTML email to Ruby Talk.)
harp:~ > echo '<html><body><b>__html_2_text?__</b></body></html>' > links -dump -stdin
__html_2_text?__??
I would much rather Ruby Talk rejected HTML emails.
I think they are pure evil, so it will be hard to convince me to spend much effort on them.
I will address individual issues, as long as they are aware of all four points above.
so... i have this rash...
<dies laughing>
OK... Gateway issues!
James Edward Gray II
···
On Dec 1, 2006, at 9:39 AM, ara.t.howard@noaa.gov wrote:
I do not see *any* posting of Jason on the news side and only a single posting on the email side:
<quote>
Rakefiles allow users to run the tests for themselves, to understand how a
library is put together, etc. The only thing that can go wrong is that the
stuff doesn't work (unless you're grabbing very untrustworthy packages, but
assumptions have to be made somewhere). Not to mention, having the Rakefile
there allows other people to properly make changes to a library if / when
they need to.
I don't see anything bad with including said Rakefiles. Do you have any
specific worries?
</quote>
Cheers
robert
···
On 01.12.2006 17:05, Trans wrote:
James Edward Gray II wrote:
On Nov 30, 2006, at 9:22 PM, Trans wrote:
Someone recently mentioned missing posts. I just did a comparsion of
comp.lang.ruby and ruby-talk-google and indeed the usenet is missing
posts.Here's the information I have on this currently:
* I rewrote the entire Gateway this last week, so anything before
that is history. The news-to-email side is already deployed. My
email-to-news code is complete, but not deployed. (Our SysAdmin will
get to it soon now.) If you raise issues, please make sure they are
recent.
* I now have very detailed logs on everything the Gateway does, so
please be specific. For example, tell me which messages are missing,
not just that they are.
* Our Usenet host does not allow us to post HTML emails. This is not
changing. (I'm not bothered by this because I do not believe anyone
should be sending HTML email to Ruby Talk.)
* Our Gateway is an NNTP <-> email Gateway. There has been at least
one instance of a Usenet post using ancient header formatting
predating NNTP. These messages are not supported.Have a look at recent topic: Wisdom of including Rakefile in releases.
The 2nd post from Jason Roelofs appears to be missing.
James Gray wrote:
I would much rather Ruby Talk rejected HTML emails.
+1
···
--
Posted via http://www.ruby-forum.com/\.
Have a look at recent topic: Wisdom of including Rakefile in releases.
The 2nd post from Jason Roelofs appears to be missing.
I have not yet received this message from Trans. I do find it in the mailing list archives though and I see it on comp.lang.ruby. I'll assume my host blocked it, ruby talk is hiccuping, or something because the Gateway logs show it was forwarded.
I do not see *any* posting of Jason on the news side and only a single posting on the email side:
Right. I'll assume we are talking about this message:
http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
The log says:
<jameskilton@gmail.com> - Re: Wisdom of including Rakefile in releases
11/30/06-15:21:43: mail2news | nntp.post() result = 441 437 HTML post
Translation: Our NNTP host rejected the HTML post.
James Edward Gray II
···
On Dec 1, 2006, at 10:35 AM, Robert Klemme wrote:
On 01.12.2006 17:05, Trans wrote:
I cannot see that it is a HTML posting - in fact, I do not see any HTML in that posting. Is it possible that the gateway rejects multipart messages? James, if you need the source (or what reached my gmail box) let me know and I forward it to you.
Kind regards
robert
···
On 01.12.2006 18:30, James Edward Gray II wrote:
On Dec 1, 2006, at 10:35 AM, Robert Klemme wrote:
On 01.12.2006 17:05, Trans wrote:
Have a look at recent topic: Wisdom of including Rakefile in releases.
The 2nd post from Jason Roelofs appears to be missing.I have not yet received this message from Trans. I do find it in the mailing list archives though and I see it on comp.lang.ruby. I'll assume my host blocked it, ruby talk is hiccuping, or something because the Gateway logs show it was forwarded.
I do not see *any* posting of Jason on the news side and only a single posting on the email side:
Right. I'll assume we are talking about this message:
http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
The log says:
<jameskilton@gmail.com> - Re: Wisdom of including Rakefile in releases
11/30/06-15:21:43: mail2news | nntp.post() result = 441 437 HTML postTranslation: Our NNTP host rejected the HTML post.
Fred, can you comment on this? The link above shows pretty much how the rejected message was formatted.
James Edward Gray II
···
On Dec 1, 2006, at 4:20 PM, Robert Klemme wrote:
On 01.12.2006 18:30, James Edward Gray II wrote:
On Dec 1, 2006, at 10:35 AM, Robert Klemme wrote:
I do not see *any* posting of Jason on the news side and only a single posting on the email side:
Right. I'll assume we are talking about this message:
http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
The log says:
<jameskilton@gmail.com> - Re: Wisdom of including Rakefile in releases
11/30/06-15:21:43: mail2news | nntp.post() result = 441 437 HTML post
Translation: Our NNTP host rejected the HTML post.I cannot see that it is a HTML posting - in fact, I do not see any HTML in that posting. Is it possible that the gateway rejects multipart messages? James, if you need the source (or what reached my gmail box) let me know and I forward it to you.
http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
I cannot see that it is a HTML posting - in fact, I do not see any
HTML in that posting. Is it possible that the gateway rejects
multipart messages? James, if you need the source (or what reached
my gmail box) let me know and I forward it to you.
I'd like to see the whole raw message, headers included (my email is
valid, please attach the whole message, (g)zipped, or it will be bounced
by my _personal_ filters).
Fred, can you comment on this? The link above shows pretty much how
the rejected message was formatted.
Are you sure the mailing-list archive software doesn't filter out HTML ?
A multipart message with only one part sounds quite unlikely to me.
James, maybe the gateway should save the rejected messages somewhere, if
only temporarily, don't you think ?
Anyway, I'm using cleanfeed on the server, an omnipresent filtering
package. It's usually quire reliable, even if it has to use some
complicated heuristics from time to time (since MIME isn't widely used
on Usenet). It's a quite standard version, with a bit of tweaking, but
not in that domain.
Why am I telling you all of this, you ask ? Well, even if it is a false
positive, if I tune my filters to let the message pass, it will anyway
have a really bad distribution, being rejected by most of the hosts that
run the same soft.
James Edward Gray II
Fred
···
Le 1 décembre 2006 à 23:30, James Edward Gray II a écrit :
On Dec 1, 2006, at 4:20 PM, Robert Klemme wrote:
--
Sometimes I sleep, sometimes it's not for days The people I meet
always go their separate ways Sometimes you tell the day By the
bottle that you drink And times when you're all alone all you do is
think (Bon Jovi, Wanted Dead or Alive)
Ok, Robert sent me what seemed to be the full message, and it's in fact
a message declared with a MIME content-type of multipart/alternative but
only one part (text/plain). This is quite absurd, and I'd suspect that
something, somewhere, decided to strip away the HTML part but leave the
MIME declaration intact.
And, of course, cleanfeed declared the message as HTML on the basis of
the headers...
Fred
(Not sure of my English on this one...)
···
Le 2 décembre 2006 à 11:16, F. Senault a écrit :
Le 1 décembre 2006 à 23:30, James Edward Gray II a écrit :
On Dec 1, 2006, at 4:20 PM, Robert Klemme wrote:
http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
I cannot see that it is a HTML posting - in fact, I do not see any
HTML in that posting. Is it possible that the gateway rejects
multipart messages? James, if you need the source (or what reached
my gmail box) let me know and I forward it to you.I'd like to see the whole raw message, headers included (my email is
valid, please attach the whole message, (g)zipped, or it will be bounced
by my _personal_ filters).
--
Broken bottles under children's feets Bodies strewn across a dead end
street But I won't heed the battle call It puts my back up, puts
my back up against the wall
(U2, Sunday Bloody Sunday)
Forgive my weak knowledge of email types here, but if someone sent a short message to the list with an attached Ruby script, would it be a multipart message? If so, that would be rejected by the NNTP host?
James
···
On Dec 2, 2006, at 5:50 AM, F. Senault wrote:
Le 2 décembre 2006 à 11:16, F. Senault a écrit :
Le 1 décembre 2006 à 23:30, James Edward Gray II a écrit :
On Dec 1, 2006, at 4:20 PM, Robert Klemme wrote:
http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
I cannot see that it is a HTML posting - in fact, I do not see any
HTML in that posting. Is it possible that the gateway rejects
multipart messages? James, if you need the source (or what reached
my gmail box) let me know and I forward it to you.I'd like to see the whole raw message, headers included (my email is
valid, please attach the whole message, (g)zipped, or it will be bounced
by my _personal_ filters).Ok, Robert sent me what seemed to be the full message, and it's in fact
a message declared with a MIME content-type of multipart/alternative but
only one part (text/plain). This is quite absurd, and I'd suspect that
something, somewhere, decided to strip away the HTML part but leave the
MIME declaration intact.
maybe.
test.rb (9 Bytes)
···
On 12/2/06, James Edward Gray II <james@grayproductions.net> wrote:
On Dec 2, 2006, at 5:50 AM, F. Senault wrote:
> Le 2 décembre 2006 à 11:16, F. Senault a écrit :
>
>> Le 1 décembre 2006 à 23:30, James Edward Gray II a écrit :
>>
>>> On Dec 1, 2006, at 4:20 PM, Robert Klemme wrote:
>>
>>>>> http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
>>
>>>> I cannot see that it is a HTML posting - in fact, I do not see any
>>>> HTML in that posting. Is it possible that the gateway rejects
>>>> multipart messages? James, if you need the source (or what reached
>>>> my gmail box) let me know and I forward it to you.
>>
>> I'd like to see the whole raw message, headers included (my email is
>> valid, please attach the whole message, (g)zipped, or it will be
>> bounced
>> by my _personal_ filters).
>
> Ok, Robert sent me what seemed to be the full message, and it's in
> fact
> a message declared with a MIME content-type of multipart/
> alternative but
> only one part (text/plain). This is quite absurd, and I'd suspect
> that
> something, somewhere, decided to strip away the HTML part but leave
> the
> MIME declaration intact.Forgive my weak knowledge of email types here, but if someone sent a
short message to the list with an attached Ruby script, would it be a
multipart message? If so, that would be rejected by the NNTP host?James
I have a feeling this is what is, or at least was, happening - I wasn't
going to say anything (since it was prior to December first) but I
noticed that posts with attachments never made it across.
ruby-talk 226884, for example, doesn't appear to have made it to the
newsgroup.
···
On Sun, 2006-12-03 at 01:10 +0900, James Edward Gray II wrote:
On Dec 2, 2006, at 5:50 AM, F. Senault wrote:
> Le 2 décembre 2006 à 11:16, F. Senault a écrit :
>
>> Le 1 décembre 2006 à 23:30, James Edward Gray II a écrit :
>>
>>> On Dec 1, 2006, at 4:20 PM, Robert Klemme wrote:
>>
>>>>> http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/227459
>>
>>>> I cannot see that it is a HTML posting - in fact, I do not see any
>>>> HTML in that posting. Is it possible that the gateway rejects
>>>> multipart messages? James, if you need the source (or what reached
>>>> my gmail box) let me know and I forward it to you.
>>
>> I'd like to see the whole raw message, headers included (my email is
>> valid, please attach the whole message, (g)zipped, or it will be
>> bounced
>> by my _personal_ filters).
>
> Ok, Robert sent me what seemed to be the full message, and it's in
> fact
> a message declared with a MIME content-type of multipart/
> alternative but
> only one part (text/plain). This is quite absurd, and I'd suspect
> that
> something, somewhere, decided to strip away the HTML part but leave
> the
> MIME declaration intact.Forgive my weak knowledge of email types here, but if someone sent a
short message to the list with an attached Ruby script, would it be a
multipart message? If so, that would be rejected by the NNTP host?
--
Ross Bamford - rosco@roscopeco.REMOVE.co.uk