SMTP Engine

Development discussions regarding the core platform (MBBS/WG)
daniel_spain
Posts: 395
Joined: Sun Aug 09, 2020 2:39 am

SMTP Engine

Post by daniel_spain »

so i bee spending alot of time to the SMTP engine last few weeks and theres some things im gonna add to it.
anyone else see anything it needs please lemme know. Currently i am modifying the current galico smtp
engine with the following:

AUTH command to authenticate your session complete with a level 4 config option to allow/disallow unauthenticated transactions.

Ability to authenticate with the "smarthost" currently if you have to use a smarthost to process mail it just asks for the address and
not a name/password/port to authenticate with the smarthost.

when done the smtp server will support the following commands:

HELO
It’s the first SMTP command: is starts the conversation identifying the sender server and is generally followed by its domain name.

EHLO
An alternative command to start the conversation, underlying that the server is using the Extended SMTP protocol.

MAIL FROM
With this SMTP command the operations begin: the sender states the source email address in the “From” field and actually starts the email transfer.

RCPT TO
It identifies the recipient of the email; if there are more than one, the command is simply repeated address by address.

SIZE
This SMTP command informs the remote server about the estimated size (in terms of bytes) of the attached email. It can also be used to report the maximum size of a message to be accepted by the server.

DATA
With the DATA command the email content begins to be transferred; it’s generally followed by a 354 reply code given by the server, giving the permission to start the actual transmission.

VRFY
The server is asked to verify whether a particular email address or username actually exists.

TURN
This command is used to invert roles between the client and the server, without the need to run a new connaction.

AUTH
With the AUTH command, the client authenticates itself to the server, giving its username and password. It’s another layer of security to guarantee a proper transmission.

RSET
It communicates the server that the ongoing email transmission is going to be terminated, though the SMTP conversation won’t be closed (like in the case of QUIT).

EXPN
This SMTP command asks for a confirmation about the identification of a mailing list.

HELP
It’s a client’s request for some information that can be useful for the a successful transfer of the email.

QUIT
It terminates the SMTP conversation.

just a quick disclaimer..... this is just a modification of the current severely outdated smtp addon that comes with the galacticomm ico.
it is not intended to be a rip-off or clone of the current smtp addon just a modification to make it better.
when done i will have versions for both ico3 and ico2.

Abraxis
Posts: 43
Joined: Sat Aug 08, 2020 8:49 pm

Re: SMTP Engine

Post by Abraxis »

[quote=daniel_spain post_id=185 time=1597698590 user_id=65]
so i bee spending alot of time to the SMTP engine last few weeks and theres some things im gonna add to it.
anyone else see anything it needs please lemme know. Currently i am modifying the current galico smtp
engine with the following:

AUTH command to authenticate your session complete with a level 4 config option to allow/disallow unauthenticated transactions.

Ability to authenticate with the "smarthost" currently if you have to use a smarthost to process mail it just asks for the address and
not a name/password/port to authenticate with the smarthost.

when done the smtp server will support the following commands:

HELO
It’s the first SMTP command: is starts the conversation identifying the sender server and is generally followed by its domain name.

EHLO
An alternative command to start the conversation, underlying that the server is using the Extended SMTP protocol.

MAIL FROM
With this SMTP command the operations begin: the sender states the source email address in the “From” field and actually starts the email transfer.

RCPT TO
It identifies the recipient of the email; if there are more than one, the command is simply repeated address by address.

SIZE
This SMTP command informs the remote server about the estimated size (in terms of bytes) of the attached email. It can also be used to report the maximum size of a message to be accepted by the server.

DATA
With the DATA command the email content begins to be transferred; it’s generally followed by a 354 reply code given by the server, giving the permission to start the actual transmission.

VRFY
The server is asked to verify whether a particular email address or username actually exists.

TURN
This command is used to invert roles between the client and the server, without the need to run a new connaction.

AUTH
With the AUTH command, the client authenticates itself to the server, giving its username and password. It’s another layer of security to guarantee a proper transmission.

RSET
It communicates the server that the ongoing email transmission is going to be terminated, though the SMTP conversation won’t be closed (like in the case of QUIT).

EXPN
This SMTP command asks for a confirmation about the identification of a mailing list.

HELP
It’s a client’s request for some information that can be useful for the a successful transfer of the email.

QUIT
It terminates the SMTP conversation.

just a quick disclaimer..... this is just a modification of the current severely outdated smtp addon that comes with the galacticomm ico.
it is not intended to be a rip-off or clone of the current smtp addon just a modification to make it better.
when done i will have versions for both ico3 and ico2.
[/quote]

Excellent Daniel! While you’re deep in code, any chance you could modify the NNTP module so that we could get newsgroups from any provider?
Abraxis/Len
Mainline Information Service

daniel_spain
Posts: 395
Joined: Sun Aug 09, 2020 2:39 am

Re: SMTP Engine

Post by daniel_spain »

Abraxis wrote:
> [quote=daniel_spain post_id=185 time=1597698590 user_id=65]
> so i bee spending alot of time to the SMTP engine last few weeks and theres
> some things im gonna add to it.
> anyone else see anything it needs please lemme know. Currently i am
> modifying the current galico smtp
> engine with the following:
>
> AUTH command to authenticate your session complete with a level 4 config
> option to allow/disallow unauthenticated transactions.
>
> Ability to authenticate with the "smarthost" currently if you
> have to use a smarthost to process mail it just asks for the address and
> not a name/password/port to authenticate with the smarthost.
>
> when done the smtp server will support the following commands:
>
> HELO
> It’s the first SMTP command: is starts the conversation identifying the
> sender server and is generally followed by its domain name.
>
> EHLO
> An alternative command to start the conversation, underlying that the
> server is using the Extended SMTP protocol.
>
> MAIL FROM
> With this SMTP command the operations begin: the sender states the source
> email address in the “From” field and actually starts the email transfer.
>
> RCPT TO
> It identifies the recipient of the email; if there are more than one, the
> command is simply repeated address by address.
>
> SIZE
> This SMTP command informs the remote server about the estimated size (in
> terms of bytes) of the attached email. It can also be used to report the
> maximum size of a message to be accepted by the server.
>
> DATA
> With the DATA command the email content begins to be transferred; it’s
> generally followed by a 354 reply code given by the server, giving the
> permission to start the actual transmission.
>
> VRFY
> The server is asked to verify whether a particular email address or
> username actually exists.
>
> TURN
> This command is used to invert roles between the client and the server,
> without the need to run a new connaction.
>
> AUTH
> With the AUTH command, the client authenticates itself to the server,
> giving its username and password. It’s another layer of security to
> guarantee a proper transmission.
>
> RSET
> It communicates the server that the ongoing email transmission is going to
> be terminated, though the SMTP conversation won’t be closed (like in the
> case of QUIT).
>
> EXPN
> This SMTP command asks for a confirmation about the identification of a
> mailing list.
>
> HELP
> It’s a client’s request for some information that can be useful for the a
> successful transfer of the email.
>
> QUIT
> It terminates the SMTP conversation.
>
> just a quick disclaimer..... this is just a modification of the current
> severely outdated smtp addon that comes with the galacticomm ico.
> it is not intended to be a rip-off or clone of the current smtp addon just
> a modification to make it better.
> when done i will have versions for both ico3 and ico2.
> [/quote]
>
> Excellent Daniel! While you’re deep in code, any chance you could modify
> the NNTP module so that we could get newsgroups from any provider?

i did that years ago for one of Netvillage's customers. if i recall correctly it was a church and they had me modify it so they could connect to their server they were paying for and pull feeds..... they paid me quite well and i never heard nothing back so maybe all was ok? anyhow i had to scrap writing my own nntp mods when google did away with the free news feeds. if you can find me a free server i can pull from i can tinker again. as for the code from the other, when i do a custom modification or work on someone elses ip using their code i dont sign an nda instead when im done i give them the code and delete all tracers on my side and if they ever want me to work on it again they have to provide the code i submitted the first time. so i dont have access to it i would be going from scratch again.

Kracken
Posts: 77
Joined: Sat Aug 08, 2020 1:12 pm

Re: SMTP Engine

Post by Kracken »

Used to play with "news.mixmin.net" some years ago, just tested and it still works !

Otherwise Vertrauen works fine and is stable, but needs an account (for testing auth)

Here's my current trace:

[code]
### INIT: [144.76.182.167] (news.mixmin.net) on port 119 [SSL: False]

### INPUT:
.

### OUTPUT:
200 news.mixmin.net InterNetNews NNRP server INN 2.7.0 (20200329 prerelease) ready (posting ok)
500 What?

### INPUT:
GROUP alt.cities.rome

### OUTPUT:
211 1 1 1 alt.cities.rome

First id: 1
Last id: 1
Total msg: 1
### INPUT:
ARTICLE 1

### OUTPUT:
220 1 <5e7c25a2-98ef-4e6a-baf5-a4262cff0818@googlegroups.com> article
X-Received: by 2002:a05:620a:200f:: with SMTP id c15mr22075263qka.172.1571675382283;
Mon, 21 Oct 2019 09:29:42 -0700 (PDT)
X-Received: by 2002:ac8:744c:: with SMTP id h12mr803629qtr.335.1571675381751;
Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
Path: news.mixmin.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!o24no57545qtl.0!news-out.google.com!x7ni279qtf.0!nntp.google.com!o24no57540qtl.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
Newsgroups: alt.cities.rome
Date: Mon, 21 Oct 2019 09:29:41 -0700 (PDT)

(...)
[/code]

Abraxis
Posts: 43
Joined: Sat Aug 08, 2020 8:49 pm

Re: SMTP Engine

Post by Abraxis »

[quote=Kracken post_id=191 time=1597715482 user_id=58]
Used to play with "news.mixmin.net" some years ago, just tested and it still works !

Otherwise Vertrauen works fine and is stable, but needs an account (for testing auth)

Here's my current trace:

[code]
### INIT: [144.76.182.167] (news.mixmin.net) on port 119 [SSL: False]

### INPUT:
.

### OUTPUT:
200 news.mixmin.net InterNetNews NNRP server INN 2.7.0 (20200329 prerelease) ready (posting ok)
500 What?

### INPUT:
GROUP alt.cities.rome

### OUTPUT:
211 1 1 1 alt.cities.rome

First id: 1
Last id: 1
Total msg: 1
### INPUT:
ARTICLE 1

### OUTPUT:
220 1 <5e7c25a2-98ef-4e6a-baf5-a4262cff0818@googlegroups.com> article
X-Received: by 2002:a05:620a:200f:: with SMTP id c15mr22075263qka.172.1571675382283;
Mon, 21 Oct 2019 09:29:42 -0700 (PDT)
X-Received: by 2002:ac8:744c:: with SMTP id h12mr803629qtr.335.1571675381751;
Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
Path: news.mixmin.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!o24no57545qtl.0!news-out.google.com!x7ni279qtf.0!nntp.google.com!o24no57540qtl.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
Newsgroups: alt.cities.rome
Date: Mon, 21 Oct 2019 09:29:41 -0700 (PDT)

(...)
[/code]
[/quote]

Well this is a bit premature for me. I know very little about getting newsgroups, but I “heard” most providers can’t do the I Have part. If I have to eventually set up a Linux box to get news I will, but would rather not.
Abraxis/Len
Mainline Information Service

Kracken
Posts: 77
Joined: Sat Aug 08, 2020 1:12 pm

Re: SMTP Engine

Post by Kracken »

Abraxis wrote:
> [quote=Kracken post_id=191 time=1597715482 user_id=58]
> Used to play with "news.mixmin.net" some years ago, just tested and it
> still works !
>
> Otherwise Vertrauen works fine and is stable, but needs an account (for testing auth)
>
> Here's my current trace:
>
> [code]
> ### INIT: [144.76.182.167] (news.mixmin.net) on port 119 [SSL: False]
>
> ### INPUT:
> .
>
> ### OUTPUT:
> 200 news.mixmin.net InterNetNews NNRP server INN 2.7.0 (20200329 prerelease) ready
> (posting ok)
> 500 What?
>
> ### INPUT:
> GROUP alt.cities.rome
>
> ### OUTPUT:
> 211 1 1 1 alt.cities.rome
>
> First id: 1
> Last id: 1
> Total msg: 1
> ### INPUT:
> ARTICLE 1
>
> ### OUTPUT:
> 220 1 <5e7c25a2-98ef-4e6a-baf5-a4262cff0818@googlegroups.com> article
> X-Received: by 2002:a05:620a:200f:: with SMTP id c15mr22075263qka.172.1571675382283;
> Mon, 21 Oct 2019 09:29:42 -0700 (PDT)
> X-Received: by 2002:ac8:744c:: with SMTP id h12mr803629qtr.335.1571675381751;
> Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> Path:
> news.mixmin.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!o24no57545qtl.0!news-out.google.com!x7ni279qtf.0!nntp.google.com!o24no57540qtl.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
> Newsgroups: alt.cities.rome
> Date: Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
>
> (...)
> [/code]
> [/quote]
>
> Well this is a bit premature for me. I know very little about getting newsgroups, but
> I “heard” most providers can’t do the I Have part. If I have to eventually set up a
> Linux box to get news I will, but would rather not.

Yes the WG NNTP server is a passive one, waiting to be fed through IHAVE, unlike Synchronet "newslink.js" which more conveniently just pull off from any free nntp like "news.mixmin.net"

daniel_spain
Posts: 395
Joined: Sun Aug 09, 2020 2:39 am

Re: SMTP Engine

Post by daniel_spain »

Kracken wrote:
> Abraxis wrote:
> > [quote=Kracken post_id=191 time=1597715482 user_id=58]
> > Used to play with "news.mixmin.net" some years ago, just tested and it
> > still works !
> >
> > Otherwise Vertrauen works fine and is stable, but needs an account (for testing
> auth)
> >
> > Here's my current trace:
> >
> > [code]
> > ### INIT: [144.76.182.167] (news.mixmin.net) on port 119 [SSL: False]
> >
> > ### INPUT:
> > .
> >
> > ### OUTPUT:
> > 200 news.mixmin.net InterNetNews NNRP server INN 2.7.0 (20200329 prerelease)
> ready
> > (posting ok)
> > 500 What?
> >
> > ### INPUT:
> > GROUP alt.cities.rome
> >
> > ### OUTPUT:
> > 211 1 1 1 alt.cities.rome
> >
> > First id: 1
> > Last id: 1
> > Total msg: 1
> > ### INPUT:
> > ARTICLE 1
> >
> > ### OUTPUT:
> > 220 1 <5e7c25a2-98ef-4e6a-baf5-a4262cff0818@googlegroups.com> article
> > X-Received: by 2002:a05:620a:200f:: with SMTP id
> c15mr22075263qka.172.1571675382283;
> > Mon, 21 Oct 2019 09:29:42 -0700 (PDT)
> > X-Received: by 2002:ac8:744c:: with SMTP id h12mr803629qtr.335.1571675381751;
> > Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> > Path:
> >
> news.mixmin.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!o24no57545qtl.0!news-out.google.com!x7ni279qtf.0!nntp.google.com!o24no57540qtl.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
> > Newsgroups: alt.cities.rome
> > Date: Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> >
> > (...)
> > [/code]
> > [/quote]
> >
> > Well this is a bit premature for me. I know very little about getting
> newsgroups, but
> > I “heard” most providers can’t do the I Have part. If I have to eventually set
> up a
> > Linux box to get news I will, but would rather not.
>
> Yes the WG NNTP server is a passive one, waiting to be fed through IHAVE, unlike
> Synchronet "newslink.js" which more conveniently just pull off from any
> free nntp like "news.mixmin.net"

now its coming back to me..... @Kracken you might even recall when i was working on this, i think you sent me a list of status codes the rfc nntp standard was calling for.

Kracken
Posts: 77
Joined: Sat Aug 08, 2020 1:12 pm

Re: SMTP Engine

Post by Kracken »

daniel_spain wrote:
> Kracken wrote:
> > Abraxis wrote:
> > > [quote=Kracken post_id=191 time=1597715482 user_id=58]
> > > Used to play with "news.mixmin.net" some years ago, just tested
> and it
> > > still works !
> > >
> > > Otherwise Vertrauen works fine and is stable, but needs an account (for
> testing
> > auth)
> > >
> > > Here's my current trace:
> > >
> > > [code]
> > > ### INIT: [144.76.182.167] (news.mixmin.net) on port 119 [SSL: False]
> > >
> > > ### INPUT:
> > > .
> > >
> > > ### OUTPUT:
> > > 200 news.mixmin.net InterNetNews NNRP server INN 2.7.0 (20200329
> prerelease)
> > ready
> > > (posting ok)
> > > 500 What?
> > >
> > > ### INPUT:
> > > GROUP alt.cities.rome
> > >
> > > ### OUTPUT:
> > > 211 1 1 1 alt.cities.rome
> > >
> > > First id: 1
> > > Last id: 1
> > > Total msg: 1
> > > ### INPUT:
> > > ARTICLE 1
> > >
> > > ### OUTPUT:
> > > 220 1 <5e7c25a2-98ef-4e6a-baf5-a4262cff0818@googlegroups.com> article
> > > X-Received: by 2002:a05:620a:200f:: with SMTP id
> > c15mr22075263qka.172.1571675382283;
> > > Mon, 21 Oct 2019 09:29:42 -0700 (PDT)
> > > X-Received: by 2002:ac8:744c:: with SMTP id
> h12mr803629qtr.335.1571675381751;
> > > Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> > > Path:
> > >
> >
> news.mixmin.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!o24no57545qtl.0!news-out.google.com!x7ni279qtf.0!nntp.google.com!o24no57540qtl.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
> > > Newsgroups: alt.cities.rome
> > > Date: Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> > >
> > > (...)
> > > [/code]
> > > [/quote]
> > >
> > > Well this is a bit premature for me. I know very little about getting
> > newsgroups, but
> > > I “heard” most providers can’t do the I Have part. If I have to eventually
> set
> > up a
> > > Linux box to get news I will, but would rather not.
> >
> > Yes the WG NNTP server is a passive one, waiting to be fed through IHAVE, unlike
> > Synchronet "newslink.js" which more conveniently just pull off from
> any
> > free nntp like "news.mixmin.net"
>
> now its coming back to me..... @Kracken you might even recall when i was working on
> this, i think you sent me a list of status codes the rfc nntp standard was calling
> for.

Yes exactly, I actually did little (python) POC for fun back then.
Started with a discussion on themajorbbs.com (stoneslinger and malakai) where they wanted to get fresh NNTP news on their WG echoes but the passive
WG nntp server wouldn't make it easy. You would need to install a (bloated/costly) solution called DNEWS that would pull news then push them into
WG through IHAVE.

Well at socket level, the rfc is straightforward, so it was lighter and easier to just run a script that triggers every X minutes and then pull from free nntp servers then push in IHAVE on the WG side. Keeps track of last msgids fetched per echo in dat files for next pass.

I actually added support for several source NNTP servers (with optional AUTH, so I could grab obscure FTN echoes from several different Synchronet BBS using my personal accounts)

While at it, I also added a QWK importer to bulk import archives through IHAVE.

Note: I also tried EXPORTING replies from the "c:\wgserv\nntpout" folder, and while it works, I had some issues with auth on some servers (refuse my replies), and didn't really followed that part.

Of course it would be nicer to have something similar in a WGNT module, and wouldnt even require IHAVE or reliance on the WG nntp server, as the MBBS SDK probably have a way to directly import messages. Synchronet works this way through newslink.js.
Not sure if there are work underway on the Phoenix project side, if there is enough demand for such functionality.

daniel_spain
Posts: 395
Joined: Sun Aug 09, 2020 2:39 am

Re: SMTP Engine

Post by daniel_spain »

Kracken wrote:
> daniel_spain wrote:
> > Kracken wrote:
> > > Abraxis wrote:
> > > > [quote=Kracken post_id=191 time=1597715482 user_id=58]
> > > > Used to play with "news.mixmin.net" some years ago, just
> tested
> > and it
> > > > still works !
> > > >
> > > > Otherwise Vertrauen works fine and is stable, but needs an account
> (for
> > testing
> > > auth)
> > > >
> > > > Here's my current trace:
> > > >
> > > > [code]
> > > > ### INIT: [144.76.182.167] (news.mixmin.net) on port 119 [SSL: False]
> > > >
> > > > ### INPUT:
> > > > .
> > > >
> > > > ### OUTPUT:
> > > > 200 news.mixmin.net InterNetNews NNRP server INN 2.7.0 (20200329
> > prerelease)
> > > ready
> > > > (posting ok)
> > > > 500 What?
> > > >
> > > > ### INPUT:
> > > > GROUP alt.cities.rome
> > > >
> > > > ### OUTPUT:
> > > > 211 1 1 1 alt.cities.rome
> > > >
> > > > First id: 1
> > > > Last id: 1
> > > > Total msg: 1
> > > > ### INPUT:
> > > > ARTICLE 1
> > > >
> > > > ### OUTPUT:
> > > > 220 1 <5e7c25a2-98ef-4e6a-baf5-a4262cff0818@googlegroups.com>
> article
> > > > X-Received: by 2002:a05:620a:200f:: with SMTP id
> > > c15mr22075263qka.172.1571675382283;
> > > > Mon, 21 Oct 2019 09:29:42 -0700 (PDT)
> > > > X-Received: by 2002:ac8:744c:: with SMTP id
> > h12mr803629qtr.335.1571675381751;
> > > > Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> > > > Path:
> > > >
> > >
> >
> news.mixmin.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!o24no57545qtl.0!news-out.google.com!x7ni279qtf.0!nntp.google.com!o24no57540qtl.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
> > > > Newsgroups: alt.cities.rome
> > > > Date: Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> > > >
> > > > (...)
> > > > [/code]
> > > > [/quote]
> > > >
> > > > Well this is a bit premature for me. I know very little about getting
> > > newsgroups, but
> > > > I “heard” most providers can’t do the I Have part. If I have to
> eventually
> > set
> > > up a
> > > > Linux box to get news I will, but would rather not.
> > >
> > > Yes the WG NNTP server is a passive one, waiting to be fed through IHAVE,
> unlike
> > > Synchronet "newslink.js" which more conveniently just pull off
> from
> > any
> > > free nntp like "news.mixmin.net"
> >
> > now its coming back to me..... @Kracken you might even recall when i was working
> on
> > this, i think you sent me a list of status codes the rfc nntp standard was
> calling
> > for.
>
> Yes exactly, I actually did little (python) POC for fun back then.
> Started with a discussion on themajorbbs.com (stoneslinger and malakai) where they
> wanted to get fresh NNTP news on their WG echoes but the passive
> WG nntp server wouldn't make it easy. You would need to install a (bloated/costly)
> solution called DNEWS that would pull news then push them into
> WG through IHAVE.
>
> Well at socket level, the rfc is straightforward, so it was lighter and easier to
> just run a script that triggers every X minutes and then pull from free nntp servers
> then push in IHAVE on the WG side. Keeps track of last msgids fetched per echo in dat
> files for next pass.
>
> I actually added support for several source NNTP servers (with optional AUTH, so I
> could grab obscure FTN echoes from several different Synchronet BBS using my personal
> accounts)
>
> While at it, I also added a QWK importer to bulk import archives through IHAVE.
>
> Note: I also tried EXPORTING replies from the "c:\wgserv\nntpout" folder,
> and while it works, I had some issues with auth on some servers (refuse my replies),
> and didn't really followed that part.
>
> Of course it would be nicer to have something similar in a WGNT module, and wouldnt
> even require IHAVE or reliance on the WG nntp server, as the MBBS SDK probably have a
> way to directly import messages. Synchronet works this way through newslink.js.
> Not sure if there are work underway on the Phoenix project side, if there is enough
> demand for such functionality.

so we could run a synchronet nntp server to have our own server to "pull" from while we figure this out and as far as auth i managed to fix this
in SMTPSEND.C by adding the auth login function and i could do the same with nntp.
My only thing as of this writing is an nntp server i can pull from/send to to test.
This way i can track where the failures are coming from on both ends.
I do have a 3rd windows server online i was using as a secondary test bbs back when Platinum was having a serious crash issue in monsters spawning
aid but after i resolved that i never took it down.
I could use it as a worldgroup tcp/ip services test bed.

Kracken
Posts: 77
Joined: Sat Aug 08, 2020 1:12 pm

Re: SMTP Engine

Post by Kracken »

daniel_spain wrote:
> Kracken wrote:
> > daniel_spain wrote:
> > > Kracken wrote:
> > > > Abraxis wrote:
> > > > > [quote=Kracken post_id=191 time=1597715482 user_id=58]
> > > > > Used to play with "news.mixmin.net" some years ago,
> just
> > tested
> > > and it
> > > > > still works !
> > > > >
> > > > > Otherwise Vertrauen works fine and is stable, but needs an
> account
> > (for
> > > testing
> > > > auth)
> > > > >
> > > > > Here's my current trace:
> > > > >
> > > > > [code]
> > > > > ### INIT: [144.76.182.167] (news.mixmin.net) on port 119 [SSL:
> False]
> > > > >
> > > > > ### INPUT:
> > > > > .
> > > > >
> > > > > ### OUTPUT:
> > > > > 200 news.mixmin.net InterNetNews NNRP server INN 2.7.0 (20200329
> > > prerelease)
> > > > ready
> > > > > (posting ok)
> > > > > 500 What?
> > > > >
> > > > > ### INPUT:
> > > > > GROUP alt.cities.rome
> > > > >
> > > > > ### OUTPUT:
> > > > > 211 1 1 1 alt.cities.rome
> > > > >
> > > > > First id: 1
> > > > > Last id: 1
> > > > > Total msg: 1
> > > > > ### INPUT:
> > > > > ARTICLE 1
> > > > >
> > > > > ### OUTPUT:
> > > > > 220 1
> <5e7c25a2-98ef-4e6a-baf5-a4262cff0818@googlegroups.com>
> > article
> > > > > X-Received: by 2002:a05:620a:200f:: with SMTP id
> > > > c15mr22075263qka.172.1571675382283;
> > > > > Mon, 21 Oct 2019 09:29:42 -0700 (PDT)
> > > > > X-Received: by 2002:ac8:744c:: with SMTP id
> > > h12mr803629qtr.335.1571675381751;
> > > > > Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> > > > > Path:
> > > > >
> > > >
> > >
> >
> news.mixmin.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!o24no57545qtl.0!news-out.google.com!x7ni279qtf.0!nntp.google.com!o24no57540qtl.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
> > > > > Newsgroups: alt.cities.rome
> > > > > Date: Mon, 21 Oct 2019 09:29:41 -0700 (PDT)
> > > > >
> > > > > (...)
> > > > > [/code]
> > > > > [/quote]
> > > > >
> > > > > Well this is a bit premature for me. I know very little about
> getting
> > > > newsgroups, but
> > > > > I “heard” most providers can’t do the I Have part. If I have to
> > eventually
> > > set
> > > > up a
> > > > > Linux box to get news I will, but would rather not.
> > > >
> > > > Yes the WG NNTP server is a passive one, waiting to be fed through
> IHAVE,
> > unlike
> > > > Synchronet "newslink.js" which more conveniently just pull
> off
> > from
> > > any
> > > > free nntp like "news.mixmin.net"
> > >
> > > now its coming back to me..... @Kracken you might even recall when i was
> working
> > on
> > > this, i think you sent me a list of status codes the rfc nntp standard was
> > calling
> > > for.
> >
> > Yes exactly, I actually did little (python) POC for fun back then.
> > Started with a discussion on themajorbbs.com (stoneslinger and malakai) where
> they
> > wanted to get fresh NNTP news on their WG echoes but the passive
> > WG nntp server wouldn't make it easy. You would need to install a
> (bloated/costly)
> > solution called DNEWS that would pull news then push them into
> > WG through IHAVE.
> >
> > Well at socket level, the rfc is straightforward, so it was lighter and easier
> to
> > just run a script that triggers every X minutes and then pull from free nntp
> servers
> > then push in IHAVE on the WG side. Keeps track of last msgids fetched per echo
> in dat
> > files for next pass.
> >
> > I actually added support for several source NNTP servers (with optional AUTH, so
> I
> > could grab obscure FTN echoes from several different Synchronet BBS using my
> personal
> > accounts)
> >
> > While at it, I also added a QWK importer to bulk import archives through IHAVE.
> >
> > Note: I also tried EXPORTING replies from the "c:\wgserv\nntpout"
> folder,
> > and while it works, I had some issues with auth on some servers (refuse my
> replies),
> > and didn't really followed that part.
> >
> > Of course it would be nicer to have something similar in a WGNT module, and
> wouldnt
> > even require IHAVE or reliance on the WG nntp server, as the MBBS SDK probably
> have a
> > way to directly import messages. Synchronet works this way through newslink.js.
> > Not sure if there are work underway on the Phoenix project side, if there is
> enough
> > demand for such functionality.
>
> so we could run a synchronet nntp server to have our own server to "pull"
> from while we figure this out and as far as auth i managed to fix this
> in SMTPSEND.C by adding the auth login function and i could do the same with nntp.
> My only thing as of this writing is an nntp server i can pull from/send to to test.
> This way i can track where the failures are coming from on both ends.
> I do have a 3rd windows server online i was using as a secondary test bbs back when
> Platinum was having a serious crash issue in monsters spawning
> aid but after i resolved that i never took it down.
> I could use it as a worldgroup tcp/ip services test bed.

Well synchronet is optional, it's just a nice nntp server that can carry dove, fido and of course usenet and exposes these echoes like a normal nntp server.
You can use Vertrauen or any nntp server and pull from them :)

But to bring these msgs into WG, you actually need that little process/link to pull news then push them onto the WG NNTP as that lazy guy is not able to do
so on its own.

Synchronet has aptly name that piece of code "newslink" and it's schedule-ran.

Post Reply