Re: [WebDNA] TCPConnect assist

This WebDNA talk-list message is from

2016


It keeps the original formatting.
numero = 112927
interpreted = N
texte = 514 --Apple-Mail=_08C498D4-5688-4CBA-8ABE-C1B98A596702 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 This works for me (Ken's code, slightly modified): [text]host=3Dbusiness.comcast.com[/text] [text]path=3D/ethernet/private-line[/text] [text]n=3D[unurl]%0D%0A[/unurl][/text] [text]content=3D[/text] [text]comcast_result=3D[tcpconnect host=3D[host]&port=3D443&ssl=3DT] [tcpsend skipheader=3DT]GET [path] HTTP/1.0[n][!] [/!]Host: [host][n][!] [/!]User-Agent: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[n][!] [/!]Content-Type: text/html[n][!] [/!]Content-Length: [countchars][content][/countchars][n][n][!] [/!][/tcpsend] [/tcpconnect][/text] comcast_result=3D[comcast_result] Best, Christer ************************************************************* Christer Olsson PO Box 9160 Phone +46 40 25 85 85 Ljusa Id=C3=A9er AB SE-200 39 Malmo Fax +46 40 25 85 89 > 26 aug. 2016 kl. 16:37 skrev Patrick McCormick = : >=20 > Thanks, Ken, I added a host param to TCPSend, but still empty. The = target server is Windows IIS 8 with ASP.net = v4.0.30319. I have to study = https://www.w3.org/Protocols/HTTP/1.0/spec.html = and then figure out = what parameters my TCPConnect & TCPSend might be missing. >=20 > Most sites like this target server use a CMS and they all send lots of = needless and redundant cruft. They=E2=80=99re also aggressive about = preventing cross domain hacking, which always seems odd since the point = of websites is to distribute content. I guess they=E2=80=99re trying to = prevent Comcast from accidentally selling something. >=20 > TCPConnect & TCPSend should emulate a person at a browser, but also = allow definition of the browser, OS, IP, etc. I=E2=80=99ve had good = luck with this in the distant past. With modern CMS systems, I think = it=E2=80=99s just a matter of hunting down the parameters necessary to = trick the server into serving a non-human browser. >=20 > An organized list of those requirements covering various combinations = of browser, server & OS would be really handy. Anyone else notice any = glaring omissions in this code: >=20 > >=20 > [!]=3D=3D=3D=3D=3D Make Connection =3D=3D=3D=3D=3D[/!] > [text]comcast_result=3D[tcpconnect = host=3Dbusiness.comcast.com&port=3D443&ssl=3DT][!] > [/!][TCPSend skipheader=3DT]GET /ethernet/private-line = HTTP/1.0[UnURL]%0D%0A[/UnURL][!] > [/!]USER-AGENT: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[UnURL]%0D%0A[/UnURL][!] > [/!]host: business.comcast.com[UnURL]%0D%0A[/UnURL][!] > [/!][/TCPSend][!] > [/!][/tcpconnect][/text] >=20 >=20 > comcast_result=3D[comcast_result] >=20 >=20 >=20 >=20 >> On Aug 26, 2016, at 6:52 AM, Kenneth Grome = wrote: >>=20 >> Try putting a Host parameter inside the tcpsend context. =20 >>=20 >> It doesn't matter that host is specified in the tcpconnect tag=20 >> because it is frequently required as a parameter in the tcpsend=20 >> context, too. This always works for me: >>=20 >> [text]host=3Dwww.paypal.com[/text] >> [text]path=3D/cgi-bin/webscr[/text] >> [text]n=3D[unurl]%0D%0A[/unurl][/text] >> [text]content=3D... name=3Dvalue pairs go here ...[/text] >>=20 >> [tcpconnect host=3D[host]&port=3D443&ssl=3DT] >> [tcpsend skipheader=3DT]POST [path] HTTP/1.0[n][!] >> [/!]Host: [host][n][!] >> [/!]User-Agent: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[n][!] >> [/!]Content-Type: text/namevalue[n][!] >> [/!]Content-Length: [countchars][content][/countchars][n][n][!] >> [/!][content][n][!] >> [/!][/tcpsend] >> [/tcpconnect] >>=20 >> This has been the required syntax for years (for most servers). =20 >> If it's not mentioned in the docs it should be. >>=20 >> Regards, >> Kenneth Grome >> WebDNA Solutions >> http://www.webdnasolutions.com >> Web Database Systems and Linux Server Administration >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us >=20 > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug Reporting: support@webdna.us --Apple-Mail=_08C498D4-5688-4CBA-8ABE-C1B98A596702 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 This works for me (Ken's code, slightly modified):

[text]host=3Dbusiness.comcast.com[/text]
[text]path=3D/ethernet/private-line[/text]
[text]n=3D[unurl]%0D%0A[/unurl][/text]
[text]content=3D[/text]

[text]comcast_result=3D[tcpconnect = host=3D[host]&port=3D443&ssl=3DT]
[tcpsend = skipheader=3DT]GET [path] HTTP/1.0[n][!]
[/!]Host: = [host][n][!]
[/!]User-Agent: Mozilla/4.0 = (compatible; MSIE 5.01; Windows NT 5.0)[n][!]
[/!]Content-Type: text/html[n][!]
[/!]Content-Length: = [countchars][content][/countchars][n][n][!]
[/!][/tcpsend]
[/tcpconnect][/text]


comcast_result=3D[comcast_result]

Best,
Christer

 *********************************************************= ****
 Christer Olsson   PO Box 9160    =     Phone +46 40 25 85 85
 Ljusa = Id=C3=A9er AB    SE-200 39 Malmo    Fax +46 40 = 25 85 89



26 aug. 2016 kl. 16:37 skrev Patrick McCormick <duganmccormick@gmail.com>:

Thanks, Ken, I added = a host param to TCPSend, but still empty.  The target server is = Windows IIS 8 with ASP.net = v4.0.30319.  I have to study https://www.w3.org/Protocols/HTTP/1.0/spec.html and = then figure out what parameters my TCPConnect & TCPSend might = be missing.

Most sites like this target = server use a CMS and they all send lots of needless and redundant cruft. =  They=E2=80=99re also aggressive about preventing cross domain = hacking, which always seems odd since the point of websites is to = distribute content. I guess they=E2=80=99re trying to prevent Comcast = from accidentally selling something.

TCPConnect & TCPSend should emulate a person at a = browser, but also allow definition of the browser, OS, IP, etc. =  I=E2=80=99ve had good luck with this in the distant past. =  With modern CMS systems, I think it=E2=80=99s just a matter = of hunting down the parameters necessary to trick the server into = serving a non-human browser.

An organized = list of those requirements covering various combinations of browser, = server & OS would be really handy. Anyone else notice any = glaring omissions in this code:

<!-- HAS_WEBDNA_TAGS -->

[!]=3D=3D=3D=3D=3D Make Connection = =3D=3D=3D=3D=3D[/!]
[text]comcast_result=3D[tcpconnect = host=3Dbusiness.comcast.com&port=3D443&ssl=3DT][!]
[/!][TCPSend skipheader=3DT]GET /ethernet/private-line = HTTP/1.0[UnURL]%0D%0A[/UnURL][!]
[/!]USER-AGENT: = Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[UnURL]%0D%0A[/UnURL][!]
[/!]host: business.comcast.com[UnURL]%0D%0A[/UnURL][!]
[/!][/TCPSend][!]
[/!][/tcpconnect][/text]


comcast_result=3D[comcast_result]




On Aug 26, 2016, at 6:52 AM, Kenneth Grome = <ken@webdnasolutions.com> wrote:

Try putting a Host parameter inside the tcpsend context. =  

It doesn't matter that host is = specified in the tcpconnect tag 
because it is = frequently required as a parameter in the tcpsend 
context, too.  This always works for me:
[text]host=3Dwww.paypal.com[/text]
[text]path=3D/cgi-bin/webscr[/text]
[text]n=3D[unurl]%0D%0A[/unurl][/text]
[text]content=3D... name=3Dvalue pairs go here ...[/text]

[tcpconnect = host=3D[host]&port=3D443&ssl=3DT]
[tcpsend = skipheader=3DT]POST [path] HTTP/1.0[n][!]
[/!]Host: = [host][n][!]
[/!]User-Agent: Mozilla/4.0 (compatible; MSIE = 5.01; Windows NT 5.0)[n][!]
[/!]Content-Type: = text/namevalue[n][!]
[/!]Content-Length: = [countchars][content][/countchars][n][n][!]
[/!][content][n][!]
[/!][/tcpsend]
[/tcpconnect]

This has been the = required syntax for years (for most servers).  
If = it's not mentioned in the docs it should be.

Regards,
Kenneth Grome
WebDNA = Solutions
http://www.webdnasolutions.com
Web Database = Systems and Linux Server Administration
---------------------------------------------------------
This message is sent to you because you are subscribed to
the mailing list <talk@webdna.us>.
To = unsubscribe, E-mail to: <talk-leave@webdna.us>
archives: http://mail.webdna.us/list/talk@webdna.us
Bug Reporting: support@webdna.us
--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug Reporting: support@webdna.us

= --Apple-Mail=_08C498D4-5688-4CBA-8ABE-C1B98A596702-- . Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] TCPConnect assist (Patrick McCormick 2016)
  2. Re: [WebDNA] TCPConnect assist (Stuart Tremain 2016)
  3. Re: [WebDNA] TCPConnect assist (Patrick McCormick 2016)
  4. Re: [WebDNA] TCPConnect assist (Patrick McCormick 2016)
  5. Re: [WebDNA] TCPConnect assist (Christer Olsson 2016)
  6. Re: [WebDNA] TCPConnect assist (Patrick McCormick 2016)
  7. Re: [WebDNA] TCPConnect assist (Kenneth Grome 2016)
  8. Re: [WebDNA] TCPConnect assist (Stuart Tremain 2016)
  9. Re: [WebDNA] TCPConnect assist (Stuart Tremain 2016)
  10. Re: [WebDNA] TCPConnect assist (Stuart Tremain 2016)
  11. Re: [WebDNA] TCPConnect assist (Patrick McCormick 2016)
  12. Re: [WebDNA] TCPConnect assist (Stuart Tremain 2016)
  13. Re: [WebDNA] TCPConnect assist (Patrick McCormick 2016)
  14. Re: [WebDNA] TCPConnect assist (Stuart Tremain 2016)
  15. [WebDNA] TCPConnect assist (Patrick McCormick 2016)
514 --Apple-Mail=_08C498D4-5688-4CBA-8ABE-C1B98A596702 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 This works for me (Ken's code, slightly modified): [text]host=3Dbusiness.comcast.com[/text] [text]path=3D/ethernet/private-line[/text] [text]n=3D[unurl]%0D%0A[/unurl][/text] [text]content=3D[/text] [text]comcast_result=3D[tcpconnect host=3D[host]&port=3D443&ssl=3DT] [tcpsend skipheader=3DT]GET [path] HTTP/1.0[n][!] [/!]Host: [host][n][!] [/!]User-Agent: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[n][!] [/!]Content-Type: text/html[n][!] [/!]Content-Length: [countchars][content][/countchars][n][n][!] [/!][/tcpsend] [/tcpconnect][/text] comcast_result=3D[comcast_result] Best, Christer ************************************************************* Christer Olsson PO Box 9160 Phone +46 40 25 85 85 Ljusa Id=C3=A9er AB SE-200 39 Malmo Fax +46 40 25 85 89 > 26 aug. 2016 kl. 16:37 skrev Patrick McCormick = : >=20 > Thanks, Ken, I added a host param to TCPSend, but still empty. The = target server is Windows IIS 8 with ASP.net = v4.0.30319. I have to study = https://www.w3.org/Protocols/HTTP/1.0/spec.html = and then figure out = what parameters my TCPConnect & TCPSend might be missing. >=20 > Most sites like this target server use a CMS and they all send lots of = needless and redundant cruft. They=E2=80=99re also aggressive about = preventing cross domain hacking, which always seems odd since the point = of websites is to distribute content. I guess they=E2=80=99re trying to = prevent Comcast from accidentally selling something. >=20 > TCPConnect & TCPSend should emulate a person at a browser, but also = allow definition of the browser, OS, IP, etc. I=E2=80=99ve had good = luck with this in the distant past. With modern CMS systems, I think = it=E2=80=99s just a matter of hunting down the parameters necessary to = trick the server into serving a non-human browser. >=20 > An organized list of those requirements covering various combinations = of browser, server & OS would be really handy. Anyone else notice any = glaring omissions in this code: >=20 > >=20 > [!]=3D=3D=3D=3D=3D Make Connection =3D=3D=3D=3D=3D[/!] > [text]comcast_result=3D[tcpconnect = host=3Dbusiness.comcast.com&port=3D443&ssl=3DT][!] > [/!][TCPSend skipheader=3DT]GET /ethernet/private-line = HTTP/1.0[unurl]%0D%0A[/UnURL][!] > [/!]USER-AGENT: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[unurl]%0D%0A[/UnURL][!] > [/!]host: business.comcast.com[unurl]%0D%0A[/UnURL][!] > [/!][/TCPSend][!] > [/!][/tcpconnect][/text] >=20 >=20 > comcast_result=3D[comcast_result] >=20 >=20 >=20 >=20 >> On Aug 26, 2016, at 6:52 AM, Kenneth Grome = wrote: >>=20 >> Try putting a Host parameter inside the tcpsend context. =20 >>=20 >> It doesn't matter that host is specified in the tcpconnect tag=20 >> because it is frequently required as a parameter in the tcpsend=20 >> context, too. This always works for me: >>=20 >> [text]host=3Dwww.paypal.com[/text] >> [text]path=3D/cgi-bin/webscr[/text] >> [text]n=3D[unurl]%0D%0A[/unurl][/text] >> [text]content=3D... name=3Dvalue pairs go here ...[/text] >>=20 >> [tcpconnect host=3D[host]&port=3D443&ssl=3DT] >> [tcpsend skipheader=3DT]POST [path] HTTP/1.0[n][!] >> [/!]Host: [host][n][!] >> [/!]User-Agent: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[n][!] >> [/!]Content-Type: text/namevalue[n][!] >> [/!]Content-Length: [countchars][content][/countchars][n][n][!] >> [/!][content][n][!] >> [/!][/tcpsend] >> [/tcpconnect] >>=20 >> This has been the required syntax for years (for most servers). =20 >> If it's not mentioned in the docs it should be. >>=20 >> Regards, >> Kenneth Grome >> WebDNA Solutions >> http://www.webdnasolutions.com >> Web Database Systems and Linux Server Administration >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us >=20 > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug Reporting: support@webdna.us --Apple-Mail=_08C498D4-5688-4CBA-8ABE-C1B98A596702 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 This works for me (Ken's code, slightly modified):

[text]path=3D/ethernet/private-line[/text]
[text]n=3D[unurl]%0D%0A[/unurl][/text]
[text]content=3D[/text]

[text]comcast_result=3D[tcpconnect = host=3D[host]&port=3D443&ssl=3DT]
[tcpsend = skipheader=3DT]GET [path] HTTP/1.0[n][!]
[/!]Host: = [host][n][!]
[/!]User-Agent: Mozilla/4.0 = (compatible; MSIE 5.01; Windows NT 5.0)[n][!]
[/!]Content-Type: text/html[n][!]
[/!]Content-Length: = [countchars][content][/countchars][n][n][!]
[/!][/tcpsend]
[/tcpconnect][/text]


comcast_result=3D[comcast_result]

Best,
Christer

 *********************************************************= ****
 Christer Olsson   PO Box 9160    =     Phone +46 40 25 85 85
 Ljusa = Id=C3=A9er AB    SE-200 39 Malmo    Fax +46 40 = 25 85 89



26 aug. 2016 kl. 16:37 skrev Patrick McCormick <duganmccormick@gmail.com>:

Thanks, Ken, I added = a host param to TCPSend, but still empty.  The target server is = Windows IIS 8 with ASP.net = v4.0.30319.  I have to study https://www.w3.org/Protocols/HTTP/1.0/spec.html and = then figure out what parameters my TCPConnect & TCPSend might = be missing.

Most sites like this target = server use a CMS and they all send lots of needless and redundant cruft. =  They=E2=80=99re also aggressive about preventing cross domain = hacking, which always seems odd since the point of websites is to = distribute content. I guess they=E2=80=99re trying to prevent Comcast = from accidentally selling something.

TCPConnect & TCPSend should emulate a person at a = browser, but also allow definition of the browser, OS, IP, etc. =  I=E2=80=99ve had good luck with this in the distant past. =  With modern CMS systems, I think it=E2=80=99s just a matter = of hunting down the parameters necessary to trick the server into = serving a non-human browser.

An organized = list of those requirements covering various combinations of browser, = server & OS would be really handy. Anyone else notice any = glaring omissions in this code:

<!-- HAS_WEBDNA_TAGS -->

[!]=3D=3D=3D=3D=3D Make Connection = =3D=3D=3D=3D=3D[/!]
[text]comcast_result=3D[tcpconnect = host=3Dbusiness.comcast.com&port=3D443&ssl=3DT][!]
[/!][TCPSend skipheader=3DT]GET /ethernet/private-line = HTTP/1.0[unurl]%0D%0A[/UnURL][!]
[/!]USER-AGENT: = Mozilla/4.0 (compatible; MSIE 5.01; Windows NT = 5.0)[unurl]%0D%0A[/UnURL][!]
[/!]host: business.comcast.com[unurl]%0D%0A[/UnURL][!]
[/!][/TCPSend][!]
[/!][/tcpconnect][/text]


comcast_result=3D[comcast_result]




On Aug 26, 2016, at 6:52 AM, Kenneth Grome = <ken@webdnasolutions.com> wrote:

Try putting a Host parameter inside the tcpsend context. =  

It doesn't matter that host is = specified in the tcpconnect tag 
because it is = frequently required as a parameter in the tcpsend 
context, too.  This always works for me:
[text]host=3Dwww.paypal.com[/text]
[text]path=3D/cgi-bin/webscr[/text]
[text]n=3D[unurl]%0D%0A[/unurl][/text]
[text]content=3D... name=3Dvalue pairs go here ...[/text]

[tcpconnect = host=3D[host]&port=3D443&ssl=3DT]
[tcpsend = skipheader=3DT]POST [path] HTTP/1.0[n][!]
[/!]Host: = [host][n][!]
[/!]User-Agent: Mozilla/4.0 (compatible; MSIE = 5.01; Windows NT 5.0)[n][!]
[/!]Content-Type: = text/namevalue[n][!]
[/!]Content-Length: = [countchars][content][/countchars][n][n][!]
[/!][content][n][!]
[/!][/tcpsend]
[/tcpconnect]

This has been the = required syntax for years (for most servers).  
If = it's not mentioned in the docs it should be.

Regards,
Kenneth Grome
WebDNA = Solutions
http://www.webdnasolutions.com
Web Database = Systems and Linux Server Administration
---------------------------------------------------------
This message is sent to you because you are subscribed to
the mailing list <talk@webdna.us>.
To = unsubscribe, E-mail to: <talk-leave@webdna.us>
archives: http://mail.webdna.us/list/talk@webdna.us
Bug Reporting: support@webdna.us
--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug Reporting: support@webdna.us

= --Apple-Mail=_08C498D4-5688-4CBA-8ABE-C1B98A596702-- . Christer Olsson

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Comments in db? (1997) Too Much Rootbeer Free Offer (1997) using showpage and showcart commands (1996) Running _every_ page through WebCat ? (1997) ImageMagick Commands? (2003) One Hour Email (2002) Webcat2, WebCommerce, Mod 10 etc. (1997) [cart] not being interpreted inside [founditems] (1997) Feature req. (2002) [format 40s]text[/format] doesn't work (1997) PSC recommends what date format yr 2000??? (1997) Restricting to one folder hierarchy on the entire server (2005) Virtual hosting and webcatNT (1997) Can this be done? (1997) 'does not contain' operator needed ... (1997) Performance Issue (2000) WebTen and WebCat (1997) help with autenticate (1998) Test (2001) [WebDNA] [BULK] WebDNA 6.2 or 7.x Hosting (might be) Needed (2011)