wget works one server for a url but gets 403 forbidden on another
By Gabriel Cooper •
The command I am using: wget Works on a digital ocean hosted ubuntu 14.10 machine Works in chrome browser Does NOT work in a rackspace hosted ubuntu 13.10 environment. There, I keep getting a 403 Forbidden error. Do you guys have any ideas why? From all environments, I am able to wget
Complete debug message from wget:
DEBUG output created by Wget 1.14 on linux-gnu.
URI encoding = ‘UTF-8’
--2015-03-11 10:14:36--
Resolving ()... 23.64.122.224
Caching => 23.64.122.224
Connecting to ()|23.64.122.224|:80... connected.
Created socket 3.
Releasing 0x0000000001eea330 (new refcount 1).
---request begin---
GET /index.htm HTTP/1.1
User-Agent: Wget/1.14 (linux-gnu)
Accept: */*
Host:
Connection: Keep-Alive
---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 403 Forbidden
Server: Apache-Coyote/1.1
Content-Type: text/html;charset=utf-8
Content-Length: 964
X-DDC-Arch-Trace: ,HttpResponse
Date: Wed, 11 Mar 2015 14:14:46 GMT
Connection: keep-alive
---response end---
403 Forbidden
Registered socket 3 for persistent reuse.
URI content encoding = ‘utf-8’
Skipping 964 bytes of body: [<html><head><title>Apache Tomcat/6.0.20 - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} Skipping 452 bytes of body: [P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 403 - </h1><HR size="1" noshade="noshade"><p><b>type</b> Status report</p><p><b>message</b> <u></u></p><p><b>description</b> <u>Access to the specified resource () has been forbidden.</u></p><HR size="1" noshade="noshade"><h3>Apache Tomcat/6.0.20</h3></body></html>] done.
2015-03-11 10:14:36 ERROR 403: Forbidden.2 Answers
Not sure that anyone cares, but from Canada:
$ wget
--2018-03-14 17:04:34--
Resolving ()... 151.101.52.247
Connecting to ()|151.101.52.247|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: [following]
--2018-03-14 17:04:34--
Connecting to ()|151.101.52.247|:443... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: / [following]
--2018-03-14 17:04:35--
Reusing existing connection to
HTTP request sent, awaiting response... 200 OK
Length: 283589 (277K) [text/html]
Saving to: ‘index.htm’
index.htm 100%[==========================>] 276.94K 1.78MB/s in 0.2s
2018-03-14 17:04:35 (1.78 MB/s) - ‘index.htm’ saved [283589/283589]Oops there goes another 280KB lost.
Not sure if it's still required but simple 'spoof' of useragent usually helps. For example:
wget --user-agent="Mozilla/4.0 (Windows; MSIE 7.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)" /HERE GOES YOUR URL/More in general
"Zoraya ter Beek, age 29, just died by assisted suicide in the Netherlands. She was physically healthy, but psychologically depressed. It's an abomination that an entire society would actively facilitate, even encourage, someone ending their own life because they had no hope. Th…"
