Escape Artists
November 20, 2017, 07:39:53 PM *
Welcome, Guest. Please login or register.

Login with username, password and session length
News: The FINAL ROUND of the PseudoPod Flash Fiction Contest has begun!
 
   Home   Help Search Login Register  
Pages: [1]
  Print  
Author Topic: 403 FORBIDDEN error when trying to get Podcastle RSS feed  (Read 7351 times)
jimhenry
Extern
*
Posts: 1


« on: July 11, 2014, 12:05:23 PM »

I'm using a home-grown podcast downloader, based on wget and a set of Perl and shell scripts.  Recently, it stopped downloading Podcastle episodes, though Escape Pod and various non-Escape-Artists podcasts still download fine.  On investigation, it seems that wget is getting a 403 FORBIDDEN error.

...I tried to insert a few lines from my script's log  files, but I'm getiting a "Sorry, you are not allowed to post links" error error from the forum software.  There are URLS in the log file but I'm not trying to make them live links with bbcode.

Any ideas?
Logged
Bdoomed
Pseudopod Tiger
Moderator
*****
Posts: 4813


Mmm. Tiger.


« Reply #1 on: July 11, 2014, 09:22:13 PM »

Code:
Try pasting the code by using the [ code] tags?

Not entirely sure what could be going wrong there.  I know PodCastle is having sooome kind of error at the moment (though I'm not entirely sure what that error is yet, it's pretty vague at this point from where I'm sitting).
Logged

I'd like to hear my options, so I could weigh them, what do you say?
Five pounds?  Six pounds? Seven pounds?
ninjaguardsheep
Extern
*
Posts: 2


Will fix computers for beer, likes the seaside


WWW
« Reply #2 on: August 03, 2014, 04:51:20 AM »

Hi,

I have also had this issue with both Pseudopod and Podcastle feeds.

I have been using Mashpodder (a command line podcatcher written in bash) to download episodes, this also uses the GNU WGET tool to download the feed xml.

After some testing I found I was able to download the feed xml with CURL (another command line http tool) without issue. I was also able to successfully download the xml using WGET with the -U argument to spoof the user agent string e.g.

Code:
wget -U firefox $URL

the above command causes WGET to appear to the web server as a version of Mozilla Firefox.

However if  WGET connects using its default user agent string http error 403 is received.
« Last Edit: August 03, 2014, 07:22:01 AM by ninjaguardsheep » Logged
ALH
Extern
*
Posts: 7


« Reply #3 on: August 17, 2014, 05:06:42 AM »

I too am getting "(403) Forbidden" from both Podcastle and Pseudopod.  Escape Pod, Drabblecast, StarShipSofa, and others are fine.  I'm using a console agent I compiled from source code found on the Microsoft forum for downloading XML RSS 2.0 podcasts.  I verified Pseudopod's main feed URL with the one I'm using.  I can't seem to find the main feed for Podcastle to check it.  I can go to the Podcastle web site and play the audio but when I try downloading the file to drop it into my MP3 player, the audio starts playing on a Quicktime player.
Logged
wintermute
Hipparch
******
Posts: 1291


What Would Batman Do?


« Reply #4 on: August 29, 2014, 06:17:47 AM »

I'm also using a homegrown perl podcatcher, and I had the same problem. Switching from using lwp (which, I believe is based on wget) to cURL solved the problem for me.

Well, at least it did until recently, but the current problems look more systemic on EA's part.

Let me know if you want to swap code.
Logged

Science means that not all dreams can come true
kibitzer
Purveyor of Unsolicited Opinions
Hipparch
******
Posts: 2222


Kibitzer: A meddler who offers unwanted advice


« Reply #5 on: August 29, 2014, 08:52:09 PM »

Yup, PodCastle's hosting was moved yesterday and this is a hangover from that. We're looking into the problem at the moment. If we can't find a fix the site will be moved back until we can resolve the problem.

Apologies for the inconvenience.
Logged

ALH
Extern
*
Posts: 7


« Reply #6 on: September 01, 2014, 10:39:48 AM »

Now it is truly the end of the world. Escape Pod just went dark with my client. I saw and tried the new url but my application still reports "(403) Forbidden". At first it was just Podcastle and Pseudopod. Now all three are gone.
Logged
kibitzer
Purveyor of Unsolicited Opinions
Hipparch
******
Posts: 2222


Kibitzer: A meddler who offers unwanted advice


« Reply #7 on: September 01, 2014, 05:26:29 PM »

As far as I can tell, all three feeds are up and running, and it looks like iTunes knows about them. What URLs are you using?

http://podcastle.org/feed/
http://escapepod.org/feed/
http://pseudopod.org/feed/
« Last Edit: September 01, 2014, 05:28:26 PM by kibitzer » Logged

ElectroSquid
Extern
*
Posts: 12



« Reply #8 on: September 03, 2014, 10:27:04 AM »

I don't know if it's related, but Stitcher does not seem to be picking up Pseudopod episodes. I can see one but not the backlist, and it's not the most recent episode either...
Logged
ALH
Extern
*
Posts: 7


« Reply #9 on: September 03, 2014, 11:18:15 AM »

My client software still says forbidden. I know the sites are up as I setup IE11's RSS function and it works fine. I'll keep looking for why my home grown package doesn't like the new servers. Until then I'll keep up with the feed via IE.
Logged
kibitzer
Purveyor of Unsolicited Opinions
Hipparch
******
Posts: 2222


Kibitzer: A meddler who offers unwanted advice


« Reply #10 on: September 03, 2014, 06:05:10 PM »

I don't know if it's related, but Stitcher does not seem to be picking up Pseudopod episodes. I can see one but not the backlist, and it's not the most recent episode either...

Thanks. We're aware of the Stitcher anomaly and we're looking into it.
Logged

wintermute
Hipparch
******
Posts: 1291


What Would Batman Do?


« Reply #11 on: September 04, 2014, 07:03:34 PM »

My problem was the defaut user agent string that lwp / cURL use. Once I spoofed a browser user agent, I stopped getting 403's, and started getting actual content.
Logged

Science means that not all dreams can come true
SquidgeyFlint
Extern
*
Posts: 1


« Reply #12 on: September 10, 2014, 01:20:00 AM »

As far as I can tell, all three feeds are up and running, and it looks like iTunes knows about them. What URLs are you using?

podcastle.org/feed/
escapepod.org/feed/
pseudopod.org/feed/


FWIW: I had some really old URLs based on feeds.escapeartists.net like feeds.escapeartists.net/PodCastle_Main and feeds.escapeartists.net/EscapePod and those URLs stopped serving traffic in the past week or so.

It is hard to find the simpler feed urls mentioned above. On podcastle.org, I can't seem to find a link to the podcast at all. On escapepod.org, the "how to subscribe" option in the nav bar points me to the feeds.escapeartists.net urls.
Logged
kibitzer
Purveyor of Unsolicited Opinions
Hipparch
******
Posts: 2222


Kibitzer: A meddler who offers unwanted advice


« Reply #13 on: September 10, 2014, 05:26:45 PM »

Fair point, we'll look at getting those changed.
Logged

Fenrix
Curmudgeonly Co-Editor of PseudoPod
Editor
*****
Posts: 3605


Have you found the Yellow Sign?


« Reply #14 on: September 13, 2014, 09:00:17 AM »

As a heads up, it appears that the latest update to itunes has broken the feed. I have not updated itunes in a while (specifically for things like this - I like to let others debug the software well before I update) but this is being reported over on the Facebook page. Thought I would share the report here.
Logged

I always lock the door when I creep by daylight.
kibitzer
Purveyor of Unsolicited Opinions
Hipparch
******
Posts: 2222


Kibitzer: A meddler who offers unwanted advice


« Reply #15 on: September 14, 2014, 05:16:36 PM »

Thanks Fenrix. I can't see a problem my end -- iTunes still updates -- and I can't see any reports on the Facebook pages. Could you post me a link to the problem reports?
Logged

ALH
Extern
*
Posts: 7


« Reply #16 on: September 19, 2014, 09:30:46 PM »

I solved my client problem by adding an additional header to the request indicating my agent works like Mozilla.  It works great now.

Life is good!
Logged
startrek.steve
Palmer
**
Posts: 21



« Reply #17 on: October 14, 2014, 05:39:20 AM »

Was this in Mashpodder?
If so can you show an example?
Steve
Logged
awfulhorrid
Extern
*
Posts: 11


Woof!


WWW
« Reply #18 on: November 02, 2014, 05:20:58 PM »

I use podget (via a once a day cron job) to get my podcasts and noticed this week that I hadn't gotten any new Escape Artists stories in quite a while. I was really far behind, so it wasn't really noticeable until now when I'm down to a few weeks worth of stories! This thread did help me solve the problem and it actually wasn't that bad once I had the user-agent clue. I modified the Wget base options to include --user-agent="" and suddenly the podcasts are flowing again.

Hope this helps others!
Logged

I strongly support the right to be different!
Equality != Liberty
Do you need me to give the Linux / Creative Commons / FOSS lecture?
kibitzer
Purveyor of Unsolicited Opinions
Hipparch
******
Posts: 2222


Kibitzer: A meddler who offers unwanted advice


« Reply #19 on: November 05, 2014, 02:02:39 AM »

Folks, thanks for your suggestions on fixing this problem. I wrote up an FAQ about it on our new support site (http://support.escapeartists.net). It's already helped out someone else in a similar situation and that's down to your helpfulness. Thanks!
Logged

Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.21 | SMF © 2015, Simple Machines Valid XHTML 1.0! Valid CSS!