Curl

From Alessandro's Wiki
Jump to: navigation, search
  • very dirty way of downloading the all Max Keiser Report episodes from Russia Today's website:
for p in `seq 1 23`
  do
  for a in `curl http://rt.com/programs/keiser-report/page-$p/|grep href |grep "keiser-report/episode"|grep -v comments|awk -F[\"\"] '{print $2}'|grep episode|cut -d'/' -f4`
  do
    urla=`curl http://rt.com/programs/keiser-report/$a/|grep mp4|grep source|awk -F[\"\"] '{print $2}' `
    wget $urla
  done
done