2016-10-05 7 views
0

URL이 끝나지 않을 때 imgur에서 이미지를 검색하는 데이 코드의 일부를 사용했습니다. .png/.jpg와 같은 이미지 확장명. 그러나 나는이 오류가 나타납니다. 살펴보고 수정 제안하십시오 :image_url = soup.select ('. 이미지 a') [0] [ 'href'] IndexError : 인덱스가 범위를 벗어남

https://github.com/asweigart/imgur-hosted-reddit-posted-downloader/blob/master/imgur-hosted-reddit-posted-downloader.py

import datetime 
import praw 
import re 
import urllib 
import requests 
from bs4 import BeautifulSoup 

sub = 'dog' 
imgurUrlPattern = re.compile(r'(http://i.imgur.com/(.*))(\?.*)?') 
r = praw.Reddit(user_agent = "download all images from a subreddit", 
       user_site = "lamiastella") 
already_done = [] 
#checkWords = ['i.imgur.com', 'jpg', 'png',] 
check_words = ['jpg', 'png'] 

subreddit = r.get_subreddit(sub) 
for submission in subreddit.get_hot(limit=10000): 
     is_image = any(string in submission.url for string in check_words) 
     print '[LOG] Getting url: ' + submission.url 
     if submission.id not in already_done and is_image: 
      if submission.url.endswith('/'): 
       modified_url = submission.url[:len(submission.url)-1] 
       try: 
         urllib.urlretrieve(modified_url, '/home/jalal/computer_vision/image_retrieval/images/' + datetime.datetime.now().strftime('%y-%m-%d-%s') + modified_url[-4:]) 
       except IOError: 
         pass 
      else: 
       try: 
         urllib.urlretrieve(submission.url, '/home/jalal/computer_vision/image_retrieval/images/' + datetime.datetime.now().strftime('%y-%m-%d-%s') + submission.url[-4:]) 
       except IOError: 
         pass 

      already_done.append(submission.id) 
      print '[LOG] Done Getting ' + submission.url 
      print('{0}: {1}'.format('submission id is', submission.id)) 
     elif 'http://imgur.com/' in submission.url: 
       # This is an Imgur page with a single image. 
       html_source = requests.get(submission.url).text # download the image's page 
       soup = BeautifulSoup(html_source, "lxml") 
       image_url = soup.select('.image a')[0]['href'] 
       if image_url.startswith('//'): 
         # if no schema is supplied in the url, prepend 'http:' to it 
         image_url = 'http:' + image_url 
         image_id = image_url[image_url.rfind('/') + 1:image_url.rfind('.')] 
         urllib.urlretrieve(image_url, '/home/jalal/computer_vision/image_retrieval/images/' + datetime.datetime.now().strftime('%y-%m-%d-%s') + image_url[-4:]) 

오류는 다음과 같습니다

[LOG] Getting url: http://imgur.com/a/yOLjm 
Traceback (most recent call last): 
    File "download_images.py", line 43, in <module> 
    image_url = soup.select('.image a')[0]['href'] 
IndexError: list index out of range 
+0

사용'인쇄가 필요합니다 (수프 .select ('. image a'))'- 아마도 빈 목록을 얻게되어 [0] 요소를 얻을 수 없습니다. – furas

+1

당신이'.image img'와'src' - soup.select ('. image img') [0] [ 'src']' – furas

답변

1

당신은 잘못된 선택이있다 - 당신이 soup.select('img')[0]['src']

import datetime 
import urllib 
import requests 
from bs4 import BeautifulSoup 

url = 'http://imgur.com/gyUWtWP' 

html_source = requests.get(url).text 
soup = BeautifulSoup(html_source, "lxml") 

image_url = soup.select('img')[0]['src'] 

if image_url.startswith('//'): 
    image_url = 'http:' + image_url 
    image_id = image_url[image_url.rfind('/') + 1:image_url.rfind('.')] 

    urllib.urlretrieve(image_url, datetime.datetime.now().strftime('%y-%m-%d-%s') + image_url[-4:]) 
+0

을 필요로한다고 생각합니다. 고마워, 어떻게하면 url = 'https : //www.instagram.com/p/BFy-ymovMyd/ '? –

+0

페이지는 자바 스크립트를 사용하여 ''을 생성하지만 이미지 URL은 HTML의 ''- soup.find ('meta ', attrs = '속성': "og : 이미지"}). attrs [ 'content']' – furas

관련 문제