Python读取网页内容显示问题

[黑夜愁客]

我想读取土豆网站的一个页面地址，比如http://www.tudou.com/programs/view/kS03BynGs8Q
但是

>>> req = urllib2.Request('http://www.tudou.com/programs/view/kS03BynGs8Q')
>>> req.add_header('User-Agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0)')
>>> page = urllib2.urlopen(req)
>>> data = page.read()
>>> print data
ﾋ
>>> print len(data)
7202

为何打印不出网页html内容呢，而且长度却是7202呢

[Waistcoat22]

可以啊，输出不就是一个html文件嘛

[Waistcoat22]

print len(data)
输出结果：31854

[黑夜愁客]

[Quote=引用 1 楼 waistcoat22 的回复:]

可以啊，输出不就是一个html文件嘛
[/Quote]那个为何输出有问题呢

[BoredNight]

debug一下看看data的内容

[freetstar]

编码的问题吧,试试
#-*- coding=utf-8 -*-

[Waistcoat22]

应该是网站返回的内容为gzip压缩格式，但我测试不是每次都返回gzip格式，所以加了个判断：

import urllib2
import StringIO
import gzip

url = 'http://www.tudou.com/programs/view/kS03BynGs8Q'
req = urllib2.Request(url)
req.add_header('User-Agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0)')
response = urllib2.urlopen(req)
content = response.read()
response.close()

html = ""
if response.headers["Content-Encoding"] == 'gzip':
    html = gzip.GzipFile(fileobj = StringIO.StringIO(content)).read()
else:
    html = content

print html

[zenxiaoxian]

import urllib,re
url ='http://www.tudou.com/programs/view/kS03BynGs8Q'
wp = urllib.urlopen(url).read()
#bug = re.findall(r"<title>*......",wp);
#for mai in bug

print wp

[I_NBFA]

这种问题先抓包