python网页中json响应

ty_suyou 2018-03-11 11:37:46

小小小白的我又来求助了QAQ
闲着无聊想要去爬一下自己在教务系统里的成绩
然后通过浏览器的F12查看后发现是一个post请求
然后就会响应中就会有一个json

但是我怎么都弄不下来

就会一直报错
爬下来的是整个页面的源代码
所以想请教一下怎么获取这个json响应
这是我的源代码我把cookies删掉了
#coding:utf-8

import requests
import json

url=r'http://202.119.206.62/jwglxt/cjcx/cjcx_cxDgXscj.html?doType=query&gnmkdm=N305005'
header={
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:58.0) Gecko/20100101 Firefox/58.0', \
'cookies':'************************', \
'Accept':'application/json, text/javascript, */*; q=0.01', \
'Accept-Language':'zh-CN,zh;q=0.8,zh-TW;q=0.7,zh-HK;q=0.5,en-US;q=0.3,en;q=0.2', \
'Accept-Encoding':'gzip, deflate', \
'Referer':'http://202.119.206.62/jwglxt/cjcx/cjcx_cxDgXscj.html?gnmkdm=N305005&layout=default&su=04161535', \
'Content-Type':'application/x-www-form-urlencoded;charset=utf-8', \
'Content-Length':'147', \
'Connection':'keep-alive', \
'Host':'202.119.206.62', \
'Content-Type':'json;charset=UTF-8' \
}
data={'_search':'false','nd':'1520778877353', \
'queryModel.currentPage':'1', \
'queryModel.showCount':'15', \
'queryModel.sortName':'', \
'queryModel.sortOrder':'asc', \
'time':'0', \
'xnm':'2017', \
'xqm':'3' \

}

r=requests.post(url,headers=header,data=data)

print(r.json())

...全文

699 5 打赏收藏转发到动态举报

写回复

用AI写文章

5 条回复

切换为时间正序

请发表友善的回复…

发表回复

ty_suyou 2018-03-12

打赏
举报

引用 2 楼 oyljerry的回复:

r应该不是标准json格式，可能有一些干扰数据，你需要先处理一下，再用json解析

r中只有整个页面的源代码，没有发现我要的数据

ty_suyou 2018-03-12

打赏
举报

引用 1 楼 tianfang的回复:

响应的全文是怎样的？是不是只是其中的部分是json？你不解析，打印出来看看

打印r发现是整个网页的源代码，里面没有发现我要的数据

oyljerry 2018-03-12

打赏
举报

r应该不是标准json格式，可能有一些干扰数据，你需要先处理一下，再用json解析

tianfang 2018-03-12

打赏
举报

响应的全文是怎样的？是不是只是其中的部分是json？你不解析，打印出来看看

ty_suyou 2018-03-12

打赏
举报

<!doctype html> <html lang="zh-CN"> <head> <title>教学综合信息服务平台</title> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> <meta name="Copyright" content="zfsoft" /> <link rel="icon" href="/jwglxt/logo/favicon.ico" type="image/x-icon" /> <link rel="shortcut icon" href="/jwglxt/logo/favicon.ico" type="image/x-icon" /> <script type="text/javascript"> var _path = "/jwglxt"; var _systemPath = "/jwglxt"; var _stylePath = "http://202.119.206.62:80/zftal-ui-v5-1.0.2"; </script>  <script type="text/javascript" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/js/jquery-1.11.1-min.js?ver=20180117"></script>  <script type="text/javascript" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/js/zftal/jquery.utils.contact-min.js?ver=20180117" charset="utf-8"></script>  <script type="text/javascript" src="/jwglxt/js/browse/browse-judge.js?ver=20180117"></script> <script type="text/javascript"> //\u6d4f\u89c8\u5668\u7248\u672c\u9a8c\u8bc1 var broswer = broswer(); if(broswer.msie==true||broswer.safari==true||broswer.mozilla==true||broswer.chrome==true){ if(broswer.msie==true&&broswer.version<9){ window.location.href = _path+"/xtgl/init_cxBrowser.html"; } }else{ window.location.href = _path+"/xtgl/init_cxBrowser.html"; } </script>  <link rel="stylesheet" type="text/css" href="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/bootstrap/css/bootstrap.min.css?ver=20180117" /> <link rel="stylesheet" type="text/css" href="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/css/zftal-ui.css?ver=20180117" /> <script type="text/javascript" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/bootstrap/js/bootstrap.min.js?ver=20180117" charset="utf-8"></script>  <link rel="stylesheet" type="text/css" href="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/chosen/css/chosen-min.css?ver=20180117" /> <script type="text/javascript" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/chosen/jquery.choosen.concat-min.js?ver=20180117" charset="utf-8"></script> <script type="text/javascript" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/chosen/lang/zh_CN-min.js?ver=20180117" charset="utf-8"></script> <script type="text/javascript" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/js/utils/jquery.utils.pinyin.min.js?ver=20180117" charset="utf-8"></script>  <script type="text/javascript" src="/jwglxt/js/jquery.zftal.contact-min.js?ver=20180117"></script>  <script type="text/javascript" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/js/zftal/lang/jquery.zftal_zh_CN-min.js?ver=20180117"></script>  <meta name="renderer" content="webkit" /> <meta http-equiv="X-UA-Compatible" content="IE=Edge,chrome=1" > <style type="text/css"> .btn-lang{ width: 76px; border-color: #357ebd; font-weight: bold; height: 30px; } .btn-lang-enabled { background-color: #428bca; color:#fff; } .btn-lang-disabled { background-color: #fff; color: #333; } .btn-lang-enabled:hover,.btn-lang-enabled:focus { color:#fff; } .btn-group>.btn-lang:last-child{ border-top-right-radius: 3px; border-bottom-right-radius: 3px; } </style> </head> <body style="background:#fafafa;"> <div class="container container_1170"> <div class="row sl_log_top"> <div class="col-sm-8 logo_1"><img src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/images/logo/logo_jw_d.png" style="margin-top:-3px" /> <span id="xtmc">教学综合信息服务平台</span> </div> <div class="col-sm-4 text-right hidden-xs"> </div> </div> <div class="row sl_log_bor4"> <div class="col-sm-8 hidden-xs sl_log_lf"> <img class="img-responsive" src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/images/login_bg_pic.jpg" /> </div> <div class="col-sm-4 sl_log_rt"> <form class="form-horizontal" role="form" action="/jwglxt/xtgl/login_slogin.html" method="post"> <input type="hidden" id="csrftoken" name="csrftoken" value="596a6b30-f50d-4435-b58b-71e4ab401be5,596a6b30f50d4435b58b71e4ab401be5"/> <h5>用户登录</h5>  <input type="text" style="display: none;" /> <input type="password" style="display: none;" />  <p style="display: none;" id="tips" class="bg_danger sl_danger"> </p> <div class="form-group"> <div class="input-group"> <div class="input-group-addon"><img src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/images/log_ic01.png" width="16" height="16" /></div> <input type="text" class="form-control" name="yhm" id="yhm" value="" placeholder="用户名" onblur="" autocomplete="off"> </div> </div> <div class="form-group"> <div class="input-group"> <div class="input-group-addon"><img src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/images/log_ic02.png" width="16" height="16" /></div> <input type="password" name="mm" id="hidMm" style="display:none"> <input type="password" class="form-control" name="mm" id="mm" value="" placeholder="密码" autocomplete="off"> </div> </div> <div class="form-group">   </div> <div class="form-group" id = "myDiv">  </div> <div class="form-group"> <button type="button" class="btn btn-primary btn-block" id="dl">登录</button> </div>  </form> <div class="sl_log_ewm hidden-xs"><img src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/images/login_ewm.gif" width="90" height="90" /> <span>用手机扫一扫,<br />安全、便捷登录</span></div> </div> </div> </div>  <div id="footerID" class="footer"> <p>版权所有© Copyright 1999-2017 正方软件股份有限公司　　中国·杭州西湖区紫霞街176号互联网创新创业园2号301</p> </div>  </body> <script type="text/javascript"> jQuery(document).ready(function() { //$('#localChange').trigger("chosen"); /// detectOS(); //用户名密码输错三次需输入验证码 }); //ip jQuery(function($){ function changeLanguage(lang) { $.ajaxSetup({async : false}); jQuery.post(_path + "/xtgl/init_changeLocal.html", {//config-shiro.xml里要加这个 language : lang != "en_US" ? "zh_CN" : "en_US" }, function(b) { if (1 == parseInt(b)) { if ($("#topButton").size() > 0) { $("#topButton").click(); } else { window.location.reload(); } } }, "json"); $.ajaxSetup({async : true}); } $("button.btn-lang").click(function() { if (!$(this).hasClass("btn-lang-enabled")) { changeLanguage($(this).attr("value")); } }) //切换英文 if($(".btn-lang-enabled").val()=="en_US"){ $("#xtmc").text(""); $("title").text("") $("#wpjssq").text("New Teacher Account Application"); $("#wjmm").text("Forgot your password?"); $("#jzfw").text("Parents visit"); $("#dlktsxx").hide(); } }); </script> <script type='text/javascript' src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/crypto/rsa/jsbn.js?ver=20180117"></script> <script type='text/javascript' src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/crypto/rsa/prng4.js?ver=20180117"></script> <script type='text/javascript' src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/crypto/rsa/rng.js?ver=20180117"></script> <script type='text/javascript' src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/crypto/rsa/rsa.js?ver=20180117"></script> <script type='text/javascript' src="http://202.119.206.62:80/zftal-ui-v5-1.0.2/assets/plugins/crypto/rsa/base64.js?ver=20180117"></script> <script type="text/javascript" src="/jwglxt/js/globalweb/comp/xtgl/login.js?ver=20180117"></script> </html> <Response [200]> >>> 这个是直接打印R出来的结果