c#爬取天猫商品信息

putianchengp 2013-07-16 02:19:48
比如要爬取天猫的价格,销量等,因为这些商品信息天猫好像是用跳转页面来处理并显示的,所以现在不知道后台怎么写代码来实现他们,亲们,进来帮帮忙呀,或者提供下研究方向,在此先谢谢啦
...全文
1264 20 打赏 收藏 转发到动态 举报
写回复
用AI写文章
20 条回复
切换为时间正序
请发表友善的回复…
发表回复
laurelen 2015-12-01
  • 打赏
  • 举报
回复
请问楼主后来怎么爬到了吗
cocia 2013-09-17
  • 打赏
  • 举报
回复
引用 17 楼 putianchengp 的回复:
[quote=引用 16 楼 wonderfuly 的回复:] 以前研究过的,通过请求下列地址获取相关信息。 不知道现在有没有变化。 http://rate.tmall.com/list_dsr_info.htm?itemId=15323196614&spuId=208776636&callback=jsonp 返回 jsonp({"dsr":{"gradeAvg":4.7,"itemId":15323196614,"peopleNum":7087,"periodSoldQuantity":0,"rateTotal":0,"sellerId":0,"spuId":208776636,"totalSoldQuantity":0}}) //gradeAvg--信用 rateTotal--评论 http://count.tbcdn.cn/counter3?keys=ICCP_1_15323196614&callback=json json({"ICCP_1_15323196614":12151});//收藏次数
谢谢答复,不过改版了,有所变化,他们js里的跳转页面竟然都无法访问,如下就是天猫的产品信息页面js, <script> TShop.poc('buyshow'); (function () { TShop.Setup({ rstShopId:101815493, valLoginIndicator: "http:\/\/buy.taobao.com\/auction\/buy.htm?from=itemDetail&x_id=&item_id=23994228417&id=23994228417", renderSystemServer:'http://render.taobao.com', valMode:128, "valCartInfo":{"itemId" : "23994228417","dbNum" : "","cartUrl": "http:\/\/cart.taobao.com\/my_cart.htm?from=bdetail","statsUrl":"http://www.atpanel.com/1.gif?category=cart_{loc}_50012346"}, "apiBidCount": "http:\/\/tbskip.taobao.com\/json\/show_bid_count.htm?itemNumId=23994228417&old_quantity=628&date=1374221900000", "apiAddCart" : "http:\/\/cart.taobao.com\/add_cart_item.htm?item_id=23994228417", "valPointRate" : "0.5", "valPointTimes" : "1", "apiTmallComboInfo": "http://ext.mdskip.taobao.com/extension/queryTmallCombo.do?itemId=23994228417&comboGroup=0", "apiTmallComboItem": "http://ext.mdskip.taobao.com/extension/queryComboItem.do?comboGroup=0", "apiItemViews": "http:\/\/count.taobao.com\/counter2?keys=ICVT_7_23994228417&inc=ICVT_7_23994228417&sign=73917104d0890fb7bdf7d2c874e683ffcb516", "apiBeans":"http:\/\/count.tbcdn.cn\/counter3?keys=SM_368_dsr-1119887712,ICCP_1_23994228417", "valTimeLeft": "277652", "valItemInfo":{ "defSelected": [], "skuMap":{ ";20549:28926;1627207:28329;":{"skuId" : "31942535321","price" : "359.00","priceCent" : "35900","stock" :"12"},";20549:28931;1627207:28329;":{"skuId" : "31942535324","price" : "359.00","priceCent" : "35900","stock" :"15"},";20549:28934;1627207:28329;":{"skuId" : "31942535327","price" : "359.00","priceCent" : "35900","stock" :"28"},";20549:28935;1627207:28329;":{"skuId" : "31942535328","price" : "359.00","priceCent" : "35900","stock" :"26"},";20549:28937;1627207:28329;":{"skuId" : "31942535330","price" : "359.00","priceCent" : "35900","stock" :"30"},";20549:28939;1627207:28329;":{"skuId" : "31942535332","price" : "359.00","priceCent" : "35900","stock" :"24"},";20549:28926;1627207:28338;":{"skuId" : "41364812555","price" : "359.00","priceCent" : "35900","stock" :"20"},";20549:28931;1627207:28338;":{"skuId" : "41364812558","price" : "359.00","priceCent" : "35900","stock" :"2"},";20549:28934;1627207:28338;":{"skuId" : "41364812561","price" : "359.00","priceCent" : "35900","stock" :"15"},";20549:28935;1627207:28338;":{"skuId" : "41364812562","price" : "359.00","priceCent" : "35900","stock" :"17"},";20549:28939;1627207:28338;":{"skuId" : "41364812566","price" : "359.00","priceCent" : "35900","stock" :"15"} } }, "cmCatId" : "0", "orderId" : "", "mainOrderId" : "", "isSevenDaysRefundment" : true, "isAreaSell": false, "isService": false, "isHouseholdService": false, "isTmallComboSupport":true, "tmallRateType" : 2, "isWTContract": false, "isMeiz":false, "trialItemId": 0 , "trialErrNum": 0 , "releaseTime":"1374233818000", "renderTime":"1374503837318", "midyearPromAuciton":true, "hitPrizeAuction":false, "warmUpTime":"1371052800000", "promBeginTime":"1371398400000", "promEndTime":"1371484799000", "inMidyearWarmUp":false, "inMidyearPromotion":false, "apiMember":'http://tmm.taobao.com/member/query_member_for_detail.do', "vipBirthJumpLink":'http://vip.tmall.com/vip/privilege.htm?priv=birthdaygift&spm=2001.1.4.3', 接下来这一串地址应该是用来获取产品一些价格,销量的信息,可是我调用并用post去取返回值,提示无法访问,亲,能再指点一下吗 "initApi" : "http://mdskip.taobao.com/core/initItemDetail.htm?trialErrNum=0&isIFC=false&sellerUserTag4=576460756600505731¬AllowOriginPrice=false&sellerUserTag2=18015686999672834&sellerUserTag3=144185556822163584&isAreaSell=false&isForbidBuyItem=false&isMeizTry=false&tmallBuySupport=true&itemTags=907,1163,1478,1483,1803,2049,3974,4166,5954,6401,6849,14082,14210&queryMaybach=true&household=false&sellerUserTag=34672672&tgTag=false&itemId=23994228417&isUseInventoryCenter=false&isSecKill=false&isApparel=false&showTagPrice=true&hitPrizeAuction=false&showShopProm=true&service3C=false&cartEnable=true", "changeLocationApi":"http://mdskip.taobao.com/core/changeLocation.htm?itemTags=907,1163,1478,1483,1803,2049,3974,4166,5954,6401,6849,14082,14210&queryMaybach=true&sellerUserTag=34672672&household=false&tgTag=false&itemId=23994228417&isUseInventoryCenter=false&isSecKill=false&sellerUserTag4=576460756600505731¬AllowOriginPrice=false&sellerUserTag2=18015686999672834&sellerUserTag3=144185556822163584&showTagPrice=true&isAreaSell=false&hitPrizeAuction=false&showShopProm=true&service3C=false&cartEnable=true", "initExtensionApi": "http://ext.mdskip.taobao.com/extension/initExtension.htm?showBreadCrumb=false&sellerId=1119887712&brand=New+Balance%2F%D0%C2%B0%D9%C2%D7&showShopProm=true&showSpuMaintainer=false" , "initExtraApi":"http://ext.mdskip.taobao.com/extension/initExtra.htm", "api":{ "fetchDcUrl" : "http://tdecorate.tbcdn.cn/dc/fetchDc.htm?pid=649471870&sellerId=1119887712&t=1374233818000" }, "itemDO" : { 'categoryId':'50012346', 'itemId':'23994228417', 'isBidden':false, 'isInRepository':false, 'auctionType':'b', 'auctionStatus':'0', 'canView':true, 'sellerFreeze':false, 'quantity':204, 'isOnline':true, 'isSecondKillFromPC':false, 'isSecondKillFromPCAndWap':false, 'userId':'1119887712', "sellerNickName" : 'newbalance%E7%AB%A5%E9%9E%8B%E6%97%97%E8%88%B0%E5%BA%97', 'isEcardAuction':false, 'brand' : 'New Balance\/\u65B0\u767E\u4F26' , 'brandId' : '20584', 'brandSiteId':'0', 'isDcAsyn' : true, 'reservePrice' : '359.00', 'spuId':'217058536', 'feature': '5', 'validatorUrl': 'http://store.taobao.com/tadget/shop_stats.htm', 'templateName': '', 'templateId': '', 'tagPicUrl': '' }, "detail":{ 'canEditInItemDet':true, 'autoccUser':false, 'isShowPreClosed':false, 'goNewAuctionFlow':false, 'isAllowReport':true, 'isTeMai':false, 'isIFCShop':false, 'isItemAllowSellerView':true, 'isAuthSeller':true, 'timeKillAuction':false, 'quantityList':[], 'defaultItemPrice':'359.00', 'rateEnable' : true, 'loginBeforeCart':false, 'cdn75': false, 'rateCloudDisable' : false, 'isDownShelf' : false, 'isHasPos' : false, 'isSkuMemorized' : false, 'dsrFromCounterEnable' : false , "isHkItem" :false }, "idsMod": [], "descAnchors" : [], "tag":{ "isAsynDesc":true, 'isMedical':false, 'isRightRecommend':true, 'isBrandSiteRightColumn':true, 'isBrandAttr':true }, "url":{ 'topUploadServerBaseUrl':'http://upload.taobao.com', 'BIDRedirectionitemDomain':'http://paimai.taobao.com', 'tradeBaseUrl':'http://trade.taobao.com/trade', 'tgDomain':'http://ju.taobao.com', 'mallList':'http://list.tmall.com', 'buyBase':'http://buy.taobao.com/auction', "tbskip":"http://tbskip.taobao.com", "rate":"http://rate.tmall.com", "mdskip":"http://mdskip.taobao.com", "extMdskip":"http://ext.mdskip.taobao.com" }, "tradeType": 2 , "cartEnable":true, "tradeConfig":{ 1 : "http://buy.taobao.com/auction/buy_now.jhtml", 2 : "http://buy.tmall.com/order/confirm_order.htm", 3 : "http://obuy.tmall.com/home/order/confirm_order.htm", 4 : "" }, "noSkipMode":{ timeout : 15000, tradeResult:{ cartEnable: true , cartType:2, tradeEnable: true , tradeType: 2 , tradeDisableTypeEnum:"" } } }); })();</script> 我的post是这么写的 function StartPort() { $.post("http://mdskip.taobao.com/core/initItemDetail.htm?trialErrNum=0&isIFC=false&sellerUserTag4=576460756600505731¬AllowOriginPrice=false&sellerUserTag2=18015686999672834&sellerUserTag3=144185556822163584&isAreaSell=false&isForbidBuyItem=false&isMeizTry=false&tmallBuySupport=true&itemTags=907,1163,1478,1483,1803,2049,3974,4166,5954,6401,6849,14082,14210&queryMaybach=true&household=false&sellerUserTag=34672672&tgTag=false&itemId=23994228417&isUseInventoryCenter=false&isSecKill=false&isApparel=false&showTagPrice=true&hitPrizeAuction=false&showShopProm=true&service3C=false&cartEnable=true&callback=onMdskip&ip=&campaignId=&key=&abt=&cat_id=&q=&u_channel=&ref=http%253A%252F%252Fnewbalancekids.tmall.com%252Fview_page-650495897.htm%253Fscm%253D1003.3.12002.0_AB-LR60-PR60%2526acm%253D12002.1003.1.63.20584_6&brandSiteId=0", function (data) { alert(data.toString()); }); }运行的时候提示拒绝访问[/quote] 拒绝访问的原因是需要在http header中增加Referer参数。
游戏人间 2013-07-23
  • 打赏
  • 举报
回复
以前研究过的,通过请求下列地址获取相关信息。 不知道现在有没有变化。 http://rate.tmall.com/list_dsr_info.htm?itemId=15323196614&spuId=208776636&callback=jsonp 返回 jsonp({"dsr":{"gradeAvg":4.7,"itemId":15323196614,"peopleNum":7087,"periodSoldQuantity":0,"rateTotal":0,"sellerId":0,"spuId":208776636,"totalSoldQuantity":0}}) //gradeAvg--信用 rateTotal--评论 http://count.tbcdn.cn/counter3?keys=ICCP_1_15323196614&callback=json json({"ICCP_1_15323196614":12151});//收藏次数
xxxcloud 2013-07-23
  • 打赏
  • 举报
回复
我也遇见了,支持一下
putianchengp 2013-07-23
  • 打赏
  • 举报
回复
引用 13 楼 erental 的回复:
我也遇见了,支持一下
怎么没人给出解答呢,天猫实在是太频繁改版了
mirtanq 2013-07-23
  • 打赏
  • 举报
回复
路过,支持一下。
putianchengp 2013-07-23
  • 打赏
  • 举报
回复
引用 16 楼 wonderfuly 的回复:
以前研究过的,通过请求下列地址获取相关信息。 不知道现在有没有变化。 http://rate.tmall.com/list_dsr_info.htm?itemId=15323196614&spuId=208776636&callback=jsonp 返回 jsonp({"dsr":{"gradeAvg":4.7,"itemId":15323196614,"peopleNum":7087,"periodSoldQuantity":0,"rateTotal":0,"sellerId":0,"spuId":208776636,"totalSoldQuantity":0}}) //gradeAvg--信用 rateTotal--评论 http://count.tbcdn.cn/counter3?keys=ICCP_1_15323196614&callback=json json({"ICCP_1_15323196614":12151});//收藏次数
谢谢答复,不过改版了,有所变化,他们js里的跳转页面竟然都无法访问,如下就是天猫的产品信息页面js, <script> TShop.poc('buyshow'); (function () { TShop.Setup({ rstShopId:101815493, valLoginIndicator: "http:\/\/buy.taobao.com\/auction\/buy.htm?from=itemDetail&x_id=&item_id=23994228417&id=23994228417", renderSystemServer:'http://render.taobao.com', valMode:128, "valCartInfo":{"itemId" : "23994228417","dbNum" : "","cartUrl": "http:\/\/cart.taobao.com\/my_cart.htm?from=bdetail","statsUrl":"http://www.atpanel.com/1.gif?category=cart_{loc}_50012346"}, "apiBidCount": "http:\/\/tbskip.taobao.com\/json\/show_bid_count.htm?itemNumId=23994228417&old_quantity=628&date=1374221900000", "apiAddCart" : "http:\/\/cart.taobao.com\/add_cart_item.htm?item_id=23994228417", "valPointRate" : "0.5", "valPointTimes" : "1", "apiTmallComboInfo": "http://ext.mdskip.taobao.com/extension/queryTmallCombo.do?itemId=23994228417&comboGroup=0", "apiTmallComboItem": "http://ext.mdskip.taobao.com/extension/queryComboItem.do?comboGroup=0", "apiItemViews": "http:\/\/count.taobao.com\/counter2?keys=ICVT_7_23994228417&inc=ICVT_7_23994228417&sign=73917104d0890fb7bdf7d2c874e683ffcb516", "apiBeans":"http:\/\/count.tbcdn.cn\/counter3?keys=SM_368_dsr-1119887712,ICCP_1_23994228417", "valTimeLeft": "277652", "valItemInfo":{ "defSelected": [], "skuMap":{ ";20549:28926;1627207:28329;":{"skuId" : "31942535321","price" : "359.00","priceCent" : "35900","stock" :"12"},";20549:28931;1627207:28329;":{"skuId" : "31942535324","price" : "359.00","priceCent" : "35900","stock" :"15"},";20549:28934;1627207:28329;":{"skuId" : "31942535327","price" : "359.00","priceCent" : "35900","stock" :"28"},";20549:28935;1627207:28329;":{"skuId" : "31942535328","price" : "359.00","priceCent" : "35900","stock" :"26"},";20549:28937;1627207:28329;":{"skuId" : "31942535330","price" : "359.00","priceCent" : "35900","stock" :"30"},";20549:28939;1627207:28329;":{"skuId" : "31942535332","price" : "359.00","priceCent" : "35900","stock" :"24"},";20549:28926;1627207:28338;":{"skuId" : "41364812555","price" : "359.00","priceCent" : "35900","stock" :"20"},";20549:28931;1627207:28338;":{"skuId" : "41364812558","price" : "359.00","priceCent" : "35900","stock" :"2"},";20549:28934;1627207:28338;":{"skuId" : "41364812561","price" : "359.00","priceCent" : "35900","stock" :"15"},";20549:28935;1627207:28338;":{"skuId" : "41364812562","price" : "359.00","priceCent" : "35900","stock" :"17"},";20549:28939;1627207:28338;":{"skuId" : "41364812566","price" : "359.00","priceCent" : "35900","stock" :"15"} } }, "cmCatId" : "0", "orderId" : "", "mainOrderId" : "", "isSevenDaysRefundment" : true, "isAreaSell": false, "isService": false, "isHouseholdService": false, "isTmallComboSupport":true, "tmallRateType" : 2, "isWTContract": false, "isMeiz":false, "trialItemId": 0 , "trialErrNum": 0 , "releaseTime":"1374233818000", "renderTime":"1374503837318", "midyearPromAuciton":true, "hitPrizeAuction":false, "warmUpTime":"1371052800000", "promBeginTime":"1371398400000", "promEndTime":"1371484799000", "inMidyearWarmUp":false, "inMidyearPromotion":false, "apiMember":'http://tmm.taobao.com/member/query_member_for_detail.do', "vipBirthJumpLink":'http://vip.tmall.com/vip/privilege.htm?priv=birthdaygift&spm=2001.1.4.3', 接下来这一串地址应该是用来获取产品一些价格,销量的信息,可是我调用并用post去取返回值,提示无法访问,亲,能再指点一下吗 "initApi" : "http://mdskip.taobao.com/core/initItemDetail.htm?trialErrNum=0&isIFC=false&sellerUserTag4=576460756600505731¬AllowOriginPrice=false&sellerUserTag2=18015686999672834&sellerUserTag3=144185556822163584&isAreaSell=false&isForbidBuyItem=false&isMeizTry=false&tmallBuySupport=true&itemTags=907,1163,1478,1483,1803,2049,3974,4166,5954,6401,6849,14082,14210&queryMaybach=true&household=false&sellerUserTag=34672672&tgTag=false&itemId=23994228417&isUseInventoryCenter=false&isSecKill=false&isApparel=false&showTagPrice=true&hitPrizeAuction=false&showShopProm=true&service3C=false&cartEnable=true", "changeLocationApi":"http://mdskip.taobao.com/core/changeLocation.htm?itemTags=907,1163,1478,1483,1803,2049,3974,4166,5954,6401,6849,14082,14210&queryMaybach=true&sellerUserTag=34672672&household=false&tgTag=false&itemId=23994228417&isUseInventoryCenter=false&isSecKill=false&sellerUserTag4=576460756600505731¬AllowOriginPrice=false&sellerUserTag2=18015686999672834&sellerUserTag3=144185556822163584&showTagPrice=true&isAreaSell=false&hitPrizeAuction=false&showShopProm=true&service3C=false&cartEnable=true", "initExtensionApi": "http://ext.mdskip.taobao.com/extension/initExtension.htm?showBreadCrumb=false&sellerId=1119887712&brand=New+Balance%2F%D0%C2%B0%D9%C2%D7&showShopProm=true&showSpuMaintainer=false" , "initExtraApi":"http://ext.mdskip.taobao.com/extension/initExtra.htm", "api":{ "fetchDcUrl" : "http://tdecorate.tbcdn.cn/dc/fetchDc.htm?pid=649471870&sellerId=1119887712&t=1374233818000" }, "itemDO" : { 'categoryId':'50012346', 'itemId':'23994228417', 'isBidden':false, 'isInRepository':false, 'auctionType':'b', 'auctionStatus':'0', 'canView':true, 'sellerFreeze':false, 'quantity':204, 'isOnline':true, 'isSecondKillFromPC':false, 'isSecondKillFromPCAndWap':false, 'userId':'1119887712', "sellerNickName" : 'newbalance%E7%AB%A5%E9%9E%8B%E6%97%97%E8%88%B0%E5%BA%97', 'isEcardAuction':false, 'brand' : 'New Balance\/\u65B0\u767E\u4F26' , 'brandId' : '20584', 'brandSiteId':'0', 'isDcAsyn' : true, 'reservePrice' : '359.00', 'spuId':'217058536', 'feature': '5', 'validatorUrl': 'http://store.taobao.com/tadget/shop_stats.htm', 'templateName': '', 'templateId': '', 'tagPicUrl': '' }, "detail":{ 'canEditInItemDet':true, 'autoccUser':false, 'isShowPreClosed':false, 'goNewAuctionFlow':false, 'isAllowReport':true, 'isTeMai':false, 'isIFCShop':false, 'isItemAllowSellerView':true, 'isAuthSeller':true, 'timeKillAuction':false, 'quantityList':[], 'defaultItemPrice':'359.00', 'rateEnable' : true, 'loginBeforeCart':false, 'cdn75': false, 'rateCloudDisable' : false, 'isDownShelf' : false, 'isHasPos' : false, 'isSkuMemorized' : false, 'dsrFromCounterEnable' : false , "isHkItem" :false }, "idsMod": [], "descAnchors" : [], "tag":{ "isAsynDesc":true, 'isMedical':false, 'isRightRecommend':true, 'isBrandSiteRightColumn':true, 'isBrandAttr':true }, "url":{ 'topUploadServerBaseUrl':'http://upload.taobao.com', 'BIDRedirectionitemDomain':'http://paimai.taobao.com', 'tradeBaseUrl':'http://trade.taobao.com/trade', 'tgDomain':'http://ju.taobao.com', 'mallList':'http://list.tmall.com', 'buyBase':'http://buy.taobao.com/auction', "tbskip":"http://tbskip.taobao.com", "rate":"http://rate.tmall.com", "mdskip":"http://mdskip.taobao.com", "extMdskip":"http://ext.mdskip.taobao.com" }, "tradeType": 2 , "cartEnable":true, "tradeConfig":{ 1 : "http://buy.taobao.com/auction/buy_now.jhtml", 2 : "http://buy.tmall.com/order/confirm_order.htm", 3 : "http://obuy.tmall.com/home/order/confirm_order.htm", 4 : "" }, "noSkipMode":{ timeout : 15000, tradeResult:{ cartEnable: true , cartType:2, tradeEnable: true , tradeType: 2 , tradeDisableTypeEnum:"" } } }); })();</script> 我的post是这么写的 function StartPort() { $.post("http://mdskip.taobao.com/core/initItemDetail.htm?trialErrNum=0&isIFC=false&sellerUserTag4=576460756600505731¬AllowOriginPrice=false&sellerUserTag2=18015686999672834&sellerUserTag3=144185556822163584&isAreaSell=false&isForbidBuyItem=false&isMeizTry=false&tmallBuySupport=true&itemTags=907,1163,1478,1483,1803,2049,3974,4166,5954,6401,6849,14082,14210&queryMaybach=true&household=false&sellerUserTag=34672672&tgTag=false&itemId=23994228417&isUseInventoryCenter=false&isSecKill=false&isApparel=false&showTagPrice=true&hitPrizeAuction=false&showShopProm=true&service3C=false&cartEnable=true&callback=onMdskip&ip=&campaignId=&key=&abt=&cat_id=&q=&u_channel=&ref=http%253A%252F%252Fnewbalancekids.tmall.com%252Fview_page-650495897.htm%253Fscm%253D1003.3.12002.0_AB-LR60-PR60%2526acm%253D12002.1003.1.63.20584_6&brandSiteId=0", function (data) { alert(data.toString()); }); }运行的时候提示拒绝访问
erental 2013-07-19
  • 打赏
  • 举报
回复
我也遇见了,支持一下
梦无残 2013-07-18
  • 打赏
  • 举报
回复
我也遇见了,支持一下
  • 打赏
  • 举报
回复
又见火车头 不懂路过学习
SoYoung_ 2013-07-18
  • 打赏
  • 举报
回复
必须 熟悉 正则 表达式 ,建议你不用自己写程序 太费劲了,可以 用现成的额 ----火车头采集器,挺简单的 。
putianchengp 2013-07-18
  • 打赏
  • 举报
回复
天猫好像代码改版了,不显示在源文件了,按f12的时候倒是可以看见
putianchengp 2013-07-18
  • 打赏
  • 举报
回复
引用 7 楼 xiaozhi_5638 的回复:
比如 这个网址的鞋子 http://detail.tmall.com/item.htm?spm=a220m.1000858.1000725.1.G8kMu4&id=15509909689&user_id=920494886&is_b=1&cat_id=50026637&q=&rn=2502f079c5cf5a531375237e8283f25b 返回来的页面html 中 价格部分标签为: <strong class="J_CurPrice">277.99</strong> 你只需要获取返回来的html 然后解析里面的<strong></strong>标签中的文本
按你说的,我去查看源文件,代码是这样的啊<strong id="J_StrPrice" class="J_CurPrice"></strong>中间的值是没有在源文件显示呢,这个该怎么办
请叫我卷福 2013-07-16
  • 打赏
  • 举报
回复
比如 这个网址的鞋子 http://detail.tmall.com/item.htm?spm=a220m.1000858.1000725.1.G8kMu4&id=15509909689&user_id=920494886&is_b=1&cat_id=50026637&q=&rn=2502f079c5cf5a531375237e8283f25b 返回来的页面html 中 价格部分标签为: <strong class="J_CurPrice">277.99</strong> 你只需要获取返回来的html 然后解析里面的<strong></strong>标签中的文本
putianchengp 2013-07-16
  • 打赏
  • 举报
回复
引用 3 楼 xiaozhi_5638 的回复:
先用webbrowser控件简单试一下 能获取返回页面的html代码 然后过滤 之后再使用webrequest等
能否详细解释下呢,我查看了商品信息的源文件,里面的跳转页面获取商品信息的地址我调用了,可是提示拒绝访问,调试的时候e.username是null,e.password也是null,不知道这两个要怎么赋值
心悠茶亦香 2013-07-16
  • 打赏
  • 举报
回复
楼上说了,就是抓取这个网页,然后正则表达式提取你需要的内容。
putianchengp 2013-07-16
  • 打赏
  • 举报
回复
引用 2 楼 dahaianb 的回复:
lz也想写爬虫程序?
就是获取些信息,不是纯爬虫程序
请叫我卷福 2013-07-16
  • 打赏
  • 举报
回复
先用webbrowser控件简单试一下 能获取返回页面的html代码 然后过滤 之后再使用webrequest等
海洋夜之星 2013-07-16
  • 打赏
  • 举报
回复
lz也想写爬虫程序?
putianchengp 2013-07-16
  • 打赏
  • 举报
回复
先自己顶一下,亲,在线等哈

110,534

社区成员

发帖
与我相关
我的任务
社区描述
.NET技术 C#
社区管理员
  • C#
  • Web++
  • by_封爱
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告

让您成为最强悍的C#开发者

试试用AI创作助手写篇文章吧