java爬虫使用cookie模拟登录的问题

SanHydra 2017-05-04 05:41:03

我用的是htmlunit框架，废话不多说，直接上码，首先是我获取登录状态cookie的代码



public Set<Cookie> login() throws IOException {

        WebClient wc=new WebClient();

        URL url = new URL("https://www.numberingplans.com/?page=account&sub=login");

        WebRequest request=new WebRequest(url);

        request.setCharset("UTF-8");

        request.setAdditionalHeader("User-Agent",user_agents.get(12));

        wc.getCookieManager().setCookiesEnabled(true);//开启cookie管理

        wc.getOptions().setThrowExceptionOnFailingStatusCode(false);

        wc.getOptions().setThrowExceptionOnScriptError(false);

        wc.getOptions().setCssEnabled(false);

        wc.getOptions().setUseInsecureSSL(true);

        wc.getOptions().setJavaScriptEnabled(true);

        wc.getOptions().setTimeout(600000);

        HtmlPage page=wc.getPage(url);

        HtmlForm htmlForm = page.getForms().get(0);

        HtmlInput password = htmlForm.getInputByName("password");

        HtmlInput username = htmlForm.getInputByName("username");

        HtmlInput login = htmlForm.getInputByValue("Login");

        password.setValueAttribute(accounts[index]);

        username.setValueAttribute(passwords[index]);

       //点击登录按钮

        login.click();

        System.out.println("login！");

        //获取cookie

        Set<Cookie> cookies = wc.getCookieManager().getCookies();

        wc.close();

        return cookies;

    }

这里的获取cookie，是获取成功了的，我用谷歌浏览器登录后查看对比得知。接下来就是，使用cookie的页面：



public IMEI queryIMEI(String imei) throws IOException {

        WebClient wc=new WebClient();

        WebRequest request=new WebRequest(new URL("https://www.numberingplans.com/?page=analysis&sub=imeinr"));

        request.setCharset("UTF-8");

        request.setAdditionalHeader("User-Agent",user_agents.get(12));

        wc.getCookieManager().setCookiesEnabled(true);//开启cookie管理

        wc.getOptions().setThrowExceptionOnScriptError(false);

        wc.getOptions().setThrowExceptionOnFailingStatusCode(false);

        wc.getOptions().setCssEnabled(false);

        wc.getOptions().setUseInsecureSSL(true);

        wc.getOptions().setJavaScriptEnabled(false);

        wc.getOptions().setTimeout(60000);

       //设置cookies

        for (Cookie cookie : cookies) {

            wc.getCookieManager().addCookie(cookie);

        }

        HtmlPage page = wc.getPage("https://www.numberingplans.com/?page=analysis&sub=imeinr");

        HtmlForm form = page.getFormByName("inputform");

        HtmlInput i = form.getInputByName("i");

        HtmlInput analyse = form.getInputByValue("analyse");

        i.setValueAttribute(imei);

        HtmlPage page2= analyse.click();

        wc.close();

        return parse(page2.asXml(),imei);

    }