搜索
搜索

如何使用Python Requests模块登录Web？

Wolf 发表于 Dev
83
狼 ：

我一直在阅读有关请求模块的信息，并尝试了几种不同的方法。

但是，在Web身份验证方面存在问题。

Testing site: http://testing-ground.scraping.pro/login
Username: admin
Password: 12345

这是示例代码

>>> import requests, re
>>> url = 'http://testing-ground.scraping.pro/login'
>>> username = 'admin'
>>> password = '12345'
>>> requests.get(url)
<Response [200]>

未经身份验证

>>> print(requests.get(url).text)
<!DOCTYPE html>
<!--[if lt IE 7]>      <html class="no-js lt-ie9 lt-ie8 lt-ie7"> <![endif]-->
<!--[if IE 7]>         <html class="no-js lt-ie9 lt-ie8"> <![endif]-->
<!--[if IE 8]>         <html class="no-js lt-ie9"> <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js"> <!--<![endif]-->
    <head>
        <meta charset="utf-8">
        <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
        <title>Web Scraper Testing Ground</title>
        <meta name="description" content="">
        <meta name="viewport" content="width=device-width">
        <link rel="stylesheet" href="/css/normalize.css">
        <link rel="stylesheet" href="/css/main.css">
        <script src="/js/vendor/modernizr-2.6.1.min.js"></script>
        <script src="/js/vendor/jquery-1.9.1.min.js"></script>
        <script src="/js/vendor/jquery-ui-1.10.2.min.js"></script>
        <script src="/js/plugins.js"></script>
        <script src="/js/main.js"></script>

        <link rel="stylesheet" href="/css/QapTcha.jquery.css" />
        <script src="/js/QapTcha.jquery.js"></script>
        
        <link rel="stylesheet" href="/fancy-captcha/captcha.css" />
        <script src="/fancy-captcha/jquery.captcha.js"></script>

    </head>
    <body>
        <script type="text/javascript">
        
          var _gaq = _gaq || [];
          _gaq.push(['_setAccount', 'UA-4436411-8']);
          _gaq.push(['_setDomainName', 'extract-web-data.com']);
          _gaq.push(['_trackPageview']);
        
          (function() {
            var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
            ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
            var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
          })();
        
        </script>
        <!--[if lt IE 7]>
            <p class="chromeframe">You are using an outdated browser. <a href="http://browsehappy.com/">Upgrade your browser today</a> or <a href="http://www.google.com/chromeframe/?redirect=true">install Google Chrome Frame</a> to better experience this site.</p>
        <![endif]-->
        <div id="topbar"></div>
        <a href="/" style="text-decoration: none">
            <div id="title">WEB SCRAPER TESTING GROUND</div>
            <div id="logo"></div>
        </a>
        <div id="content">
<h1>LOGIN</h1>
<div id="caseinfo">Often in order to reach the desired information you need to be logged in to the website. Most of today's websites use so-called form-based authentication which implies sending user credentials using POST method, authenticating it on the server and storing user's session in a cookie.</p>
<p>This simple test shows scraper's ability to:</p>
    <ol>
        <li>Send user credentials via POST method</li>
        <li>Receive, Keep and Return a session cookie</li>
        <li>Process HTTP redirect (302)</li>
    </ol>
<p>How to test:</p>
    <ol>
        <li>Enter <b>admin</b> and <b>12345</b> in the form below and press <b>Login</b></li>
        <li>If you see <span class="success">WELCOME :)</span> then the user credentials were sent, the cookie was passed and HTTP redirect was processed</li>
        <li>If you see <span class="error">ACCESS DENIED!</span> then either you entered wrong credentials or they were not sent to the server properly</li>
        <li>If you see <span class="error">THE SESSION COOKIE IS MISSING OR HAS A WRONG VALUE!</span> then the user credentials were properly sent but the session cookie was not properly stored or passed</li>
        <li>If you see <span class="success">REDIRECTING...</span> then the user credentials were properly sent but HTTP redirection was not processed</li>
        <li>Click <b>GO BACK</b> to start again</li>
    </ol>
</div>

<hr/>

<div id="case_login">
<h3>Please, login:</h3>
    <form action="login?mode=login" method="POST">
        <label for="usr">User name:</label>
        <input id="usr" name="usr" type="text" placeholder="enter 'admin' here">
        <label for="pwd">Password:</label>
        <input id="pwd" name="pwd" type="text" placeholder="enter '12345' here">
        <input type="submit" value="Login">
    </form>
</div>
<br/><br/><br/>
        </div>
    </body>
</html>
>>>

有认证

>>> print(requests.get(url, auth=(username, password)).text)
<!DOCTYPE html>
<!--[if lt IE 7]>      <html class="no-js lt-ie9 lt-ie8 lt-ie7"> <![endif]-->
<!--[if IE 7]>         <html class="no-js lt-ie9 lt-ie8"> <![endif]-->
<!--[if IE 8]>         <html class="no-js lt-ie9"> <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js"> <!--<![endif]-->
    <head>
        <meta charset="utf-8">
        <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
        <title>Web Scraper Testing Ground</title>
        <meta name="description" content="">
        <meta name="viewport" content="width=device-width">
        <link rel="stylesheet" href="/css/normalize.css">
        <link rel="stylesheet" href="/css/main.css">
        <script src="/js/vendor/modernizr-2.6.1.min.js"></script>
        <script src="/js/vendor/jquery-1.9.1.min.js"></script>
        <script src="/js/vendor/jquery-ui-1.10.2.min.js"></script>
        <script src="/js/plugins.js"></script>
        <script src="/js/main.js"></script>

        <link rel="stylesheet" href="/css/QapTcha.jquery.css" />
        <script src="/js/QapTcha.jquery.js"></script>
        
        <link rel="stylesheet" href="/fancy-captcha/captcha.css" />
        <script src="/fancy-captcha/jquery.captcha.js"></script>

    </head>
    <body>
        <script type="text/javascript">
        
          var _gaq = _gaq || [];
          _gaq.push(['_setAccount', 'UA-4436411-8']);
          _gaq.push(['_setDomainName', 'extract-web-data.com']);
          _gaq.push(['_trackPageview']);
        
          (function() {
            var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
            ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
            var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
          })();
        
        </script>
        <!--[if lt IE 7]>
            <p class="chromeframe">You are using an outdated browser. <a href="http://browsehappy.com/">Upgrade your browser today</a> or <a href="http://www.google.com/chromeframe/?redirect=true">install Google Chrome Frame</a> to better experience this site.</p>
        <![endif]-->
        <div id="topbar"></div>
        <a href="/" style="text-decoration: none">
            <div id="title">WEB SCRAPER TESTING GROUND</div>
            <div id="logo"></div>
        </a>
        <div id="content">
<h1>LOGIN</h1>
<div id="caseinfo">Often in order to reach the desired information you need to be logged in to the website. Most of today's websites use so-called form-based authentication which implies sending user credentials using POST method, authenticating it on the server and storing user's session in a cookie.</p>
<p>This simple test shows scraper's ability to:</p>
    <ol>
        <li>Send user credentials via POST method</li>
        <li>Receive, Keep and Return a session cookie</li>
        <li>Process HTTP redirect (302)</li>
    </ol>
<p>How to test:</p>
    <ol>
        <li>Enter <b>admin</b> and <b>12345</b> in the form below and press <b>Login</b></li>
        <li>If you see <span class="success">WELCOME :)</span> then the user credentials were sent, the cookie was passed and HTTP redirect was processed</li>
        <li>If you see <span class="error">ACCESS DENIED!</span> then either you entered wrong credentials or they were not sent to the server properly</li>
        <li>If you see <span class="error">THE SESSION COOKIE IS MISSING OR HAS A WRONG VALUE!</span> then the user credentials were properly sent but the session cookie was not properly stored or passed</li>
        <li>If you see <span class="success">REDIRECTING...</span> then the user credentials were properly sent but HTTP redirection was not processed</li>
        <li>Click <b>GO BACK</b> to start again</li>
    </ol>
</div>

<hr/>

<div id="case_login">
<h3>Please, login:</h3>
    <form action="login?mode=login" method="POST">
        <label for="usr">User name:</label>
        <input id="usr" name="usr" type="text" placeholder="enter 'admin' here">
        <label for="pwd">Password:</label>
        <input id="pwd" name="pwd" type="text" placeholder="enter '12345' here">
        <input type="submit" value="Login">
    </form>
</div>
<br/><br/><br/>
        </div>
    </body>
</html>
>>>

由于输出中有Web登录表单，因此我认为身份验证未按预期进行。

<h3>Please, login:</h3>
    <form action="login?mode=login" method="POST">
        <label for="usr">User name:</label>
        <input id="usr" name="usr" type="text" placeholder="enter 'admin' here">
        <label for="pwd">Password:</label>
        <input id="pwd" name="pwd" type="text" placeholder="enter '12345' here">
        <input type="submit" value="Login">
    </form>

在这种情况下有什么问题，我应该怎么做才能解决？

排水：

您应该在登录页面指向的位置发帖：


>>> import requests, re
>>> url = 'http://testing-ground.scraping.pro/login?mode=login'
>>> username = 'admin'
>>> password = '12345'
>>> requests.post(url, data={'usr':username, 'pwd':password})

本文收集自互联网，转载请注明来源。

如有侵权，请联系 [email protected] 删除。

编辑于
0

我来说两句

0 条评论
登录 后参与评论

相关文章

Neopets使用Python Requests模块登录

Facebook登录-Python 3 Requests模块

如何使用Python的“请求”模块“登录”网站？

如何使用Python的“请求”模块“登录”网站？

如何使用 Python requests 模块下载视频？

尝试使用 requests().post() 登录网页时，“模块”对象不可调用

如何知道何时使用Python的“请求”模块“登录”网站？

如何使用Requests Python模块进行curl调用

如何使用“ requests”模块python进行简单的快速请求？

使用python-Requests / urllib3 /或selenium模块获取多个Web URL的状态代码

Python登录多个模块

使用登录多个模块

Python - 如何使用隐藏值登录到 Web 表单？

使用 Python 请求模块登录 Robinhood

使用Python的“请求”模块登录ASP网站

使用Requests模块Python构建URL

如何使用Python登录网站？

如何使用 Python 登录网站

如何使用本地python模块>

如何使用远程python模块

使用 JAAS 登录模块注销

如何使用Requests模块在Python 3中发布此API代码？持续收到405错误

使用python登录网站和Web Scapping

我无法使用 post requests python 登录网站

如何为“ python3”安装“ requests”模块？

如何在模块中使用变量（登录系统）

无法在Flask的子模块中使用Python登录

在aspx网页上使用python请求模块登录

无法使用Python的请求模块登录ASP.NET网站

TOP 榜单

  1. 1

    隐藏发件人没有短信PHP

  2. 2

    Hashchange事件侦听器在将事件处理程序附加到事件之前进行侦听

  3. 3

    在浏览器中请求URL时会发生什么？

  4. 4

    flask-admin 如何自定义删除按钮

  5. 5

    材质UI垂直滑块。如何改变在垂直材料UI滑块导轨的厚度（反应）

  6. 6

    用日期数据透视表和日期顺序查询

  7. 7

    Jqgrid：多级别组摘要

  8. 8

    java io ioexception无法解析服务器地址解析器的响应

  9. 9

    Swift如何使用Base64Url编码JWT标头和有效负载之类的json对象

  10. 10

    sshd AllowGroups组未授予访问权限

  11. 11

    jQuery无限滚动固定div中的滚动

  12. 12

    android 背部按下

  13. 13

    Flexbox CSS 对齐属性环境惰性？

  14. 14

    为什么随机森林中的平均降低基尼系数取决于人口规模？

  15. 15

    ClickHouse 创建临时表

  16. 16

    为什么PlusShare.Builder setRecipients方法不起作用？

  17. 17

    如何在Android中识别MICR代码

  18. 18

    PyQt4.QtCore模块无法向sip模块注册

  19. 19

    正则表达式，用于查找所有以任何字母开头和数字开头的文件

  20. 20

    是否可以通过编程方式对很多动画进行重新着色？

  21. 21

    机器密钥生成

热门标签

归档