从不同结构和薪水符号的HTML作业规范中提取薪水

我希望以一种通用的方式从工作规范中获取薪资信息（考虑到可以指定薪资的多种方式（在有“ Salary”字样的情况下，有无“ 0”）等等。）

采取了三种不同的工作规范，我使用抓取了HTML urllib2，然后对grep“每种工资”一词执行了不区分大小写的初始操作。结果差异很大（请注意Jupyter的贴子不够漂亮）：

In [52]:

urllib2
Out[52]:
<module 'urllib2' from '/Users/Evan/anaconda/lib/python2.7/urllib2.pyc'>
In [82]:

情况1

reponse = urllib2_urlopen('http://apply.ovoenergycareers.co.uk/vacancies/453/cro-manager/london/')
In [83]:

content = reponse.read()
In [84]:

save_html('salarygrep1', content)
In [59]:

!grep -i salary salarygrep1.html
!grep -i salary salarygrep1.html
  <dt class="field_salary">Salary</dt>
  <dd class="value_salary">
In [86]:

with open('salarygrep1.html') as s:
    for line in s:
        if 'salary' in line.lower():
            print line
  <dt class="field_salary">Salary</dt>

  <dd class="value_salary">

In [79]:

情况＃2

reponse = urllib2_urlopen('http://apply.ovoenergycareers.co.uk/vacancies/475/ovo-telesales-agent/bristol/')
In [80]:

content = reponse.read()
In [81]:

save_html('salarygrep2', content)
In [63]:

!grep -i salary salarygrep2.html
  <dt class="field_salary">Salary</dt>
  <dd class="value_salary">
    Salary: �18,000 + benefits & competitive commission scheme; OTE range: �20,500 - �30,000
In [87]:

with open('salarygrep2.html') as s:
    for line in s:
        if 'salary' in line.lower():
            print line
​
  <dt class="field_salary">Salary</dt>

  <dd class="value_salary">

    Salary: �18,000 + benefits & competitive commission scheme; OTE range: �20,500 - �30,000

In [88]:

情况＃3

reponse = urllib2_urlopen('https://gs7.globalsuccessor.com/centrica02/tpl_centrica02.asp?s=4A515F4E5A565B1A&jobid=48490,2356610248&key=21798303&c=028859657862&pagestamp=dbykvxmmwfnblykbqc')
In [89]:

content = reponse.read()
In [90]:

save_html('salarygrep3', content)
In [67]:

!grep -i salary salarygrep3.html
!grep -i salary salarygrep3.html
<p id="igSoundBite"><em><div>Salary: &#163;28-&#163;38K depending on experience</div></em></p><h3 id="igJobDesc0">Job Description</h3><p><div>Assistant Product Development Manager </div>
In [95]:

with open('salarygrep3.html') as s:
    for line in s:
        if 'salary' in line.lower():
            print line
<p id="igSoundBite"><em><div>Salary: &#163;28-&#163;38K depending on experience</div></em></p><h3 id="igJobDesc0">Job Description</h3><p><div>Assistant Product Development Manager </div>

In [70]:

情况＃4

reponse = urllib2_urlopen('http://jobs.emounlimited.com/senior-digital-project-manager/')
In [71]:

content = reponse.read()
In [72]:

save_html('salarygrep4', content)
In [94]:

!grep -i salary salarygrep4.html
In [92]:

with open('salarygrep4.html') as s:
    for line in s:
        if 'salary' in line.lower():
            print line
In [ ]:

​

• 在第一种情况下，实际工资是不同的<div>，根本不会被收取。
• 在情况2中，薪水确实被检测到，但是（i）这是一个需要处理的范围，并且（ii）存在非ASCII货币字符（英镑）。
• 在情况3中，薪水也被检测到，但是（i）这是一个需要处理的范围，并且（ii）存在非ASCII货币字符（英镑）。
• 在这种情况下，由于指定了薪水，但未提及“薪水”一词，因此什么也没发现。

认为在页面设计和薪水规范方面存在很大差异，是否相信一种尺寸适合所有（或一种尺寸适合最高级）的正则表达式或正则表达式的组合可能会奏效？如果没有，我将如何构建它/它们？还是确实，是否有Python方法可以减少对正则表达式的依赖？