我遇到的问题是刮除元素本身。我可以抓取前两个(IncidentNbr和DispatchTime),但是我无法获取地址...(1300 Dunn Ave),我希望能够抓取该元素,但又要使其具有足够的动态性,所以我不能实际解析为“ 1300 Dunn Ave”,我正在解析该元素。这是源代码
<td><span id="lstCallsForService_ctrl0_lblIncidentNbr">150318182198</span></td>
<td><nobr><span id="lstCallsForService_ctrl0_lblDispatchTime">3-18 10:25</span></nobr></td>
<td>
<a id="lstCallsForService_ctrl0_lnkAddress" href="https://maps.google.com/?q=1300 DUNN AVE, Jacksonville, FL" target="_blank" style="text-decoration:underline;">1300 DUNN AVE</a>
</td>
这是我的代码:
from lxml import html
import requests
page = requests.get('http://callsforservice.jaxsheriff.org/')
tree = html.fromstring(page.text)
callSignal = tree.xpath('//span[@id="lstCallsForService_ctrl0_lblIncidentNbr"]/text()')
dispatchTime = tree.xpath('//span[@id="lstCallsForService_ctrl0_lblDispatchTime"]/text()')
location = tree.xpath('//span[@id="lstCallsForService_ctrl0_lnkAddress"]/text()')
print 'Call Signal: ', callSignal
print "Dispatch Time: ", dispatchTime
print "Location: ", location
这是我的输出:
Call Signal: ['150318182198']
Dispatch Time: ['3-18 10:25']
Location: []
关于如何抓取地址的任何想法吗?
首先,它是一个a
元素,而不是一个span
。而且您需要在双斜杠之前text()
:
//a[@id="lstCallsForService_ctrl0_lnkAddress"]//text()
为什么要双斜杠?这是因为实际上此a
元素没有直接的文本节点子代:
<a id="lstCallsForService_ctrl0_lnkAddress" href="https://maps.google.com/?q=5100 CLEVELAND RD, Jacksonville, FL" target="_blank">
<u>5100 CLEVELAND RD</u>
</a>
您还可以通过u
标签访问文本:
//a[@id="lstCallsForService_ctrl0_lnkAddress"]/u/text()
此外,将解决方案扩展为多个结果:
id
属性匹配使用来找到单元格值contains()
text_content()
方法获取文本执行:
for item in tree.xpath('//tr[@class="closedCall"]'):
callSignal = item.xpath('.//span[contains(@id, "lblIncidentNbr")]')[0].text_content()
dispatchTime = item.xpath('.//span[contains(@id, "lblDispatchTime")]')[0].text_content()
location = item.xpath('.//a[contains(@id, "lnkAddress")]')[0].text_content()
print 'Call Signal: ', callSignal
print "Dispatch Time: ", dispatchTime
print "Location: ", location
print "------"
印刷:
Call Signal: 150318182333
Dispatch Time: 3-18 11:22
Location: 9600 APPLECROSS RD
------
Call Signal: 150318182263
Dispatch Time: 3-18 11:12
Location: 1100 E 1ST ST
------
...
本文收集自互联网,转载请注明来源。
如有侵权,请联系[email protected] 删除。
我来说两句