爬虫网易财经上市公司财务数据

声明：代码仅作学习交流用途，代码分享者与创作者不承担任何由他人恶意运行而导致的责任，勿擅自修改限制频率的参数，勿恶意攻击网页，请学习浏览者遵守社会公德与法律秩序，爬虫导致的网页崩溃等损失由计算机操作者负全部责任，造成严重后果的需要承担刑事责任
爬虫代写：邮箱 leon_leon@yeah.net

import requests
from lxml import etree
from time import sleep
from fake_useragent import UserAgent
import pandas as pd
from random import randintplace_name = pd.read_csv(r'C:\Users\Admin\PycharmProjects\untitled\股票数据\上市公司代码.csv',encoding='utf-8')
length = len(place_name)
for i in range(length):print(i)UA = UserAgent().edgeurl_base='http://quotes.money.163.com/f10/zycwzb_{},year.html'name_code = place_name.iloc[i,0]url = url_base.format(name_code)headers={'User-Agent':UA}response = requests.get(url,headers=headers)#   print(response.status_code)#   print(response.encoding)sleep(randint(1,2))#  print(response.text)e = etree.HTML(response.text)v1 = e.xpath('''//div[@class='col_r']/table/tr[2]/td/text()''')v2 = e.xpath('''//div[@class='col_r']/table/tr[3]/td/text()''')v3 = e.xpath('''//div[@class='col_r']/table/tr[4]/td/text()''')v4 = e.xpath('''//div[@class='col_r']/table/tr[5]/td/text()''')v5 = e.xpath('''//div[@class='col_r']/table/tr[6]/td/text()''')v6 = e.xpath('''//div[@class='col_r']/table/tr[7]/td/text()''')v7 = e.xpath('''//div[@class='col_r']/table/tr[8]/td/text()''')v8= e.xpath('''//div[@class='col_r']/table/tr[9]/td/text()''')v9 = e.xpath('''//div[@class='col_r']/table/tr[10]/td/text()''')v10 = e.xpath('''//div[@class='col_r']/table/tr[11]/td/text()''')v11 = e.xpath('''//div[@class='col_r']/table/tr[12]/td/text()''')v12 = e.xpath('''//div[@class='col_r']/table/tr[13]/td/text()''')v13 = e.xpath('''//div[@class='col_r']/table/tr[14]/td/text()''')v14 = e.xpath('''//div[@class='col_r']/table/tr[15]/td/text()''')v15= e.xpath('''//div[@class='col_r']/table/tr[16]/td/text()''')v16 = e.xpath('''//div[@class='col_r']/table/tr[17]/td/text()''')v17 = e.xpath('''//div[@class='col_r']/table/tr[18]/td/text()''')v18 =e.xpath('''//div[@class='col_r']/table/tr[19]/td/text()''')v19 = e.xpath('''//div[@class='col_r']/table/tr[20]/td/text()''')all_info = {'基本每股收益(元)': v1,'每股净资产(元)': v2,'每股经营活动产生的现金流量净额(元)':v3,'主营业务收入(万元)': v4,'主营业务利润(万元)': v5,'营业利润(万元)': v6,'投资收益(万元)':v7,'营业外收支净额(万元)':v8,'利润总额(万元)':v9,'净利润(万元)':v10,'净利润(扣除非经常性损益后)(万元)':v11,'经营活动产生的现金流量净额(万元)':v12,'现金及现金等价物净增加额(万元)':v13,'总资产(万元)':v14,'流动资产(万元)':v15,'总负债(万元)':v16,'流动负债(万元)':v17,'股东权益不含少数股东权益(万元)':v18,'净资产收益率加权(%)':v19}outdata = pd.DataFrame(all_info)outdata.to_csv('C:\\Users\\Admin\\PycharmProjects\\untitled\\股票数据\\{}财务1.csv'.format(name_code), encoding='GBK')print('已保存111111111111111111111111111')v1 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[1]/td/text()''')v2 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[2]/td/text()''')v3 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[3]/td/text()''')v4 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[4]/td/text()''')v5 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[5]/td/text()''')v6 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[6]/td/text()''')v7 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[7]/td/text()''')v8 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[8]/td/text()''')v9 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[9]/td/text()''')v10 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[10]/td/text()''')v11 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[11]/td/text()''')v12 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[12]/td/text()''')v13 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[13]/td/text()''')v14 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[14]/td/text()''')v15 = e.xpath('''/html/body/div[2]/div[4]/div[3]/div[4]/table/tr[15]/td/text()''')all_info = {'基本每股收益(元)': v1,'每股净资产(元)': v2,'每股经营活动产生的现金流量净额(元)':v3,'主营业务收入(万元)': v4,'主营业务利润(万元)': v5,'营业利润(万元)': v6,'投资收益(万元)':v7,'营业外收支净额(万元)':v8,'利润总额(万元)':v9,'净利润(万元)':v10,'净利润(扣除非经常性损益后)(万元)':v11,'经营活动产生的现金流量净额(万元)':v12,'现金及现金等价物净增加额(万元)':v13,'总资产(万元)':v14,'流动资产(万元)':v15}outdata = pd.DataFrame(all_info)outdata.to_csv('C:\\Users\\Admin\\PycharmProjects\\untitled\\股票数据\\{}财务2.csv'.format(name_code), encoding='GBK')print('已保存222222222222222222222222222222222222222222')v1 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[1]/td/text()''')v2 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[2]/td/text()''')v3 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[3]/td/text()''')v4 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[4]/td/text()''')v5 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[5]/td/text()''')v6 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[6]/td/text()''')v7 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[7]/td/text()''')v8 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[8]/td/text()''')v9 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[9]/td/text()''')v10 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[10]/td/text()''')v11 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[11]/td/text()''')v12 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[12]/td/text()''')v13 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[13]/td/text()''')v14 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[14]/td/text()''')v15 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[15]/td/text()''')v16 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[16]/td/text()''')v17 = e.xpath('''/html/body/div[2]/div[4]/div[5]/div[4]/table/tr[17]/td/text()''')all_info = {'基本每股收益(元)': v1,'每股净资产(元)': v2,'每股经营活动产生的现金流量净额(元)':v3,'主营业务收入(万元)': v4,'主营业务利润(万元)': v5,'营业利润(万元)': v6,'投资收益(万元)':v7,'营业外收支净额(万元)':v8,'利润总额(万元)':v9,'净利润(万元)':v10,'净利润(扣除非经常性损益后)(万元)':v11,'经营活动产生的现金流量净额(万元)':v12,'现金及现金等价物净增加额(万元)':v13,'总资产(万元)':v14,'流动资产(万元)':v15,'总负债(万元)':v16,'流动负债(万元)':v17}outdata = pd.DataFrame(all_info)outdata.to_csv('C:\\Users\\Admin\\PycharmProjects\\untitled\\股票数据\\{}财务3.csv'.format(name_code), encoding='GBK')print('已保存3333333333333333333333333333333333333333333333')v1 = e.xpath('''/html/body/div[2]/div[4]/div[7]/div[4]/table/tr[1]/td/text()''')v2 = e.xpath('''/html/body/div[2]/div[4]/div[7]/div[4]/table/tr[2]/td/text()''')v3 = e.xpath('''/html/body/div[2]/div[4]/div[7]/div[4]/table/tr[3]/td/text()''')v4 = e.xpath('''/html/body/div[2]/div[4]/div[7]/div[4]/table/tr[4]/td/text()''')all_info = {'基本每股收益(元)': v1,'每股净资产(元)': v2,'每股经营活动产生的现金流量净额(元)':v3,'主营业务收入(万元)': v4}outdata = pd.DataFrame(all_info)outdata.to_csv('C:\\Users\\Admin\\PycharmProjects\\untitled\\股票数据\\{}财务4.csv'.format(name_code), encoding='GBK')print('已保存44444444444444444444444444444444444444444444444444444')v1 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[1]/td/text()''')v2 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[2]/td/text()''')v3 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[3]/td/text()''')v4 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[4]/td/text()''')v5 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[5]/td/text()''')v6 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[6]/td/text()''')v7 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[7]/td/text()''')v8 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[8]/td/text()''')v9 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[9]/td/text()''')v10 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[10]/td/text()''')v11 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[11]/td/text()''')v12 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[12]/td/text()''')v13 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[13]/td/text()''')v14 = e.xpath('''/html/body/div[2]/div[4]/div[9]/div[4]/table/tr[14]/td/text()''')all_info = {'基本每股收益(元)': v1,'每股净资产(元)': v2,'每股经营活动产生的现金流量净额(元)':v3,'主营业务收入(万元)': v4,'主营业务利润(万元)': v5,'营业利润(万元)': v6,'投资收益(万元)':v7,'营业外收支净额(万元)':v8,'利润总额(万元)':v9,'净利润(万元)':v10,'净利润(扣除非经常性损益后)(万元)':v11,'经营活动产生的现金流量净额(万元)':v12,'现金及现金等价物净增加额(万元)':v13,'总资产(万元)':v14}outdata = pd.DataFrame(all_info)outdata.to_csv('C:\\Users\\Admin\\PycharmProjects\\untitled\\股票数据\\{}财务5.csv'.format(name_code), encoding='GBK')print('已保存55555555555')

爬虫网易财经上市公司财务数据相关推荐

Python爬虫实战，requests模块，爬虫采集网易财经股票交易数据
前言本文给大家分享的是如何通过Python爬虫采集网易财经易数据开发工具 Python版本: 3.8 相关模块: requests模块 parsel模块环境搭建安装Python并添加到环境变量 ...
使用R语言从网易财经批量获取股票数据并进行整合的方法
最近因为投资分析需要接触R语言,需要获取A股上市公司数据.从同花顺下载效率太低,就到处找途径.分享下方法,共其他小白参考,请大神指正. R语言自带的quantmod数据不错,不过国内A股数据不全,而且 ...
python获取财务数据曝光_Python-股票-从网易财经获取主要财务指标数据
以下代码从网易财经的个股页面获取主要财务指标,获取的数据输出到Excel电子表格中. import pandas as pd from pandas.core.frame import DataFra ...
python爬网站数据实例网易财经股票数据历史资金流向-批量采集网易财经所有A股股票数据并导出excel表格...
2.[代码][Python]代码 # -*- coding: utf-8-*- # @Date : 2014-05-20 # @Author : Lifemaxer # @Website : http ...
【竞争】SAP副总裁九华山庄的发言和真相报道(转：网易财经)
7月8日, 北京九华山庄. 有200多位SAP员工参加的 "SAP中国第三季度销售大会"(简称"九华山庄会议")上,刚刚上任不到三个月的SAP中国区董事总经理的 ...
爬取网易财经中股票的历史交易数据
爬取网易财经中股票的历史交易数据需求分析得到股票代码股票代码的信息是在东方财富网中获取(http://quote.eastmoney.com/stocklist.html) 得到股票的历史交易记 ...
爬取上市公司财务数据
python爬取上市公司财务数据爬取入口 http://data.eastmoney.com/bbsj/201112/yjbb.html 使用selenium进行爬取的,本来参考其他博主的代码,但是 ...
Python-股票-从网易财经获取主要财务指标数据
以下代码从网易财经的个股页面获取主要财务指标,获取的数据输出到Excel电子表格中. import pandas as pd from pandas.core.frame import DataFra ...
爬取网易财经全部A股上市公司年报
首先要找到所有A股上市公司的股票代码,将东方财富网列表中所有的股票的代码(6位数字号)取下来东方财富网股票代码列表: http://quote.eastmoney.com/stocklist.htm ...

爬虫网易财经上市公司财务数据

爬虫网易财经上市公司财务数据相关推荐

最新文章

热门文章