环境信息

处理器：龙芯3C5000
操作系统：Loongnix Server 8.4.1
内核版本：4.19.190-6.5

1、arrow-0.15.1的编译参数

每家的参数不一样，可以根据自己需求更改。

2、生成makefile阶段报错信息

2.1 预备工作

首先系统中先安装cmake、make、gcc、gcc-c++这个软件包，然后开始编译，arrow使用cmake构建器，所以最好能对cmake了解一点(题外话，推荐的cmake书籍是《》)。

2.2 缺少boost相关库导致错误

2.2.1 错误信息：

ORC VERSION :.5.5
PROTOBUF VERSION :V3 .7.1
RAPIDJSON VERSION :2bbd33b33217ff4a73434ebf10cdac41e2ef5e34
RE2 VERSION :2019-08-01
SNAPPY VERSION :1.1.7
THRIFT VERSION :0 .12.0
THRIFT MD5 CHECKSUM :3deebbb4d1ca77dd9c9e009alea02183
URIPARSER VERSION :0.9.3
ZLIB VERSION :1.2.11
ZSTD VERSION :.4.3
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake :165 ( message):
Could NOT find Boost ( missing:regex system filesystem )(found suitable
version "1.73.0",minimum required is "1.58")
Call stack (mostrecent call first):
/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake :458 (_FPHSA_FAILURE_MESSAGE)
/usr/share/cmake/Modules/FindBoost.cmake :2177 ( find_package_handle_standard_args)
cmake _modules/FindBoostAlt.cmake :49 ( find_package)
cmake _modules/ThirdpartyToolchain.cmake :643 ( find_package)
CMakeLists .txt :416 ( include)

2.2.2 原因及解决

报这个错的原因是因为系统里面默认没有安装boost软件包，所以只需要执行下面安装即可！

[loongson@bogon build]$ sudo yum install boost-devel

安装完成后继续执行cmake命令，然后继续报boost相关错误

2.2.3 错误信息

CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):
Could NOT find Boost (missing: Boost_INCLUDE_DIR regex system filesystem)
(Required is at least version "1.58")
Call Stack (most recent call first):
/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:458(_FPHSA_FAILURE_MESSAG)
/usr/share/cmake/Modules/FindBoost.cmake :2177 ( find_package_handle_standard_args)
cmake_modules/FindBoostAlt.cmake:49 (find_package)
cmake_modules/ThirdpartyToolchain.cmake:643 (find_package)

2.2.4 原因及解决

前面已经安装了boost，居然还报错，检查了一下编译选项，发现其中有一项DARROW_BOOST_USE_SHARED=OFF ，这一项会导致使用boost静态库，然后目前系统中还没有安装对应的包，执行sudo yum install boost-static命令安装对应的boost静态库，然后继续执行cmake命令。

2.3 缺少double-conversion 导致错误

2.3.1 错误信息

project has asked CMake to find a package configuration file provided by
"double-conversion", but CMake did not find one.
Could not find a package configuration file provided by "double-conversion"
with any of the following names:
double-conversionConfig.cmake
double-conversion-config.cmake

2.3.2 解决方法

Loongnix Server 8.4中 double-conversion软件包位于epel仓库，首先安装epel仓库地址的包，然后再执行double-conversion安装：

[loongson@bogon build]$ sudo yum install loongnix-release-epel
[loongson@bogon build]$ sudo yum install double-conversion double-conversion-devel

2.4 缺少snappy导致错误

2.4.1 错误信息

DOUBLE_CONVERSION_HAS_CASE_INSENSIBILITY
-- Performing Test DOUBLE_CONVERSION_HAS_CASE_INSENSIBILITY - Success
Could NOT find Snappy ( missing:Snappy DIR )
CMake Error at / usr/ share/cmake/Modules/FindPackageHandleStandardArgs.cmake :165 ( message):
Could NOT find SnappyAlt ( missing:Snappy _LIBSnappy _INCLUDE_DIR)

2.4.2 解决方法

[loongson@bogon build]$ sudo yum install snappy-devel

2.5 缺少libglog导致错误

2.5.1 错误信息

- Building without OpenSSL support. Minimum OpenSSL version 1.0.2 required.
-- Checking for module 'libglog'
-- Package 'libglog', required by 'virtual:world', not found
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):
Could NOT find GLOG (missing: GLOG_INCLUDE_DIR GLOG_LIB)

2.5.2 解决方法

Loongnix Server 8.4中，glog位于PowerTools仓库，所以需要先打开PowerTools仓库：

[loongson@bogon build]$ sudo vim /etc/yum.repos.d/Loongnix-PowerTools.repo

将其中的 enabled=0修改为 enabled=1。

然后执行安装命令：

[loongson@bogon build]$ sudo yum install glog-devel

根据提示信息中openssl相关的内容，安装openssl-devel软件包。

2.6 缺少thrift导致错误

2.6.1 错误信息

-- Found libglog, version 0.3.5
-- Found GLOG: /usr/include
Checking for module ' thrift‘
-- Package  thrift',required by 'virtual:world, not found
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):
Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
Call Stack (most recent call first):
/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE)
cmake_modules/FindThrift.cmake:89

2.6.2 解决方法

在Loongnix Server 8.4中，thrift位于storage下面的ceph-pacific仓库中，
1）可以按照如下方式配置这个仓库：

[loongson@bogon build]$ sudo vim /etc/yum.repos.d/Loongnix-storage.repo

仓库内容如下：

[pacific]
name=Loongnix server $releasever - ceph-pacific
baseurl=http://pkg.loongnix.cn/loongnix-server/$releasever/storage/$basearch/release/ceph-pacific/
gpgcheck=0
enabled=1
priority=4
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-LOONGNIX

然后保存退出，在命令行执行安装软件包的命令：

[loongson@bogon build]$ sudo yum install thrift-devel

2.7 缺少protobuf导致错误

2.7.1 错误信息

CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):
Could NOT find Protobuf (missing:Protobuf _INCLUDE_DIR)( Requiredis at least version "2.6.1")
Call Stack (most recent call first):
/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:458(_FPHSA_FAILURE_MESSAGE)
/usr/share/cmake/Modules/FindProtobuf.cmake:626 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
cmake_modules/ThirdpartyToolchain.cmake:197 (find_package)
cmake_modules/ThirdpartyToolchain.cmake:1349 (resolve_dependency_with_version)

2.7.2 解决方法

[loongson@bogon build]$ sudo yum install protobuf-devel

然后继续执行cmake命令。还是出现protobuf相关错误，信息如下：

2.7.3 错误信息

-- ZLIB_VERSION: 1.2.11
-- ZSTD_VERSION: v1.4.3
-- Boost include dir: /usr/include
-- Boost libraries: /usr/1lib64/libboost_regex.a/usr/1ib64/libboost_system.a/usr/1ib64/libboost_filesystem.a
-- Could NOT find Snappy (missing: Snappy_DIR)
-- Building without OpenSSL support. Minimum OpenSSL version 1.0.2 required.
-- Found Protobuf: Protobuf_LIBRARY-NOTFOUND;-pthread (found suitable version "3.5.0", minimum required is "2.6.1")
CMake Error at cmake_modules/ThirdpartyToolchain.cmake:1372 (message):
libprotoc was set to Protobuf _PROTOC_LIBRARY-NOTFOUND
Call Stack ( mostrecent call first ):

2.7.4 解决方法

这个错误想了半天才找到原因，还是因为编译选项中禁止了protobuf的动态库，然后又忘了装protobuf的静态库导致的…

[loongson@bogon build]$ sudo yum install protobuf-static

2.8 缺少rapidjson导致错误

2.8.1 错误信息

CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):
Could NOT find RapidJSONALt (missing: RAPIDJSON_INCLUDE_DIR) (found
suitable version "2bbd33b33217ff4a73434ebf1l0cdac4le2ef5e34", minimum
required is "1.1.0")
Call Stack (most recent call first):
/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE)
cmake_modules/FindRapidJSONALt.cmake:56 (find_package_handle_standard_args)
cmake_modules/ThirdpartyToolchain.cmake:1776 (find_package)

2.8.2 解决方法

[loongson@bogon build]$ sudo yum install rapidjson-devel

2.9 缺少flatbuffers导致错误

2.9.1 错误信息

CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):Could NOT find FlatbuffersAlt (missing: FLATBUFFERS_LIBFLATBUFFERS_INCLUDE_DIR FLATC)
Call Stack (most recent call first):/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE)cmake_modules/FindFlatbuffersAlt.cmake:42 (find_package_handle_standard_args)cmake_modules/ThirdpartyToolchain.cmake:1846 (find_package)CMakeLists.txt:416 (include)

2.9.2 解决方法

Loongnix Server 8.4.1系统中没有flatbuffers这个包，需要从上游直接拉取源码进行编译。不过好在这个软件包一把可以编译通过，不需要做更改。
flatbuffers源码地址：https://github.com/google/flatbuffers.git

[loongson@bogon workspace]$ git clone https://github.com/google/flatbuffers.git
......
[loongson@bogon workspace]$ cd flatbuffers/
[loongson@bogon flatbuffers]$ mkdir build
[loongson@bogon flatbuffers]$ cd build
[loongson@bogon build]$ cmake ..
[loongson@bogon build]$ make -j32
[loongson@bogon build]$ ls
CMakeCache.txt       compile_commands.json             flatbuffers.pc  flatsamplebfbs    flattests          libflatbuffers.so.23.1.4  tests
CMakeFiles           CTestTestfile.cmake               flatc           flatsamplebinary  libflatbuffers.a   Makefile
cmake_install.cmake  flatbuffers-config-version.cmake  flathash        flatsampletext    libflatbuffers.so  samples

这样编译出来的flatbuffers默认只有静态库、而没有动态库，需要需要动态库的话，需要调整一下。编译完成之后，结果如上面ls所示。
将编译后的内容对应拷贝到系统相应目录下，如下：

# 在flatbuffers的build目录下：
[loongson@bogon build]$ sudo cp -a libflatbuffers.* /lib64/
[sudo] loongson 的密码：
[loongson@bogon build]$ sudo cp -a flatbuffers.pc /lib64/pkgconfig/
[loongson@bogon build]$ sudo cp flatc flathash flatsamplebfbs flatsamplebinary flatsampletext flattests /usr/bin/
[loongson@bogon build]$ sudo mkdir /usr/lib64/cmake/flatbuffers
# 注意这块儿切换了目录，来到了源码目录下的CMake目录下执行的命令！！！
[loongson@bogon CMake]$ sudo cp FindFlatBuffers.cmake /usr/lib64/cmake/flatbuffers/
[loongson@bogon CMake]$ sudo cp flatbuffers-config.cmake /usr/lib64/cmake/flatbuffers/

此处暂时没有拷贝头文件，后面用到再继续拷贝。继续cmake编译arrow

2.10 缺少liblz4导致错误

2.10.1 错误信息

-- Found ZLIB: /usr/lib64/libz.so (found version "1.2.11")
-- Checking for module 'liblz4'
--   Package 'liblz4', required by 'virtual:world', not found
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):Could NOT find Lz4 (missing: LZ4_LIB LZ4_INCLUDE_DIR)
Call Stack (most recent call first):

2.10.2 解决方法

[loongson@bogon build]$ sudo yum install lz4-devel

2.11 缺失re2导致错误

2.11.1 错误信息

--   Found liblz4, version 1.8.3
-- Found Lz4: /usr/lib64/liblz4.so
-- Checking for module 're2'
--   Package 're2', required by 'virtual:world', not found
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):Could NOT find RE2 (missing: RE2_LIB RE2_INCLUDE_DIR)

2.11.2 解决方法

[loongson@bogon build]$ sudo yum install re2-devel

安装re2-devel同时会依赖安装re2，安装完成后执行cmake命令，还是继续报错，错误信息如下：

2.11.3 报错信息

-- Checking for module 're2'
--   Found re2, version 0.0.0
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:165 (message):Could NOT find RE2 (missing: RE2_LIB)
Call Stack (most recent call first):/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE)cmake_modules/FindRE2.cmake:62 (find_package_handle_standard_args)cmake_modules/ThirdpartyToolchain.cmake:184 (find_package)cmake_modules/ThirdpartyToolchain.cmake:2078 (resolve_dependency)CMakeLists.txt:416 (include)

2.11.4 解决方法

打开cmake的配置选项，在build目录下执行ccmake ..命令，然后翻到最后位置，将下面两项修改为如下内容(RE2_LIB的内容可以通过rpm -ql re2-devel查看到)。

2.12 依赖llvm 7.1版本导致错误

2.12.1 错误信息

CMake Error at cmake_modules/FindLLVM.cmake:34 (find_package):Could not find a configuration file for package "LLVM" that is compatiblewith requested version "7.1".The following configuration files were considered but not accepted:/usr/lib64/cmake/llvm/LLVMConfig.cmake, version: 8.0.1/lib64/cmake/llvm/LLVMConfig.cmake, version: 8.0.1

2.12.2 解决方法

你如果编译到这一步可能和我的信息不是很一致，因为我之前已经安装了llvm-8.0.1，所以有找到llvm软件包，只是版本不匹配。

这个错误的原因是目前系统中支持的LLVM版本为8.0.1，而arrow-0.15.1需要的版本是7.1。7.1支持的功能没道理在8.0.1不支持，所以修改CMakeLists.txt文件中llvm的版本信息，让它匹配8.0.1。

[loongson@bogon build]$ vim ../CMakeLists.txt

将

 91 set(ARROW_LLVM_VERSION "7.0")92 # TODO: Remove this when we drop LLVM 7 support.93 set(ARROW_LLVM_VERSION_FALLBACK "7.1")

修改为

 91 set(ARROW_LLVM_VERSION "8.0.1")92 # TODO: Remove this when we drop LLVM 7 support.93 set(ARROW_LLVM_VERSION_FALLBACK "8.0.1")

修改完之后，继续执行cmake编译命令，报错信息如下：

2.12.3 错误信息

CMake Error at src/arrow/ipc/CMakeLists.txt:65 (get_target_property):get_target_property() called with non-existent target "flatbuffers::flatc".
-- flatc:
CMake Error at /usr/lib64/cmake/llvm/LLVMExports.cmake:1059 (message):The imported target "LLVMDemangle" references the file"/usr/lib64/libLLVMDemangle.a"but this file does not exist.  Possible reasons include:

2.12.4 解决方法

这块儿报错显示了没有找到静态库，所以安装llvm的静态库

[loongson@bogon build]$ sudo yum install llvm-static

2.13 去掉sse和simd支持

根据/home/loongson/workspace/arrow-apache-arrow-0.15.1/cpp/build/CMakeFiles/CMakeError.log中的报错信息，关掉这两个支持。
因为这两个都是X86支持的指令集，在LoongArch架构中并不支持，所以需要禁用。
在编译选项中加上下面两个：

-DARROW_SSE42=OFF \
-DARROW_USE_SIMD=OFF \

2.14 flatbuffers报错

2.14.1 错误信息

CMake Error at cmake_modules/ThirdpartyToolchain.cmake:1880 (get_target_property):get_target_property() called with non-existent target"flatbuffers::flatbuffers".
Call Stack (most recent call first):CMakeLists.txt:416 (include)-- Found hdfs.h at: /home/loongson/workspace/arrow-apache-arrow-0.15.1/cpp/thirdparty/hadoop/include/hdfs.h
-- CMAKE_C_FLAGS: -fPIC -O3 -DNDEBUG   -Wall
-- CMAKE_CXX_FLAGS:  -Wno-noexcept-type -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -fdiagnostics-color=always -O3 -DNDEBUG  -Wall
CMake Error at src/arrow/ipc/CMakeLists.txt:63 (get_target_property):get_target_property() called with non-existent target "flatbuffers::flatc".CMake Error at src/arrow/ipc/CMakeLists.txt:65 (get_target_property):get_target_property() called with non-existent target "flatbuffers::flatc".

2.14.2 解决方法

⊙▂⊙，前面手长了，添加了这个信息（cmake知识需要再进一步），然后把它删了。

sudo rm -rf /usr/lib64/cmake/flatbuffers

2.15 错误

2.15.1 错误信息

好多类似的错误，

CMake Error in src/arrow/CMakeLists.txt:Found relative path while evaluating include directories of "arrow_objlib":"RAPIDJSON_INCLUDE_DIR-NOTFOUND"

2.15.2 解决方法

在cmake配置选项中添加
-DRAPIDJSON_INCLUDE_DIR=/usr/include/rapidjson

继续执行cmake命令，谢天谢地，终于生成Makefile了！

3 make阶段错误解决

3.1 缺少parquet_constants.cpp文件

3.1.1 错误信息

[ 66%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/parquet_constants.cpp.o
c++: error: /home/loongson/workspace/arrow-apache-arrow-0.15.1/cpp/src/parquet/parquet_constants.cpp: No such file or directory
c++: fatal error: no input files
compilation terminated.

3.1.2 解决方法

从arrow最新版里面拷贝parquet_constants.cpp和parquet_constants.h文件到对应目录下。

3.2 python未找到

3.2.1 错误信息

/bin/sh: python: 未找到命令
make[2]: *** [src/gandiva/precompiled/CMakeFiles/precompiled.dir/build.make:96：src/gandiva/precompiled_bitcode.cc] 错误 127
make[1]: *** [CMakeFiles/Makefile2:1786：src/gandiva/precompiled/CMakeFiles/precompiled.dir/all] 错误 2

3.2.2 解决方法

Loongnix Server 8.4.1中默认Python为Python3.6版本，其创建链接为
python3，所以手动给它创建python的软连接

[loongson@bogon cpp]$ sudo ln -s /usr/bin/python3.6 /usr/bin/python

3.3 /usr/bin/ld: 找不到 -ltinfo

3.3.1 错误信息

[100%] Linking CXX shared library ../../build/release/libgandiva.so
/usr/bin/ld: 找不到 -ltinfo
collect2: error: ld returned 1 exit status
make[2]: *** [src/gandiva/CMakeFiles/gandiva_shared.dir/build.make:207：build/release/libgandiva.so.15.1.0] 错误 1
make[1]: *** [CMakeFiles/Makefile2:1592：src/gandiva/CMakeFiles/gandiva_shared.dir/all] 错误 2

3.3.2 解决方法

[loongson@bogon cpp]$ sudo yum install ncurses-devel

【保姆级教程】在龙芯3A5000上编译arrow-0.15.1相关推荐

包教包会：龙芯3A5000上尝试运行任意Windows软件
几个月之前,龙芯中科刚放出可用的二进程翻译模块时,我写了一篇<在龙芯3A5000上运行Windows程序>.在龙芯3A5000上运行Windows程序https://zhuanlan.zh ...
保姆级教程，龙蜥操作系统安装使用一步到位！
本文以龙蜥操作系统(Anolis OS) 8.4 为例,为龙蜥社区的用户提供安装指南,希望本文能帮助用户可使用图形化安装接口部署 Anolis OS 到目标平台上. 一.准备 ISO 安装镜像登录龙 ...
在龙芯3B1500上编译安装ICESTORM （open source platform for lattice ICE40 serial FPGA)
编译安装icestorm 1, 从github上clone 源码,如果速度慢,可以考虑用gitee先加载,再clone gitee: 2,make:编译mpsee缺ftdi.h, dnf search ...
uos20(龙芯平台)上编译及更换最新kernl 5.9及kernel 4.19
OS: uos 20 龙芯版下载龙芯或龙梦提供的4.19源码或从内核官网下载最新kernel(验证过5.9.13) 龙芯源码下载地址:http://ftp.loongnix.org/kernel/l ...
保姆级教程，如何发现 GitHub 上的优质项目？
先看再点赞,给自己一点思考的时间,微信搜索[沉默王二]关注这个靠才华苟且的程序员. 本文 GitHub github.com/itwanger 已收录,里面还有一线大厂整理的面试题,以及我的系列文章. ...
龙芯3A5000 上安装docker-compose
操作系统:Loongnix server 8.4 yum install -y loongnix-release-openstack-victoria.noarch yum install -y lo ...
龙芯3a5000下编译redis 7.0源码
1.下载redis 7.0源码后解压缩备用 https://redis.io/download/ 2.下载最新版本的config.guess和config.sub redis 用到了jemalloc库 ...
龙芯3a5000下编译nginx源码
1.nginx源码获取 http://hg.nginx.org/nginx 选择tag,选择稳定版本1.22,点击gz下载gz压缩格式的源码. 2.编译环境需要安装一大堆依赖,不过我测试这台机器因为之 ...
用C++条码扫描SDK测试龙芯3A5000的二进制翻译
本文主要记录了Dynamsoft Barcode Reader(DBR)在龙芯3A5000上的运行测试.感谢子扉提供的ssh主机. 龙芯3A5000国产CPU采用自主研发的LoongArch架构,支持 ...

【保姆级教程】在龙芯3A5000上编译arrow-0.15.1