测试环境搭建整套大数据系统（六：搭建sqoop）

一：下载安装包

https://archive.apache.org/dist/sqoop/

二：解压修改配置。

tar -zxvf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz -C /opt
cd /opt
mv sqoop-1.4.7.bin__hadoop-2.6.0/ sqoop-1.4.7
1
2
3

修改环境变量

vi /etc/profile
1

#SQOOP_HOME
export SQOOP_HOME=/opt/sqoop-1.4.7
export PATH=$PATH:$SQOOP_HOME/bin
1
2
3

source /etc/profile
1

修改配置

cd /opt/apache-hive-3.1.2-bin/conf
cp sqoop-env-template.sh sqoop-env.sh 
vi sqoop-env.sh
1
2
3

export HADOOP_COMMON_HOME=/opt/hadoop-3.2.4/

#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/opt/hadoop-3.2.4/

#set the path to where bin/hbase is available
#export HBASE_HOME=

#Set the path to where bin/hive is available
export HIVE_HOME=/opt/apache-hive-3.1.2-bin
1
2
3
4
5
6
7
8
9
10

三：增加jar包

1. 增加mysql驱动
   将5.7包的驱动，放在lib目录下
   
2. 下载commons-lang-2.6.jar包，放在lib下，删除3以上jar包。

https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.6/

3. cp hive-common-3.1.2.jar的包放在lib目录

cp /opt/apache-hive-3.1.2-bin/lib/hive-common-3.1.2.jar /opt/sqoop-1.4.7/lib/
1

四：检验。

sqoop version
1