为了编译能通过,maven需要加入仓库地址以及一些必须要的包的依赖情况:

pentaho中央仓库:

在properties里面配置版本号:

6.0.0.0-353

pentaho1

Pentaho Repository1

http://repository.pentaho.org/artifactory/repo/

true

2.kettle一些核心的依赖,由于有些jar包下载不下来,所以exclution掉之后再去mvn仓库找合适的包:

pentaho-kettle

kettle-core

${kettle.version}

jug-lgpl

jug-lgpl

org.apache.commons

commons-vfs2

secondstring

secondstring

org.slf4j

slf4j-log4j12

xercesImpl

xerces

org.apache.xmlgraphics

batik-js

pentaho-kettle

kettle-engine

${kettle.version}

org.apache.commons

commons-vfs2

pentaho-library

libbase

${kettle.version}

pentaho-library

libformula

${kettle.version}

pentaho

metastore

${kettle.version}

pentaho

pentaho-mongodb-plugin

${kettle.version}

pentaho

pentaho-mongo-utils

6.0.0.0-351

org.apache.commons

commons-vfs2

2.1

net.sourceforge.jexcelapi

jxl

2.6.12

rhino

js

1.7R2

3.下载jar包时当遇到500m大小的jar时,暂停mvn手动下载然后移动到本地仓库

插件的路径:D:\dev\apache-maven-3.3.9\repository\pentaho\pentaho-big-data-plugin\6.0.0.0-353

4.java调本地ktr代码:

1 importjava.util.List;2

3 importorg.junit.Test;4 importorg.junit.runner.RunWith;5 importorg.pentaho.di.core.KettleEnvironment;6 importorg.pentaho.di.core.Result;7 importorg.pentaho.di.core.RowMetaAndData;8 importorg.pentaho.di.core.exception.KettleException;9 importorg.pentaho.di.job.Job;10 importorg.pentaho.di.job.JobMeta;11 importorg.pentaho.di.trans.Trans;12 importorg.pentaho.di.trans.TransMeta;13 importorg.slf4j.Logger;14 importorg.slf4j.LoggerFactory;15 importorg.springframework.test.context.ContextConfiguration;16 importorg.springframework.test.context.junit4.SpringJUnit4ClassRunner;17

18 importcn.shunlu.repository.BaseDataInitTest;19

20 @RunWith(SpringJUnit4ClassRunner.class)21 @ContextConfiguration(locations="/applicationContext.xml")22 public class KettleTest extendsBaseDataInitTest{23

24 private static Logger logger = LoggerFactory.getLogger(KettleTest.class);25

26 private static final String KETTLE_PLUGIN_BASE_FOLDER = "E:\\dev\\pentaho\\data-integration\\plugins\\";27 //private static final String KETTLE_PLUGIN_BASE_FOLDER = "C:\\dev\\pentaho6\\data-integration\\system\\karaf\\system\\pentaho";28 //private static final String KETTLE_PLUGIN_BASE_FOLDER = "C:\\dev\\pentaho6\\data-integration\\plugins";

29

30

31 /**

32 * 调转换33 */

34 @Test35 public voidtest() {36 logger.info("hi"+logger.getClass().getName());37 try

38 {39 //这里是设置我们pentaho的运行环境,实际上我们加入的maven依赖只是为了让代码编译通过,实际真正干活的还是pentaho自己40 //也可以自己建个maven的私服把pentaho里面的运行环境的jar丢上去,就能通过java调了

41 System.setProperty("KETTLE_PLUGIN_BASE_FOLDERS", KETTLE_PLUGIN_BASE_FOLDER);42 String transPath = "e:\\tmp\\2.ktr";43

44 KettleEnvironment.init();45

46 TransMeta transMeta = newTransMeta(transPath);47

48 Trans trans = newTrans(transMeta);49 System.out.println(trans);50 trans.setVariable("importOrExport", "出口");51 trans.setVariable("batchId", "57bebcfd816c0dffb72d6fa4");52 trans.setVariable("codeMap_type", "country");53 trans.execute(null);54

55 trans.waitUntilFinished();56

57 Result r =trans.getResult();58 List rowsResult =r.getRows();59

60 if (trans.getErrors() > 0)61 {62 throw newException(trans.getResult().getLogText());63 }64 }65 catch(Exception e)66 {67 e.printStackTrace();68 }69 }70

71 /**

72 *73 * @description 调job74 * @date 2016年9月6日75 *@author

76 */

77 @Test78 public void testJob() throwsException{79 logger.info("hi"+logger.getClass().getName());80 try{81 System.setProperty("KETTLE_PLUGIN_BASE_FOLDERS", KETTLE_PLUGIN_BASE_FOLDER);82

83 String jobPath = "e:\\tmp\\job1.kjb";84 KettleEnvironment.init();85

86 JobMeta jobMeta = new JobMeta(jobPath, null);87

88 Job job = new Job(null, jobMeta);89

90 job.setVariable("importOrExport", "出口");91 job.setVariable("batchId", "57bebcfd816c0dffb72d6fa4");92 job.setVariable("codeMap_type", "country");93

94 job.start();95 job.waitUntilFinished();96

97 if (job.getErrors() > 0) {98 throw newException(99 "There are errors during job exception!(执行job发生异常)");100 }101 } catch(KettleException e) {102 e.printStackTrace();103 }104 }105

106 }

View Code

注:加依赖的目的就是为了让编译能通过,最后运行的环境其实还是我们手动指定的plugins目录如图所示:

这里只是写了个testCase来调用我们本地.ktr和.kjb pentaho这边接收参数的话,我也是只做了个简单的job.

调转换就直接这么接收参数:

如果是调job接收命名参数需要在他的下一个步骤转换里面设置写命名参数就行了:

然后这个转换还是跟上一个转换一样的,而且参数也是那么接收的.${paramName}这样子.其实代码网上很多,但是整合maven那些依赖之间的关系特麻烦.

最近整合发现个问题,如果不将mongo-plugins和mongo-utils包放入plugins目录里面也无法成功调用,因此需要去到,

增加完之后的plugins目录: