RM Server: Job agent extensions are not loaded correctly

mschwarzermschwarzer Member Posts: 6 Contributor II
edited November 2018 in Help

I'm runing Rapidminer server (from Amazon AMI) but my bundled job agent does not recognize the extensions correctly. Loading the Web mining extensions fails due to missing dependency of Text mining extension even if the rmx_text.jar is in the extensions directory.

 

Error log from job execution:

 

...
2018-03-04 14:32:30.213 INFO 3724 --- [main] c.r.e.j.s.RapidMinerInitializerService : Setting execution mode to 'APPSERVER'
2018-03-04 14:32:30.213 INFO 3724 --- [main] c.r.e.j.s.RapidMinerInitializerService : Loading extensions from '/opt/rmserver/job-agent/extensions'
2018-03-04 14:32:30.223 INFO 3724 --- [main] com.rapidminer : Performing upgrade to version 8.1.000
2018-03-04 14:32:30.224 INFO 3724 --- [main] com.rapidminer : Set locale to en.
2018-03-04 14:32:30.260 INFO 3724 --- [main] PlatformUtilities : rapidminer.home is '/opt/rmserver/job-agent/engine'.
2018-03-04 14:32:30.275 INFO 3724 --- [main] com.rapidminer : Initializing license manager.
2018-03-04 14:32:30.534 INFO 3724 --- [main] com.rapidminer : Cannot access file system in execution mode APPSERVER. Not loading repositories.
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: PMML
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: JDBC Connectors
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: Remote Repository
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: Advanced File Connectors
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: Professional
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: Productivity
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: Legacy Result Access
2018-03-04 14:32:30.993 INFO 3724 --- [main] com.rapidminer : Register plugin: Process Scheduling
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: Social Media
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: Cloud Connectivity
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: H2O
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: Concurrency
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: Model Simulator
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: MeaningCloud
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: Pdf Table Extraction
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: Web Mining
2018-03-04 14:32:30.994 INFO 3724 --- [main] com.rapidminer : Register plugin: Weka
2018-03-04 14:32:31.011 ERROR 3724 --- [main] com.rapidminer : Cannot load extension rmx_web: Depends on rmx_text which cannot be found!
2018-03-04 14:32:31.799 INFO 3724 --- [main] com.rapidminer : Registered configurator Twitter Connection.
2018-03-04 14:32:32.139 INFO 3724 --- [main] com.rapidminer : Registered configurator Salesforce Connection.
2018-03-04 14:32:32.140 INFO 3724 --- [main] com.rapidminer : Registered configurator Amazon S3 Connection.
...

My extensions folders looks the following:

[root@ip-172-31-14-238 job-agent]# ls /opt/rmserver/job-agent/extensions/custom/extensions/ -l
total 100204
-rw-r--r--. 1 root root 6537031 4. Mär 13:59 rmx_com.aylien.textapi.rapidminer-ANY-0.2.0.jar
-rw-r--r--. 1 root root 300178 4. Mär 13:59 rmx_keras-ANY-1.0.3.jar
-rw-r--r--. 1 root root 99973 4. Mär 13:59 rmx_MeaningCloud-ANY-1.0.1.jar
-rw-r--r--. 1 root root 4869914 4. Mär 13:59 rmx_operator_toolbox-ANY-0.9.0.jar
-rw-r--r--. 1 root root 22575659 4. Mär 13:59 rmx_paren-ANY-5.3.1.jar
-rw-r--r--. 1 root root 13643313 4. Mär 13:59 rmx_pdf_table_extraction-ANY-0.2.1.jar
-rw-r--r--. 1 root root 81533 4. Mär 13:59 rmx_python_scripting-ANY-7.4.0.jar
-rw-r--r--. 1 root root 2291491 4. Mär 13:59 rmx_reporting-ANY-5.3.0.jar
-rw-r--r--. 1 root root 470464 4. Mär 13:59 rmx_series-ANY-7.4.0.jar
-rw-r--r--. 1 root root 21378013 4. Mär 13:59 rmx_text-ANY-8.1.0.jar
-rw-r--r--. 1 root root 23160834 4. Mär 13:59 rmx_web-ANY-7.3.0.jar
-rw-r--r--. 1 root root 7183194 4. Mär 13:59 rmx_weka-ANY-7.3.0.jar

As a result my process fails because a operator is missing:

...
2018-03-04 14:32:43.603 INFO 3724 --- [main] c.r.e.j.e.ExecutionProcessListener : Execution of process stopped
2018-03-04 14:32:43.610 ERROR 3724 --- [main] c.r.e.j.service.ErrorReporterService : User Error during execution

com.rapidminer.operator.UserError: The dummy operator Process Documents from Web (replacing web:process_web_modern) cannot be executed.
at com.rapidminer.operator.DummyOperator.doWork(DummyOperator.java:94)
...

Any help? Does it depend on the order in which the extensions are loaded?

 

Best regards

Tagged:
jan_spoerer

Best Answer

Answers

  • Pavithra_RaoPavithra_Rao Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 123 RM Data Scientist

    @mschwarzer

    Could you confirm if you have placed the extension jar files in both server root directory and extension directory?

     

    i.e C:\RapidMinerServer8.1\extensions and C:\RapidMinerServer8.1\job-agent\extensions.

     

    The new server architecture is made such that, we need to place the extensions in server root directory and desired job-agent extension directory.

     

    Hope this helps.

     

    Cheers

     

  • mschwarzermschwarzer Member Posts: 6 Contributor II

    Yes - extensions are also available for rmserver/standalone

     

    [root@ip-172-31-14-238 centos]# ls -l /opt/rmserver/extensions/custom/
    total 100204
    -rw-r--r--. 1 root root 6537031 4. Mär 15:23 rmx_com.aylien.textapi.rapidminer-ANY-0.2.0.jar
    -rw-r--r--. 1 root root 300178 4. Mär 15:23 rmx_keras-ANY-1.0.3.jar
    -rw-r--r--. 1 root root 99973 4. Mär 15:23 rmx_MeaningCloud-ANY-1.0.1.jar
    -rw-r--r--. 1 root root 4869914 4. Mär 15:23 rmx_operator_toolbox-ANY-0.9.0.jar
    -rw-r--r--. 1 root root 22575659 4. Mär 15:23 rmx_paren-ANY-5.3.1.jar
    -rw-r--r--. 1 root root 13643313 4. Mär 15:23 rmx_pdf_table_extraction-ANY-0.2.1.jar
    -rw-r--r--. 1 root root 81533 4. Mär 15:23 rmx_python_scripting-ANY-7.4.0.jar
    -rw-r--r--. 1 root root 2291491 4. Mär 15:23 rmx_reporting-ANY-5.3.0.jar
    -rw-r--r--. 1 root root 470464 4. Mär 15:23 rmx_series-ANY-7.4.0.jar
    -rw-r--r--. 1 root root 21378013 4. Mär 15:23 rmx_text-ANY-8.1.0.jar
    -rw-r--r--. 1 root root 23160834 4. Mär 15:23 rmx_web-ANY-7.3.0.jar
    -rw-r--r--. 1 root root 7183194 4. Mär 15:23 rmx_weka-ANY-7.3.0.jar

    In the plugin directory, too (com.rapidanalytics.plugindir=/opt/rmserver/plugins):

    [root@ip-172-31-14-238 centos]# ls -l /opt/rmserver/plugins/custom/extensions/
    total 100204
    -rw-r--r--. 1 root root 6537031 4. Mär 13:59 rmx_com.aylien.textapi.rapidminer-ANY-0.2.0.jar
    -rw-r--r--. 1 root root 300178 4. Mär 13:59 rmx_keras-ANY-1.0.3.jar
    -rw-r--r--. 1 root root 99973 4. Mär 13:59 rmx_MeaningCloud-ANY-1.0.1.jar
    -rw-r--r--. 1 root root 4869914 4. Mär 13:59 rmx_operator_toolbox-ANY-0.9.0.jar
    -rw-r--r--. 1 root root 22575659 4. Mär 13:59 rmx_paren-ANY-5.3.1.jar
    -rw-r--r--. 1 root root 13643313 4. Mär 13:59 rmx_pdf_table_extraction-ANY-0.2.1.jar
    -rw-r--r--. 1 root root 81533 4. Mär 13:59 rmx_python_scripting-ANY-7.4.0.jar
    -rw-r--r--. 1 root root 2291491 4. Mär 13:59 rmx_reporting-ANY-5.3.0.jar
    -rw-r--r--. 1 root root 470464 4. Mär 13:59 rmx_series-ANY-7.4.0.jar
    -rw-r--r--. 1 root root 21378013 4. Mär 13:59 rmx_text-ANY-8.1.0.jar
    -rw-r--r--. 1 root root 23160834 4. Mär 13:59 rmx_web-ANY-7.3.0.jar
    -rw-r--r--. 1 root root 7183194 4. Mär 13:59 rmx_weka-ANY-7.3.0.jar

     

     

  • mschwarzermschwarzer Member Posts: 6 Contributor II

    Web mining + text processing extensions show both up in the available operators page in the admin interface:

     




    Text Processing

    (rmx_text)


    7.5.0



    Value Series

    (rmx_series)


    7.4.0



    Web Mining

    (rmx_web)


    7.3.0

    Maybe it's version related? The file name is "rmx_text-ANY-8.1.0.jar" but in the web interface it's 7.5.0.
Sign In or Register to comment.