Rapidminer hangs at startup

Racal

Hi,

I experience following problem:

At startup (./RapidMiner-Studio.sh), Rapidminer hangs at "Initializing checks"

When I delete the ~/.RapidMiner directory, startup succeeds, but only then, if I start up again, it hangs again.

- Rapidminer 9.8

- Linux mint 20

- Java java-8-openjdk-amd64

- Working memory = 10Gb

I do notice Java is eating up my memory.

I set the setting of maximum  memory usage for Rapidminer at 1Gb, 2Gb, 3Gb, ..... to no avail...

anyone with a suggestion as to solve this?

many thanks.

jwpfau

Hi Racal,

Gnome 3.22 has a known issue with the gnome accessibility wrapper.
https://bugzilla.gnome.org/show_bug.cgi?id=791970

Can you try to use this modified start script which disables the wrapper?

#!/bin/bash

############################################################
##                                                        ##
##       Unix Start Script for RapidMiner Studio          ##
##                                                        ##
##  This script tries to determine the location of        ##
##  RapidMiner Studio, searches for a proper Java         ##
##  executable and starts the program.                    ##
##                                                        ##
############################################################

## remove _JAVA_OPTIONS environment variable for this run ##
## it could contain stuff that break Studio launching so we ignore it completely ##
unset _JAVA_OPTIONS

if [ -z "${RAPIDMINER_HOME}" ] ; then
	RAPIDMINER_HOME="$(cd "$(dirname "$0")" 2>/dev/null && pwd)"
    echo "RAPIDMINER_HOME is not set. Trying the directory '${RAPIDMINER_HOME}'..."
fi 

##########################
##                      ##
##  Searching for Java  ##
##                      ##
##########################

# JAVA_HOME set, so use it
if [ ! -z "${JAVA_HOME}" ] ; then
    if [ -x "${JAVA_HOME}/bin/java" ]; then
        JAVA="${JAVA_HOME}/bin/java"
    fi
fi

# otherwise, try to find java using which
if [ -z "${JAVA}" ] ; then
    _jfnd="`which java`"
    if [ -x "${_jfnd}" ]; then
        JAVA="${_jfnd}"
    else
        echo 'Could not find the java executable in default path or ${JAVA_HOME}/bin/java.'
        echo "Edit $0 and/or your local startup files."
        exit 1
    fi
    unset _jfnd
fi



###############################################
##                                           ##
##  Launch RapidMiner and check for updates  ##
##                                           ##
###############################################

update_root=~/.RapidMiner/update
update_dir=${update_root}/RUinstall
update_script=${update_root}/UPDATE

LAUNCH=1
while [ ${LAUNCH} -eq 1 ]
do
    # Performing possible update
    if [ -d "${update_dir}" ]; then
        if [ -w "${RAPIDMINER_HOME}" ] ; then
            echo "======================================================================="
            echo "Performing update. Copying files from '${update_dir}' to '${RAPIDMINER_HOME}'."
            cp -rf "${update_dir}"/* "${RAPIDMINER_HOME}"
            rm -rf "${update_dir}"
            echo "Copy complete."
            if [ -f "${update_script}" ] ; then
                echo "Deleting obsolete files listed in ${update_script}."
                {
                    while read COMMAND FILE
                    do
                        if [ "DELETE" = "${COMMAND}" ] ; then
                            # Strip rapidminer/ prefix
                            FILE=`echo ${FILE} | sed -e 's/^rapidminer\///'`
                            TO_DELETE=${RAPIDMINER_HOME}/${FILE}
                            if [ -f "${TO_DELETE}" ] ; then
                                echo "Deleting regular file ${TO_DELETE}"
                                rm "${TO_DELETE}"
                            elif [ -d "${TO_DELETE}" ] ; then
                                echo "Deleting directory ${TO_DELETE}"
                                rmdir "${TO_DELETE}"
                            else
                                echo "Cannot delete file ${TO_DELETE} (does not exist)"
                            fi                          
                        else
                            echo "Unknown update command: ${COMMAND}"
                        fi
                    done
                } < ${update_script}
                rm "${update_script}"
                echo "Completed deletion of obsolete files."
            else
                echo "No update script found in ${update_script}."
            fi
            rm -rf "${update_root}"
            echo "Update complete"
            echo "======================================================================="
        else
            echo "======================================================================="
            echo "ATTENTION: An update was downloaded, but we cannot write to"
            echo "           ${RAPIDMINER_HOME}. "
            echo "           Ignoring update. Please restart as super user."
            echo "======================================================================="
        fi
    fi

    # Compile launch parameters
    rmClasspath="${RAPIDMINER_HOME}"/lib/*
    JVM_OPTIONS=$("$JAVA" "-Djava.awt.headless=true" "-Djavax.accessibility.assistive_technologies=" -cp "${rmClasspath}" com.rapidminer.launcher.JVMOptionBuilder "$@")
    
    # Launch Studio
    LAUNCH=0
    if [ $# -gt 0 ]; then
      eval \"$JAVA\" $JVM_OPTIONS -Djavax.accessibility.assistive_technologies= -cp \"${rmClasspath}\" com.rapidminer.launcher.GUILauncher \"$@\"
    else
      eval \"$JAVA\" $JVM_OPTIONS -Djavax.accessibility.assistive_technologies= -cp \"${rmClasspath}\" com.rapidminer.launcher.GUILauncher
    fi


    if [ $? -eq 2 ]
    then
        echo RapidMiner Studio will now relaunch 
        LAUNCH=1
    fi
done

Thanks,
Jonas

Racal

Dear Jonas (and Marco),

great! This seems to have solved it. Started 2 consecutive times with no problems!

Many thanks!

ps: I forgot to state that I use the XFCE version of Mint, but still gnome has influence clearly

pps: there have sneaked some html codings into your script :

2>/dev/null &&amp

again, many thanks!

Kind regards, Marc

Marco_Boeck

Hi,

Could you please post the content of the rapidminer-studio.log from the USER_HOME/.RapidMiner folder here?

Also note that we recommend at least 16GB of RAM (or much more depending on what kind of data and operations you plan to do), though for small tasks it should work with as little as 4GB.

Regards,
Marco

Racal

Hi Marco,

thanks for coming back, my log:

Nov 17, 2020 11:14:30 AM com.rapidminer.gui.safemode.SafeMode launchStarts
INFO: Found left-behind lock file from last startup at /home/marc/.RapidMiner/safeMode.lock.
Nov 17, 2020 11:14:30 AM com.rapidminer.tools.I18N <clinit>
INFO: Set locale to en.
Nov 17, 2020 11:14:31 AM com.rapidminer.gui.RapidMinerGUI run
INFO: Launching RapidMiner 9.8.000, platform ANY
Nov 17, 2020 11:14:32 AM com.rapidminer.tools.PlatformUtilities logInfo
INFO: rapidminer.home is '/home/marc/rapidminer-studio'.
Nov 17, 2020 11:14:32 AM com.rapidminer.core.license.ProductConstraintManager initialize
INFO: Initializing license manager.
Nov 17, 2020 11:14:32 AM com.rapidminer.core.license.ProductConstraintManager initialize
INFO: Using default license location.
Nov 17, 2020 11:14:32 AM com.rapidminer.core.license.ProductConstraintManager initialize
INFO: Registering default product.
Nov 17, 2020 11:14:32 AM com.rapidminer.repository.FileRepositoryProvider load
WARNING: Unknown tag: filesystemRepository
Nov 17, 2020 11:14:32 AM com.rapidminer.search.GlobalSearchRegistry registerSearchCategory
INFO: Global Search category repository registered.
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Professional
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Legacy Result Access
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Productivity
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Model Deployment Management
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: HTML5 Charts
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Data Editor
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Blending
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Remote Repository
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Cloud Connectivity
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: JDBC Connectors
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Browser
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Operator Recommender
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Social Media
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Concurrency
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: CTA
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: H2O
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Model Simulator
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Time Series
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Utility
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Advanced File Connectors
Nov 17, 2020 11:14:33 AM com.rapidminer.tools.plugin.Plugin registerPlugins
INFO: Register plugin: Process Scheduling
Nov 17, 2020 11:14:35 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator Twitter Connection.
Nov 17, 2020 11:14:36 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initPlugin$2
INFO: Async: Init browser setup.
Nov 17, 2020 11:14:36 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator Salesforce Connection.
Nov 17, 2020 11:14:36 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator Amazon S3 Connection.
Nov 17, 2020 11:14:36 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator Azure Blob Storage Connection.
Nov 17, 2020 11:14:36 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator Azure Data Lake Storage Gen1 Connection.
Nov 17, 2020 11:14:36 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator gui.configurable.cloud.azure.gen2.name.
Nov 17, 2020 11:14:36 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator Google Cloud Storage Connection.
Nov 17, 2020 11:14:36 AM com.rapidminer.tools.config.ConfigurationManager register
INFO: Registered configurator Dropbox Connection.
Nov 17, 2020 11:14:37 AM com.rapidminer.extension.jdbc.tools.jdbc.JDBCProperties <init>
WARNING: Missing database driver class name for ODBC Bridge (e.g. Access)
Nov 17, 2020 11:14:37 AM com.rapidminer.extension.jdbc.tools.jdbc.JDBCProperties <init>
WARNING: Missing database driver class name for Ingres
Nov 17, 2020 11:14:37 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initPlugin$2
INFO: Async: Basic browser setup test starting.
Nov 17, 2020 11:14:38 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initPlugin$2
INFO: Async: Created basic browser instance.
Nov 17, 2020 11:14:38 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initPlugin$2
INFO: Async: Loaded basic browser test content. Executing functionality check.
Nov 17, 2020 11:14:38 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initPlugin$2
INFO: Async: Basic browser setup test successful.
Nov 17, 2020 11:14:38 AM com.rapidminer.repository.RepositoryManager registerExtensionSamples
INFO: Registered 'Time Series' as sample folder.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Process Scheduling was loaded in 129ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Blending was loaded in 143ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Concurrency was loaded in 150ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Utility was loaded in 150ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Productivity was loaded in 165ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Operator Recommender was loaded in 181ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Data Editor was loaded in 184ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Advanced File Connectors was loaded in 203ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Remote Repository was loaded in 205ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Model Deployment Management was loaded in 211ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension CTA was loaded in 213ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Time Series was loaded in 221ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Social Media was loaded in 221ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Model Simulator was loaded in 232ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Browser was loaded in 249ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Professional was loaded in 256ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension HTML5 Charts was loaded in 274ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Legacy Result Access was loaded in 397ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension H2O was loaded in 451ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension JDBC Connectors was loaded in 780ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.tools.plugin.Plugin initAll
INFO: Extension Cloud Connectivity was loaded in 805ms.
Nov 17, 2020 11:14:39 AM com.rapidminer.search.GlobalSearchRegistry registerSearchCategory
INFO: Global Search category operator registered.
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for Amazon S3 Connection
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for Azure Blob Storage Connection
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for Azure Data Lake Storage Gen1 Connection
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for gui.configurable.cloud.azure.gen2.name
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for Dropbox Connection
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for Salesforce Connection
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for Google Cloud Storage Connection
Nov 17, 2020 11:14:51 AM com.rapidminer.tools.config.ClientConfigurationManager loadAllParameters
INFO: No configuration file found for Twitter Connection
Nov 17, 2020 11:14:52 AM com.rapidminer.search.GlobalSearchRegistry registerSearchCategory
INFO: Global Search category actions registered.
Nov 17, 2020 11:14:52 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initGui$5
INFO: Async: Hardware accelerated browser setup test starting.
Nov 17, 2020 11:14:52 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initGui$5
INFO: Async: Created hardware accelerated browser instance.
Nov 17, 2020 11:14:52 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initGui$5
INFO: Async: Loaded hardware accelerated browser test content. Executing functionality check.
Nov 17, 2020 11:14:52 AM com.rapidminer.extension.browser.PluginInitBrowser lambda$initGui$5
INFO: Async: Hardware accelerated browser setup test successful.
Nov 17, 2020 11:14:55 AM com.rapidminer.search.GlobalSearchRegistry registerSearchCategory
INFO: Global Search category academy registered.
Nov 17, 2020 11:14:55 AM com.rapidminer.gui.search.GlobalSearchGUIRegistry registerSearchVisualizationProvider
INFO: Global Search GUI provider added for category academy.

best, Marc

Marco_Boeck

Hi,

Thank you for providing the log!
Unfortunately, it contains nothing unusual

If you are up for it, I'd love to see some very specific debug information, which you can acquire the following way:

1. Start Studio, wait until it hangs.
2. Run the following in the shell: jcmd (It should be located in the JAVA/bin folder). That gives you the process id of RapidMiner Studio.
3. The id you got back insert into the following command by replacing {PID} with it: jcmd {PID} Thread.print

This gives you a list of stacktraces for each thread of Studio, and thus hopefully more insight into what exactly hangs.
Though my gut feeling is that something does not play nice with the latest Linux distribution versions, seeing as Ubuntu 20 also seems to share the problem..


Thank you,
Marco

Racal

Marco,

thanks, logging is in attached file.

best regards, Marc