Options

[SOLVED]Problem with Config file for Read Server Log

starstar Member Posts: 14 Contributor II
edited July 2019 in Help
Hi,
I have a log file in the following format:

112.135.255.32 - [06/Apr/2013:23:55:07 +0530] "POST /SVRClientWeb/ActionController HTTP/1.1" 200 14107 "https://www.example.com/SVRClientWeb/ActionController?sblparam=Z6spFdlqDbbbgtECSSpzHGTShMYdnVO7D7KyPZZBEmpeZSPuP20Ky7zr9jZXl1rnj+s5lCszddZe QtctW6Q5og==" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.31 (KHTML, like Gecko) Chrome/26.0.1410.43 Safari/537.31" POST /SVRClientWeb/ActionController - HTTP/1.1 www.example.com

For the Read Server Log in Rapid Miner I have downloaded the two config files available at
http://sourceforge.net/p/polliwog/feature-requests/5/

But the process get stuck and stop running? I feel that these config files do not match with my log file format? How to solve my problem. Thanks in advance!
Tagged:

Answers

  • Options
    MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Probably the format of your file does not match the format defined in the config files. But anyway, the operator should not simply get stuck but give you a decent error message. Can you upload an excerpt of your server log somewhere such that we can try to reproduce the problem on your data?

    Best regards,
    Marius
  • Options
    starstar Member Posts: 14 Contributor II
    Thanks Marius!That will be a great help.

    Please find the sample of my log file here.

    https://www.dropbox.com/s/ynbfvig86hyxdka/logfile
  • Options
    starstar Member Posts: 14 Contributor II
    I changed my log file according to the IIS log file Format : http://sourceforge.net/p/polliwog/feature-requests/5/
    But it also didn't work. Has anybody tried using an IIS log file with RapidMiner??
  • Options
    MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Can you upload your updated logfile?

    Best regards,
    Marius
  • Options
    starstar Member Posts: 14 Contributor II
    Please use the sample log file here :

    https://www.dropbox.com/s/r02kc4l1aq98msk/ex121127.log

    I used following config file:

    https://www.dropbox.com/s/66u36j2sr77tu3w/w3c-iis7-addl-extended-log-entry-format.xml

    Thanks Marius!

  • Options
    MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Your log file misses the sent bytes field at the very end of each line.

    Best regards,
    Marius
  • Options
    starstar Member Posts: 14 Contributor II
    Hi Marius!

    I have done lot of editing to both log files and to config files. Still couldn’t find a way to solve this. At first I removed the bytes sent part from the config file. Once it failed then i added a bytes sent to column to the logfile. After I entered column names to the log file according to the config file. Everything produces the same result as follows. The program get stuck and I have to use kill command in terminal to exit.

    https://www.dropbox.com/s/anati514awfboei/Screenshot%20from%202013-06-28%2018%3A17%3A03.png

    One other thing I'm using Rapidminer in Ubuntu 12.04. For Apache log files this works fine and I can get results. Problem is with the IIS log files.

    Have you tried this with my log files?
  • Options
    MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Hey, I tried your log file, and if I added a random integer, e.g. 12, to the very end of each line, it worked perfectly. I can only test on Windows 7, though.

    Hope this helps!

    Best regards,
    Marius
  • Options
    starstar Member Posts: 14 Contributor II
    Hi Marius!

    Thanks for the help! Yea it worked finally!  :)
Sign In or Register to comment.