Logscape Support

Members Login
Username 
 
Password 
    Remember Me  
Logscape Support -> logscape -> Performance issues, can't find a way to fix them
Post Info TOPIC: Performance issues, can't find a way to fix them
mark


Member

Status: Offline
Posts: 13
Date:
Performance issues, can't find a way to fix them
Permalink  
 

Hello

I'm running the latest version of Logscape (b310) my system is REH 6 with 32GB ram and 16 Cores

I have just 4GB of logs, with any search keeps getting stuck at  12% Events: 278,471 (35s) 

Any idea what it may be or where to look for clues? 

 

My boot proprieties is:

vmargs=-Xms8G -Xmx8G -Xss256k -XX:MaxDirectMemorySize=512M -XX:+HeapDumpOnOutOfMemoryError -XX:+UseFastAccessorMethods -Xrs -XX:CompileCommand=exclude,jregex/Pretokenizer,next -XX:+UseConcMarkSweepGC -XX:+UseCompressedOops -Xbootclasspath/p:lib/jdk7-introspector.jar -Dcom.sun.management.jmxremote.port=8989 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false

sysprops=-DLOGSCAPE -Dvso.base.port=11000 -Dagent.role=dev.Management -Dmax.hot.days=8 -Dweb.app.port=8080 -Ddashboard.heap=4G -Dlogspace.heap=1G  -Daggspace.heap=2G

mainclass=com.liquidlabs.vso.VSOMain

sys-bundles=system-bundles

deploy=downloads

sharedConfig=downloads

pre-cp=foo.jar

post-cp=blah.jar

 

 

 

Boot.sh is

 

#!/bin/bash

#### This script is called from vscape-s.sh OR vscape.sh - which enable vscape.sh [start, stop]

####

 

export LC_CTYPE=C.UTF-8

export PATH=.:$PATH

CP=.:boot.jar

if [ -z "${JAVA_HOME}" ]; then

 java -DVSCAPE_BOOTSTRAP -XX:MaxPermSize=512M -Xms8G -Xmx8G -Dlog4j.configuration=./agent-log4j.properties -Xverify:none -cp $CP com.liquidlabs.boot.BootStrapper $@ &

else

 $JAVA_HOME/bin/java -DLOGSCAPE_BOOTSTRAP -XX:MaxPermSize=512M -Xms8G -Xmx8G -Dlog4j.configuration=./agent-log4j.properties -Xverify:none -cp $CP com.liquidlabs.boot.BootStrapper $@ &

fi

echo  $! > pids/agent-$!.pid

 

 

Thanks!!

Mark



__________________
Nathen


Member

Status: Offline
Posts: 23
Date:
Permalink  
 

Hi Mark,

Could you email us a large sample, approximately 100mb uncompressed, of your data through to support@logscape.com and we'll take a look into this issue.

Thanks,
Nathen

__________________
mark


Member

Status: Offline
Posts: 13
Date:
Permalink  
 

Sent

Thanks!!

Mark

__________________
Nathen


Member

Status: Offline
Posts: 23
Date:
Permalink  
 

Hi Mark,

We've launched a pre-release of Logscape 3.0 today which included a fix for your issue, I emailed you a download link.

Thanks,
Nathen

__________________
neilson9


Senior Member

Status: Offline
Posts: 100
Date:
Permalink  
 

Hi Mark - how did you get on with the update? Remember to change the EOLN rule. to "}

Cheers Neil.

__________________
mark


Member

Status: Offline
Posts: 13
Date:
Permalink  
 

Hello

Apologies I wrote back via email, the update helped a lot, I can search at the speed of about 15 Million records per minute, it is not blazing fast but it just keep going, I have about a 1 billion records on a single node, it does not crash.
My disks are also not very fast.

There are still few little inconsistency like the hits on the list of the sources and the real hits but it is acceptable.

Looking at having a distributed environment and at buy some commercial support when we complete the test phase

Thanks heaps

Mark

__________________
neilson9


Senior Member

Status: Offline
Posts: 100
Date:
Permalink  
 

Hi Mark,
I was wondering how you got on - need any help?

Regards,
Neil.

__________________
Page 1 of 1  sorted by
 
Quick Reply

Please log in to post quick replies.
Logscape Support -> logscape -> Performance issues, can't find a way to fix them


Create your own FREE Forum
Report Abuse 		Powered by ActiveBoard