Details
-
Bug
-
Resolution: Duplicate
-
Low
-
None
-
None
-
None
-
None
Description
HOPS ticket for this issue is https://extranet.atlassian.com/jira/browse/HOP-148
FishEye was using >1GB of ram and bounced off heap due to customer loading large SQL file. There should be a file size limit that will prevent large files from being processed so that FishEye would not crash.
top - 19:59:11 up 8 days, 18:38, 2 users, load average: 0.56, 0.90, 0.68 Tasks: 110 total, 1 running, 109 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.1%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 8388608k total, 7031600k used, 1357008k free, 0k buffers Swap: 0k total, 0k used, 0k free, 0k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 25736 js-fishe 15 0 1235m 1.0g 18m S 0.3 12.4 183:34.49 java
The heap dump (107 MB) is in root@rocket:~/oom_issue/heap.bin.gz
The FishEye /service/j2ee_fisheye/log/main/current is attached as rocket.fisheye.current
Thread dump is attached as rocket.fisheye.thread_dump
NewRelic trace of /WEB-INF/jsp/file/fileView.jsp @ https://rpm.newrelic.com/accounts/35842/applications/411476/transaction_traces/35842_928339
Excerpt from Fisheye log
2011-10-04 11:14:32.859472500 java.lang.OutOfMemoryError: Java heap space 2011-10-04 12:26:15.230540500 2011-10-04 19:26:15,229 WARN - [KANUI] Not indexing contents of HEAD of live-db-dumps/live-db.bob.kanui.com.br.sql because its size (11M) is too large (limit is 5M) 2011-10-04 12:37:32.444630500 2011-10-04 19:37:25,452 ERROR - Error for /source/browse/KANUI/live-db-dumps/live-db.bob.kanui.com.br.sql 2011-10-04 12:37:32.444632500 java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-10-04 12:38:48.279659500 Exception in thread "btpool0-1" java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-10-04 12:39:01.930033500 Oct 4, 2011 7:37:37 PM org.tmatesoft.svn.core.internal.util.DefaultSVNDebugLogger log 2011-10-04 12:39:01.930035500 SEVERE: WC: GC overhead limit exceeded 2011-10-04 12:39:01.930036500 java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-10-04 12:39:01.933912500 2011-10-04 19:38:36,129 ERROR - handle failed 2011-10-04 12:39:01.933913500 java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-10-04 12:39:01.933913500 2011-10-04 19:39:01,932 ERROR - /source/browse/KANUI/live-db-dumps/live-db.bob.kanui.com.br.sql?r1=1410&r2=1416 2011-10-04 12:39:01.933914500 java.lang.OutOfMemoryError: Java heap space 2011-10-04 12:39:01.933915500 2011-10-04 19:38:33,873 ERROR - Error for /source/browse/KANUI/live-db-dumps/live-db.bob.kanui.com.br.sql 2011-10-04 12:39:01.933916500 java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-10-04 12:39:01.940150500 2011-10-04 19:37:56,476 ERROR - Error for /source/browse/KANUI/live-db-dumps/live-db.bob.kanui.com.br.sql 2011-10-04 12:39:01.940152500 java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-10-04 12:39:01.940152500 2011-10-04 19:39:01,937 ERROR - /source/browse/KANUI/live-db-dumps/live-db.bob.kanui.com.br.sql 2011-10-04 12:39:01.940153500 javax.el.ELException: java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-10-04 12:39:01.940154500 at javax.el.BeanELResolver.getValue(BeanELResolver.java:298) <snip> 2011-10-04 12:47:13.322401500 Full thread dump Java HotSpot(TM) Server VM (20.1-b02 mixed mode):
Attachments
Issue Links
- duplicates
-
-
- Closed
-