DX Application Performance Management

  • Private Community

  • 1.  CEM Collector - Too many btstats xml files

    Posted Sep 20, 2012 05:38 PM
    Our CEM collector designated for DB Cleanup, Stats Aggregation, and TIM Collection is hoarding up a large number of btstats XML file named like this in the <collector_home>/cem/tess/badfiles

    btstats-2012-08-26-19_29_55-172.xx.xx.xx.xml.

    We don't see any issues at macro level as defects are being collected and incident are being generated. But this collector seems to create around 1million files every month or so maxing out the filesystem. Any idea

    1) why this file is being created
    2) what can I do to resolve this

    Thanks,
    AD


  • 2.  RE: CEM Collector - Too many btstats xml files

    Posted Oct 08, 2012 05:10 PM
    Hello Community:

    Any thoughts for AD?

    Thanks,
    Mary


  • 3.  RE: CEM Collector - Too many btstats xml files

    Broadcom Employee
    Posted Oct 09, 2012 04:39 PM
    Arjun,
    Does your collector log say anything about the TIM collection service not being able to collect or process the files?

    Does your collector have enough resources to handle all three services? Typically, you'll want the TIM collection service by itself.

    -Hiko


  • 4.  RE: CEM Collector - Too many btstats xml files

    Posted Oct 17, 2012 05:15 PM
    Yes, we have a collector dedicated for the 3 services with no agents reporting to it. I've noticed when a btstats xml file is created in the badfiles directory this is the output I get in the logs -

    10/17/12 05:11:40.746 PM EDT [ERROR] [RTTMDataCollectionThreadPool-5] [Manager.com.timestock.tess.framework.service.BtStatsCollectionService] Cannot execute task:
    java.util.concurrent.ExecutionException: com.timestock.common.exceptions.TsRuntimeException: BtStats data missing required 'minTime' element
    at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:233)
    at java.util.concurrent.FutureTask.get(FutureTask.java:94)
    at com.timestock.tess.framework.executor.BtStatsProcessCompletionService.runTask(BtStatsProcessCompletionService.java:35)
    at com.timestock.tess.framework.service.BtStatsCollectionService.execute(BtStatsCollectionService.java:69)
    at com.timestock.tess.framework.handler.DataCollectionHandler.getBtStatsFile(DataCollectionHandler.java:952)
    at com.timestock.tess.framework.handler.DataCollectionHandler.getRawData(DataCollectionHandler.java:651)
    at com.timestock.tess.framework.handler.DataCollectionHandler.getData(DataCollectionHandler.java:590)
    at com.timestock.tess.framework.handler.DataCollectionHandler.processDownloadedFiles(DataCollectionHandler.java:220)
    at com.timestock.tess.framework.task.BtDataCollectionTask.getDataFiles(BtDataCollectionTask.java:97)
    at com.timestock.tess.framework.task.BtDataCollectionTask.run(BtDataCollectionTask.java:83)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:452)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314)
    at java.util.concurrent.FutureTask.run(FutureTask.java:149)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:109)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:218)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:896)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
    at java.lang.Thread.run(Thread.java:735)
    at com.timestock.tess.framework.thread.BtDataCollectionThread.run(BtDataCollectionThread.java:33)
    Caused by:
    com.timestock.common.exceptions.TsRuntimeException: BtStats data missing required 'minTime' element
    at com.timestock.tess.services.processors.BtStatsProcessor.process(BtStatsProcessor.java:237)
    at com.timestock.tess.framework.task.ListBtStatsProcessingTask.call(ListBtStatsProcessingTask.java:49)
    at com.timestock.tess.framework.task.ListBtStatsProcessingTask.call(ListBtStatsProcessingTask.java:1)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314)
    at java.util.concurrent.FutureTask.run(FutureTask.java:149)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:452)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314)
    at java.util.concurrent.FutureTask.run(FutureTask.java:149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:896)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
    at java.lang.Thread.run(Thread.java:735)
    at com.timestock.tess.framework.thread.BtStatsThread.run(BtStatsThread.java:34)