[kepler-dev] [Bug 5324] New: dcd_mgr buffer too small -- xxx Lost data.. messages

bugzilla-daemon at ecoinformatics.org bugzilla-daemon at ecoinformatics.org
Thu Feb 24 17:56:37 PST 2011


http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5324

           Summary: dcd_mgr buffer too small -- xxx Lost data.. messages
           Product: Kepler
           Version: 2.1.0
          Platform: Other
        OS/Version: All
            Status: NEW
          Severity: normal
          Priority: P2
         Component: sensor-view
        AssignedTo: barseghian at nceas.ucsb.edu
        ReportedBy: barseghian at nceas.ucsb.edu
         QAContact: kepler-dev at kepler-project.org
   Estimated Hours: 0.0


After running dcd_mgr for awhile I start getting messages like:
xxx Lost data: 2011-02-24T16:39:45.667Z    CR800_sq311_1    3.3662283421E-01

Looking at SPAN's data_storage.c, this looks like intended behavior, at a
certain point old data is discarded in ring buffer fashion. Data is discarded
when MAX_DATA_QUEUE_SIZE is reached, and it seems hardcoded to 256.

This seems problematically small, and should probably be user configurable.

Sampling 3 sensors at 1sps, gives you 85 seconds before old data starts
expiring. And I think if the spanToDT process goes down, our current flow will
lose this data.

-- 
Configure bugmail: http://bugzilla.ecoinformatics.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.


More information about the Kepler-dev mailing list