metrics_5m lost one data

[42701618]

Hi :
In metric_full,there is one data at Tue Jul 18 19:39:00 GMT+08:00 2017,but metrics_5m lost one data at 7:35PM. blueflood'log is following:

[2017-07-18 19:44:59,521 +0800] [INFO ] [BasicRollup conductor] [com.rackspacecloud.blueflood.service.RollupService:run 270] Scheduling slotKey metrics_5m,1579,48 @ 1500378299516 last collection time: 1500377997686 last rollup time: 1499169104456 isReroll: false
.....
....

[2017-07-18 19:44:59,743 +0800] [INFO ] [locator-fetcher-23] [com.rackspacecloud.blueflood.service.LocatorFetchRunnable:run 116] Number of locators getting rolled up for slotkey: [metrics_5m,1579,48] are 4611; isReroll: false
.....
....

[2017-07-18 19:44:59,743 +0800] [INFO ] [locator-fetcher-23] [com.rackspacecloud.blueflood.service.LocatorFetchRunnable:finishExecution 213] Successful completion of rollups for (gran,slot,shard) metrics_5m,1579,48 in 16890 ms

I query cassandra with cql
select * from "DATA".metric_state where key=48 allow filtering;
the result is that:

key | column1 |value

48 |metrics_5m,1579,A |1500377949678
48 |metrics_5m,1579,X |1500377949678

How can I find the root cause of this problem？
Thanks

[42701618]

hello

[shintasmith]

@42701618 , what version of blueflood are you using? Also, do you see any Write or Read timeout in the blueflood log from rollups?

[42701618]

hi @shintasmith

1.the version of blueflood is blueflood-2.0.0.

2.NO Write or Read timeout in the blueflood log from rollups

[42701618]

Following is data which is from metrics_full and metrics_5m,and metrics_5m lost one data at 7:35PM.
select column1,writetime(value) from metrics_full where key='*****************' order by column1 ;
1500379620000 1500379697725000 ->> Tue Jul 18 20:07:00 GMT+08:00 2017 Tue Jul 18 20:08:17 GMT+08:00 2017
1500379380000 1500379456720000 ->> Tue Jul 18 20:03:00 GMT+08:00 2017 Tue Jul 18 20:04:16 GMT+08:00 2017
1500379140000 1500379216879000 ->> Tue Jul 18 19:59:00 GMT+08:00 2017 Tue Jul 18 20:00:16 GMT+08:00 2017
1500378900000 1500378976709000 ->> Tue Jul 18 19:55:00 GMT+08:00 2017 Tue Jul 18 19:56:16 GMT+08:00 2017
1500378660000 1500378757594000 ->> Tue Jul 18 19:51:00 GMT+08:00 2017 Tue Jul 18 19:52:37 GMT+08:00 2017
1500378420000 1500378496452000 ->> Tue Jul 18 19:47:00 GMT+08:00 2017 Tue Jul 18 19:48:16 GMT+08:00 2017
1500378180000 1500378256624000 ->> Tue Jul 18 19:43:00 GMT+08:00 2017 Tue Jul 18 19:44:16 GMT+08:00 2017
1500377940000 1500378017212000 ->> Tue Jul 18 19:39:00 GMT+08:00 2017 Tue Jul 18 19:40:17 GMT+08:00 2017
1500377700000 1500377776450000 ->> Tue Jul 18 19:35:00 GMT+08:00 2017 Tue Jul 18 19:36:16 GMT+08:00 2017
1500377460000 1500377536653000 ->> Tue Jul 18 19:31:00 GMT+08:00 2017 Tue Jul 18 19:32:16 GMT+08:00 2017

[42701618]

select column1,writetime(value) from metrics_5m where key='*****************' order by column1;
1500378300000 1500378910341001 ->> Tue Jul 18 19:45:00 GMT+08:00 2017 Tue Jul 18 19:55:10 GMT+08:00 2017
1500378000000 1500378600325002 ->> Tue Jul 18 19:40:00 GMT+08:00 2017 Tue Jul 18 19:50:00 GMT+08:00 2017
1500377400000 1500378000306000 ->> Tue Jul 18 19:30:00 GMT+08:00 2017 Tue Jul 18 19:40:00 GMT+08:00 2017

[42701618]

hi @shintasmith