Cumulocity IoT Feedback Portal
The exports from the platform are limited to 1M entries to be processed. These also include the items from database, that are filtered out from the export at the end, because there are no relevant fragments in them.
As an example, if I create an export for temperature measurements of 50k devices (which send measurement every 30 minutes) for 1 day and if these devices also send humidity measurement, after export, i will not get all temperature measurements for the day, because during processing, all measurements (even humidity) are processed. Total measurements for day are 4.8M, first 1M is processed and out of this only 500k are temperature.
BIG PROBLEM here is, that the user has no indication, that his whole period has not been processed. He sees 500k entries in the export and doesn't know, if it was truncated or not. So he is not aware of the fact, that he should shorten the period.
We propose following improvements:
Quick fix: Indicate in the export, if limit was hit
Allow for filtering measurements/events/... by type in the export, so the user knows exactly, that only the objects of interest are processed and no other objects are included in the 1M limit.
An indication of data trunction will be shipped as part of 10.13
���
���Dear Sender,
I'm out of office, with limited access to my email.
I'll come back on the 29th of November. For any urgent topic, please contact Arbri Shqepa.
Thank you
Best Regards
Alessandro Fini
Confidentially notice: The information contained in this electronic message and any attachments (the "Message") is intended for one or more specific individuals or entities and are confidential.
Any disclosure, distribution and/or copying of this Message by any subject different from the named recipient(s) is strictly prohibited by law.
If you are not the intended recipient, please notify the sender immediately, delete this Message and do not disclose, distribute, or copy it to any third party or otherwise use this Message.
I will be setting up a call with Peter to discuss business use case and the overlap with the DataHub. Chris Furlong is included in the discussions.
I see the reason behind this request. Some of the customers find it a critical.
Great suggestion!
Would be great if the process is as follows:
sort the entries
process the entries
filter up to one million
print to the export
Currently we have something like:
sort the entries
filter up to 1 million entries
process the entries
print
good feature to have