Batch to Real-Time: Incremental Data Collection & Analytics Platform

Simple item page
dc.contributor.authorAydin, Ahmet
dc.contributor.authorAnderson, Ken
dc.date.accessioned2016-12-29T02:10:56Z
dc.date.available2016-12-29T02:10:56Z
dc.date.issued2017-01-04
dc.description.abstractReal-time data collection and analytics is a desirable but challenging feature to provide in data-intensive software systems. To provide highly concurrent and efficient real-time analytics on streaming data at interactive speeds requires a well-designed software architecture that makes use of a carefully selected set of software frameworks. In this paper, we report on the design and implementation of the Incremental Data Collection & Analytics Platform (IDCAP). The IDCAP provides incremental data collection and indexing in real-time of social media data; support for real-time analytics at interactive speeds; highly concurrent batch data processing supported by a novel data model; and a front-end web client that allows an analyst to manage IDCAP resources, to monitor incoming data in real-time, and to provide an interface that allows incremental queries to be performed on top of large Twitter datasets.
dc.format.extent10 pages
dc.identifier.doi10.24251/HICSS.2017.712
dc.identifier.isbn978-0-9981331-0-2
dc.identifier.urihttp://hdl.handle.net/10125/41876
dc.language.isoeng
dc.relation.ispartofProceedings of the 50th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectbig data
dc.subjectdata analytics
dc.subjectincremental
dc.subjectreal-time
dc.titleBatch to Real-Time: Incremental Data Collection & Analytics Platform
dc.typeConference Paper
dc.type.dcmiText

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
paper0727.pdf
Size:
2.12 MB
Format:
Adobe Portable Document Format
Download

Collections

Big Data Engineering Minitrack