Achieving high-throughput distributed, graph-based multi-stage stream processing
Tallennettuna:
| Julkaisussa: | ProQuest Dissertations and Theses (2015) |
|---|---|
| Päätekijä: | |
| Julkaistu: |
ProQuest Dissertations & Theses
|
| Aiheet: | |
| Linkit: | Citation/Abstract Full Text - PDF |
| Tagit: |
Ei tageja, Lisää ensimmäinen tagi!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 1757999334 | ||
| 003 | UK-CbPIL | ||
| 020 | |a 978-1-339-39233-2 | ||
| 035 | |a 1757999334 | ||
| 045 | 0 | |b d20150101 | |
| 084 | |a 66569 |2 nlm | ||
| 100 | 1 | |a Suriarachchi, Amila | |
| 245 | 1 | |a Achieving high-throughput distributed, graph-based multi-stage stream processing | |
| 260 | |b ProQuest Dissertations & Theses |c 2015 | ||
| 513 | |a Dissertation/Thesis | ||
| 520 | 3 | |a Processing complex computations on high volume streaming data in real time is a challenge for many organizational data processing systems. Such systems should produce results with low latency while processing billions of messages daily. In order to address these requirements distributed stream processing systems have been developed. Although high performance is one of the main goals of these systems, there is less attention has been paid for inter node communication performance which is a key aspect to achieve overall system performance. In this thesis we describe a framework for enhancing inter node communication efficiency. We compare performance of our system with Twitter Storm and Yahoo S4 using an implementation of Pan Tompkins algorithm which is used to detect QRS complexities of an ECG signal using a 2 node graph. Our results show our solution performs 4 times better than other systems. We also use four level node graph which is used to process smart plug data to test the performance of our system for a complex graph. Finally we demonstrate how our system is scalable and resilient to faults. | |
| 653 | |a Computer science | ||
| 773 | 0 | |t ProQuest Dissertations and Theses |g (2015) | |
| 786 | 0 | |d ProQuest |t ProQuest Dissertations & Theses Global | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/1757999334/abstract/embedded/L8HZQI7Z43R0LA5T?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/1757999334/fulltextPDF/embedded/L8HZQI7Z43R0LA5T?source=fedsrch |