• about reply
Storm Reply Logo
Menu
    Choose language:
    • about Reply
    Storm Reply Logo
    Focus On

    IoT Data Stream on AWS Cloud ingestion and streaming processing

    24 August 2020

    FOCUS ON: Events,

    IoT devices are growing therefore more and more appliances starting from cars and machineries up to wearable such as watches are now smart and connected. This huge number of devices generates a huge number of messages which needs to be ingested, stored and processed. Classical ingestion mechanisms based on traditional servers are not suitable to sustain such a high volume and highly variable workload.

    By leveraging on AWS services Reply has been able to implement a data ingestion platform fully based on AWS services, scalable and highly available. Reply solution is composed of modules:

    • Ingestion Module: set of inbound channels for data
    • Processing module: complex event processor
    • Storage and forward module: outbound module forwarding data according to the matched complex event rules

    DATA INGESTION:

    • Messages
      • AWS IoT Basic Ingest
      • AWS IoT Core
      • AWS Kinesis Data Stream
      • AWS Kinesis Firehose
    • Binary Files
      • AWS S3
    • Video
      • AWS Kinesis Video Stream
    • Database
      • AWS Glue
    • SFTP
      • AWS Transfer SFTP
    • Custom Data Source
      • AWS Glue

    DATA PROCESSING:

    • Messages
      • AWS Kinesis Data Analytics (Apache Flink Application)
      • Custom Data Source
        • AWS Spark Streaming Job

    DATA STORAGE AND FORWARDING:

    • Storage
      • AWS S3
      • AWS Dynamo
      • AWS RDS
      • AWS RedShift
      • Forwarding (outbound)
        • AWS Kinesis Data Stream
        • Active MQ
        • HTTPS (Post)
        • AWS SQS
        • AWS SNS

    COMPLEX EVENT PROCESSOR AT SPEED

    Reply best practice in IoT Data Ingestion allows to ingest data via multiple channels and uses AWS Kinesis as collector for all data.

    Once ingested data needs to be processed in order to identify events which might be combination of multiple events eventually generated by multiple devices:
    example: when all lights are OFF and the thermostat is over 30°C turn the AC on or to conditionally forward messages to multiple consumer applications:
    example: Send all temperature message to the thermal application, when for 10 times in a row the temperature is above 30°C send the message also to the alarm monitor application

    Reply solution includes a Complex Event processor implemented on AWS Kinesis Data Analytics which is able to apply complex rules and handle new rules dynamically at scale being able to process incoming messages at very high frequency.

    Moreover, in IoT latency might be very important for some use cases as we want to know that a specific alarm is on immediately, to satisfy this requirement, Reply solution has a configurable maximum latency which tunes AWS resources to comply with the specific requirement being able to achieve and end2end sub second latency event for high message volumes.

    RELATED CONTENTS

    31.01.2023 - 02.02.2023 / Barcelona

    Event

    IoT Solutions World Congress 2023

    Sense Reply and Storm Reply participate at the IoT Solutions World Congress 2023 event. Experts and innovators will share their expertise and use cases on disruptive technologies such as the Internet of Things, Artificial Intelligence, Digital Twins, Augmented Reality and Quantum Computing .

    08.11.2022 - 10.11.2022 / Nürnberg

    Event

    SPS Smart Production Solutions 2022

    With the IOT Innovator Framework, Storm Reply offers a fast and efficient path to IoT solutions with AWS, tailored to individual needs. Visit the Storm Reply experts at the AWS booth at SPS - Smart Production Solutions and learn more about how you can build competitive advantages with AWS.

    19.10.2022 / Dresden

    Event

    Storm Reply at AWS Community Day DACH 2022

    Storm Reply is a co-organizer of the AWS Community Day DACH 2022, which takes place on 19 October 2022 in Dresden. The event for the community provides interesting insights into all topics from the world of AWS.

     ​
     
     
     
    Reply ©​​ 2023 - Company Information -
     PrivacyCookie Settings​
    • Abou​t Reply​​​​
    • Investors​​​
    • Newsroom
    • Follow Reply on
    ​
    • ​About Storm ​Reply​
    • Privacy & Cookies Policy
    • Information (Client)
    • Information (Supplier)