Striim, A Next Generation Distributed Streaming Platform
Computer Science Research Seminar Series
On Thursday, February 25, the Department of Computer Science will hold its third research seminar with Alok Pareek, Founder and head of engineering at Striim. Entitled “Striim, A Next Generation Distributed Streaming Platform,” this virtual seminar will be moderated by Dr. Kia Teymourian, assistant professor and coordinator of programming languages.
The abstract for, “Striim, A Next Generation Distributed Streaming Platform” is as follows:
Striim is a novel end-to-end distributed streaming ETL and intelligence platform that enables rapid development and deployment of streaming applications. A key area of innovation is to process database events in a continuous streaming manner while accommodating for schema drift, and failures. The real-time ETL engine has been architected from ground-up to enable simple, distributed, stateful management of events with E1P semantics.
This talk will cover core architectural choices of the real time ETL engine (i) built-in adapters, and caching structures to extract and load data in real-time from legacy and new cloud endpoints (ii) an extensible SQL-based transformation engine to transform events; users can inject custom logic via a component called Open Processor (iv) New primitives like MODIFY, BEFORE and AFTER to manage database change records and (v) built-in data validation that continuously checks if everything is continually making it to the destination. We will cover real world implementation challenges and future open problems.
Archived seminars from this series can be found on the Department of Computer Science events web page.