Results of the Data Pipeline Configuration Chat AI with Shell (Video and Report, Winter 2023/24 Project)

Symbolic picture for the article. The link opens the image in a large view.

This project is one of six Scrum projects with industry partners that were part of the Winter 2023/24 AMOS Projects. Below please find the video (you may also like the other videos) and the project summary which details the final result of the project. We run these projects every semester, so please be in touch if you would like to motivate one of your own!

Demo Video

Project Summary

Project namePipeline Configuration Chat AI
Project missionOur mission is to develop a cutting-edge tool that seamlessly blends chat AI technology with the most robust data processing capabilities of RTDIP. The project is dedicated to creating a platform where users can effortlessly configure data pipelines using a conversational interface.
Industry partnerShell
Team logo
Project summaryOur Chatbot is based on the RTDIP framework, an open-source solution originally developed by Shell. Using it, data from real-time sensors, like wind or temperature sensor, can be extracted, transformed, and saved, all securely. To interact with RTDIP, up until now, data engineers had to write long configuration files, sometimes multiple of those a day. Our solution, ChatRTDIP simplifies the process by enabling the creation of configuration files using only natural text input. This has the potential to save a lot of time for data teams.
Project illustration
Team photo
Project repositoryhttps://github.com/amosproj/amos2023ws05-pipeline-config-chat-ai