Results of the Data Pipeline and Storage Manager with IAV (Video and Report, Winter 2023/24 Project)

Symbolic picture for the article. The link opens the image in a large view.

This project is one of six Scrum projects with industry partners that were part of the Winter 2023/24 AMOS Projects. Below please find the video (you may also like the other videos) and the project summary which details the final result of the project. We run these projects every semester, so please be in touch if you would like to motivate one of your own!

Demo Video

Project Summary

Project nameData Pipeline and Storage Management
Project missionThe mission of the Data Pipeline and Storage Management project is to develop a cloud-native pipelining service that enables the analysis and management of project data. This involves storing raw data in a storage bucket, managing data pipeline requests, and providing a frontend for users to upload and access data for analysis. The project focuses on creating a system that facilitates efficient data handling and insight extraction, all within a cloud-based infrastructure
Industry partnerIAV GMBH
Team logo
Project summaryWe have successfully completed the mission of developing a cloud-native pipelining service to facilitate the analysis and management of project data. The end-to-end service encompasses a robust storage system for raw data, an efficient management interface for data pipeline requests, and a user-friendly frontend for uploading and analysing data. This achievement marks a significant milestone in streamlining project data handling and analytics, providing a solid foundation for future advancements and utilisation.
Project illustration
Team photoN/A
Project repositoryGitHub – amosproj/amos2023ws04-pipeline-manager