ETL Data Engineering and Analysis of Sales Data using Big Data Technologies
Developed and implemented a data pipeline for Extracting, Transforming and Loading - ETL sales data, leveraging Big data technologies such as Hadoop - HDFS, Hive and Spark with Spark SQL.
Automated the entire data pipeline or ETL Process using Apache Airflow.
Created an interactive sales dashboard in Power BI.