Skip to content

Latest commit

 

History

History
38 lines (27 loc) · 1.16 KB

README.md

File metadata and controls

38 lines (27 loc) · 1.16 KB

STOCK DATA STREAMING AND ANALYSIS

DESCRIPTION

  • This project is basically for collecting enormous data and analysing it.
  • It includes live streaming of data from FOREX ( Foreign Exchange ) trading API and Electric Vehicle stocks API.
  • The data is fetched and processed using Kafka Streaming and Spark streaming.
  • Throughout this project stocks of Forex data and Electric Vehicle parts making companies data were analyzed and business use case is implemented.
  • The analyzed data is then visualized by plotting different graphs using python libraries.

STREAMING TOOLS

  • Websocket,
  • Requests library,
  • Pandas datareader library,
  • Netcat,
  • API : Tiingo API,Alpha Vantage API.
  • data visualization tool: matplotlib,Seaborn

TECHNOLOGIES USED:

  • Spark
  • Kafka
  • Pyspark

Project Flow

alt text

ROLES AND RESPONSIBILITIES

  • DATA STREAMING AND SPARK submit job- Rajib’s team
  • Use cases- Eshwar’s team
  • Visualization- Karan’s team
  • EV stock use case-Kareem's team
  • Deployment-Trupti’s Team

This project uses the following license: MIT License