Super Nova Machine Learning Group

Introduction

Team

See Team members

Meeting Minutes

• 20210328 Kickoff
• 20210404 Project selection

Resources

• Git cheat sheet
• [Deep learning] How to build an emotional chatbot
• Convert Twitter ID to User ID

Get twitter data

Run the script

export BEARER_TOKEN=Bearer Token
python3 ./src/twitter/get_tweets.py

Convert json to CSV:

cat 2021_04_11_china_.json | jq -r '.data[] | {author_id,id,text}' | jq -s | jq -r '(map(keys) | add | unique) as $cols | map(. as $row | $cols | map($row[.])) as $rows | $cols, $rows[] | @csv' > 2021_04_11_china.csv

Installation

pip3 install jupyterlab

Run a local jupyter server

Run the command below and a web browser will be started.

jupyter-lab

There is a script under src/jupyter. You can also create a new notebook.

Commonly used commands for jupyter can be found here.