Redshift Data Ingestion from S3 [draft]
S3 -> COPY -> Redshift Staging Database -> Redshift Database Reference Data Engineering in S3 and Redshift with Python Amazon redshift: bulk insert vs COPYing from s3
Posts
Upload Files to S3 Bucket
Uploading local files to AWS S3 with boto3 is quite straight forward. You can install the AWS python SDK boto3 via 1 pip install boto3 Before any implementation, please make sure you have enough permission to interactive with S3. In order to upload file to S3, you can do something like the the following 1 2 3 4 import boto3 s3res = boto3.resource("s3", region="us-east-1") s3.meta.client.upload_file("<LOCAL_FILE_PATH>", "<YOUR_BUCKET>", "<YOUR_KEY>") For example, you can use the above snippet like...
Understand AWS Redshift Query Execution Plan [draft]
Resume resources
Reference MonkeyLearn: Word Cloud cresuma: Find Action Word cresuma: 200+ Action Verbs you Should Immediately Try on Your Resume cresuma: 90 Killing Resume Buzzwords to Avoid & Include in 2023 TealHQ: How to Write a Targeted Resume TealHQ: How to Use ChatGPT to Write Your Cover Letter ZipRecruiter: Data Engineer Must-Have Resume Skills and Keywords
System Design Practice - MyTube [draft]
Typical Steps Defining the requirements. Estimating capacity requirements. Going Over High Level Design. Looking at each individual components.