Hi, I’m Eric Yang!
I am a Data Enthusiast and Engineer Manager based at ap-southeast-2 🇦🇺 with background of Computer Science 👨💻 and Artificial Intelligence 🤖.
I build data teams and end-to-end data platform to make business impact. This includes engineering data transformation pipelines, Machine Learning model development, model training scheduling, model serving, deployment and monitoring.
Currently I am working on
- Learning Data Engineering with Databricks
- Reading Designing Data-Intensive Applications
- Preparing myself for the Sydney Half-Marathon on 17th September 2023!
Non-exhaustive lists of my technology skills, from most proficient to least.
|Language||Python, SQL, Java, Bash, R|
|Data Management||Apache Spark, Hadoop, Hive, Presto, Kafka, Airflow, Beam, Databricks, Snowflake, dbt|
|Data Analysis & Visualisation||Data Modelling, SQL, Pandas, Tableau, Plotly, Scikit-Learn, Tensorflow|
|Cloud Computing||AWS EMR, EKS, Athena, Glue, Redshift, RDS, Docker, Lambda,|
|Others||FastAPI, Linux, Docker, Jenkins, Kubernetes, DataDog, Jira, Confluence, Bitbucket|