@ericlu
Big Data engineer
🌱 Member since January 2025
I have the following skills
- Proficient in designing data lakes and implementing lake-house architectures using StarRocks + Paimon.
- Knowledge of modern data warehouse design standards, with experience building big data platforms using StarRocks and the Hadoop ecosystem.
- Expertise in Kubernetes (k8s) and Docker principles, including integrating big data engines with k8s, such as Flink and Spark on k8s.
- Proficient in Java programming, as well as common Linux shell and Python scripting.
- Understand the design principles of Hadoop’s HDFS and MapReduce, and familiarity with related components like Hive, Spark SQL, and Ranger.
- Skilled in real-time data ingestion components like Kafka and Pulsar.
- Proficient in Spark’s working principles and code development.
- Proficient in Flink’s working principles and code development.
- Familiarity with time-series databases like OpenTSDB and MatrixDB.
- Expertise in Spring-related frameworks.
what makes you great?
Technical Expertise and Problem-Solving Skills