Bo R.

Professional skills: 1. Have an in-depth understanding of the principles and processes of Spark, and be able to use Spark API to develop applications, be familiar with Spark Streaming components, and be able to use it to develop real-time computing systems, understand Spark sources; proficient in using Scala language 2. Familiar with streaming data processing framework Flink, familiar with the implementation of lamda architecture and kappa architecture 3. Familiar with Hadoop system architecture, master the construction of Hadoop clusters, and be able to quickly deploy Hadoop clusters with CDH 4. Familiar with Zookeeper's architecture and operating principles, and be able to apply it to provide collaborative services for clusters, such as HA 5. Familiar with the system architecture of Hive and HBase, able to use Hive for statistical analysis of massive data, able to actualize HBase tables according to requirements, and able to tune Hive and HBase 6. Familiar with the common open source log collection framework fl ume and Kafka message queue, and be able to use them to realize log collection in different scenarios 7. Familiar with Redis cache database application 8. Familiar with the idea of full-text search, familiar with Lucene, proficient in Elasticsearch architecture, proficient in building a log collection system based on ELK & filebeat, and doing secondary development 9. Familiar with big data platform to build other projects, such as ClickHouse, flume, Sqoop, Azkaban, etc. 10. Familiar with JavaSE and JavaEE related knowledge, familiar with JVM model, common garbage collection algorithm, garbage collector and JVM tuning, familiar with multi-process, multi-thread concurrent solutions and programming ideas, proficient in JavaSE technology stack, Spring, Spring Boot technology stack 11. Proficiency in using Linux common operating commands, familiar with shell script programming 12. Familiar with big data governance process and data lake technology, such as IceBerg Work experience 1. Data development in ISoftStone Group 2. Data collection work in Appen Services that can be provided: 1. It can provide a series of development from data extraction, cleaning, analysis to result display 2. Rapid development of microservice-based businesses Interested work 1. Data development What I like to do 1. New technology exploration