Bachelors degree in Computer Science or Electronic Engineering willing to accept foreign education equivalent plus ten 10 years of experience performing solutions development . Specific skillsother requirements quantitative experience requirement not applicable to this section must possess the following performance tuning with Spark, Scala and Python to build and implement ETL processes; performing Hive database management, including partitioning and bucketing; performing data anomaly detection and data quality assurance using SQL, HDFS, Hive, DatabricksDelta Lake, Flume and Kafka; building streamprocessing systems, using Storm or SparkStreaming; performing code reviews to ensure use of best practice and standards; designing multitenant, containerized Hadoop architecture for memoryCPU managementsharing across different lines of business LOBs; and processing large unstructured datasets using HDFS, SQOOP Hive, Pig, Flume and Kafka. Hybrid 3 days in office2 days remote.

Categories: eb3

0 Comments

Leave a Reply

Avatar placeholder

Your email address will not be published. Required fields are marked *