Must have experience with designing and building pipelines Using Spark framework and optimizing workflows; managing a high volume of data in Hadoop ecosystem on cloud GCP;creating and managing tables in GCP BigQuery; processing a high volume of data in onprem Cloudera Hadoop clusters using Spark and HIVE queries; tools Impala and Tez for ETL processes in the Hadoop Environment; coding in Scala and Python; managing and migrating data from the Enterprise data warehouse built in Teradata; building data lakes using Hadoop Bigdata Hive, SparkScala Transformations; SQL development including using complex queries, stored procedures, and user defined functions; loading data into GDP; the Teradata database, DB2; and ETL DataStage server and parallel jobs. Employer will accept any amount of graduate coursework, graduate research experience or experience with the required skills.br br Continuation of Section H.8 alternate combination of education and experience that is acceptable Bachelors degree or the equivalent in Computer Science, Information Technology, Engineering, or a related field plus 2 years of experience in software engineering or related experience.br br Continuation of Section H.10B acceptable alternate occupation Position does not require specific years of experience in an alternate occupation but requires experience with the skills listed in H.14.

Categories: eb3

0 Comments

Leave a Reply

Avatar placeholder

Your email address will not be published. Required fields are marked *