Must have at least 1 year of prior work experience in each of the followingbr 1. Building data pipelines to read streaming data as Avro messages from a Kafka queue.br 2. Integrating various transactional database systems such as Oracle, MSSQL Server, Sybase into Bigquery data warehouse using Dataflow pipelines written in Java.br 3. Integrating APIbased sources such as SurveyMonkey, Neogov, and SABA with Bigquery by writing Python Scripts.br 4. Built data pipelines to migrate data from an onpremise database to ElasticSearch.br 5. Developing pipeline to read data from GCS buckets and load it into Bigquery and BigTable column families.br 6. Automate the process to deploy and run data pipelines using tools such as Terraform and Airflow.br br Telecommuting allowed for this position

Categories: eb3

0 Comments

Leave a Reply

Avatar placeholder

Your email address will not be published. Required fields are marked *