Cloud Data Engineer

Are you an experienced Cloud data engineer looking for a new challenge? SGI is helping a respected company recruit a Cloud Data Engineer. This is a remote, contract role that comes with a favorable hourly rate. If you were already working in this IT Management role, here are some of the things you would have done this week: ● Create scalable ETL and reporting solutions ● Review, analyze, and evaluate the scope of business problems ● Develop ETL and data warehousing solutions ● Ensure data integrity, performance quality, and resolution of data load failures ● Create detailed technical specification To succeed in this data capture position, you should be proficient in HDFS, HBase, YARN, SPARK, Oozie, and shell scripting and have a background in all aspects of software engineering with good skills in parallel data processing, data flows, REST APIs, JSON, XML, and microservice architecture. You will also need: ● Experience in RDBMS technologies and concepts ● Min 8 years experience in Azure, AWS or GCP Data, Big Query, Spark ● Experience working with Teradata, Netezza, Oracle, DB2 databases ● An understanding of File Formats - ORC, Parquet, Avro File formats ● Programming/scripting experience skills - UNIX shell, Python, Perl, and JavaScript ● Experience working on large data sets with performance tuning and troubleshooting Other essential attributes include knowledge of Spark, Spark Streaming, Spark SQL, and Kafka, experience working with Databricks, Snowflake, Big Query, or Red Shift and as a data engineer, excellent communication skills, and the ability to work independently. If this remote GCP Data Engineer job excites and motivates you, please apply with SGI today.

Created: 2021-11-29