Big Data Engineer (Various Levels)

Big Data Engineer (Various Levels)

Synergis

Atlanta, GA

Contract

Hybrid

Big Data Engineer
12-month contract

Synergis' client is seeking an experienced Data Engineer – Big Data. The successful candidate must have Big Data engineering experience and must demonstrate an affinity for working with others to create successful solutions.  Join a smart, highly skilled team with a passion for technology, where you will work on our state of the art Big Data Platforms. They must be a very good communicator, both written and verbal, and have some experience working with business areas to translate their business data needs and data questions into project requirements.  The candidate will participate in all phases of the Data Engineering life cycle and will independently and collaboratively write project requirements, architect solutions and perform data ingestion development and support duties. 

Big Data Engineer Skills and Experience:
              Required:

  • 6+ years of overall IT experience
  • 3+ years of experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming
    • Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka
    • Deep knowledge of troubleshooting and tuning Spark applications
  • 3+ years of experience with data ingestion from Message Queues (Tibco, IBM, etc.) and different file formats across different platforms like JSON, XML, CSV
  • 3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS, or
  • 3+ years of experience building, testing, and optimizing ‘Big Data’ data ingestion pipelines, architectures, and data sets
  • 2+ years of experience with Python (and/or Scala) and PySpark/Scala-Spark
  • 3+ years of experience with Cloud platforms e.g. AWS, GCP, etc.
  • 3+ years of experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake or BigQuery
  • 2+ years of experience with NoSQL databases, including HBASE and/or Cassandra
  • Experience in successfully building and deploying a new data platform on Azure/ AWS
  • Experience in Azure / AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue
  • Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series
  • Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog 
  • Knowledge of Unix/Linux platform and shell scripting is a must
  • Strong analytical and problem-solving skills

            Big Data Engineer Preferred SKills(Not Required):  

  • Strong SQL skills with ability to write intermediate complexity queries
  • Strong understanding of Relational & Dimensional modeling  
  • Experience with GIT code versioning software
  • Experience with REST API and Web Services
  • Good business analyst and requirements gathering/writing skills

Education
Bachelor’s Degree required.  Preferably in Information Systems, Computer Science, Computer Information Systems or related field

The hourly pay rate range for this position is $55.00 to $75.00(dependent on factors including but not limited to client requirements, experience, statutory considerations, and location). Benefits available to full-time employees: medical, dental, vision, disability, life insurance, 401k and commuter benefits. *Note: Disclosure as required by the Equal Pay for Equal Work Act (CO), NYC Pay Transparency Law, and sb5761 (WA)
 
Synergis is proud to be an Equal Opportunity Employer.  We value diversity and do not discriminate on the basis of race, color, ethnicity, national origin, religion, age, gender, gender identity, political affiliation, sexual orientation, marital status, disability, military/veteran status, or any other status protected by applicable law.

For immediate consideration, please forward your resume to jyates@synergishr.com
 
If you require assistance or an accommodation in the application or employment process, please contact us at jyates@synergishr.com.

Synergis is a workforce solutions partner serving thousands of businesses and job seekers nationwide. Our digital world has accelerated the need for businesses to build IT ecosystems that enable growth and innovation along with enhancing the Total Experience (TX). Synergis partners with our clients at the intersection of talent and transformation to scale their balanced teams of tech, digital and creative professionals. Learn more about Synergis at www.synergishr.com.

About Synergis

Our digital world has accelerated the need for businesses to build IT ecosystems that enable growth and innovation along with enhancing the Total experience (TX). Synergis partners with our clients at the intersection of talent and transformation to scale their balanced teams of tech, digital and creative professionals.

Synergis is an Equal Opportunity/Affirmative Action employer.

Learn more